EP3618058B1 - Compensation and automatic gain control in active noise reduction devices - Google Patents
Compensation and automatic gain control in active noise reduction devices Download PDFInfo
- Publication number
- EP3618058B1 EP3618058B1 EP19201934.7A EP19201934A EP3618058B1 EP 3618058 B1 EP3618058 B1 EP 3618058B1 EP 19201934 A EP19201934 A EP 19201934A EP 3618058 B1 EP3618058 B1 EP 3618058B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- anr
- signal
- input signal
- vga
- gain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000009467 reduction Effects 0.000 title claims description 17
- 238000000034 method Methods 0.000 claims description 52
- 230000008569 process Effects 0.000 claims description 33
- 238000012545 processing Methods 0.000 claims description 31
- 238000006073 displacement reaction Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 description 19
- 230000006870 function Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 13
- 230000006835 compression Effects 0.000 description 10
- 238000007906 compression Methods 0.000 description 10
- 238000001514 detection method Methods 0.000 description 10
- 238000012546 transfer Methods 0.000 description 10
- 230000008859 change Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 210000000613 ear canal Anatomy 0.000 description 6
- 230000002829 reductive effect Effects 0.000 description 5
- 230000035945 sensitivity Effects 0.000 description 4
- 230000002238 attenuated effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000000116 mitigating effect Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000010355 oscillation Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- 230000005534 acoustic noise Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
- G10K11/17821—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
- G10K11/17827—Desired external signals, e.g. pass-through audio such as music or speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17879—General system configurations using both a reference signal and an error signal
- G10K11/17881—General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
- G10K2210/10—Applications
- G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
- G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/05—Noise reduction with a separate noise microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/01—Hearing devices using active noise cancellation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
Definitions
- This disclosure generally relates to technology for controlling overload conditions in active noise reducing (ANR) devices.
- ANR active noise reducing
- ANR devices can utilize one or more digital signal processors (DSPs) for implementing various signal flow topologies. Examples of such DSPs are described in U.S. Patents 8,073,150 and 8,073,151 .
- US 2011/243343 A1 discloses an apparatus and method of controlling provision of ANR, in which amplitudes of a piece of audio employed in the provision of ANR are monitored, and the compression of one or both of feedback and feedforward ANR reference sounds is made dependent on frequency such that a first sound of one frequency need only reach a lower amplitude to trigger compression, while a second sound of another frequency must reach a higher amplitude to trigger compression.
- US 2010/0260345 A1 discloses an active noise control (ANC) system configured to generate at an anti-noise signal configured to drive a speaker to generate sound waves to destructively interfere with an undesired sound present in a target space.
- the anti-noise signal is adjusted based an output signal of an audio system.
- the at least one anti-noise signal may be adjusted based on at least one of a volume level of the audio system, a power level of at least one predetermined frequency or frequency range of the output signal of the audio system, frequency content of an output signal of the audio system.
- the present invention relates to a method and an ANR device as set out in independent claims 1 and 11. Other embodiments are described in the dependent claims.
- this document features one or more machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
- the operations include receiving an input signal generated by one or more sensors associated with an ANR headphone, wherein the input signal comprises a first portion and a second portion in an ANR signal flow path, processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone and determining one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
- the operations further include automatically adjusting, based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path.
- the set of coefficients are selected in accordance with the gain of the VGA.
- the operations also include processing the second portion of the input signal in the ANR signal flow path using the adjusted gain and the selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
- Various implementations described herein may provide one or more of the following advantages.
- throttling compensation under overload conditions only in a selected portion of the frequency range the performance of small form-factor ANR devices (e.g., in-ear headsets) may be improved.
- selective throttling in the low frequency range may allow for mitigating overload conditions while avoiding potentially objectionable noise modulations that may occur due to turning off the entire feedforward compensation.
- throttling the compensation at such low frequencies upon detection of an overload condition may have an insignificant effect on the psychoacoustic experience of the user, and therefore may improve the overall user experience as compared to a device that completely shuts off the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) upon detection of overload.
- an ANR signal flow path e.g., a feedforward path or a feedback path
- a tunable filter may be disposed in the same or another ANR signal flow path (e.g., a feedback path) to mitigate overload conditions due to low frequency stimuli detected by a corresponding microphone (e.g., a feedback microphone in this particular example).
- the tunable filter (which may be implemented, for example, as a high-pass or notch filter) may improve user experience and driver-life by reducing low frequency displacement of the driver resulting from, for example, jaw motion or walking.
- VGA variable gain amplifier
- SNR signal-to-noise ratio
- An active noise reduction (ANR) device can include a configurable digital signal processor (DSP), which can be used for implementing various signal flow topologies and filter configurations. Examples of such DSPs are described in U.S. Patents 8,073,150 and 8,073,151 . U.S. Patent 9,082,388 describes an acoustic implementation of an in-ear active noise reducing (ANR) headphone, as shown in FIG. 1 .
- DSP digital signal processor
- This headphone 100 includes a feedforward microphone 102, a feedback microphone 104, an output transducer 106 (which may also be referred to as an electroacoustic transducer or acoustic transducer), and a noise reduction circuit (not shown) coupled to both microphones and the output transducer to provide anti-noise signals to the output transducer based on the signals detected at both microphones.
- An additional input (not shown in FIG. 1 ) to the circuit provides additional audio signals, such as music or communication signals, for playback over the output transducer 106 independently of the noise reduction signals.
- headphone which is interchangeably used herein with the term headset, includes various types of personal acoustic devices such as in-ear, around-ear or over-the-ear headsets, earphones, and hearing aids.
- the headsets or headphones can include an earbud or ear cup for each ear.
- the earbuds or ear cups may be physically tethered to each other, for example, by a cord, an over-the-head bridge or headband, or a behind-the-head retaining structure.
- the earbuds or ear cups of a headphone may be connected to one another via a wireless link.
- the signal flow topologies can be implemented in an ANR device to enable functionalities such as audio equalization, feedback noise cancellation, feedforward noise cancellation, etc.
- the signal flow topologies can include a feedforward noise reduction path 110 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedforward compensator 112) to reduce the effects of a noise signal picked up by the feedforward microphone 102.
- the signal flow topologies can include a feedback noise reduction path 114 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedback compensator 116) to reduce the effects of a noise signal picked up by the feedback microphone 104.
- the signal flow topologies can also include an audio path 118 that includes circuitry (e.g., equalizer 120) for processing input audio signals 108 such as music or communication signals, for playback over the output transducer 106.
- the acoustic noise energy that the ANR device attempts to reduce is small enough to keep the system hardware within capacity.
- discrete acoustic signals or low frequency pressure disturbances e.g., loud pops, bangs, door slams, etc.
- picked up by the feedforward or feedback microphones can cause the noise reduction circuitry to overrun the capacity of the electronics or the output transducer 106 in trying to reduce the resulting noise, thereby creating audible artifacts which may be deemed objectionable by some users.
- overload conditions can be manifested by, for example, clipping of amplifiers, hard excursion limits of acoustic drivers or transducers, or levels of excursion that cause sufficient change in the acoustics response so as to cause oscillation.
- the problem of overload conditions can be particularly significant in small form-factor ANR devices such as in-ear headphones.
- the feedforward compensator may generate a signal that would require the acoustic transducer to exceed the corresponding physical excursion limit.
- a particular acoustic transducer may need to be displaced 1 mm to generate an anti-noise signal for a 100 Hz noise, 2 mm to generate an anti-noise signal for a 50 Hz noise, and so on.
- Many acoustic transducers, particularly small transducers used in small form-factor ANR devices are physically incapable of producing such large displacements.
- the demand of the high displacement by a compensator can cause the transducer to generate sounds that cause audible artifacts, which may contribute to an objectionable user experience.
- the audible artifacts can include oscillations, potentially objectionable transient sounds (e.g., "thuds,” “cracks,” “pops,” or “clicks”), or crackling/buzzing sounds.
- the feedforward path 110 can include a variable gain amplifier (VGA) 125, the gain of which can be reduced (throttled) upon detection of a signal that can potentially overload the output transducer 106.
- VGA variable gain amplifier
- a sidechain filter 128, which is a filter that is applied to a signal sampled from the main signal flow to generate a test signal for determining whether or not to throttle the gain of the VGA 125.
- the output of the VGA 125 can be passed through the sidechain filter 128 (the transfer function of which is denoted as K sc_ff ) connected to the feedforward path 110, and the output of the sidechain filter is compared (using, for example, a comparator 130) to a pre-determined threshold, T ff 132 to decide whether an overload condition exists.
- the output of the comparator 130 is provided to the variable gain amplifier (VGA) 125.
- the gain of the VGA 125 is adjusted to throttle the signal in the feedforward path 110 to mitigate the overload condition.
- FIG. 3A shows a sidechain filter only for the feedforward path, a similar sidechain filter may also be implemented in the feedback path. Also, the sidechain filters may be disposed in the feedforward or feedback paths before or after the corresponding main compensators 112 or 116, respectively.
- reducing the gain of the entire feedforward or feedback path may also generate some undesirable audible artifacts and/or noise modulations. For example, if the noise that causes an overload condition has significant energy at low and high frequencies, turning off or significantly reducing the gain of the feedforward compensator may allow the noise to pass through un-attenuated and may create an uncomfortable or objectionable experience for some users.
- the technology described herein may improve user experience in such cases by allowing gain adjustments in only selected frequency ranges upon detection of an overload condition, while allowing compensation signals to be generated at frequencies outside of the selected range.
- the feedforward compensation may be throttled only in the low frequency portion of the spectrum, while allowing feedforward compensation to continue for other frequencies. This may provide an improved psychoacoustic experience for users because upon detection of a low frequency disturbance, the feedforward compensation is temporarily suspended only in a selected portion of the frequency range. If the selected frequency range is in the sub-100 Hz region, the user experience is not significantly degraded for most users because human ears are typically not very sensitive to noise in that frequency range.
- FIG. 3B is a block diagram of an example of an ANR device 350 with parallel feedforward compression, in which feedforward compensation is throttled in only a portion of the operating frequency range upon detection of an overload condition in that frequency range.
- the device 350 includes, in the feedforward path 110, at least two parallel paths each processing a different portion of the operating frequency range.
- the feedforward path 110 can include a main feedforward compensator 133 (denoted by the transfer function K ffM ) which processes a frequency range that substantially excludes frequencies where overload conditions are expected to occur.
- the feedforward path 110 also includes an auxiliary feedforward compensator 134 (denoted by the transfer function K ffP ) connected in parallel to the main feedforward compensator 133.
- the auxiliary feedforward compensator 134 processes the frequency range in which overload conditions are expected to occur.
- a VGA 125, sidechain filter 128, and comparator 130 are connected to the output of the auxiliary compensator 134 to throttle the compensation in the corresponding frequency range upon detection of an overload condition.
- the main feedforward compensator 133 continues to provide compensation in the corresponding frequency range.
- the auxiliary compensator can be configured to process signals only in the sub-100 Hz range, such that feedforward compensation due to low frequency pressure disturbances are throttled using the VGA 125.
- the main feedforward compensator 133 (which can be configured to process signals above 100 Hz) continues to provide feedforward compensation to reduce noise in the corresponding frequency range. In some implementations, this improves the overall noise reduction performance of the corresponding ANR device, while limiting audible artifacts that could be caused by low frequency pressure disturbances.
- the threshold 132 associated with the comparator 130 may be determined in various ways. In some implementations, the threshold 132 may be determined based on the characteristics of the output transducer. For example, the threshold 132 might be set as a voltage reference point to prevent the drive voltage output by the VGA 125 from causing the output transducer 106 to hit a mechanical limit, or reaching a drive level where the acoustic distortion due to mechanical, magnetic or electrical characteristics is deemed undesirable. In some cases, these limits may be related to equivalent pressure levels in the ear canal. For example, as the size of the output transducer gets smaller, these limits may occur at lower equivalent pressure levels in the ear canal.
- the main feedforward compensator 133 and auxiliary feedforward compensator 134 can include filters for isolating corresponding operating frequency ranges.
- the auxiliary compensator 134 can include a low-pass filter with a passband cut-off frequency substantially equal to 100 Hz.
- the main feedforward compensator 133 can include, for example, a high pass filter with a stopband cut-off frequency substantially equal to 100 Hz.
- Other configurations may also be used depending, for example, on the corresponding applications.
- the main feedforward compensator 133 can include a band-pass filter to isolate a frequency range that excludes frequencies where overload conditions are expected to occur.
- the passbands of the main and auxiliary feedforward compensators may overlap partially. While FIG. 3B describes the filter topologies only in the feedforward path 110, a similar parallel topology may also be used in the feedback path.
- the sidechain filter can be implemented as a filter bank, where a particular sidechain filter is selected based on a mode of operation of the ANR device. For example, if the ANR device is being used in mode where some ambient sounds (e.g., human voice) are allowed to pass through, the sidechain filter selected can be different from one that is selected in a mode in which feedforward compensation is performed for the entire operating frequency range.
- the filter bank can be implemented using a DSP where a different set of filter coefficients and/or threshold value are selected for the sidechain filter based on an identified operating mode.
- the main feedforward compensator 133 can be configured to provide noise attenuation in the corresponding frequency range as long as the signal from the feedforward microphone 102 is not clipped.
- the sidechain filter can be operated based on input from one or more additional sensors. For example, an accelerometer may be used to identify movements by a user (e.g., running, jogging etc.) that may cause an overload condition. In some implementations, historical information on user-behavior may be used to anticipate events that may cause an overload condition.
- this information may be used in enabling a proactive throttling of the low frequency portion of the feedforward signal path.
- the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) corresponding to the acoustic transducer for one ear may be coordinated with the compensation in the corresponding signal flow path of the acoustic transducer for the other ear. For example, if a user is wearing both earbuds of a headphone, such coordination between the corresponding signal flow paths may ensure that the ANR performance in the two ears are substantially similar.
- the sidechain filters of a signal flow path may be adjusted based on determining whether both earbuds of a headphone are being worn by a user. Sensors that can be used for this purpose include, for example, capacitive sensors or infrared sensors disposed on earbuds or ear cups to determine whether an earbud or ear cup is being worn by a user.
- the above discussions describe the overloading problem of the acoustic transducer primarily with respect to the feedforward path 110.
- the electroacoustic transducer 106 may also be driven to an overload condition due to stimuli picked up by the feedback microphone 104.
- stimuli picked up by the feedback microphone 104 For example, in the case of in-ear ANR headphones that are tightly sealed in the ear canal, low frequency stimuli like jaw motion can create large pressure variations that are picked up by the feedback microphone 104.
- FIG. 4 is a plot showing the pressure variations in the ear canal over a two second time period, which are detected by a feedback microphone. In some cases, for tightly sealed in-ear headphones, low frequency pressure variations (at approximately 15 Hz) may be generated when the user walks on a firm surface.
- Such low frequency pressure variations of high magnitude upon being detected by a feedback microphone 104, may cause the feedback compensator 116 to generate a feedback compensation signal that drives the acoustic transducer to an overload condition. This in turn may cause the acoustic transducer 106 to generate audible artifacts and degrade the performance of the ANR device. While the example of a user walking on a firm surface, which generates low frequency variations at approximately 15 Hz, is used herein as one example, other events may cause low frequency variations at different frequencies. The techniques described herein are generally applicable to events that cause low frequency variations that may lead to an overdrive condition, regardless of the particular frequency.
- FIG. 5A is a block diagram of an example of such a feedback compensator 500, which includes a tunable filter 502 configured to mitigate overload conditions due to low frequency stimuli picked up by the feedback microphone 104.
- the feedback compensator 500 also includes a fixed filter 504 configured to generate the feedback compensation signal for the transducer 106.
- the tunable filter 502 upon detection of high-magnitude low-frequency stimuli (resulting, for example, from jaw motion or walking), the tunable filter 502 can be configured to filter out such stimuli from the input signal provided to the fixed filter 504 to generate the feedback compensation signal. Under such a signal flow scheme, the feedback compensator can continue to generate feedback compensation signals for noise reduction even in the presence of high-magnitude low-frequency stimuli without being driven to an overload condition.
- the parameters for the tunable filter can be selected, for example, by a parameter selector module 508 that determines an appropriate set of parameters based on the output of an estimator 506.
- the estimator 506 determines, from the feedback compensation signal generated by the fixed filter 504, whether the feedback compensation signal could potentially drive the acoustic transducer 106 into an overload condition.
- the parameter selector module 508 can be configured to select one or more parameters (or a set of filter coefficients) for the tunable filter 502, such that the tunable filter 502 filters out the stimuli that is causing the generation of the large feedback compensation signal.
- the parameter selector module 508 can be configured to access a look-up table to select the one or more parameters (or set of filter coefficients) for the tunable filter 502, based on the extent of driver displacement reported by the estimator 506.
- the estimator can be configured to monitor the output of the fixed filter 504 to reduce the chances of the output voltage exceeding a threshold condition associated with, for example, driving the output transducer 106 to an unacceptably high displacement, or clipping the electrical output.
- the parameter selector module 508 can be configured to select the one or more parameters or coefficients of the tunable filter 502 such that the tunable filter 502 acts as a high-pass filter.
- FIGs. 6A-6C show magnitude responses of different tunable high-pass filters parameterized by a parameter a.
- selecting the value of a to be equal to unity results in an all-pass filter.
- the value of a may be chosen in accordance with a desired magnitude response that would filter out the low frequency stimuli.
- the parameter selector module 508 can be configured to select the one or more parameters or filter coefficients of the tunable filter 502 such that the tunable filter 502 acts as a notch filter. This can be useful, for example, when the pressure variations causing an overload condition is in a narrow frequency range. For example, when a user walks on a firm surface wearing tightly-sealed in-ear headphones, high-magnitude pressure variations can occur at about 15 Hz. In such cases, a notch filter can be used to prevent such pressure variations from generating feedback signals that could drive the acoustic transducer to an overload. Because only a narrow range of frequencies are suppressed using notch filter, such a filter may only insignificantly degrade the feedback compensation performance of the ANR device.
- FIG. 5A shows a block diagram of another system that may be used in either of a feedforward or a feedback ANR signal flow path. Specifically, FIG.
- FIG. 5B is a block diagram of an example system 550 that uses a combination of a variable gain amplifier (VGA) 552 and a tunable filter 554 disposed in a signal flow path of an ANR device.
- the signal flow path which includes a sensor (e.g., a microphone 557 and/or a non-microphone sensor 555) at one end and an acoustic transducer 106 at the other end, can include, for example, a feedback path or a feedforward path of the ANR device. If the signal flow path in which the system 550 is disposed is a feedforward path, the tunable filter 554 may be referred to as a feedforward compensator. If the signal flow path in which the system 550 is disposed is a feedback path, the tunable filter 554 may be referred to as a feedback compensator.
- the noise reduction performance of the ANR device may be balanced against its overload performance by adaptively adjusting the VGA 552 and the tunable filter 554 based on the environment of the ANR device.
- the noise reduction performance may be improved by increasing the gain of the VGA 552.
- the ANR device may introduce system-generated noise (e.g., noise generated by the electronics disposed in the signal flow path), which may be manifested as a substantially constant audible "hiss" generated by the acoustic transducer 106.
- increasing the gain of the VGA 552 may in some cases improve the signal-to-noise ratio (SNR), and decrease the undesirable hissing audio generated by the acoustic transducer 106.
- SNR signal-to-noise ratio
- pre-amplifying the gain of the VGA 552 boosts any signals captured using the microphones 557 (e.g., feedback and/or feedforward microphones), which in some cases may result in clipping of the incoming signal.
- the dynamic range of the system may also be reduced, causing the system (e.g., the electronics of the signal flow path and/or the acoustic transducer 106) to overload more easily.
- the system e.g., the electronics of the signal flow path and/or the acoustic transducer 106
- such overload conditions may cause the acoustic transducer 106 to produce audible pops and clicks, which in turn may detract from the improved user-experience resulting from the lowered noise floor.
- the signal flow path illustrated in FIG. 5B is an example of a system that can be used to balance the noise reduction performance with the overload performance of an ANR device.
- the gain of the VGA can be adjusted to a relatively high value that reduces the audible noise floor. This in turn may expose the ANR device to a higher likelihood of being driven to overload conditions.
- the parameter selector 558 may be configured to adjust the gain of the VGA to a lower value to reduce the chances of the system being driven to an overload condition.
- the VGA gain is reduced in a noisier environment, a psychoacoustic effect of the increased noise floor may not be significantly noticeable to a user.
- the adaptive reducing of the gain of the VGA 552 may result in mitigating audible pops and clicks that may otherwise have degraded the user experience due to the occurrence of overload conditions.
- the filter coefficients of the tunable filter 554 are also adjusted accordingly to compensate for the change in gain of the VGA 552. For example, if the parameter selector 558 increases the gain of the VGA 552 by 6 dB, the parameter selector 558 may also be configured to select an appropriate set of filter coefficients for the tunable filter 554, such that the magnitude response of the tunable filter is reduced by about 6 dB to compensate for the increased gain of the VGA 552. In some cases, such simultaneous adjustment of the VGA and the tunable filter ensures that the overall gain of the signal flow path is substantially constant, and the user experience is substantially uniform.
- the VGA 552 is configured to process signals captured by one or more sensors such as microphones 557 and/or non-microphone sensors 555.
- the microphones 557 can be of various types, possibly depending on, for example, the signal flow path in which the system 550 is disposed. For example, if the system 550 is disposed in a feedforward ANR path, the microphone 557 can include the feedforward microphone of the ANR device, such as the microphone 102 described above. In another example, if the system 550 is disposed in a feedback ANR path, the microphone 557 can include a feedback microphone such as the microphone 104 described above.
- the sensors 555 can also be of various types.
- the non-microphone sensors 555 can include, for example, a pressure sensor, an accelerometer, or a gyroscope. Such non-microphone sensors 555 may be used, for example, to detect pressure changes or activities that may prompt a change in the settings of the VGA 552 and/or the tunable filter 554. For example, based on the output of an accelerometer disposed in an ANR headphone, a determination may be made that the user is running or jogging, which in turn may produce low frequency pressure variations at a particular frequency. Based on such a determination, the parameter selector 558 may be configured to adjust the gain associated with the VGA and the filter coefficients of the tunable filter 554. While the system 550 illustrated in FIG. 5B includes both non-microphone sensors 555 and microphones 557, systems that include only microphones 557 or only non-microphone sensors 555 are also possible.
- the adjustments to the gain of the VGA 552 and the filter coefficients of the tunable filter 554 may be made based on predicting the onset of a particular event.
- the environment of a user may be determined based on the output of a global positioning system (GPS) (e.g., one disposed either in the ANR device or in a mobile phone connected to the ANR device), and the settings of the VGA 552 and the tunable filter 554 may be adjusted in accordance with the determination.
- GPS global positioning system
- the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in quiet environments.
- the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in noisy environments.
- the user's environment may be detected based on one or more applications executing on the ANR device and/or a mobile device connected to the ANR device. For example, upon determining that the user has just started an application that tracks the user's running steps, an inference may be made that the user is about to start a run.
- the parameter selector 558 can be configured to adjust the VGA 552 and the tunable filter 554 to account for the corresponding expected low-pressure variations in the ANR device.
- information about both the environment and the activity of the user may be used in determining that operating parameters of the VGA 552 and the filter coefficients of the tunable filter.
- the parameter selector 558 can be configured to select the operating parameters of the VGA 552 and the tunable filter 554 in various ways.
- the parameter selector may be configured to access a computer-readable storage device that stores a representation of a look-up table that stores different sets of filter coefficients of the tunable filter 554 linked to different gain values of the VGA 552.
- the parameter selector can be configured to calculate the filter coefficients of the tunable filter 554 based on a pre-defined relationship with the selected gain values.
- the gain values to be used in different environments may be empirically determined or calculated as a function of the outputs of one or more sensors such as a pressure sensor or microphone.
- the gain level of the VGA 552 may also be changed based on user-input received via a user interface.
- the user interface can be a control such as a switch, knob, or dial disposed on the ANR device, or a software-based graphical user interface displayed on a display device such as one displayed on a connected mobile device.
- the estimator 556 can be configured to determine whether any adjustments to the VGA 552 and/or the tunable filter 554 are needed. Accordingly, the estimator 556 can be configured to signal the parameter selector 558 to adjust one or both of the VGA 552 and the tunable filter 554. In some implementations, the estimator 556 is substantially similar to the estimator 506 described above with reference to FIG. 5A . In some implementations, the estimator 556 can be a displacement estimator configured to estimate whether the drive signal for the acoustic transducer can potentially cause the transducer to exceed its excursion limit. In some implementations, the estimator 556 can include a pressure estimator configured to detect the occurrence of pressure disturbances in the environment.
- the system 550 may be operated in various modes.
- the system 550 can be configured to run substantially continuously upon initialization. For example, if the system 550 is disposed in a feedforward or feedback path of an ANR headphone, the system may be initialized when the ANR functionality of the headphone is activated, and then allowed to run during the operating period of the headphone. In some cases though, such a mode of operation may cause multiple pops and clicks, which could degrade the user experience to some extent.
- the system 550 can include a control (e.g., a button) to deactivate/activate the system 550 based on user-input.
- the system 550 could be configured such that the parameter selector 558 adjusts the VGA 552 and the tunable filter 554 in accordance with the current environment, and then either shuts off or goes into standby mode.
- the system may be reactivated based on a user-input which indicates that the environment has changed, or that a readjustment is otherwise desired.
- the system 550 or the ANR device in which it is deployed may include one or more controls (e.g., hardware buttons and/or software controls presented on a user interface) for selecting the mode of operation of the system 550.
- the adjustments may be performed in various ways.
- the adjustments are performed substantially periodically.
- the adjustments may be performed with a time period of about 100 ms or more.
- the frequency of adjustments may be selected empirically, for example, to allow the system 550 to adequately adjust to changing environments.
- the adjustments can be performed upon detection of a change in the environment.
- the estimator 556 may signal the parameter selector 558 to adjust the VGA 552 and the tunable filter 554 accordingly.
- a decision threshold may be associated with the adjustments.
- an adjustment may be made only if the amount of required change in the gain of the VGA 552 exceeds a threshold amount. For example, an adjustment may be made only if the gain adjustment is 2.25 dB or higher.
- the threshold amount may be determined empirically, for example, to prevent overly frequent adjustments.
- the adjustments to the gain level of the VGA 552 can be performed in various ways.
- the adjustments may be made in a single step.
- the adjustments may be made as a series of multiple steps. For example, if an adjustment of 6 dB needs to be made, the adjustments may be made as a single step change of 6 dB, or a series of six steps each implementing a 1 dB change, or another combination of steps.
- the step sizes may be determined empirically, for example, based on the tolerance for any associated audible artifacts generated by the step changes.
- the time gap between the steps may also be adjusted, for example, to reduce the possibility of multiple audible artifacts to be merged into a single louder artifact. However, increasing the gap between the steps also increases the total adjustment time.
- the spacing between the steps can therefore be selected empirically in accordance with a target tradeoff between the adjustment time and the tolerable audible artifacts.
- FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path.
- FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown in FIG. 7 ) for different combinations of filter coefficients.
- the filter coefficients are parameterized by the parameter n.
- FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown in FIG. 7 ) for different combinations of filter coefficients.
- the filter coefficients are parameterized by the parameter n.
- the curves 810, 812, 814, and 816 represent the phase responses for parameter
- FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n in terms of frequency and bi-quad singularities Q.
- the Q is also known as the quality factor.
- the curves describing the pole and zero frequency and Qs as a function of tuning variation show that the notch sharpness and notch center frequency are coupled.
- the notch depth increases with increasing frequency.
- FIGs. 8C and 8D show the variations in filter coefficient values of the bi-quad notch filter with respect to the tuning parameter n.
- the values of the coefficients b1 and a1 are in the vicinity of 2, and the values of the coefficients b2 and a2 are in the vicinity of unity.
- the filter coefficient values e.g., b1, b2, a1 and a2, in the present example
- FIGs. 9A-9B , and FIGs. 10A-10B illustrate the performance of a tunable filter in the feedback path.
- FIGs. 9A and 9B show magnitude and phase responses of the loop gain (provided as a product of the driver-voltage-to-feedback-microphone-voltage transfer function and the feedback compensator transfer function Kfb) of the feedback path without a tunable filter and with a tunable filter, respectively.
- the particular tunable filter used in this example included twelve cascaded bi-quad notch filters, each of which were substantially similar to the bi-quad notch filter illustrated in FIG. 7 .
- the tunable filter remains stable and exhibits consistent loop gain behavior for the various values of the tuning parameter n.
- FIGs. 10A and 10B which show the sensitivity of a feedback path of the example ANR device without a tunable filter ( FIG. 10A ), and with a tunable filter ( FIG. 10B ), the sensitivity of the filters also remains consistent for the various values of the tuning parameter.
- FIG. 11 shows the variation in output voltage of the feedback compensator 116 for the various values of the tuning parameter n.
- the parameter value can be adjusted to get different levels of suppression at around the desired 15 Hz frequency, without significantly affecting the feedback compensator output at other frequencies.
- FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in the feedback path.
- This notch filter is another single bi-quad notch filter such as the one illustrated in FIG. 7 , but with the coefficients a1 and a2 held to be constants.
- the frequency of the complex poles and zeros were equal and the Q of the zeros was varied to change the depth of the notch, which resulted in changes to the coefficients b1 and b2 only.
- Such variations of the coefficients are illustrated in FIG. 12B .
- FIG. 13 is a flowchart of an example process 1300 for implementing parallel feedforward compression in accordance with technology described above. At least a portion of the process 1300 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073,150 and 8,073,151 .
- Operations of the process 1300 include receiving an input signal representing audio captured by a feedforward microphone of an ANR device such as an ANR headphone (1302).
- the ANR device can be an in-ear headphone such as the one described with reference to FIG. 1 .
- the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
- the feedforward microphone can be a part of an array of microphones.
- Operations of the process 1300 also include processing a first frequency range of the input signal to generate a first feedforward signal for an acoustic transducer of the ANR headphone (1304). This can be done using a first feedforward compensator disposed in the ANR device to generate anti-noise signals to reduce or cancel noise signals picked up by the feedforward microphone.
- generating the first feedforward signal includes processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first feedforward compensator to generate the first feedforward signal.
- the first filter can be a high-pass or band-pass filter having a passband that includes the first frequency range.
- the first feedforward signal represents an anti-noise signal configured to reduce a noise signal in the first filtered signal.
- the process 1300 also includes processing a second frequency range of the input signal to generate a second feedforward signal for the acoustic transducer (1306). This can be done, for example, by a second feedforward compensator disposed in parallel to the first feedforward compensator.
- the first frequency range includes frequencies higher than the frequencies in the second frequency range. For example, an upper limit of the second frequency range can be substantially equal to 100 Hz, whereas the lower limit of the first frequency range can be greater than or substantially equal to 100 Hz.
- the first frequency range can include at least a portion of the second frequency range.
- generating the second feedforward signal includes processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second feedforward compensator to generate the second feedforward signal.
- the second filter can have a passband that includes the second frequency range, and the second feedforward signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal.
- Operations of the process 1300 further include detecting that the second feedforward signal satisfies a threshold condition (1308).
- a threshold condition can include, for example, determining that a voltage level representing the second feedforward signal reaches or exceeds a threshold to indicate an overdrive condition of the electroacoustic transducer.
- This can also include, for example, filtering the second feedforward signal using a digital filter, and comparing the filtered second feedforward signal to a value associated with the threshold condition.
- the set of coefficients of the digital filter can be selected based on a mode of operation of the ANR headphone.
- Operations of the process 1300 also include attenuating the second feedforward signal responsive to determining that the second feedforward signal satisfies the threshold condition (1310). For example, if the second feedforward signal satisfies the threshold condition, a determination is made that the second feedforward signal would drive the acoustic transducer, or other portions of the associated electronics, to overload, and accordingly, a variable gain amplifier in the signal path of the second feedforward signal is adjusted to attenuate the second feedforward signal.
- Operations of the process can also include, for example, generating a combined feedforward signal for the acoustic transducer by summing the second feedforward signal and the first feedforward signal, or by summing the attenuated second feedforward signal and the first feedforward signal.
- the acoustic transducer can then be driven using, in part, the combined feedforward signal.
- FIG. 14 is a flowchart of an example process 1400 for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described above. At least a portion of the process 1400 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073,150 and 8,073,151 . Operations of the process 1400 include receiving an input signal representing audio captured by a feedback microphone of an ANR device such as an ANR headphone (1402). In some implementations, the ANR device can be an in-ear headphone such as one described with reference to FIG. 1 .
- the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
- the feedback microphone can be a part of an array of microphones.
- Operations of the process 1400 also include generating, by a feedback compensator and based on the input signal, a first signal (1404).
- the feedback compensator can be substantially similar to the fixed filter 504 described above with reference to FIG. 5A .
- the first signal can include an anti-noise signal generated in response to a noise detected by a feedback microphone, wherein the anti-noise signal is configured to cancel or at least reduce the effect of the noise.
- the operations of the process 1400 include determining one or more characteristics of the first signal (1406). This can be done, for example, using a module substantially similar to the estimator 506 described above with reference to FIG. 5A .
- the one or more characteristics can include a voltage level of the first signal, the voltage level being indicative of an amount of excursion or driver displacement of the corresponding acoustic transducer 106.
- the one or more characteristics can be indicative of a frequency or frequency range of the input signal where the underlying noise is detected.
- the operations of the process 1400 further include selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the feedback compensator (1408).
- the plurality of filter coefficients can be selected, for example, in accordance with a target frequency response of the digital filter. For example, if the one or more characteristics of the first signal indicate that the voltage level of the first signal can potentially drive the corresponding acoustic transducer to an overload condition, and that the underlying noise in the input signal is in the vicinity of 15 Hz, the plurality of coefficients can be chosen to configure the digital filter as a high-pass or notch filter to suppress or attenuate components of the input signal around 15 Hz.
- selecting the plurality of coefficients can be done by accessing a pre-stored look-up table that includes parameter or coefficient values for the digital filter for various combinations of the one or more characteristics determined for the first signal.
- the digital filter is substantially similar to the tunable filter described above with reference to FIGs. 5A and 5B .
- the digital filter may be disposed in the feedback path of an ANR device in series with a feedback compensator, and either before or after the feedback compensator.
- the digital filter may be integrated together with the feedback compensator in the form of a combined set of coefficients.
- the tunable filter 502 and the fixed filter 504 may be combined in the form of a unified filter providing feedback compensation.
- the digital filter may be implemented in various forms, including for example, as an infinite impulse response (IIR) filter or a finite impulse response (FIR filter).
- Operations of the process 1400 also include generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback compensation signal for an acoustic transducer of the ANR headphone (1410).
- a portion of the input signal causing the generation of out-of-range feedback compensation signals may be attenuated, thereby preventing any potential overload conditions in the acoustic transducer. In some implementations, this may improve user experience by avoiding audible artifacts that are otherwise generated by such overload conditions.
- FIG. 15 is a flowchart of an example process 1500 for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device in accordance with technology described above. At least a portion of the process 1500 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073,150 and 8,073,151 . Operations of the process 1500 include receiving an input signal captured by one or more sensors associated with an ANR device such as an ANR headphone (1502). In some implementations, the one or more sensors can include one or more of a feedforward microphone and feedback microphone of the ANR headphone. In some implementations, the one or more sensors include one or more of a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
- VGA variable gain amplifier
- Operations of the process 1500 also include determining one or more characteristics of the first portion of the input signal (1506).
- the one or more characteristics of the first portion of the input signal is indicative of a noise floor associated with the external environment of the ANR headphone.
- determining the one or more characteristics of the first portion of the input signal includes processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
- determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped.
- the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
- determining the one or more characteristics of the first portion of the input signal includes determining a non-linear relationship between the first portion of the input signal and the first output signal. For example, a non-linear relationship may be manifested by an output signal that causes an acoustic transducer to generate an audible artifact such as a pop or click.
- Operations of the process 1500 also include automatically adjusting based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path (1508).
- VGA variable gain amplifier
- the gain of the VGA is adjusted periodically during an operation of the ANR headphone. The time period of the adjustments may be determined empirically, and can be, for example, at least about 100 ms.
- the gain of the VGA is adjusted responsive to determining that the one or more characteristics of the first portion of the input signal or the first output signal satisfies a threshold condition.
- the threshold condition can include, for example, an amount of required gain adjustment.
- the gain of the VGA may be adjusted only if the required adjustment is at least 2.25 dB.
- Operations of the process 1500 also include selecting a set of coefficients for a tunable digital filter disposed in the ANR signal flow path in accordance with the gain of the VGA (1510). For example, if the gain of the VGA is adjusted by a particular amount (e.g., 5 dB), the set of coefficients for the tunable digital filter may be selected such that the magnitude response of the filter due to the selected coefficients compensates for the gain adjustment of the VGA. This may be done, for example, to keep the overall gain of the signal flow path substantially unchanged.
- a particular amount e.g., 5 dB
- Operations of the process 1500 further include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone (1512).
- the second output signal reduces the chances of the system 550 being driven to an overload condition, as compared to the first output signal.
- the process 1500 may therefore be used for mitigating overload conditions in a feedforward or feedback path of the ANR headphone.
- the functionality described herein, or portions thereof, and its various modifications can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.
- a computer program product e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.
- a computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
- a computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.
- Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). In some implementations, at least a portion of the functions may also be executed on a floating point or fixed point digital signal processor (DSP) such as the Super Harvard Architecture Single-Chip Computer (SHARC) developed by Analog Devices Inc.
- DSP floating point or fixed point digital signal processor
- SHARC Super Harvard Architecture Single-Chip Computer
- processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer.
- a processor will receive instructions and data from a read-only memory or a random access memory or both.
- Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
- the parallel feedforward compensation may be combined with a tunable digital filter in the feedback path.
- a tunable digital filter in the feedforward path may be combined with a parallel compensation scheme in the feedback path.
- various combinations of the parallel compensation technique, tunable filter technique, and the VGA technique may be used in the ANR signal flow paths (e.g., a feedback path or a feedforward path) of an ANR device.
- an ANR signal flow path can include a tunable digital filter as well as a parallel compensation scheme to attenuate generated control signal in a specific portion of the frequency range.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Headphones And Earphones (AREA)
- Circuit For Audible Band Transducer (AREA)
Description
- This disclosure generally relates to technology for controlling overload conditions in active noise reducing (ANR) devices.
- ANR devices can utilize one or more digital signal processors (DSPs) for implementing various signal flow topologies. Examples of such DSPs are described in
U.S. Patents 8,073,150 and8,073,151 . -
US 2011/243343 A1 discloses an apparatus and method of controlling provision of ANR, in which amplitudes of a piece of audio employed in the provision of ANR are monitored, and the compression of one or both of feedback and feedforward ANR reference sounds is made dependent on frequency such that a first sound of one frequency need only reach a lower amplitude to trigger compression, while a second sound of another frequency must reach a higher amplitude to trigger compression. -
US 2010/0260345 A1 discloses an active noise control (ANC) system configured to generate at an anti-noise signal configured to drive a speaker to generate sound waves to destructively interfere with an undesired sound present in a target space. The anti-noise signal is adjusted based an output signal of an audio system. The at least one anti-noise signal may be adjusted based on at least one of a volume level of the audio system, a power level of at least one predetermined frequency or frequency range of the output signal of the audio system, frequency content of an output signal of the audio system. - The present invention relates to a method and an ANR device as set out in
independent claims 1 and 11. Other embodiments are described in the dependent claims. - In another aspect, this document features one or more machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations. The operations include receiving an input signal generated by one or more sensors associated with an ANR headphone, wherein the input signal comprises a first portion and a second portion in an ANR signal flow path, processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone and determining one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal. The operations further include automatically adjusting, based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path. The set of coefficients are selected in accordance with the gain of the VGA. The operations also include processing the second portion of the input signal in the ANR signal flow path using the adjusted gain and the selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
- Various implementations described herein may provide one or more of the following advantages. By throttling compensation under overload conditions only in a selected portion of the frequency range, the performance of small form-factor ANR devices (e.g., in-ear headsets) may be improved. For example, selective throttling in the low frequency range may allow for mitigating overload conditions while avoiding potentially objectionable noise modulations that may occur due to turning off the entire feedforward compensation. Because the human ear is relatively less sensitive to low frequencies (e.g., sub-100 Hz), throttling the compensation at such low frequencies upon detection of an overload condition may have an insignificant effect on the psychoacoustic experience of the user, and therefore may improve the overall user experience as compared to a device that completely shuts off the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) upon detection of overload. In addition to, or independently of the processing in one ANR signal flow path (e.g., a feedforward path), a tunable filter may be disposed in the same or another ANR signal flow path (e.g., a feedback path) to mitigate overload conditions due to low frequency stimuli detected by a corresponding microphone (e.g., a feedback microphone in this particular example). In some cases, the tunable filter (which may be implemented, for example, as a high-pass or notch filter) may improve user experience and driver-life by reducing low frequency displacement of the driver resulting from, for example, jaw motion or walking. In some implementations, by providing a variable gain amplifier (VGA) disposed in series with a tunable filter in a signal flow path (e.g., a feedback path or a feedforward path), the noise reduction performance of an ANR device may be adaptively balanced with its overload characteristics. For example, in some cases, increasing the gain of the VGA may result in a better signal-to-noise ratio (SNR) at the cost of a decreased dynamic range and/or an increased likelihood of being driven to overload conditions. Automatic and simultaneous adjustments of both the VGA and the tunable filter may therefore be used in making an ANR device adaptive to various different environments, thereby improving the overall user experience.
- Two or more of the features described in this disclosure, including those described in this summary section, may be combined to form implementations not specifically described herein. The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will be apparent from the description and drawings, and from the claims.
-
-
FIG. 1 shows an in-the-ear active noise reduction (ANR) headphone. -
FIG. 2 is a block diagram of an ANR device. -
FIG. 3A is an example of a block diagram of an ANR device with feedforward compression. -
FIG. 3B is an example of a block diagram of an ANR device with parallel feedforward compression. -
FIG. 4 is a plot showing pressure variations in the ear canal due to the jaw motion of a user using a sealed in-ear headphone. -
FIG. 5A is a block diagram of a feedback path filter that includes a tunable filter configured to mitigate overload conditions due to low frequency stimuli. -
FIG. 5B is a block diagram of an example combination of a variable gain amplifier (VGA) and a tunable filter disposed in a signal flow path of an ANR device. -
FIGs. 6A-6C are magnitude responses of different tunable high-pass filters. -
FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path. -
FIG. 8A shows magnitude and phase responses of the bi-quad notch filter ofFIG. 7 for different combinations of filter coefficients. -
FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n. -
FIGs. 8C and 8D show the variations in coefficient values of the bi-quad notch filter with respect to the tuning parameter n. -
FIG. 9A shows magnitude and phase responses of a feedback path loop gain of an example ANR device without a tunable filter. -
FIG. 9B shows magnitude and phase responses of the feedback path loop gain ofFIG. 9A , but with a tunable filter. -
FIG. 10A shows the sensitivity of a feedback path of an example ANR device without a tunable filter. -
FIG. 10B shows the sensitivity of the feedback path ofFIG. 10A , but with a tunable filter. -
FIG. 11 shows the variation in output voltage of a feedback compensator for various values of the tuning parameter of a tunable filter connected in series. -
FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in an ANR signal flow path. -
FIG 12B shows the variation in coefficient values of the notch filter represented inFIG. 12A . -
FIG. 13 is a flowchart of an example process for implementing parallel feedforward compression in accordance with technology described herein. -
FIG. 14 is a flowchart of an example process for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described herein. -
FIG. 15 is a flowchart of an example process for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device. - An active noise reduction (ANR) device can include a configurable digital signal processor (DSP), which can be used for implementing various signal flow topologies and filter configurations. Examples of such DSPs are described in
U.S. Patents 8,073,150 and8,073,151 .U.S. Patent 9,082,388 FIG. 1 . Thisheadphone 100 includes afeedforward microphone 102, afeedback microphone 104, an output transducer 106 (which may also be referred to as an electroacoustic transducer or acoustic transducer), and a noise reduction circuit (not shown) coupled to both microphones and the output transducer to provide anti-noise signals to the output transducer based on the signals detected at both microphones. An additional input (not shown inFIG. 1 ) to the circuit provides additional audio signals, such as music or communication signals, for playback over theoutput transducer 106 independently of the noise reduction signals. - The term headphone, which is interchangeably used herein with the term headset, includes various types of personal acoustic devices such as in-ear, around-ear or over-the-ear headsets, earphones, and hearing aids. The headsets or headphones can include an earbud or ear cup for each ear. The earbuds or ear cups may be physically tethered to each other, for example, by a cord, an over-the-head bridge or headband, or a behind-the-head retaining structure. In some implementations, the earbuds or ear cups of a headphone may be connected to one another via a wireless link.
- Various signal flow topologies can be implemented in an ANR device to enable functionalities such as audio equalization, feedback noise cancellation, feedforward noise cancellation, etc. For example, as shown in the example block diagram of an
ANR device 200 inFIG. 2 , the signal flow topologies can include a feedforwardnoise reduction path 110 that drives theoutput transducer 106 to generate an anti-noise signal (using, for example, a feedforward compensator 112) to reduce the effects of a noise signal picked up by thefeedforward microphone 102. In another example, the signal flow topologies can include a feedbacknoise reduction path 114 that drives theoutput transducer 106 to generate an anti-noise signal (using, for example, a feedback compensator 116) to reduce the effects of a noise signal picked up by thefeedback microphone 104. The signal flow topologies can also include anaudio path 118 that includes circuitry (e.g., equalizer 120) for processing input audio signals 108 such as music or communication signals, for playback over theoutput transducer 106. - During most operating conditions, the acoustic noise energy that the ANR device attempts to reduce is small enough to keep the system hardware within capacity. However, in some circumstances, discrete acoustic signals or low frequency pressure disturbances (e.g., loud pops, bangs, door slams, etc.) picked up by the feedforward or feedback microphones can cause the noise reduction circuitry to overrun the capacity of the electronics or the
output transducer 106 in trying to reduce the resulting noise, thereby creating audible artifacts which may be deemed objectionable by some users. These conditions, which are referred to herein as overload conditions, can be manifested by, for example, clipping of amplifiers, hard excursion limits of acoustic drivers or transducers, or levels of excursion that cause sufficient change in the acoustics response so as to cause oscillation. The problem of overload conditions can be particularly significant in small form-factor ANR devices such as in-ear headphones. For example, in order to compensate for low frequency pressure disturbances (e.g., a bus going over a pothole, a door slam, or the sound of an airplane taking off), the feedforward compensator may generate a signal that would require the acoustic transducer to exceed the corresponding physical excursion limit. Due to acoustic leaks, the excursion or driver displacement to create a given pressure typically increases with decreasing frequencies. For example, a particular acoustic transducer may need to be displaced 1 mm to generate an anti-noise signal for a 100 Hz noise, 2 mm to generate an anti-noise signal for a 50 Hz noise, and so on. Many acoustic transducers, particularly small transducers used in small form-factor ANR devices are physically incapable of producing such large displacements. In such cases, the demand of the high displacement by a compensator can cause the transducer to generate sounds that cause audible artifacts, which may contribute to an objectionable user experience. The audible artifacts can include oscillations, potentially objectionable transient sounds (e.g., "thuds," "cracks," "pops," or "clicks"), or crackling/buzzing sounds. - In some cases, such artifacts can be reduced by temporarily lowering the gain along selected portions of the signal processing pathways (also referred to herein as "throttling"), such that a transient increase in noise from the lowering of the gain is potentially less objectionable to a user than the artifact being addressed. For example, as shown in the block diagram of an
example ANR device 300 inFIG. 3A , thefeedforward path 110 can include a variable gain amplifier (VGA) 125, the gain of which can be reduced (throttled) upon detection of a signal that can potentially overload theoutput transducer 106. This can be done, for example, using a sidechain filter 128, which is a filter that is applied to a signal sampled from the main signal flow to generate a test signal for determining whether or not to throttle the gain of theVGA 125. For example, the output of theVGA 125 can be passed through the sidechain filter 128 (the transfer function of which is denoted as Ksc_ff) connected to thefeedforward path 110, and the output of the sidechain filter is compared (using, for example, a comparator 130) to a pre-determined threshold,T ff 132 to decide whether an overload condition exists. The output of thecomparator 130 is provided to the variable gain amplifier (VGA) 125. If thecomparator 130 detects that the filtered output signal is greater than the threshold Tff, the gain of theVGA 125 is adjusted to throttle the signal in thefeedforward path 110 to mitigate the overload condition. WhileFIG. 3A shows a sidechain filter only for the feedforward path, a similar sidechain filter may also be implemented in the feedback path. Also, the sidechain filters may be disposed in the feedforward or feedback paths before or after the correspondingmain compensators - In some cases, reducing the gain of the entire feedforward or feedback path may also generate some undesirable audible artifacts and/or noise modulations. For example, if the noise that causes an overload condition has significant energy at low and high frequencies, turning off or significantly reducing the gain of the feedforward compensator may allow the noise to pass through un-attenuated and may create an uncomfortable or objectionable experience for some users. The technology described herein may improve user experience in such cases by allowing gain adjustments in only selected frequency ranges upon detection of an overload condition, while allowing compensation signals to be generated at frequencies outside of the selected range. For example, because noise reduction compensation in the lower end of the frequency spectrum (e.g., below 100 Hz) is often the dominant reason for creating overload conditions, the feedforward compensation may be throttled only in the low frequency portion of the spectrum, while allowing feedforward compensation to continue for other frequencies. This may provide an improved psychoacoustic experience for users because upon detection of a low frequency disturbance, the feedforward compensation is temporarily suspended only in a selected portion of the frequency range. If the selected frequency range is in the sub-100 Hz region, the user experience is not significantly degraded for most users because human ears are typically not very sensitive to noise in that frequency range.
-
FIG. 3B is a block diagram of an example of anANR device 350 with parallel feedforward compression, in which feedforward compensation is throttled in only a portion of the operating frequency range upon detection of an overload condition in that frequency range. Thedevice 350 includes, in thefeedforward path 110, at least two parallel paths each processing a different portion of the operating frequency range. For example, thefeedforward path 110 can include a main feedforward compensator 133 (denoted by the transfer function KffM) which processes a frequency range that substantially excludes frequencies where overload conditions are expected to occur. Thefeedforward path 110 also includes an auxiliary feedforward compensator 134 (denoted by the transfer function KffP) connected in parallel to the main feedforward compensator 133. Theauxiliary feedforward compensator 134 processes the frequency range in which overload conditions are expected to occur. AVGA 125, sidechain filter 128, andcomparator 130 are connected to the output of theauxiliary compensator 134 to throttle the compensation in the corresponding frequency range upon detection of an overload condition. However, even when theVGA 125 throttles the feedforward compensation of theauxiliary compensator 134, the main feedforward compensator 133 continues to provide compensation in the corresponding frequency range. For example, the auxiliary compensator can be configured to process signals only in the sub-100 Hz range, such that feedforward compensation due to low frequency pressure disturbances are throttled using theVGA 125. Even when the feedforward compensation by theauxiliary compensator 134 is throttled, the main feedforward compensator 133 (which can be configured to process signals above 100 Hz) continues to provide feedforward compensation to reduce noise in the corresponding frequency range. In some implementations, this improves the overall noise reduction performance of the corresponding ANR device, while limiting audible artifacts that could be caused by low frequency pressure disturbances. - The
threshold 132 associated with thecomparator 130 may be determined in various ways. In some implementations, thethreshold 132 may be determined based on the characteristics of the output transducer. For example, thethreshold 132 might be set as a voltage reference point to prevent the drive voltage output by theVGA 125 from causing theoutput transducer 106 to hit a mechanical limit, or reaching a drive level where the acoustic distortion due to mechanical, magnetic or electrical characteristics is deemed undesirable. In some cases, these limits may be related to equivalent pressure levels in the ear canal. For example, as the size of the output transducer gets smaller, these limits may occur at lower equivalent pressure levels in the ear canal. - In some implementations, the main feedforward compensator 133 and
auxiliary feedforward compensator 134 can include filters for isolating corresponding operating frequency ranges. For example, theauxiliary compensator 134 can include a low-pass filter with a passband cut-off frequency substantially equal to 100 Hz. The main feedforward compensator 133 can include, for example, a high pass filter with a stopband cut-off frequency substantially equal to 100 Hz. Other configurations may also be used depending, for example, on the corresponding applications. For example, the main feedforward compensator 133 can include a band-pass filter to isolate a frequency range that excludes frequencies where overload conditions are expected to occur. In some implementations, the passbands of the main and auxiliary feedforward compensators may overlap partially. WhileFIG. 3B describes the filter topologies only in thefeedforward path 110, a similar parallel topology may also be used in the feedback path. - In some implementations, multiple sidechain filters can be used in conjunction with the
auxiliary compensator 134. For example, the sidechain filter can be implemented as a filter bank, where a particular sidechain filter is selected based on a mode of operation of the ANR device. For example, if the ANR device is being used in mode where some ambient sounds (e.g., human voice) are allowed to pass through, the sidechain filter selected can be different from one that is selected in a mode in which feedforward compensation is performed for the entire operating frequency range. In some implementations, the filter bank can be implemented using a DSP where a different set of filter coefficients and/or threshold value are selected for the sidechain filter based on an identified operating mode. In some implementations, the main feedforward compensator 133 can be configured to provide noise attenuation in the corresponding frequency range as long as the signal from thefeedforward microphone 102 is not clipped. In some implementations, the sidechain filter can be operated based on input from one or more additional sensors. For example, an accelerometer may be used to identify movements by a user (e.g., running, jogging etc.) that may cause an overload condition. In some implementations, historical information on user-behavior may be used to anticipate events that may cause an overload condition. For example, if it is known that a user enters her car every morning at 7:30 am and again every evening at 5 pm, and each time the slamming of the car door results in an overload condition, this information may be used in enabling a proactive throttling of the low frequency portion of the feedforward signal path. - In some implementations, the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) corresponding to the acoustic transducer for one ear may be coordinated with the compensation in the corresponding signal flow path of the acoustic transducer for the other ear. For example, if a user is wearing both earbuds of a headphone, such coordination between the corresponding signal flow paths may ensure that the ANR performance in the two ears are substantially similar. In some implementations, the sidechain filters of a signal flow path may be adjusted based on determining whether both earbuds of a headphone are being worn by a user. Sensors that can be used for this purpose include, for example, capacitive sensors or infrared sensors disposed on earbuds or ear cups to determine whether an earbud or ear cup is being worn by a user.
- The above discussions describe the overloading problem of the acoustic transducer primarily with respect to the
feedforward path 110. Theelectroacoustic transducer 106 may also be driven to an overload condition due to stimuli picked up by thefeedback microphone 104. For example, in the case of in-ear ANR headphones that are tightly sealed in the ear canal, low frequency stimuli like jaw motion can create large pressure variations that are picked up by thefeedback microphone 104.FIG. 4 is a plot showing the pressure variations in the ear canal over a two second time period, which are detected by a feedback microphone. In some cases, for tightly sealed in-ear headphones, low frequency pressure variations (at approximately 15 Hz) may be generated when the user walks on a firm surface. Such low frequency pressure variations of high magnitude, upon being detected by afeedback microphone 104, may cause thefeedback compensator 116 to generate a feedback compensation signal that drives the acoustic transducer to an overload condition. This in turn may cause theacoustic transducer 106 to generate audible artifacts and degrade the performance of the ANR device. While the example of a user walking on a firm surface, which generates low frequency variations at approximately 15 Hz, is used herein as one example, other events may cause low frequency variations at different frequencies. The techniques described herein are generally applicable to events that cause low frequency variations that may lead to an overdrive condition, regardless of the particular frequency. - In some implementations, audible artifacts generated due to the low frequency pressure variations in the ear canal may be mitigated by using a tunable filter in the feedback compensator.
FIG. 5A is a block diagram of an example of such afeedback compensator 500, which includes atunable filter 502 configured to mitigate overload conditions due to low frequency stimuli picked up by thefeedback microphone 104. Thefeedback compensator 500 also includes a fixedfilter 504 configured to generate the feedback compensation signal for thetransducer 106. In some implementations, upon detection of high-magnitude low-frequency stimuli (resulting, for example, from jaw motion or walking), thetunable filter 502 can be configured to filter out such stimuli from the input signal provided to the fixedfilter 504 to generate the feedback compensation signal. Under such a signal flow scheme, the feedback compensator can continue to generate feedback compensation signals for noise reduction even in the presence of high-magnitude low-frequency stimuli without being driven to an overload condition. - The parameters for the tunable filter can be selected, for example, by a
parameter selector module 508 that determines an appropriate set of parameters based on the output of anestimator 506. In some implementations, theestimator 506 determines, from the feedback compensation signal generated by the fixedfilter 504, whether the feedback compensation signal could potentially drive theacoustic transducer 106 into an overload condition. Based on the output of theestimator 506, theparameter selector module 508 can be configured to select one or more parameters (or a set of filter coefficients) for thetunable filter 502, such that thetunable filter 502 filters out the stimuli that is causing the generation of the large feedback compensation signal. Theparameter selector module 508 can be configured to access a look-up table to select the one or more parameters (or set of filter coefficients) for thetunable filter 502, based on the extent of driver displacement reported by theestimator 506. In some implementations, the estimator can be configured to monitor the output of the fixedfilter 504 to reduce the chances of the output voltage exceeding a threshold condition associated with, for example, driving theoutput transducer 106 to an unacceptably high displacement, or clipping the electrical output. - In some implementations, the
parameter selector module 508 can be configured to select the one or more parameters or coefficients of thetunable filter 502 such that thetunable filter 502 acts as a high-pass filter.FIGs. 6A-6C show magnitude responses of different tunable high-pass filters parameterized by a parameter a. The transfer function of the filter corresponding toFIG. 6A is given by: -
-
- For each of the above transfer functions, selecting the value of a to be equal to unity results in an all-pass filter. However, upon detection of low frequency stimuli that drives the acoustic transducer to an overload condition, the value of a (or a resulting set of filter coefficients) may be chosen in accordance with a desired magnitude response that would filter out the low frequency stimuli.
- In some implementations, the
parameter selector module 508 can be configured to select the one or more parameters or filter coefficients of thetunable filter 502 such that thetunable filter 502 acts as a notch filter. This can be useful, for example, when the pressure variations causing an overload condition is in a narrow frequency range. For example, when a user walks on a firm surface wearing tightly-sealed in-ear headphones, high-magnitude pressure variations can occur at about 15 Hz. In such cases, a notch filter can be used to prevent such pressure variations from generating feedback signals that could drive the acoustic transducer to an overload. Because only a narrow range of frequencies are suppressed using notch filter, such a filter may only insignificantly degrade the feedback compensation performance of the ANR device. - While the description so far uses examples where the parallel compression is used in a feedforward signal flow path (
FIG. 3B ) and the tunable filter is used in a feedback signal path (FIG. 5A ), each of these techniques may be used in other signal flow paths. For example, the feedforward compression technique may be used in a feedback ANR signal flow path, and a tunable filter may be used in a feedforward ANR signal flow path.FIG. 5B shows a block diagram of another system that may be used in either of a feedforward or a feedback ANR signal flow path. Specifically,FIG. 5B is a block diagram of anexample system 550 that uses a combination of a variable gain amplifier (VGA) 552 and a tunable filter 554 disposed in a signal flow path of an ANR device. The signal flow path, which includes a sensor (e.g., amicrophone 557 and/or a non-microphone sensor 555) at one end and anacoustic transducer 106 at the other end, can include, for example, a feedback path or a feedforward path of the ANR device. If the signal flow path in which thesystem 550 is disposed is a feedforward path, the tunable filter 554 may be referred to as a feedforward compensator. If the signal flow path in which thesystem 550 is disposed is a feedback path, the tunable filter 554 may be referred to as a feedback compensator. - In some implementations, the noise reduction performance of the ANR device may be balanced against its overload performance by adaptively adjusting the
VGA 552 and the tunable filter 554 based on the environment of the ANR device. In some implementations, the noise reduction performance may be improved by increasing the gain of theVGA 552. For example, the ANR device may introduce system-generated noise (e.g., noise generated by the electronics disposed in the signal flow path), which may be manifested as a substantially constant audible "hiss" generated by theacoustic transducer 106. In such cases, increasing the gain of theVGA 552 may in some cases improve the signal-to-noise ratio (SNR), and decrease the undesirable hissing audio generated by theacoustic transducer 106. This may also be referred to as lowering of the "noise floor," and improve user experience particularly in low-noise environments. However, pre-amplifying the gain of theVGA 552 boosts any signals captured using the microphones 557 (e.g., feedback and/or feedforward microphones), which in some cases may result in clipping of the incoming signal. For example, if the gain of theVGA 552 is increased to lower the noise floor, the dynamic range of the system may also be reduced, causing the system (e.g., the electronics of the signal flow path and/or the acoustic transducer 106) to overload more easily. In some cases, such overload conditions may cause theacoustic transducer 106 to produce audible pops and clicks, which in turn may detract from the improved user-experience resulting from the lowered noise floor. - The signal flow path illustrated in
FIG. 5B is an example of a system that can be used to balance the noise reduction performance with the overload performance of an ANR device. For example, in quiet environments, where the likelihood of low frequency disturbances (e.g., those caused by low frequency pressure variations in the environment) is low, the gain of the VGA can be adjusted to a relatively high value that reduces the audible noise floor. This in turn may expose the ANR device to a higher likelihood of being driven to overload conditions. Therefore, as soon as an overload condition is detected by theestimator 556, or when the ANR device is moved to an environment where the likelihood of low frequency pressure variations is higher, theparameter selector 558 may be configured to adjust the gain of the VGA to a lower value to reduce the chances of the system being driven to an overload condition. In some cases, if the VGA gain is reduced in a noisier environment, a psychoacoustic effect of the increased noise floor may not be significantly noticeable to a user. However, the adaptive reducing of the gain of theVGA 552 may result in mitigating audible pops and clicks that may otherwise have degraded the user experience due to the occurrence of overload conditions. - In some implementations, when the gain of the
VGA 552 is adjusted to a particular level, the filter coefficients of the tunable filter 554 are also adjusted accordingly to compensate for the change in gain of theVGA 552. For example, if theparameter selector 558 increases the gain of theVGA 552 by 6 dB, theparameter selector 558 may also be configured to select an appropriate set of filter coefficients for the tunable filter 554, such that the magnitude response of the tunable filter is reduced by about 6 dB to compensate for the increased gain of theVGA 552. In some cases, such simultaneous adjustment of the VGA and the tunable filter ensures that the overall gain of the signal flow path is substantially constant, and the user experience is substantially uniform. - The
VGA 552 is configured to process signals captured by one or more sensors such asmicrophones 557 and/ornon-microphone sensors 555. Themicrophones 557 can be of various types, possibly depending on, for example, the signal flow path in which thesystem 550 is disposed. For example, if thesystem 550 is disposed in a feedforward ANR path, themicrophone 557 can include the feedforward microphone of the ANR device, such as themicrophone 102 described above. In another example, if thesystem 550 is disposed in a feedback ANR path, themicrophone 557 can include a feedback microphone such as themicrophone 104 described above. Thesensors 555 can also be of various types. In some implementations, thenon-microphone sensors 555 can include, for example, a pressure sensor, an accelerometer, or a gyroscope. Suchnon-microphone sensors 555 may be used, for example, to detect pressure changes or activities that may prompt a change in the settings of theVGA 552 and/or the tunable filter 554. For example, based on the output of an accelerometer disposed in an ANR headphone, a determination may be made that the user is running or jogging, which in turn may produce low frequency pressure variations at a particular frequency. Based on such a determination, theparameter selector 558 may be configured to adjust the gain associated with the VGA and the filter coefficients of the tunable filter 554. While thesystem 550 illustrated inFIG. 5B includes bothnon-microphone sensors 555 andmicrophones 557, systems that include onlymicrophones 557 or onlynon-microphone sensors 555 are also possible. - In some implementations, the adjustments to the gain of the
VGA 552 and the filter coefficients of the tunable filter 554 may be made based on predicting the onset of a particular event. In some implementations, the environment of a user may be determined based on the output of a global positioning system (GPS) (e.g., one disposed either in the ANR device or in a mobile phone connected to the ANR device), and the settings of theVGA 552 and the tunable filter 554 may be adjusted in accordance with the determination. For example, if the user of the ANR device is determined to be in a library or office, theparameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in quiet environments. Conversely, if the user is determined to be in a train during commuting hours, theparameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in noisy environments. In some implementations, the user's environment may be detected based on one or more applications executing on the ANR device and/or a mobile device connected to the ANR device. For example, upon determining that the user has just started an application that tracks the user's running steps, an inference may be made that the user is about to start a run. Accordingly, theparameter selector 558 can be configured to adjust theVGA 552 and the tunable filter 554 to account for the corresponding expected low-pressure variations in the ANR device. In some implementations, information about both the environment and the activity of the user may be used in determining that operating parameters of theVGA 552 and the filter coefficients of the tunable filter. - The
parameter selector 558 can be configured to select the operating parameters of theVGA 552 and the tunable filter 554 in various ways. In some implementations, the parameter selector may be configured to access a computer-readable storage device that stores a representation of a look-up table that stores different sets of filter coefficients of the tunable filter 554 linked to different gain values of theVGA 552. In some implementations, the parameter selector can be configured to calculate the filter coefficients of the tunable filter 554 based on a pre-defined relationship with the selected gain values. The gain values to be used in different environments may be empirically determined or calculated as a function of the outputs of one or more sensors such as a pressure sensor or microphone. In some implementations, the gain level of theVGA 552 may also be changed based on user-input received via a user interface. The user interface can be a control such as a switch, knob, or dial disposed on the ANR device, or a software-based graphical user interface displayed on a display device such as one displayed on a connected mobile device. - The
estimator 556 can be configured to determine whether any adjustments to theVGA 552 and/or the tunable filter 554 are needed. Accordingly, theestimator 556 can be configured to signal theparameter selector 558 to adjust one or both of theVGA 552 and the tunable filter 554. In some implementations, theestimator 556 is substantially similar to theestimator 506 described above with reference toFIG. 5A . In some implementations, theestimator 556 can be a displacement estimator configured to estimate whether the drive signal for the acoustic transducer can potentially cause the transducer to exceed its excursion limit. In some implementations, theestimator 556 can include a pressure estimator configured to detect the occurrence of pressure disturbances in the environment. - The
system 550 may be operated in various modes. In some implementations, thesystem 550 can be configured to run substantially continuously upon initialization. For example, if thesystem 550 is disposed in a feedforward or feedback path of an ANR headphone, the system may be initialized when the ANR functionality of the headphone is activated, and then allowed to run during the operating period of the headphone. In some cases though, such a mode of operation may cause multiple pops and clicks, which could degrade the user experience to some extent. In some implementations, thesystem 550 can include a control (e.g., a button) to deactivate/activate thesystem 550 based on user-input. In some implementations, instead of performing continuous adjustments upon activation, thesystem 550 could be configured such that theparameter selector 558 adjusts theVGA 552 and the tunable filter 554 in accordance with the current environment, and then either shuts off or goes into standby mode. The system may be reactivated based on a user-input which indicates that the environment has changed, or that a readjustment is otherwise desired. In some implementations, thesystem 550 or the ANR device in which it is deployed may include one or more controls (e.g., hardware buttons and/or software controls presented on a user interface) for selecting the mode of operation of thesystem 550. - In a mode of operation in which the
system 550 automatically adjusts the gain of theVGA 552 and the filter coefficients of the tunable filter 554, the adjustments may be performed in various ways. In some implementations, the adjustments are performed substantially periodically. For example, the adjustments may be performed with a time period of about 100 ms or more. The frequency of adjustments may be selected empirically, for example, to allow thesystem 550 to adequately adjust to changing environments. In some implementations, the adjustments can be performed upon detection of a change in the environment. For example, if theestimator 556 detects a signal indicative of a change in the environment (e.g., the occurrence of a low frequency pressure event), the estimator may signal theparameter selector 558 to adjust theVGA 552 and the tunable filter 554 accordingly. - In some implementations, in order to prevent the
system 550 from adjusting too frequently, a decision threshold may be associated with the adjustments. In some implementations, an adjustment may be made only if the amount of required change in the gain of theVGA 552 exceeds a threshold amount. For example, an adjustment may be made only if the gain adjustment is 2.25 dB or higher. The threshold amount may be determined empirically, for example, to prevent overly frequent adjustments. - The adjustments to the gain level of the
VGA 552 can be performed in various ways. In some implementations, the adjustments may be made in a single step. In some implementations, the adjustments may be made as a series of multiple steps. For example, if an adjustment of 6 dB needs to be made, the adjustments may be made as a single step change of 6 dB, or a series of six steps each implementing a 1 dB change, or another combination of steps. The step sizes may be determined empirically, for example, based on the tolerance for any associated audible artifacts generated by the step changes. In some implementations, the time gap between the steps may also be adjusted, for example, to reduce the possibility of multiple audible artifacts to be merged into a single louder artifact. However, increasing the gap between the steps also increases the total adjustment time. The spacing between the steps can therefore be selected empirically in accordance with a target tradeoff between the adjustment time and the tolerable audible artifacts. -
- In practice, multiple bi-quad notch filters may be cascaded to achieve the desired level of suppression.
FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown inFIG. 7 ) for different combinations of filter coefficients. The filter coefficients are parameterized by the parameter n. Specifically, thecurves curves FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n in terms of frequency and bi-quad singularities Q. The Q is also known as the quality factor. Infigure 8B the curves describing the pole and zero frequency and Qs as a function of tuning variation show that the notch sharpness and notch center frequency are coupled. To maintain desirable feedback ANR performance, the notch depth increases with increasing frequency. -
FIGs. 8C and 8D show the variations in filter coefficient values of the bi-quad notch filter with respect to the tuning parameter n. In the particular example shown inFIGs. 8C and 8D , the values of the coefficients b1 and a1 are in the vicinity of 2, and the values of the coefficients b2 and a2 are in the vicinity of unity. This is related to the particular implementation which uses a sample rate of 384000 samples per second, which is greater than the desired 15 Hz notch frequency. In some implementations, the filter coefficient values (e.g., b1, b2, a1 and a2, in the present example) can be stored in a look-up table, or derived from mapping rules such as the frequency/Q mapping illustrated inFIG. 8B . -
FIGs. 9A-9B , andFIGs. 10A-10B illustrate the performance of a tunable filter in the feedback path. Specifically,FIGs. 9A and 9B show magnitude and phase responses of the loop gain (provided as a product of the driver-voltage-to-feedback-microphone-voltage transfer function and the feedback compensator transfer function Kfb) of the feedback path without a tunable filter and with a tunable filter, respectively. The particular tunable filter used in this example included twelve cascaded bi-quad notch filters, each of which were substantially similar to the bi-quad notch filter illustrated inFIG. 7 . As illustrated byFIG. 9B , the tunable filter remains stable and exhibits consistent loop gain behavior for the various values of the tuning parameter n. Further, as illustrated byFIGs. 10A and 10B , which show the sensitivity of a feedback path of the example ANR device without a tunable filter (FIG. 10A ), and with a tunable filter (FIG. 10B ), the sensitivity of the filters also remains consistent for the various values of the tuning parameter. -
FIG. 11 shows the variation in output voltage of thefeedback compensator 116 for the various values of the tuning parameter n. Specifically, thecurves -
FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in the feedback path. This notch filter is another single bi-quad notch filter such as the one illustrated inFIG. 7 , but with the coefficients a1 and a2 held to be constants. In this example, the frequency of the complex poles and zeros were equal and the Q of the zeros was varied to change the depth of the notch, which resulted in changes to the coefficients b1 and b2 only. Such variations of the coefficients are illustrated inFIG. 12B . -
FIG. 13 is a flowchart of anexample process 1300 for implementing parallel feedforward compression in accordance with technology described above. At least a portion of theprocess 1300 can be implemented using one or more processing devices such as DSPs described inU.S. Patents 8,073,150 and8,073,151 . - Operations of the
process 1300 include receiving an input signal representing audio captured by a feedforward microphone of an ANR device such as an ANR headphone (1302). In some implementations, the ANR device can be an in-ear headphone such as the one described with reference toFIG. 1 . In some implementations, the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices. In some implementations, the feedforward microphone can be a part of an array of microphones. - Operations of the
process 1300 also include processing a first frequency range of the input signal to generate a first feedforward signal for an acoustic transducer of the ANR headphone (1304). This can be done using a first feedforward compensator disposed in the ANR device to generate anti-noise signals to reduce or cancel noise signals picked up by the feedforward microphone. In some implementations, generating the first feedforward signal includes processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first feedforward compensator to generate the first feedforward signal. The first filter can be a high-pass or band-pass filter having a passband that includes the first frequency range. The first feedforward signal represents an anti-noise signal configured to reduce a noise signal in the first filtered signal. - The
process 1300 also includes processing a second frequency range of the input signal to generate a second feedforward signal for the acoustic transducer (1306). This can be done, for example, by a second feedforward compensator disposed in parallel to the first feedforward compensator. In some implementations, the first frequency range includes frequencies higher than the frequencies in the second frequency range. For example, an upper limit of the second frequency range can be substantially equal to 100 Hz, whereas the lower limit of the first frequency range can be greater than or substantially equal to 100 Hz. In some implementations, the first frequency range can include at least a portion of the second frequency range. In some implementations, generating the second feedforward signal includes processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second feedforward compensator to generate the second feedforward signal. The second filter can have a passband that includes the second frequency range, and the second feedforward signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal. - Operations of the
process 1300 further include detecting that the second feedforward signal satisfies a threshold condition (1308). This can include, for example, determining that a voltage level representing the second feedforward signal reaches or exceeds a threshold to indicate an overdrive condition of the electroacoustic transducer. This can also include, for example, filtering the second feedforward signal using a digital filter, and comparing the filtered second feedforward signal to a value associated with the threshold condition. The set of coefficients of the digital filter can be selected based on a mode of operation of the ANR headphone. - Operations of the
process 1300 also include attenuating the second feedforward signal responsive to determining that the second feedforward signal satisfies the threshold condition (1310). For example, if the second feedforward signal satisfies the threshold condition, a determination is made that the second feedforward signal would drive the acoustic transducer, or other portions of the associated electronics, to overload, and accordingly, a variable gain amplifier in the signal path of the second feedforward signal is adjusted to attenuate the second feedforward signal. - Operations of the process can also include, for example, generating a combined feedforward signal for the acoustic transducer by summing the second feedforward signal and the first feedforward signal, or by summing the attenuated second feedforward signal and the first feedforward signal. The acoustic transducer can then be driven using, in part, the combined feedforward signal.
- All of the various signal topologies and filter designs described above can be implemented in the configurable digital signal processor described in the cited patents. These topologies and filter designs may also be implemented in analog circuits, or in a combination of analog and digital circuits, using conventional circuit design techniques, though the resulting product may be larger or less flexible than one implemented using an integrated, configurable digital signal processor.
-
FIG. 14 is a flowchart of anexample process 1400 for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described above. At least a portion of theprocess 1400 can be implemented using one or more processing devices such as DSPs described inU.S. Patents 8,073,150 and8,073,151 . Operations of theprocess 1400 include receiving an input signal representing audio captured by a feedback microphone of an ANR device such as an ANR headphone (1402). In some implementations, the ANR device can be an in-ear headphone such as one described with reference toFIG. 1 . In some implementations, the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices. In some implementations, the feedback microphone can be a part of an array of microphones. - Operations of the
process 1400 also include generating, by a feedback compensator and based on the input signal, a first signal (1404). In some implementations, the feedback compensator can be substantially similar to the fixedfilter 504 described above with reference toFIG. 5A . For example, the first signal can include an anti-noise signal generated in response to a noise detected by a feedback microphone, wherein the anti-noise signal is configured to cancel or at least reduce the effect of the noise. - The operations of the
process 1400 include determining one or more characteristics of the first signal (1406). This can be done, for example, using a module substantially similar to theestimator 506 described above with reference toFIG. 5A . The one or more characteristics can include a voltage level of the first signal, the voltage level being indicative of an amount of excursion or driver displacement of the correspondingacoustic transducer 106. In some implementations, the one or more characteristics can be indicative of a frequency or frequency range of the input signal where the underlying noise is detected. - The operations of the
process 1400 further include selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the feedback compensator (1408). The plurality of filter coefficients can be selected, for example, in accordance with a target frequency response of the digital filter. For example, if the one or more characteristics of the first signal indicate that the voltage level of the first signal can potentially drive the corresponding acoustic transducer to an overload condition, and that the underlying noise in the input signal is in the vicinity of 15 Hz, the plurality of coefficients can be chosen to configure the digital filter as a high-pass or notch filter to suppress or attenuate components of the input signal around 15 Hz. In some implementations, selecting the plurality of coefficients can be done by accessing a pre-stored look-up table that includes parameter or coefficient values for the digital filter for various combinations of the one or more characteristics determined for the first signal. In some implementations, the digital filter is substantially similar to the tunable filter described above with reference toFIGs. 5A and5B . - The digital filter may be disposed in the feedback path of an ANR device in series with a feedback compensator, and either before or after the feedback compensator. In some implementations, the digital filter may be integrated together with the feedback compensator in the form of a combined set of coefficients. For example, with reference to
FIG. 5A , thetunable filter 502 and the fixedfilter 504 may be combined in the form of a unified filter providing feedback compensation. The digital filter may be implemented in various forms, including for example, as an infinite impulse response (IIR) filter or a finite impulse response (FIR filter). - Operations of the
process 1400 also include generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback compensation signal for an acoustic transducer of the ANR headphone (1410). In some implementations, once the input signal is processed by the digital filter with selected coefficients, a portion of the input signal causing the generation of out-of-range feedback compensation signals may be attenuated, thereby preventing any potential overload conditions in the acoustic transducer. In some implementations, this may improve user experience by avoiding audible artifacts that are otherwise generated by such overload conditions. -
FIG. 15 is a flowchart of anexample process 1500 for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device in accordance with technology described above. At least a portion of theprocess 1500 can be implemented using one or more processing devices such as DSPs described inU.S. Patents 8,073,150 and8,073,151 . Operations of theprocess 1500 include receiving an input signal captured by one or more sensors associated with an ANR device such as an ANR headphone (1502). In some implementations, the one or more sensors can include one or more of a feedforward microphone and feedback microphone of the ANR headphone. In some implementations, the one or more sensors include one or more of a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer. - Operations of the
process 1500 also include determining one or more characteristics of the first portion of the input signal (1506). In some implementations, the one or more characteristics of the first portion of the input signal is indicative of a noise floor associated with the external environment of the ANR headphone. In some implementations, determining the one or more characteristics of the first portion of the input signal includes processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal. For example, determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped. In some implementations, the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped. In some implementations, determining the one or more characteristics of the first portion of the input signal includes determining a non-linear relationship between the first portion of the input signal and the first output signal. For example, a non-linear relationship may be manifested by an output signal that causes an acoustic transducer to generate an audible artifact such as a pop or click. - Operations of the
process 1500 also include automatically adjusting based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path (1508). In some implementations, the gain of the VGA is adjusted periodically during an operation of the ANR headphone. The time period of the adjustments may be determined empirically, and can be, for example, at least about 100 ms. In some implementations, the gain of the VGA is adjusted responsive to determining that the one or more characteristics of the first portion of the input signal or the first output signal satisfies a threshold condition. The threshold condition can include, for example, an amount of required gain adjustment. For example, the gain of the VGA may be adjusted only if the required adjustment is at least 2.25 dB. - Operations of the
process 1500 also include selecting a set of coefficients for a tunable digital filter disposed in the ANR signal flow path in accordance with the gain of the VGA (1510). For example, if the gain of the VGA is adjusted by a particular amount (e.g., 5 dB), the set of coefficients for the tunable digital filter may be selected such that the magnitude response of the filter due to the selected coefficients compensates for the gain adjustment of the VGA. This may be done, for example, to keep the overall gain of the signal flow path substantially unchanged. - Operations of the
process 1500 further include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone (1512). In some implementations, the second output signal reduces the chances of thesystem 550 being driven to an overload condition, as compared to the first output signal. Theprocess 1500 may therefore be used for mitigating overload conditions in a feedforward or feedback path of the ANR headphone. - The functionality described herein, or portions thereof, and its various modifications (hereinafter "the functions") can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.
- A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.
- Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). In some implementations, at least a portion of the functions may also be executed on a floating point or fixed point digital signal processor (DSP) such as the Super Harvard Architecture Single-Chip Computer (SHARC) developed by Analog Devices Inc.
- Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
- Other embodiments and applications not specifically described herein are also within the scope of the following claims. For example, the parallel feedforward compensation may be combined with a tunable digital filter in the feedback path. In another example, a tunable digital filter in the feedforward path may be combined with a parallel compensation scheme in the feedback path. In some implementations, various combinations of the parallel compensation technique, tunable filter technique, and the VGA technique may be used in the ANR signal flow paths (e.g., a feedback path or a feedforward path) of an ANR device. In some implementations, an ANR signal flow path can include a tunable digital filter as well as a parallel compensation scheme to attenuate generated control signal in a specific portion of the frequency range.
- Elements of different implementations described herein may be combined to form other embodiments not specifically set forth within the scope of the invention as defined within the appended claims. Elements may be left out of the structures described herein without adversely affecting their operation. Furthermore, various separate elements may be combined into one or more individual elements to perform the functions described herein.
Claims (15)
- A method comprising:receiving an input signal generated by one or more sensors (555, 557) associated with an active noise reduction, ANR, headphone (100; 200; 300; 350), wherein the input signal comprises a first portion and a second portion;processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer (106) of the ANR headphone;determining, by one or more processing devices (556, 558) in an ANR signal flow path, one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal;automatically adjusting, by the one or more processing devices based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier, VGA, (552) disposed in the ANR signal flow path; selecting, by the one or more processing devices (558), a set of coefficients for a tunable digital filter (554) disposed in the ANR signal flow path, wherein the set of coefficients are selected in accordance with the gain of the VGA; andprocessing the second portion of the input signal in the ANR signal flow path using the adjusted gain and the selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
- The method of claim 1, wherein the one or more sensors comprise one or more of: a feedforward microphone of the ANR headphone, a feedback microphone of the ANR headphone, a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
- The method of claim 1, wherein the ANR signal flow path comprises a feedforward path disposed between a feedforward microphone of the ANR headphone and the electroacoustic transducer, or a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
- The method of claim 1, further comprising deactivating VGA gain adjustments responsive to a first user-input received by an input-device of the ANR headphone.
- The method of claim 4, further comprising reactivating VGA gain adjustments responsive to a second user-input received by the input-device of the ANR headphone.
- The method of claim 1, wherein the gain of the VGA is adjusted periodically during an operation of the ANR headphone.
- The method of claim 1, wherein the gain of the VGA is adjusted responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition.
- The method of claim 1, wherein the one or more characteristics of the first portion of the input signal is indicative of a noise floor of an external environment of the ANR headphone.
- The method of claim 1, wherein determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal comprises determining that the first output signal is clipped.
- The method of claim 1, wherein the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
- An active noise reduction, ANR, device comprising:one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, wherein the input signal comprises a first portion and a second portion;a variable gain amplifier, VGA, (552) and a tunable digital filter disposed in an ANR signal flow path of the ANR device, wherein the VGA is configured to process the first and the second portions of the input signal, wherein the ANR signal flow path is connected to an electroacoustic transducer (106) of the ANR device; andone or more processing devices (556, 558) configured to:determine one or more characteristics of a first portion of the input signal,automatically adjust, based on the one or more characteristics of the first portion of the input signal, a gain of the VGA,select a set of coefficients for the tunable digital filter, wherein the set of coefficients are selected in accordance with the gain of the VGA,wherein determining the one or more characteristics of the first portion of the input signal comprises:processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR device; anddetermining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal, andwherein processing the second portion of the input signal in the ANR signal flow path comprises using the adjusted gain and the selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR
- The ANR device of claim 11, wherein the one or more sensors comprise one or more of: a feedforward microphone, a feedback microphone, a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
- The ANR device of claim 11, wherein the one or more characteristics of the first portion of the input signal is indicative of a noise floor of an external environment of the ANR device.
- The ANR device of claim 11, wherein the ANR signal flow path comprises a feedforward path disposed between a feedforward microphone of the ANR device and the electroacoustic transducer.
- The ANR device of claim 11, wherein the one or more processing devices are configured to adjust the gain of the VGA responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition.
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/473,926 US10580398B2 (en) | 2017-03-30 | 2017-03-30 | Parallel compensation in active noise reduction devices |
US15/473,889 US10553195B2 (en) | 2017-03-30 | 2017-03-30 | Dynamic compensation in active noise reduction devices |
US15/473,939 US10614790B2 (en) | 2017-03-30 | 2017-03-30 | Automatic gain control in an active noise reduction (ANR) signal flow path |
EP18718353.8A EP3602538B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
PCT/US2018/025196 WO2018183714A2 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18718353.8A Division-Into EP3602538B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
EP18718353.8A Division EP3602538B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3618058A1 EP3618058A1 (en) | 2020-03-04 |
EP3618058B1 true EP3618058B1 (en) | 2022-08-17 |
Family
ID=62002483
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19201902.4A Active EP3627493B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
EP18718353.8A Active EP3602538B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
EP19201934.7A Active EP3618058B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19201902.4A Active EP3627493B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
EP18718353.8A Active EP3602538B1 (en) | 2017-03-30 | 2018-03-29 | Compensation and automatic gain control in active noise reduction devices |
Country Status (3)
Country | Link |
---|---|
EP (3) | EP3627493B1 (en) |
CN (2) | CN116741138A (en) |
WO (1) | WO2018183714A2 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10748521B1 (en) * | 2019-06-19 | 2020-08-18 | Bose Corporation | Real-time detection of conditions in acoustic devices |
US10937410B1 (en) * | 2020-04-24 | 2021-03-02 | Bose Corporation | Managing characteristics of active noise reduction |
CN111741407B (en) * | 2020-06-12 | 2021-08-10 | 瑞声科技(新加坡)有限公司 | Loudspeaker compensation method, device, storage medium and equipment |
US11564035B1 (en) * | 2021-09-08 | 2023-01-24 | Cirrus Logic, Inc. | Active noise cancellation system using infinite impulse response filtering |
CN113794965B (en) * | 2021-10-28 | 2022-11-01 | 歌尔科技有限公司 | Earphone frequency response calibration method and device, earphone equipment and storage medium |
WO2024021502A1 (en) * | 2022-07-27 | 2024-02-01 | 北京爱德发科技有限公司 | Noise-canceling earphones, noise-canceling method and device, storage medium, and processor |
CN116908886B (en) * | 2023-09-13 | 2023-12-26 | 北京凯芯微科技有限公司 | System and method for automatically detecting gain range of GNSS module |
CN116994545B (en) * | 2023-09-25 | 2023-12-08 | 苏州至盛半导体科技有限公司 | Dynamic original sound adjusting method and device for K song system |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006157130A (en) * | 2004-11-25 | 2006-06-15 | Globo Technology:Kk | Regular dodecahedron loudspeaker apparatus |
TW200627999A (en) * | 2005-01-05 | 2006-08-01 | Srs Labs Inc | Phase compensation techniques to adjust for speaker deficiencies |
TWI310177B (en) * | 2006-12-29 | 2009-05-21 | Ind Tech Res Inst | Noise canceling device and method thereof |
JP5082517B2 (en) * | 2007-03-12 | 2012-11-28 | ヤマハ株式会社 | Speaker array device and signal processing method |
US8699719B2 (en) * | 2009-03-30 | 2014-04-15 | Bose Corporation | Personal acoustic device position determination |
US8189799B2 (en) * | 2009-04-09 | 2012-05-29 | Harman International Industries, Incorporated | System for active noise control based on audio system output |
US8073151B2 (en) | 2009-04-28 | 2011-12-06 | Bose Corporation | Dynamically configurable ANR filter block topology |
US8073150B2 (en) | 2009-04-28 | 2011-12-06 | Bose Corporation | Dynamically configurable ANR signal processing topology |
US8532310B2 (en) * | 2010-03-30 | 2013-09-10 | Bose Corporation | Frequency-dependent ANR reference sound compression |
US8737636B2 (en) * | 2009-07-10 | 2014-05-27 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation |
US8494185B2 (en) * | 2010-07-18 | 2013-07-23 | Bose Corporation | Electro-acoustic transducer tuning and data storage |
US9082388B2 (en) | 2012-05-25 | 2015-07-14 | Bose Corporation | In-ear active noise reduction earphone |
CN102932710B (en) * | 2012-10-10 | 2015-06-03 | 广州创维平面显示科技有限公司 | Method and device for bass compensation |
US9445184B2 (en) * | 2013-12-03 | 2016-09-13 | Bose Corporation | Active noise reduction headphone |
CN105025418B (en) * | 2014-04-17 | 2018-10-09 | 山东共达电声股份有限公司 | A kind of active noise reduction controller |
KR20170084054A (en) * | 2014-09-30 | 2017-07-19 | 아브네라 코포레이션 | Aoustic processor having low latency |
JP6611512B2 (en) * | 2015-08-07 | 2019-11-27 | 株式会社オーディオテクニカ | Noise canceling headphones |
-
2018
- 2018-03-29 EP EP19201902.4A patent/EP3627493B1/en active Active
- 2018-03-29 CN CN202310860272.8A patent/CN116741138A/en active Pending
- 2018-03-29 EP EP18718353.8A patent/EP3602538B1/en active Active
- 2018-03-29 CN CN201880036193.2A patent/CN110720121B/en active Active
- 2018-03-29 EP EP19201934.7A patent/EP3618058B1/en active Active
- 2018-03-29 WO PCT/US2018/025196 patent/WO2018183714A2/en unknown
Also Published As
Publication number | Publication date |
---|---|
EP3602538B1 (en) | 2024-06-05 |
CN110720121A (en) | 2020-01-21 |
EP3618058A1 (en) | 2020-03-04 |
EP3627493B1 (en) | 2024-05-15 |
EP3627493A1 (en) | 2020-03-25 |
EP3602538A2 (en) | 2020-02-05 |
WO2018183714A3 (en) | 2018-11-22 |
CN116741138A (en) | 2023-09-12 |
WO2018183714A2 (en) | 2018-10-04 |
CN110720121B (en) | 2024-04-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11636841B2 (en) | Automatic gain control in an active noise reduction (ANR) signal flow path | |
US10553195B2 (en) | Dynamic compensation in active noise reduction devices | |
US10580398B2 (en) | Parallel compensation in active noise reduction devices | |
EP3618058B1 (en) | Compensation and automatic gain control in active noise reduction devices | |
EP3704688B1 (en) | Compressive hear-through in personal acoustic devices | |
KR102354215B1 (en) | Ambient sound enhancement and acoustic noise cancellation based on context | |
EP3008724B1 (en) | Controlling stability in anr devices | |
US10714073B1 (en) | Wind noise suppression for active noise cancelling systems and methods | |
US11785382B2 (en) | Gain-adaptive active noise reduction (ANR) device | |
US11651759B2 (en) | Gain adjustment in ANR system with multiple feedforward microphones | |
CN112788466A (en) | Filter parameter configuration method of active noise reduction earphone and active noise reduction earphone | |
GB2589802A (en) | Earphone system | |
US11961502B1 (en) | Wearable audio device with feedback instability control | |
US20230087943A1 (en) | Active noise control method and system for headphone | |
CN118476243A (en) | Audio device with perceptual mode auto leveler |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 3602538 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200903 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20220506 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 3602538 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018039565 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1512689 Country of ref document: AT Kind code of ref document: T Effective date: 20220915 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220817 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221219 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221117 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1512689 Country of ref document: AT Kind code of ref document: T Effective date: 20220817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221217 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20221118 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018039565 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
26N | No opposition filed |
Effective date: 20230519 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20230331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230329 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230329 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240220 Year of fee payment: 7 Ref country code: GB Payment date: 20240220 Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220817 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240220 Year of fee payment: 7 |