EP2437258B1 - Method and device for frequency compression with selective frequency shifting - Google Patents

Method and device for frequency compression with selective frequency shifting Download PDF

Info

Publication number
EP2437258B1
EP2437258B1 EP11183051.9A EP11183051A EP2437258B1 EP 2437258 B1 EP2437258 B1 EP 2437258B1 EP 11183051 A EP11183051 A EP 11183051A EP 2437258 B1 EP2437258 B1 EP 2437258B1
Authority
EP
European Patent Office
Prior art keywords
frequency
channel
channels
shifting
mapping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP11183051.9A
Other languages
German (de)
French (fr)
Other versions
EP2437258A2 (en
EP2437258A3 (en
Inventor
Robert BÄUML
Ulrich Kornagel
Thomas Pilgrim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP2437258A2 publication Critical patent/EP2437258A2/en
Publication of EP2437258A3 publication Critical patent/EP2437258A3/en
Application granted granted Critical
Publication of EP2437258B1 publication Critical patent/EP2437258B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
    • H04R25/353—Frequency, e.g. frequency shift or compression
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition

Definitions

  • the present invention relates to a method of frequency-compressing an audio signal by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels.
  • the present invention relates to a corresponding device for frequency compression of an audio signal with a shifting device for shifting or mapping a portion of the audio signal.
  • the present invention also relates to a hearing device with such a device.
  • a hearing device is understood to mean any sound-emitting device that can be worn in or on the ear, such as a hearing aid, a headset, headphones and the like.
  • Hearing aids are portable hearing aids that are used to care for the hearing impaired.
  • hearing aids such as behind-the-ear hearing aids (BTE), receiver in the canal (RIC) and in-the-ear hearing aids (Id0), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
  • BTE behind-the-ear hearing aids
  • RIC receiver in the canal
  • Id0 in-the-ear hearing aids
  • ITE canal hearing aids
  • the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
  • bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
  • Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic Receiver, e.g. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed.
  • a signal processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them.
  • the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
  • the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
  • the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
  • Hearing aids are essentially two common methods to increase speech intelligibility.
  • a frequency-dependent level compensation is generally performed by means of AGC (Automatic Game Control) in order to lift signals above the hearing threshold of the hearing impaired, so that he can perceive the signals again.
  • AGC Automatic Game Control
  • the second method is usually used in addition to the first and aims at hearing damage, in which even by pure amplification of the signal, the threshold of hearing in certain, typically high, frequencies can not be achieved. These high frequencies are mapped to a low (audible) frequency range so that they can be lifted above the threshold of hearing by amplification.
  • the method is called frequency compression because the desired frequency range is mapped to a smaller, more audible frequency range.
  • the method used uses properties of the filter bank used for easy implementation. It selectively copies individual channels, depending on their instantaneous power, to other channels, so that the frequency components contained in these channels, shifted at the output, reappear in a different frequency range. Where the channels are displayed determines a mapping rule and is adjustable, so that different compression ratios can be realized.
  • FIG. 2 shows the principle of frequency compression by simply copying channels.
  • the center frequency 14 is associated with a channel 14 '.
  • the frequency of the sound (dominant instantaneous frequency 11 "and 14") relative to the respective channel center within the source and destination channel is identical.
  • a method in which a higher, first frequency band, which lies above the hearing range of a deaf person, is transposed into a second frequency band which is audible to the carrier.
  • a dominant signal is detected in the higher band and this transposed down by means of an oscillator with adaptive frequency and a mixer in the audible range.
  • the shifted signal of the first frequency band and the signal of the second frequency band present in the audible target area are mixed.
  • the object of the present invention is therefore to the frequency compression of an audio signal to the effect optimize that creates an improved listening experience. It is a corresponding method and a corresponding device to propose.
  • this object is achieved by a method for frequency compression of an audio signal, by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, wherein a dominant instantaneous frequency in the first frequency Frequency channel is determined in the move or mapping first the entire first frequency channel including the dominant instantaneous frequency is shifted or mapped into the second frequency channel, wherein the dominant instantaneous frequency receives an intermediate frequency position, a final frequency position for the dominant instantaneous frequency by a predetermined continuous compression characteristic in the second Frequency channel is determined based on the frequency position of the dominant instantaneous frequency in the first frequency channel and the dominant Instantanfre shifted or imaged from the intermediate frequency position to the final frequency position.
  • the invention provides a device for frequency compression of an audio signal with a first displacement device for shifting or imaging a portion of the audio signal provided in a plurality of frequency channels from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, and comprising estimating means for determining a dominant instantaneous frequency in the first frequency channel, wherein with the first displacement means the entire first frequency channel including the dominant instantaneous frequency in the second frequency channel being displaceable or mappable such that the dominant instantaneous frequency obtains an intermediate frequency position, computing means for determining a final frequency position for the dominant instantaneous frequency by a predetermined continuous compression characteristic in the second frequency channel from the frequency position of the dominant instantaneous frequency in the first frequency channel, and second shifting means for shifting or mapping the dominant instantaneous frequency from the intermediate frequency quency position to the final frequency position.
  • the shifting or mapping of the dominant instantaneous frequency from the intermediate frequency position to the final frequency position is accomplished by amplitude modulation.
  • the amplitude modulation corresponds to a multiplication of the signal with the modulation term exp (j * 2 ⁇ f * t). This in turn corresponds in the spectral range of a shift by the frequency .DELTA.f.
  • the second frequency channel for the displacement or mapping of the first frequency channel is fixed. In this way, calculation time can be saved in the channel shift.
  • the second frequency channel is for shifting or mapping the first frequency channel determined by the compression curve.
  • the second frequency channel for the displacement is not specified here, so that one or more frequency channels can be determined on the basis of the compression characteristic that comes into question for the second frequency channel.
  • the second frequency channel one of several possible frequency channels can be selected, in which the dominant instantaneous frequency is arranged closest to the respective channel center. In this way, artifacts, which can arise through the modulation avoid.
  • the frequency compression device may comprise a polyphase filter bank for providing the audio signal in a plurality of frequency channels. This makes it possible to generate only positive frequency components in the channels.
  • the device according to the invention is particularly advantageously used in a listening device and in particular in a hearing aid.
  • a frequency compression in hearing aid users can be realized with fewer artifacts.
  • FIG. 4 is a channel arrangement similar to FIG. 2 shown. There are several channels with the center frequencies 10 to 15 reproduced.
  • a displacement of the channel 14 'to the channel 11' is performed in a first step 17.
  • a tone or a dominant instantaneous frequency 14 " which becomes, as in connection with FIG. 2 already explained, here too in the first step 17, shifted from a frequency position f s to the intermediate frequency position f z .
  • the distance of the intermediate frequency position f z to the channel center 11 of the second channel 11 ' corresponds to the distance of the frequency position f s of the original instantaneous frequency 14 "relative to the channel center 14 of the source channel or first channel 14'.
  • the first step 17 of the frequency shift represents only a coarse channel-by-channel shift. It is unlikely that the tone 14 "will actually land at a frequency position that results directly from a frequency compression characteristic
  • FIG. 4 is a frequency position f d on which the sound 14 "would actually land if the image is taken with a predetermined compression characteristic, therefore, the aim of the present invention is to perform a further shift step after the first step 17 in order to obtain the shifted sound 11". to shift to the final frequency position f d , so that the target tone 18 results.
  • the shifted tone 11 is shifted by amplitude modulation in a second step 19.
  • the shifting takes place here by the amount ⁇ f.
  • the tone is thus shifted to its final position f d .
  • first frequency channel 14 ' a specific frequency range
  • second frequency channel 11' another range
  • the dominant instantaneous frequency can be accurately modulated where it is expected according to the mapping characteristic.
  • this method can be used in a polyphase filter bank which generates only the complex-valued, analytical signal (only positive frequency component of a Fourier transformation) in the channels.
  • the method can be applied regardless of the tonality of the channel, as there are no negative effects to be feared in noisy proportions.
  • FIG. 5 shows the measurement result of the frequency compression according to the invention.
  • the output frequency f o and in the abscissa the input frequency f i shown.
  • a frequency sweep is applied to the input.
  • the modulation in the target channel creates a continuous frequency response.
  • the assignment of source frequency to target frequency is referred to as a compression characteristic. So there are no more frequency jumps and thus no related artifacts.
  • mapping rule from source to target frequency must be provided by appropriate means of audiology.
  • a mapping can typically be made on the basis of a Bark ERB or Spinc frequency division, as in the document EP 1 333 700 A2 is described.
  • FIG. 6 shows a block diagram of a possible embodiment of a frequency compression device according to the invention.
  • the instantaneous source frequency f s is estimated by an estimator 21.
  • each target channel 22, 22' is estimated.
  • the assignment scheme may either be fixed, ie a fixed selection of the source channels 20, 20', 20 "will be assigned to a single destination channel, or variable, ie dependent on the frequency estimate and the compression characteristic is determined for each source channel 20, 20 ', 20 ", to which destination channel 22, 22', 22" it is assigned.
  • the signal from the selected source channel is modulated by a modulator 24 by means of amplitude modulation such that the mapping of source frequency to target frequency exactly corresponds to the compression characteristic.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)

Description

Die vorliegende Erfindung betrifft ein Verfahren zur Frequenzkompression eines Audiosignals durch Bereitstellen des Audiosignals in mehreren Frequenzkanälen und Verschieben oder Abbilden eines Anteils des Audiosignals von einem ersten Frequenzkanal der mehreren Frequenzkanäle in einen zweiten Frequenzkanal der mehreren Frequenzkanäle. Darüber hinaus betrifft die vorliegende Erfindung eine entsprechende Vorrichtung zur Frequenzkompression eines Audiosignals mit einer Verschiebeeinrichtung zum Verschieben oder Abbilden eines Anteils des Audiosignals. Ferner bezieht sich die vorliegende Erfindung auch auf eine Höreinrichtung mit einer derartigen Vorrichtung. Unter einer Höreinrichtung wird hier jedes im oder am Ohr tragbare, schallausgebende Gerät verstanden, wie beispielsweise ein Hörgerät, ein Headset, Kopfhörer und dergleichen.The present invention relates to a method of frequency-compressing an audio signal by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels. Moreover, the present invention relates to a corresponding device for frequency compression of an audio signal with a shifting device for shifting or mapping a portion of the audio signal. Furthermore, the present invention also relates to a hearing device with such a device. A hearing device is understood to mean any sound-emitting device that can be worn in or on the ear, such as a hearing aid, a headset, headphones and the like.

Hörgeräte sind tragbare Hörvorrichtungen, die zur Versorgung von Schwerhörenden dienen. Um den zahlreichen individuellen Bedürfnissen entgegenzukommen, werden unterschiedliche Bauformen von Hörgeräten wie Hinter-dem-Ohr-Hörgeräte (HdO), Hörgerät mit externem Hörer (RIC: receiver in the canal) und In-dem-Ohr-Hörgeräte (Id0), z.B. auch Concha-Hörgeräte oder Kanal-Hörgeräte (ITE, CIC), bereitgestellt. Die beispielhaft aufgeführten Hörgeräte werden am Außenohr oder im Gehörgang getragen. Darüber hinaus stehen auf dem Markt aber auch Knochenleitungshörhilfen, implantierbare oder vibrotaktile Hörhilfen zur Verfügung. Dabei erfolgt die Stimulation des geschädigten Gehörs entweder mechanisch oder elektrisch.Hearing aids are portable hearing aids that are used to care for the hearing impaired. To accommodate the many individual needs, there are various types of hearing aids such as behind-the-ear hearing aids (BTE), receiver in the canal (RIC) and in-the-ear hearing aids (Id0), e.g. Concha hearing aids or canal hearing aids (ITE, CIC). The hearing aids listed by way of example are worn on the outer ear or in the ear canal. In addition, bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.

Hörgeräte besitzen prinzipiell als wesentliche Komponenten einen Eingangswandler, einen Verstärker und einen Ausgangswandler. Der Eingangswandler ist in der Regel ein Schallempfänger, z. B. ein Mikrofon, und/oder ein elektromagnetischer Empfänger, z. B. eine Induktionsspule. Der Ausgangswandler ist meist als elektroakustischer Wandler, z. B. Miniaturlautsprecher, oder als elektromechanischer Wandler, z. B. Knochenleitungshörer, realisiert. Der Verstärker ist üblicherweise in eine Signalverarbeitungseinheit integriert. Dieser prinzipielle Aufbau ist in FIG 1 am Beispiel eines Hinter-dem-Ohr-Hörgeräts dargestellt. In ein Hörgerätegehäuse 1 zum Tragen hinter dem Ohr sind ein oder mehrere Mikrofone 2 zur Aufnahme des Schalls aus der Umgebung eingebaut. Eine Signalverarbeitungseinheit 3, die ebenfalls in das Hörgerätegehäuse 1 integriert ist, verarbeitet die Mikrofonsignale und verstärkt sie. Das Ausgangssignal der Signalverarbeitungseinheit 3 wird an einen Lautsprecher bzw. Hörer 4 übertragen, der ein akustisches Signal ausgibt. Der Schall wird gegebenenfalls über einen Schallschlauch, der mit einer Otoplastik im Gehörgang fixiert ist, zum Trommelfell des Geräteträgers übertragen. Die Energieversorgung des Hörgeräts und insbesondere die der Signalverarbeitungseinheit 3 erfolgt durch eine ebenfalls ins Hörgerätegehäuse 1 integrierte Batterie 5.Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer. The input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic Receiver, e.g. B. an induction coil. The output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized. The amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed. A signal processing unit 3, which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them. The output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal. The sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier. The power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5

Bei Hörgeräten kennt man im Wesentlichen zwei gängige Verfahren, um die Sprachverständlichkeit zu erhöhen. In den meisten Geräten wird, im Allgemeinen mittels AGC (Automatic Game Control), ein frequenzabhängiger Pegelausgleich durchgeführt, um Signale über die Hörschwelle des Schwerhörigen zu heben, sodass dieser die Signale wieder wahrnehmen kann. Das zweite Verfahren wird meist ergänzend zum ersten eingesetzt und zielt auf Hörschäden ab, bei denen selbst durch reine Verstärkung des Signals die Hörschwelle in gewissen, typischerweise hohen, Frequenzen nicht erreicht werden kann. Diese hohen Frequenzen werden auf einen tiefen (hörbaren) Frequenzbereich abgebildet, sodass sie grundsätzlich durch Verstärkung über die Hörschwelle gehoben werden können. Das Verfahren wird Frequenzkompression genannt, da der gewünschte Frequenzbereich auf einen kleineren, besser hörbaren Frequenzbereich abgebildet wird.Hearing aids are essentially two common methods to increase speech intelligibility. In most devices, a frequency-dependent level compensation is generally performed by means of AGC (Automatic Game Control) in order to lift signals above the hearing threshold of the hearing impaired, so that he can perceive the signals again. The second method is usually used in addition to the first and aims at hearing damage, in which even by pure amplification of the signal, the threshold of hearing in certain, typically high, frequencies can not be achieved. These high frequencies are mapped to a low (audible) frequency range so that they can be lifted above the threshold of hearing by amplification. The method is called frequency compression because the desired frequency range is mapped to a smaller, more audible frequency range.

Es befinden sich Hörgeräte auf dem Markt, die Frequenzkompression unterstützen. Das darin verwendete Verfahren nutzt Eigenschaften der verwendeten Filterbank für eine einfache Implementierung. Es werden selektiv einzelne Kanäle, unter anderem abhängig von deren Momentanleistung, auf andere Kanäle kopiert, sodass die in diesen Kanälen enthaltenen Frequenzanteile, am Ausgang verschoben, in einem anderen Frequenzbereich wieder auftauchen. Wohin die Kanäle abgebildet werden, bestimmt eine Abbildungsvorschrift und ist einstellbar, sodass verschiedene Kompressionsverhältnisse realisierbar sind.There are hearing aids on the market that support frequency compression. The method used uses properties of the filter bank used for easy implementation. It selectively copies individual channels, depending on their instantaneous power, to other channels, so that the frequency components contained in these channels, shifted at the output, reappear in a different frequency range. Where the channels are displayed determines a mapping rule and is adjustable, so that different compression ratios can be realized.

FIG 2 zeigt das Prinzip der Frequenzkompression durch einfaches Kopieren von Kanälen. In der Figur sind mehrere Kanäle dargestellt, die durch ihre Mittenfrequenzen 10 bis 15 symbolisch kenntlich gemacht sind. Beispielsweise ist der Mittenfrequenz 14 ein Kanal 14' zugeordnet. Innerhalb des Kanals 14' befindet sich eine dominante Momentanfrequenz 14" . Im Zuge der Frequenzkompression soll der Kanal 14' auf den Kanal 11' kopiert, verschoben oder abgebildet werden. Bei dieser Verschiebung wird dann auch die dominante Momentanfrequenz 14" auf die Zielfrequenz 11" verschoben. Die Frequenz des Tons (dominante Momentanfrequenz 11" und 14") relativ zur jeweiligen Kanalmitte innerhalb von Quell- und Zielkanal ist identisch. FIG. 2 shows the principle of frequency compression by simply copying channels. In the figure, several channels are shown, which are symbolically indicated by their center frequencies 10 to 15. For example, the center frequency 14 is associated with a channel 14 '. Within the channel 14 ', there is a dominant instantaneous frequency 14 "In the course of the frequency compression, the channel 14' is to be copied, shifted or imaged onto the channel 11 'In this displacement, then the dominant instantaneous frequency 14" to the target frequency 11 " The frequency of the sound (dominant instantaneous frequency 11 "and 14") relative to the respective channel center within the source and destination channel is identical.

Durch das einfache Kopieren der Kanäle entsteht allerdings auch eine nicht kontinuierliche Abbildung von Quellfrequenz auf Zielfrequenz, wie bei dem in FIG 3 dargestellten Test mittels Frequenz-Sweep zu sehen ist. Es ist dort die Ausgangsfrequenz fo über der Eingangsfrequenz fi dargestellt. Am Eingang der Signalverarbeitung des Hörgeräts wird ein Frequenz-Sweep angelegt. Am Ausgang der Signalverarbeitung wird ein entsprechendes Ausgangssignal mit den Ausgangsfrequenzen fo gemessen. Deutlich sind die Frequenzsprünge 16 an den Kanalübergängen zu erkennen. Dennoch ist die grundsätzliche Abbildungskennlinie für das Abbilden bzw. Verschieben der Frequenzkanäle deutlich erkennbar. In der Regel treten auch etwas schwächere Artefakte auf, die in FIG 3 nicht dargestellt sind und die für das vorliegende Arbeitsprinzip keine maßgebliche Rolle spielen. Das Problem bei dieser Frequenzabbildung ist, dass zwei im Eingangsspektrum aufeinanderfolgende Frequenzen im Ausgangsspektrum vertauscht sein können. Dies führt dazu, dass Tonfolgen am Eingang gegenüber den resultierenden Tonfolgen am Ausgang in ihrer Frequenz verwürfelt erscheinen, was den Höreindruck verschlechtern kann.However, simply copying the channels also creates a non-continuous mapping of source frequency to target frequency, as in the FIG. 3 shown test can be seen by frequency sweep. It shows the output frequency f o above the input frequency f i . At the input of the signal processing of the hearing aid, a frequency sweep is applied. At the output of the signal processing, a corresponding output signal with the output frequencies f o is measured. Clearly the frequency jumps 16 can be recognized at the channel transitions. Nevertheless, the basic mapping characteristic for the mapping or shifting of the frequency channels is clearly visible. As a rule, something also occurs weaker artifacts in FIG. 3 are not shown and do not play a significant role in the present working principle. The problem with this frequency mapping is that two frequencies in the input spectrum can be reversed in the output spectrum. As a result, sound sequences at the input appear scrambled at the output in relation to the resulting tone sequences, which can worsen the hearing impression.

Aus dem Dokument WO 2007/000161 A1 ist ein Verfahren bekannt, bei dem ein höheres, erstes Frequenzband, das oberhalb des Hörbereichs eines Schwerhörigen liegt, in ein zweites, für den Träger hörbares Frequenzband transponiert wird. Dazu wird in dem höheren Band ein dominantes Signal erkannt und dieses mittels eines Oszillators mit adaptiver Frequenz und einem Mischer in den hörbaren Bereich herunter transponiert. Das verschobene Signal des ersten Frequenzbandes und das Signal des zweiten Frequenzbandes, das in dem hörbaren Zielbereich vorhanden ist, werden gemischt.From the document WO 2007/000161 A1 For example, a method is known in which a higher, first frequency band, which lies above the hearing range of a deaf person, is transposed into a second frequency band which is audible to the carrier. For this purpose, a dominant signal is detected in the higher band and this transposed down by means of an oscillator with adaptive frequency and a mixer in the audible range. The shifted signal of the first frequency band and the signal of the second frequency band present in the audible target area are mixed.

Dokument EP 133700 A2 , beschreibt ein Frequenzkompressionsverfahren, bei dem ein einziger kontinuierlicher Frequenzbereich mittels einer kontinuierlichen, nichtlinearen Frequenzkompressionskennlinie komprimiert wird.document EP 133700 A2 U.S. Patent No. 4,806,010 describes a frequency compression method in which a single continuous frequency range is compressed by means of a continuous, non-linear frequency compression characteristic.

Aus Dokument WO 2005015952 A1 sind Verfahren bekannt, Frequenzbänder aus einem höheren Frequenzbereich in einen niedrigeren umzusetzen. Das Dokument schlägt hierzu ein Resampling in der Zeit-Domäne oder alternativ eine Frequenzkompression in der Frequenz-Domäne vor. Es können Frequenzbänder zur Kompression vorgesehen werden, die ein ausreichend starkes Signal aufweisen oder keine harmonischen Anteile.From document WO 2005015952 A1 Methods are known to implement frequency bands from a higher frequency range to a lower frequency. For this, the document suggests a resampling in the time domain or alternatively a frequency compression in the frequency domain. Frequency bands for compression may be provided which have a sufficiently strong signal or no harmonic components.

Die Aufgabe der vorliegenden Erfindung besteht somit darin, die Frequenzkompression eines Audiosignals dahingehend zu optimieren, dass ein verbesserter Höreindruck entsteht. Es ist ein entsprechendes Verfahren und eine entsprechende Vorrichtung vorzuschlagen.The object of the present invention is therefore to the frequency compression of an audio signal to the effect optimize that creates an improved listening experience. It is a corresponding method and a corresponding device to propose.

Erfindungsgemäß wird diese Aufgabe gelöst durch ein Verfahren zur Frequenzkompression eines Audiosignals, durch Bereitstellen des Audiosignals in mehreren Frequenzkanälen und Verschieben oder Abbilden eines Anteils des Audiosignals von einem ersten Frequenzkanal der mehreren Frequenzkanäle in einen zweiten Frequenzkanal der mehreren Frequenzkanäle, wobei eine dominante Momentanfrequenz in dem ersten Frequenzkanal ermittelt wird, bei dem Verschieben oder Abbilden zunächst der gesamte erste Frequenzkanal einschließlich der dominanten Momentanfrequenz in den zweiten Frequenzkanal verschoben oder abgebildet wird, wobei die dominante Momentanfrequenz eine Zwischenfrequenzposition erhält, eine endgültige Frequenzposition für die dominante Momentanfrequenz durch eine vorgegebene kontinuierliche Kompressionskennlinie in dem zweiten Frequenzkanal ausgehend von der Frequenzposition der dominanten Momentanfrequenz in dem ersten Frequenzkanal ermittelt wird und die dominante Momentanfrequenz von der Zwischenfrequenzposition auf die endgültige Frequenzposition geschoben oder abgebildet wird.According to the invention, this object is achieved by a method for frequency compression of an audio signal, by providing the audio signal in a plurality of frequency channels and shifting or mapping a portion of the audio signal from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, wherein a dominant instantaneous frequency in the first frequency Frequency channel is determined in the move or mapping first the entire first frequency channel including the dominant instantaneous frequency is shifted or mapped into the second frequency channel, wherein the dominant instantaneous frequency receives an intermediate frequency position, a final frequency position for the dominant instantaneous frequency by a predetermined continuous compression characteristic in the second Frequency channel is determined based on the frequency position of the dominant instantaneous frequency in the first frequency channel and the dominant Instantanfre shifted or imaged from the intermediate frequency position to the final frequency position.

Darüber hinaus wird erfindungsgemäß bereitgestellt eine Vorrichtung zur Frequenzkompression eines Audiosignals mit einer ersten Verschiebeeinrichtung zum Verschieben oder Abbilden eines Anteils des Audiosignals, das in mehreren Frequenzkanälen bereitgestellt ist, von einem ersten Frequenzkanal der mehreren Frequenzkanäle in einen zweiten Frequenzkanal der mehreren Frequenzkanäle, sowie umfassend eine Schätzeinrichtung zum Ermitteln einer dominanten Momentanfrequenz in dem ersten Frequenzkanal, wobei mit der ersten Verschiebeeinrichtung der gesamte erste Frequenzkanal einschließlich der dominanten Momentanfrequenz in den zweiten Frequenzkanal so verschiebbar oder abbildbar ist, dass die dominante Momentanfrequenz eine Zwischenfrequenzposition erhält, eine Recheneinrichtung zum Ermitteln einer endgültigen Frequenzposition für die dominante Momentanfrequenz durch eine vorgegebene kontinuierliche Kompressionskennlinie in dem zweiten Frequenzkanal ausgehend von der Frequenzposition der dominanten Momentanfrequenz in dem ersten Frequenzkanal, und eine zweite Verschiebeeinrichtung zum Verschieben oder Abbilden der dominanten Momentanfrequenz von der Zwischenfrequenzposition auf die endgültige Frequenzposition.In addition, the invention provides a device for frequency compression of an audio signal with a first displacement device for shifting or imaging a portion of the audio signal provided in a plurality of frequency channels from a first frequency channel of the plurality of frequency channels to a second frequency channel of the plurality of frequency channels, and comprising estimating means for determining a dominant instantaneous frequency in the first frequency channel, wherein with the first displacement means the entire first frequency channel including the dominant instantaneous frequency in the second frequency channel being displaceable or mappable such that the dominant instantaneous frequency obtains an intermediate frequency position, computing means for determining a final frequency position for the dominant instantaneous frequency by a predetermined continuous compression characteristic in the second frequency channel from the frequency position of the dominant instantaneous frequency in the first frequency channel, and second shifting means for shifting or mapping the dominant instantaneous frequency from the intermediate frequency quency position to the final frequency position.

In vorteilhafter Weise ist es so möglich, trotz kanalweisen Verschiebens einen Ton exakt an diejenige Position zu verschieben, die die vorgegebene Kompressionskennlinie fordert.In an advantageous manner, it is thus possible, despite channel-by-channel shifting, to shift a tone exactly to that position which requires the predetermined compression characteristic.

Vorzugsweise erfolgt das Verschieben oder Abbilden der dominanten Momentanfrequenz von der Zwischenfrequenzposition auf die endgültige Frequenzposition durch Amplitudenmodulation. Die Amplitudenmodulation entspricht einer Multiplikation des Signals mit dem Modulationsterm exp(j·2πΔf·t). Dies wiederum entspricht im Spektralbereich einer Verschiebung um die Frequenz Δf.Preferably, the shifting or mapping of the dominant instantaneous frequency from the intermediate frequency position to the final frequency position is accomplished by amplitude modulation. The amplitude modulation corresponds to a multiplication of the signal with the modulation term exp (j * 2πΔf * t). This in turn corresponds in the spectral range of a shift by the frequency .DELTA.f.

In einer speziellen Ausführungsform ist der zweite Frequenzkanal für das Verschieben oder Abbilden des ersten Frequenzkanals fest vorgegeben. Auf diese Weise kann bei der Kanalverschiebung Rechenzeit eingespart werden.In a specific embodiment, the second frequency channel for the displacement or mapping of the first frequency channel is fixed. In this way, calculation time can be saved in the channel shift.

Bei einer alternativen Ausführungsform wird der zweite Frequenzkanal für das Verschieben oder Abbilden des ersten Frequenzkanals anhand der Kompressionskennlinie bestimmt. Dies bedeutet, dass der zweite Frequenzkanal für das Verschieben hier nicht vorgegeben ist, sodass einer oder mehrere Frequenzkanäle anhand der Kompressionskennlinie ermittelt werden können, die für den zweiten Frequenzkanal in Frage kommen. Als zweiter Frequenzkanal kann derjenige von mehreren möglichen Frequenzkanälen gewählt werden, bei dem die dominante Momentanfrequenz am nächsten in der jeweiligen Kanalmitte angeordnet ist. Auf diese Weise lassen sich Artefakte, welche durch die Modulation entstehen können, vermeiden.In an alternative embodiment, the second frequency channel is for shifting or mapping the first frequency channel determined by the compression curve. This means that the second frequency channel for the displacement is not specified here, so that one or more frequency channels can be determined on the basis of the compression characteristic that comes into question for the second frequency channel. As the second frequency channel, one of several possible frequency channels can be selected, in which the dominant instantaneous frequency is arranged closest to the respective channel center. In this way, artifacts, which can arise through the modulation avoid.

Die erfindungsgemäße Vorrichtung zur Frequenzkompression kann eine Polyphasen-Filterbank zum Bereitstellen des Audiosignals in mehreren Frequenzkanälen aufweisen. Damit ist es möglich, in den Kanälen nur positive Frequenzanteile zu erzeugen.The frequency compression device according to the invention may comprise a polyphase filter bank for providing the audio signal in a plurality of frequency channels. This makes it possible to generate only positive frequency components in the channels.

Besonders vorteilhaft wird die erfindungsgemäße Vorrichtung in einer Höreinrichtung und insbesondere in einem Hörgerät eingesetzt. Damit kann eine Frequenzkompression bei Hörgeräteträgern mit weniger Artefakten realisiert werden.The device according to the invention is particularly advantageously used in a listening device and in particular in a hearing aid. Thus, a frequency compression in hearing aid users can be realized with fewer artifacts.

Die vorliegende Erfindung wird nun anhand der beigefügten Zeichnungen näher erläutert, in denen zeigen:

FIG 1
den prinzipiellen Aufbau eines Hörgeräts gemäß dem Stand der Technik;
FIG 2
das Prinzip der Frequenzkompression durch einfaches Kopieren von Kanälen gemäß dem Stand der Technik;
FIG 3
eine Frequenzübertragungsfunktion der Kompression gemäß FIG 2 entsprechend dem Stand der Technik;
FIG 4
das erfindungsgemäße Prinzip der Frequenzkompression durch Kopieren von Kanälen mit anschließender Modulation;
FIG 5
die gemessene Frequenzübertragungsfunktion bei der Kompression gemäß FIG 4; und
FIG 6
ein Blockschaltbild einer erfindungsgemäßen Vorrichtung zur Frequenzkompression.
The present invention will now be explained in more detail with reference to the accompanying drawings, in which:
FIG. 1
the basic structure of a hearing aid according to the prior art;
FIG. 2
the principle of frequency compression by simply copying channels according to the prior art;
FIG. 3
a frequency transfer function of the compression according to FIG. 2 according to the prior art;
FIG. 4
the inventive principle of frequency compression by copying channels with subsequent modulation;
FIG. 5
the measured frequency transfer function in compression according to FIG. 4 ; and
FIG. 6
a block diagram of a device according to the invention for frequency compression.

Die nachfolgend näher geschilderten Ausführungsbeispiele stellen bevorzugte Ausführungsformen der vorliegenden Erfindung dar.The embodiments described in more detail below represent preferred embodiments of the present invention.

In FIG 4 ist eine Kanalanordnung ähnlich wie in FIG 2 dargestellt. Es sind mehrere Kanäle mit den Mittenfrequenzen 10 bis 15 wiedergegeben. Wie in dem bekannten Beispiel wird in einem ersten Schritt 17 eine Verschiebung des Kanals 14' auf den Kanal 11' durchgeführt. Innerhalb des Kanals 14' befindet sich ein Ton bzw. eine dominante Momentanfrequenz 14" . Diese wird, wie in Zusammenhang mit FIG 2 bereits erläutert, auch hier in dem ersten Schritt 17 von einer Frequenzposition fs auf die Zwischenfrequenzposition fz verschoben. Der Abstand der Zwischenfrequenzposition fz zur Kanalmitte 11 des zweiten Kanals 11' entspricht dem Abstand der Frequenzposition fs der ursprünglichen Momentanfrequenz 14" gegenüber der Kanalmitte 14 des Quellkanals bzw. ersten Kanals 14'.In FIG. 4 is a channel arrangement similar to FIG. 2 shown. There are several channels with the center frequencies 10 to 15 reproduced. As in the known example, a displacement of the channel 14 'to the channel 11' is performed in a first step 17. Within the channel 14 'there is a tone or a dominant instantaneous frequency 14 ", which becomes, as in connection with FIG. 2 already explained, here too in the first step 17, shifted from a frequency position f s to the intermediate frequency position f z . The distance of the intermediate frequency position f z to the channel center 11 of the second channel 11 'corresponds to the distance of the frequency position f s of the original instantaneous frequency 14 "relative to the channel center 14 of the source channel or first channel 14'.

Der erste Schritt 17 der Frequenzverschiebung stellt nur eine grobe kanalweise Verschiebung dar. Dass der Ton 14" bei seiner Verschiebung tatsächlich auf einer Frequenzposition landet, die unmittelbar aus einer Frequenzkompressionskennlinie hervorgeht, ist unwahrscheinlich. In FIG 4 ist eine Frequenzposition fd dargestellt, auf der der Ton 14" tatsächlich landen würde, wenn die Abbildung mit einer vorgegebenen Kompressionskennlinie erfolgt. Ziel der vorliegenden Erfindung ist es daher, nach dem ersten Schritt 17 einen weiteren Schiebeschritt durchzuführen, um den verschobenen Ton 11" auf die endgültige Frequenzposition fd zu schieben, sodass sich der Zielton 18 ergibt. Für diesen Zweck wird der verschobene Ton 11" durch Amplitudenmodulation in einem zweiten Schritt 19 verschoben. Das Verschieben erfolgt hier um den Betrag Δf. In dem zweiten Schritt 19 wird der Ton also auf seine endgültige Position fd geschoben.The first step 17 of the frequency shift represents only a coarse channel-by-channel shift. It is unlikely that the tone 14 "will actually land at a frequency position that results directly from a frequency compression characteristic FIG. 4 is a frequency position f d on which the sound 14 "would actually land if the image is taken with a predetermined compression characteristic, therefore, the aim of the present invention is to perform a further shift step after the first step 17 in order to obtain the shifted sound 11". to shift to the final frequency position f d , so that the target tone 18 results. For this purpose, the shifted tone 11 "is shifted by amplitude modulation in a second step 19. The shifting takes place here by the amount Δf. In the second step 19, the tone is thus shifted to its final position f d .

Durch Vorgabe einer kontinuierlichen Abbildungskennlinie von Quell- auf Zielfrequenz lässt sich grundsätzlich sicherstellen, dass Frequenzen in ihrer Reihenfolge am Ausgang nicht vertauscht erscheinen. Um eine solche kontinuierliche Abbildungskennlinie im Hörgerät zu realisieren, wird in dem vorliegenden Ausführungsbeispiel eine Kombination aus selektiver Kanalabbildung und Amplitudenmodulation verwendet. Die Kanalabbildung sorgt dafür, dass, wie bereits ausführlich dargestellt wurde, ein bestimmter Frequenzbereich (erster Frequenzkanal 14') zuerst grob in einen anderen Bereich (zweiter Frequenzkanal 11') abgebildet wird, ähnlich schon bekannten Verfahren. Durch Messung der dominanten Momentanfrequenz fs in dem Quellkanal 14' kann über die Abbildungskennlinie genau ermittelt werden, worauf diese im Zielkanal (11') abgebildet werden muss. Durch entsprechende Modulation des Kanals 11' kann die dominante Momentanfrequenz genau dorthin moduliert werden, wo sie gemäß der Abbildungskennlinie erwartet wird. Vorteilhaft lässt sich dieses Verfahren bei einer Polyphasen-Filterbank einsetzen, die nur das komplexwertige, analytische Signal (nur positiver Frequenzanteil einer FourierTransformation) in den Kanälen erzeugt. Hierbei lässt sich mittels Modulation mit einem Modulationsterm exp(j·2πΔf t) jeder Kanal zyklisch modulieren, sodass die Frequenzanteile darin entsprechend zyklisch um die Kreisfrequenz Δω=2πΔf verschoben werden.By specifying a continuous mapping characteristic from source to target frequency, it is generally possible to ensure that frequencies in their order at the output do not appear reversed. In order to realize such a continuous imaging characteristic in the hearing aid, a combination of selective channel mapping and amplitude modulation is used in the present exemplary embodiment. The channel mapping ensures that, as has already been shown in detail, a specific frequency range (first frequency channel 14 ') is first roughly imaged into another range (second frequency channel 11'), similar to already known methods. By measuring the dominant instantaneous frequency f s in the source channel 14 ', it is possible to determine exactly via the imaging characteristic line, whereupon this must be mapped in the target channel (11'). By appropriate modulation of the channel 11 ', the dominant instantaneous frequency can be accurately modulated where it is expected according to the mapping characteristic. Advantageously, this method can be used in a polyphase filter bank which generates only the complex-valued, analytical signal (only positive frequency component of a Fourier transformation) in the channels. By modulating with a modulation term exp (j * 2πΔf t), each channel can be cyclically modulated so that the frequency components therein are correspondingly cyclically shifted by the angular frequency Δω = 2πΔf.

Grundsätzlich sind bei der Messung bzw. Schätzung der dominanten Momentanfrequenz zwei Fälle zu unterscheiden:

  1. 1) Es existiert eine dominante Frequenz, die geschätzt werden kann, d.h. es existiert ein starker tonaler Anteil in diesem Kanal. Damit kann eine Abbildung auf eine Zielfrequenz erfolgen.
  2. 2) Es existiert keine dominante Frequenz, d.h. das Signal in dem Kanal ist rauschartig. Die Frequenzabschätzung führt zu einer mehr oder weniger zufälligen Momentanfrequenz. Dies wiederum führt bei der Abbildung auf eine Zielfrequenz zu einer Phasenrandomisierung bzw. zufälligen Modulation in dem Kanal, was bei rauschartigen Kanälen kaum Einfluss auf den Höreindruck bewirkt.
Basically, two cases have to be distinguished in the measurement or estimation of the dominant instantaneous frequency:
  1. 1) There is a dominant frequency that can be estimated, ie there is a strong tonal component in this channel. This can be a mapping to a target frequency.
  2. 2) There is no dominant frequency, ie the signal in the channel is noisy. The frequency estimation leads to a more or less random instantaneous frequency. This in turn results in the mapping to a target frequency to a phase randomization or random modulation in the channel, which causes hardly any influence on the listening experience with noise-like channels.

Insofern lässt sich das Verfahren unabhängig von der Tonalität des Kanals anwenden, da keine negativen Auswirkungen bei rauschartigen Anteilen zu befürchten sind.In this respect, the method can be applied regardless of the tonality of the channel, as there are no negative effects to be feared in noisy proportions.

FIG 5 zeigt das Messergebnis der erfindungsgemäßen Frequenzkompression. Wie in FIG 3 ist auch hier in der Ordinate die Ausgangsfrequenz fo und in der Abszisse die Eingangsfrequenz fi dargestellt. An den Eingang ist ein Frequenz-Sweep angelegt. Durch die Modulation im Zielkanal entsteht ein kontinuierlicher Frequenzverlauf. Die Zuordnung von Quellfrequenz zu Zielfrequenz wird als Kompressionskennlinie bezeichnet. Es treten also keine Frequenzsprünge mehr auf und somit auch keine diesbezüglichen Artefakte. FIG. 5 shows the measurement result of the frequency compression according to the invention. As in FIG. 3 is here also in the ordinate the output frequency f o and in the abscissa the input frequency f i shown. A frequency sweep is applied to the input. The modulation in the target channel creates a continuous frequency response. The assignment of source frequency to target frequency is referred to as a compression characteristic. So there are no more frequency jumps and thus no related artifacts.

Das zweistufige Frequenzverschiebungsverfahren gemäß der vorliegenden Erfindung kann in zwei Varianten durchgeführt werden:

  1. 1) Die Abbildungsvorschrift der Kanäle ist fest, und nur innerhalb der Kanäle wird eine Modulation aufgeprägt. Das bedeutet, dass die Zuordnung der verschiedenen Quellkanäle auf einen Zielkanal im voraus bekannt ist. Innerhalb des Zielkanals wird dann eine Modulation vorgenommen, sodass aufgrund der geschätzten Momentanfrequenz des ausgewählten Quellkanals und der Abbildungsvorschrift die gewünschte Zielfrequenz im Zielkanal vorliegt.
  2. 2) Die Abbildung zwischen Kanälen ist nicht vorgegeben, sondern wird aufgrund der Abbildungskennlinie und der geschätzten Momentanfrequenz festgelegt. Zusätzlich wird wie bei der ersten Variante eine Modulation aufgeprägt. Das bedeutet, dass die Zuordnung der verschiedenen Quellkanäle auf einen Zielkanal während des Betriebs ermittelt wird, und die Abbildungskennlinie sowohl für die Zuordnung der verschiedenen Quellkanäle auf einen Zielkanal herangezogen wird als auch für die anschließende Modulation innerhalb des Zielkanals. Dies nutzt die Tatsache aus, dass sich die Kanäle einer Filterbank typischerweise überlappen und verschiedene Zuordnungen von Quellkanälen zu Zielkanälen mit unterschiedlichen Modulationen zu einem ähnlichen Ergebnis führen würden. Es ist hierbei vorteilhaft, die Abbildung so zu gestalten, dass sowohl im Quell- als auch Zielkanal die Momentanfrequenz nahe der Bandmitte liegt, da dann Artefakte durch die Modulation minimiert werden.
The two-stage frequency shifting method according to the present invention can be carried out in two variants:
  1. 1) The mapping rule of the channels is fixed, and only within the channels a modulation is imposed. This means that the assignment of the different source channels to a destination channel is known in advance. Within the target channel, a modulation is then made so that the desired target frequency is present in the target channel on the basis of the estimated instantaneous frequency of the selected source channel and the mapping rule.
  2. 2) The mapping between channels is not specified, but is determined based on the mapping characteristic and the estimated instantaneous frequency. In addition, as in the first variant, a modulation is impressed. This means that the assignment of the various source channels to a destination channel during operation is determined, and the mapping characteristic for both the assignment of the different source channels to a destination channel is used as well as for the subsequent modulation within the target channel. This takes advantage of the fact that the channels of a filter bank typically overlap and different assignments of source channels to destination channels with different modulations would result in a similar result. It is advantageous in this case to arrange the mapping in such a way that both in the source and in the target channel the instantaneous frequency is close to the midband, since artifacts are then minimized by the modulation.

Die Abbildungsvorschrift von Quell- auf Zielfrequenz muss durch geeignete Mittel der Audiologie bereitgestellt werden. Hier kann typischerweise eine Abbildung anhand einer Bark-ERB- oder Spinc-Frequenzaufteilung vorgenommen werden, wie dies in dem Dokument EP 1 333 700 A2 beschrieben ist.The mapping rule from source to target frequency must be provided by appropriate means of audiology. Here, a mapping can typically be made on the basis of a Bark ERB or Spinc frequency division, as in the document EP 1 333 700 A2 is described.

FIG 6 zeigt ein Blockschaltbild einer möglichen Ausführungsform einer erfindungsgemäßen Frequenzkompressionsvorrichtung. In jedem Quellkanal 20, 20', 20" der Filterbank wird die momentane Quellfrequenz fs durch einen Schätzer 21 geschätzt. Basierend auf dem Zuordnungsschema der Frequenzkompression (abgeleitet von der Kompressionskennlinie) und dem Signal s der dominanten Momentanfrequenz wird jedem Zielkanal 22, 22', 22" ein Quellkanal 20, 20', 20" durch eine Verschiebeeinrichtung 23 zugewiesen. Das Zuordnungsschema kann entweder fest, d.h. eine feste Auswahl der Quellkanäle 20, 20', 20" werden einem einzigen Zielkanal zugeordnet, oder variabel sein, d.h. abhängig von der Frequenzschätzung und der Kompressionskennlinie wird für jeden Quellkanal 20, 20', 20" festgelegt, welchem Zielkanal 22, 22', 22" er zugeordnet wird. Im Zielkanal wird das Signal aus dem ausgewählten Quellkanal über einen Modulator 24 mittels Amplitudenmodulation derart moduliert, dass die Abbildung von Quellfrequenz auf Zielfrequenz exakt der Kompressionskennlinie entspricht. FIG. 6 shows a block diagram of a possible embodiment of a frequency compression device according to the invention. In each source channel 20, 20 ', 20 "of the filter bank, the instantaneous source frequency f s is estimated by an estimator 21. Based on the frequency compression assignment scheme (derived from the compression characteristic) and the dominant instantaneous frequency signal s, each target channel 22, 22' is estimated. , 22 "is assigned a source channel 20, 20 ', 20" by a shifter 23. The assignment scheme may either be fixed, ie a fixed selection of the source channels 20, 20', 20 "will be assigned to a single destination channel, or variable, ie dependent on the frequency estimate and the compression characteristic is determined for each source channel 20, 20 ', 20 ", to which destination channel 22, 22', 22" it is assigned. In the target channel, the signal from the selected source channel is modulated by a modulator 24 by means of amplitude modulation such that the mapping of source frequency to target frequency exactly corresponds to the compression characteristic.

Claims (8)

  1. Method for frequency compression for an audio signal (s), by
    - providing the audio signal (s) in a plurality of frequency channels (14', 20, 20', 20'') and
    - shifting or mapping a component of the audio signal (s) from a first frequency channel (14') from a plurality of frequency channels (14', 20, 20', 20'') into a second frequency channel (11') from a plurality of frequency channels (11', 22, 22', 22''), wherein a desired frequency range is mapped onto a smaller frequency range,
    - a dominant instantaneous frequency (14'') in the first frequency channel (14') is obtained,
    - the shifting or mapping first of all involves the whole first frequency channel (14'), including the dominant instantaneous frequency (14''), being shifted or mapped into the second frequency channel (11'),
    characterized in that
    - the dominant instantaneous frequency (14'') is provided with an intermediate frequency position (fz),
    - a final frequency position (fd) for the dominant instantaneous frequency (14'') is ascertained by a prescribed continuous compression characteristic in the second frequency channel (11') from the frequency position (fs) of the dominant instantaneous frequency (14'') in the first frequency channel (14'), and
    - the dominant instantaneous frequency (14'') is shifted or mapped from the intermediate frequency position (fz) onto the final frequency position (fd).
  2. Method according to Claim 1, wherein the shifting or mapping of the dominant instantaneous frequency (14'') from the intermediate frequency position (fz) onto the final frequency position (fd) is effected by means of amplitude modulation.
  3. Method according to Claim 1 or 2, wherein the second frequency channel (11') is firmly prescribed for the shifting or mapping of the first frequency channel (14').
  4. Method according to Claim 1 or 2, wherein for the shifting or mapping of the first frequency channel (14') the second frequency channel (11') is determined on the basis of the continuous compression characteristic.
  5. Method according to Claim 4, wherein the second frequency channel (11') chosen is the one from a plurality of possible frequency channels (11', 22, 22', 22'') for which the dominant instantaneous frequency (14'') closest to the respective channel centre is mapped.
  6. Apparatus for frequency compression for an audio signal (s), having
    - a first shifting device (23) for shifting or mapping a component of the audio signal (s), which is provided in a plurality of frequency channels (14', 20, 20', 20''), from a first frequency channel (14') from the plurality of frequency channels (14', 20, 20', 20'') into a second frequency channel (11') from a plurality of frequency channels (11', 22, 22', 22''), wherein a desired frequency range is mapped onto a smaller frequency range,
    - an estimation device (21) for ascertaining a dominant instantaneous frequency (14'') in the first frequency channel (14'), wherein
    - the first shifting device (23) can be used to shift or map the whole first frequency channel (14'), including the dominant instantaneous frequency (14''), into the second frequency channel (11'),
    - characterized in that
    the dominant instantaneous frequency (14'') is provided with an intermediate frequency position (fz),
    - a computation device for ascertaining a final frequency position (fd) for the dominant instantaneous frequency (14'') by means of a prescribed continuous compression characteristic in the second frequency channel (11') from the frequency position (fs) of the dominant instantaneous frequency (14'') in the first frequency channel (14'), and
    - a second shifting device (24) for shifting or mapping the dominant instantaneous frequency (14'') from the intermediate frequency position (fz) onto the final frequency position (fd).
  7. Apparatus according to Claim 6, which has a polyphase filter bank for providing the audio signal (s) in the plurality of frequency channels (14', 20, 20', 20'').
  8. Hearing device having an apparatus according to Claim 6 or 7.
EP11183051.9A 2010-09-29 2011-09-28 Method and device for frequency compression with selective frequency shifting Active EP2437258B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102010041653.3A DE102010041653B4 (en) 2010-09-29 2010-09-29 Method and apparatus for frequency compression with selective frequency shift

Publications (3)

Publication Number Publication Date
EP2437258A2 EP2437258A2 (en) 2012-04-04
EP2437258A3 EP2437258A3 (en) 2013-09-04
EP2437258B1 true EP2437258B1 (en) 2015-11-11

Family

ID=44720711

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11183051.9A Active EP2437258B1 (en) 2010-09-29 2011-09-28 Method and device for frequency compression with selective frequency shifting

Country Status (4)

Country Link
US (1) US9031269B2 (en)
EP (1) EP2437258B1 (en)
DE (1) DE102010041653B4 (en)
DK (1) DK2437258T3 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2488167A (en) * 2011-02-18 2012-08-22 Nec Corp Handover procedure in a home base station connected to a home base station gateway
TWI504282B (en) * 2012-07-20 2015-10-11 Unlimiter Mfa Co Ltd Method and hearing aid of enhancing sound accuracy heard by a hearing-impaired listener
US9084050B2 (en) * 2013-07-12 2015-07-14 Elwha Llc Systems and methods for remapping an audio range to a human perceivable range
TWI543634B (en) * 2013-12-10 2016-07-21 元鼎音訊股份有限公司 Method and computer program product of processing voice segment and hearing aid
KR102308541B1 (en) * 2015-01-16 2021-10-05 삼성전자주식회사 Method and apparatus for transmitting packet in a multi-carrier wireless communication system based on filter bank
KR102494080B1 (en) * 2016-06-01 2023-02-01 삼성전자 주식회사 Electronic device and method for correcting sound signal thereof
US11188292B1 (en) 2019-04-03 2021-11-30 Discovery Sound Technology, Llc System and method for customized heterodyning of collected sounds from electromechanical equipment
CN110265042B (en) * 2019-05-31 2021-07-23 歌尔科技有限公司 Sound signal processing method, device and equipment
CN110491407B (en) * 2019-08-15 2021-09-21 广州方硅信息技术有限公司 Voice noise reduction method and device, electronic equipment and storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6577739B1 (en) * 1997-09-19 2003-06-10 University Of Iowa Research Foundation Apparatus and methods for proportional audio compression and frequency shifting
FR2822000B1 (en) * 2001-03-08 2003-05-23 Thomson Multimedia Sa TRANSMISSION DEVICE LIMITING PARASITES OUTSIDE THE ALLOCATED FREQUENCY BAND
EP1333700A3 (en) 2003-03-06 2003-09-17 Phonak Ag Method for frequency transposition in a hearing device and such a hearing device
AU2003904207A0 (en) 2003-08-11 2003-08-21 Vast Audio Pty Ltd Enhancement of sound externalization and separation for hearing-impaired listeners: a spatial hearing-aid
DK1920632T3 (en) * 2005-06-27 2010-03-08 Widex As Hearing aid with improved high frequency reproduction and method of processing an audio signal
DE102006019728A1 (en) * 2006-04-27 2007-11-15 Siemens Audiologische Technik Gmbh Time-adaptive setting of a hearing aid device and corresponding method
EP2304972B1 (en) * 2008-05-30 2015-07-08 Phonak AG Method for adapting sound in a hearing aid device by frequency modification
FR2950497B1 (en) * 2009-09-24 2011-10-21 Eutelsat Sa USEFUL LOAD FOR MULTIFACEAL SATELLITE

Also Published As

Publication number Publication date
US9031269B2 (en) 2015-05-12
DE102010041653A1 (en) 2012-03-29
DK2437258T3 (en) 2016-02-15
DE102010041653B4 (en) 2015-04-02
US20120076333A1 (en) 2012-03-29
EP2437258A2 (en) 2012-04-04
EP2437258A3 (en) 2013-09-04

Similar Documents

Publication Publication Date Title
EP2437258B1 (en) Method and device for frequency compression with selective frequency shifting
EP2180726B2 (en) Sound localization in binaural hearing aids
EP2229010A2 (en) Method for compensating for interference in a hearing aid, hearing aid and method for adjusting same
DE102011006129B4 (en) Hearing device with feedback suppression device and method for operating the hearing device
DE102014204557A1 (en) Transmission of a wind-reduced signal with reduced latency
EP3926982A2 (en) Method for direction-dependent noise suppression for a hearing system comprising a hearing device
EP1912470B1 (en) Method for the dynamic compression of an audio signal and corresponding hearing device
EP2822300B1 (en) Detection of listening situations with different signal sources
EP2584795B1 (en) Method for determining a compression characteristic curve
EP2606660B1 (en) Method for fitting a hearing device using percentile analysis
EP2437521B2 (en) Method for frequency compression with harmonic adjustment and corresponding device
EP2373063A1 (en) Hearing device and method for setting the same for acoustic feedback-free operation
DE102007035173A1 (en) Method for adjusting a hearing system with a perceptive model for binaural hearing and hearing aid
EP2190218B1 (en) Filter bank system with specific stop-band attenuation for a hearing device
DE102006046699B3 (en) Hearing device particularly hearing aid, has signal processing mechanism by which signals are processed in multiple frequency channels and adjusting mechanism is used for adjusting levels of individual frequency channels
DE102013207080A1 (en) Binaural microphone adaptation using your own voice
DE102011089865B4 (en) Method for adapting a frequency compression device of a hearing device and corresponding adaptation device
EP2622879B1 (en) Method and device for frequency compression
DE102014200677A1 (en) Method and device for analyzing hearing aid settings
DE102011087692B4 (en) Hearing apparatus and method for improving the visibility of a portion of an input signal for a user of the hearing device
DE102010039303A1 (en) Method for reducing interference and hearing device
EP2699020B1 (en) Method and device for determining a gain factor of a hearing aid
WO2012041372A1 (en) Method for frequency compression, adjustment device and hearing device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 21/00 20130101AFI20130730BHEP

Ipc: H04R 25/00 20060101ALI20130730BHEP

Ipc: G10L 19/02 20130101ALN20130730BHEP

17P Request for examination filed

Effective date: 20140303

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20140709

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101ALI20150423BHEP

Ipc: G10L 19/02 20130101ALN20150423BHEP

Ipc: G10L 21/00 20130101AFI20150423BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101ALI20150429BHEP

Ipc: G10L 19/02 20130101ALN20150429BHEP

Ipc: G10L 21/00 20130101AFI20150429BHEP

INTG Intention to grant announced

Effective date: 20150519

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 760804

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151215

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502011008323

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160209

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160211

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502011008323

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

26N No opposition filed

Effective date: 20160812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 760804

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160928

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20110928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230921

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230918

Year of fee payment: 13

Ref country code: DK

Payment date: 20230921

Year of fee payment: 13

Ref country code: DE

Payment date: 20230919

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20231001

Year of fee payment: 13