EP2622879A1 - Procédé et dispositif de compression de fréquence - Google Patents

Procédé et dispositif de compression de fréquence

Info

Publication number
EP2622879A1
EP2622879A1 EP10763664.9A EP10763664A EP2622879A1 EP 2622879 A1 EP2622879 A1 EP 2622879A1 EP 10763664 A EP10763664 A EP 10763664A EP 2622879 A1 EP2622879 A1 EP 2622879A1
Authority
EP
European Patent Office
Prior art keywords
channel
amplitude
frequency
compression
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP10763664.9A
Other languages
German (de)
English (en)
Other versions
EP2622879B1 (fr
Inventor
Ulrich Kornagel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Siemens Medical Instruments Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Medical Instruments Pte Ltd filed Critical Siemens Medical Instruments Pte Ltd
Publication of EP2622879A1 publication Critical patent/EP2622879A1/fr
Application granted granted Critical
Publication of EP2622879B1 publication Critical patent/EP2622879B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
    • H04R25/353—Frequency, e.g. frequency shift or compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility

Definitions

  • the present invention relates to a process for Fre ⁇ quenzkompression an audio signal at a listening device. Moreover, the present invention relates to an ent ⁇ speaking device for frequency compression.
  • a hearing device is understood to mean any sound-emitting device which can be worn in or on the ear, in particular a hearing aid, a headset, headphones and the like.
  • Hearing aids are portable hearing aids that are used to care for the hearing impaired.
  • different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (IDO), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
  • BTE behind-the-ear hearing aids
  • RIC hearing aid with external receiver
  • IDO in-the-ear hearing aids
  • ITE canal hearing aids
  • the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
  • bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
  • Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is usually integrated in a signal processing unit. This basic structure is shown in FIG. 1 using the example of a behind-the-ear hearing device. In a hearing aid housing 1 for carrying behind the ear, one or more microphones 2 for receiving the sound from the environment are installed.
  • a signal Processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and ver ⁇ strengthens them.
  • the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
  • the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the equipment wearer ⁇ gene.
  • the power supply of the hearing aid and in particular the signal processing unit 3 is carried out by a likewise integrated into the hearing aid housing 1 battery. 5
  • Dead regions are frequency ranges in which spectral components can no longer be audibly amplified.
  • spectral components from a source frequency range which is typically at higher frequencies and in which no amplification is to be applied (eg "dead region"), are pushed into a lower-lying target frequency range gain
  • Known frequency compression can be applied usefully for example, function as follows. It is a compression requirement for an individual hearing loss tailored, wherein the Kompres ⁇ sion regulations define which source frequency is to be on which target frequency compressed or mapped the practical realization of this compression procedure carried out by a filter bank. . that is, the compression rule defi ned ⁇ which source channel of the filter bank to which the target channel mapped or compressed. the smallest element So this process is a channel. This means that the spectral components within a channel are not compressed.
  • the possible positions of the channels are defined by the structure of the filter bank and thus fixed (fixed filter bank grid).
  • a speech ⁇ sound is voiced sounds in front of a fundamental frequency and multiple harmonics, which are found at integer multiples of the fundamental frequency. This is called the fine structure of the signal.
  • the fine structure is responsible for the perception of the pitch of the speech sound.
  • the Ampli ⁇ amplitudes of the fundamental frequency and the harmonics define the color of the sound, and form the so-called spectral A ⁇ hüllende.
  • the spectral envelope of vowels shows a typical formant structure in each case.
  • the spektra ⁇ le envelope carries the essential information which allows the Un ⁇ terscheidung the different sounds (eg distinc- tion of vowels).
  • prior art frequency compression is accomplished by shifting source channels on a fixed filter bank grid.
  • the fixed filter bank raster is defined by the filter bank structure and not by the harmonic structure of the signal. Therefore, movement of source channels on the fixed filter bank grid to their destination channels in accordance with the compression rule destroys the harmonic structure.
  • the reason for this is that when you move the harmonic structure just be ⁇ is not taken into account. This means that the harmonics no longer inevitably occur at integer multiples of the fundamental frequency after compression. The destruction of the harmonic structure, however, leads to audible artifacts.
  • the object of the present invention is therefore to be able to better avoid artifacts in the frequency compression.
  • this object is achieved by a method for frequency compression of an audio signal in a listening device, by obtaining an amplitude information of a source channel of a plurality of frequency channels of the audio signal and impressing an amplitude corresponding to the Amplitudeninforma ⁇ tion to a signal in a target channel of the plurality of frequency channels, to which the source channel is mapped in the frequency compression.
  • the invention provides an on ⁇ direction of the frequency compression of an audio signal for a listening device, comprising an estimating means for obtaining an amplitude information of a source channel of a plurality of frequency channels of said audio signal and processing means for impressing an amplitude corresponding to the amplitude information to a signal in a target channel of the plurality of frequency channels to which the source channel for Fre ⁇ Compression compression is to map.
  • the amplitude information in a source channel of an audio signal is separated from the actual signal and used to impose a corresponding amplitude ei ⁇ nem signal in a target channel. Frequencies in the target channel are not affected thereby, whereby the har ⁇ monic structure of the audio signal can be maintained.
  • the amplitude information may be a mean channel amplitude. This is easy to win for one channel and can transmit as well with little effort to a target channel ⁇ to.
  • the amplitude information is a spectral model of the audio signal
  • the spectral model is subjected to the pression Frequenzkom- and the signal of the target channel
  • ⁇ formative amplitude is determined from the compressed spectral model.
  • the spectral model is ⁇ example, be the spectral envelope, resulting from the Ampiitu- the fundamental frequency and harmonic of a harmonic signal.
  • the spectral model thus represents a function that models the amplitude values over the frequency.
  • the réelle josgende amplitude for the target channel can be obtained by Ab ⁇ keys of the compressed spectral model.
  • the amplitude for a specific frequency is obtained from the compressed spectral model or the compressed spectral envelope.
  • the impressed to amplitude can be obtained alternatively by integral ⁇ or summation of values of the compressed spectral model within the range of the target channel.
  • a medium amplitude value for the target channel from the Spekt ⁇ ralmodell is determined.
  • the spectral model of the audio signal is obtained for each of the at least one channel Frequenzkanä ⁇ le amplitude and the channel amplitudes.
  • at least one value per frequency channel is provided for the spectral model.
  • the spectral model can be obtained by interpolation (spline).
  • the individual points are linear
  • the spectral model can also be a polynomial function.
  • the spectral model or the spectral envelope is simulated by an analytical function. From this in turn, amplitude values can be obtained without high computational effort.
  • the spectral model can also be obtained by an LPC analysis (li ⁇ near predictive coefficient) in the time domain. This can be dispensed with a filter bank.
  • the device for the frequency compression has a polyphase filter bank to deliver the audio signal in several frequency channels ⁇ ready. This makes it possible to generate only positive frequency components in the channels.
  • the device according to the invention is particularly advantageously used in a listening device and in particular in a hearing aid.
  • frequency compression in Hörgerä ⁇ teierin can be realized with fewer artifacts.
  • FIG. 1 shows the basic structure of a hearing aid according to the
  • FIG. 3 shows the spectral model of FIG. 2 after the compression
  • the main object of the present invention is to leave the spectral fine structure, in particular of a harmonic signal, untouched by subjecting only the amplitude information of a spectrum to compression.
  • a spectral envelope which represents a measure of the magnitude of the amplitude in the spectrum, is compressed.
  • the providedssig ⁇ nal is spectrally dispersed by means of a filter bank.
  • a corresponding calculated channel strength For each channel participating in the compression process, a corresponding calculated channel strength. Examples of channel strengths are the amplitude, the square of the amplitude or any other measure of the power or strength of the signal in the entspre ⁇ sponding channel.
  • the channel strengths can be interpreted as samples of the spectral envelopes that are to be compressed.
  • the channel strength represents an amplitude information in the sense of the present application.
  • the compression is achieved by shifting the channel strengths from the source channels to the destination channels according to a predetermined compression rule.
  • the original channel strengths of the destination channel (before compression) will be overwritten. That is, according to the present invention, the phase of an original signal (before compression) is maintained in the target channel. Only the channel strengths are modified. Thus, for example, after the filter bank, the envelope is impressed on the respective signals, and the phases are retained.
  • the compression rule according to the vorlie ⁇ constricting invention is similar to the compression provision of a compression system according to the prior art.
  • the sub ⁇ difference between the approach according to the prior art and the inventive approach is that only the channel strengths are shifted according to the inventive approach, while the complete channel signals are shifted in the approach according to the prior art. In the approach according to the invention, therefore, the spectral fine structure is retained. A harmonic remains a harmonic. If necessary, only its amplitude is varied.
  • the obtained spectral model (such as an envelope or envelope).
  • This spectral model is at ⁇ example by linear interpolation, quadratic Inter ⁇ polation, cubic interpolation or by analytical Mo- obtained using a polynomial function.
  • the spectral model or the envelope is compressed according to the compression rule ⁇ .
  • the compressed spectral model is used to calculate the strengths of the target channels.
  • the phases of the destination channels are not modified as in the first implementation variant described above.
  • FIG. 2 shows a spectral model of an input signal of a hearing device.
  • the channel strength (e.g., amplitude, power, etc.) is plotted for each of the frequency channels 10 over the frequency f.
  • the respective channel strength is symbolized by a point 11.
  • Neighboring points 11 are each by a
  • the spectral envelope 12 thus represents a spectral model of the input signal.
  • a high-frequency portion 13 of the entire spectrum is to be compressed.
  • the compression starts at a frequency f_cut_off.
  • the range to be compressed ranges from this frequency f_cut_off to the highest processed frequency channel.
  • the channels in the compression area 13 may be referred to as source channels 14 for frequency compression.
  • f_cut_off is the linearly interpolated curve of Figure 2 ent ⁇ speaking compresses the compression rule to significantly less frequency channels.
  • the structure of the envelope is Although in terms of the amplitude sequence, remained essentially he ⁇ hold, but the curve was compressed in the frequency direction. The highest frequency f_max 'after the compression is thus below the frequency f_max in the uncompressed case according to FIG. 2. However, this also means that a large number of source channels 14 are mapped onto fewer destination channels 15. The target channels 15 each have the same width as a source channel 14. The channel structure is therefore unaffected by the compression. From the compressed envelope 12 '(compressed spectral model), the channel strength can thus be determined for each target channel 15, as will be shown with reference to the examples of FIG. 4 and FIG.
  • the compressed envelope 12 ' is scanned. It can already be seen here that the sampled values are not necessarily at the break points of the compressed envelope 12 '. Thus, it is not the strength of a source channel 14 that maps exactly to the strength of a target channel 15. Rather, the value for the channel strength of the target channel is obtained directly from the sample, which results at the respective channel center of the compressed envelope 12 '.
  • the sampling may also be performed at a different frequency position within each destination channel 15. Thus, for example, the sampling can also take place at a channel boundary.
  • the value of a destination channel 15 is determined in another way. Namely, it is determined by averaging based on an integral or a sum of all values of the compressed envelope 12 'within each channel. The respective mean value 16 is then a measure of the strength of the target channel 15. Again, the channel structure and in particular the distance between harmonics of the frequency compression remains unaffected. The amplitude of the spectral components in komp ⁇ rim convinced range is only adjusted or changed. According to a modified embodiment, the decomposition of the input signal into the spectral fine structure and the spectral envelope can also be performed by means of an LPC (linear predictive coefficient) analysis and calculating the residual signal in the

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)

Abstract

L'objet de la présente invention est la réduction des artéfacts lors de la compression de fréquence d'un signal audio pour un dispositif auditif et en particulier pour une prothèse auditive. A cet effet, l'invention concerne un procédé selon lequel des informations d'amplitude d'un canal source, par exemple une enveloppe spectrale, sont obtenues à partir d'une pluralité de canaux de fréquence dudit signal audio. Enfin, une amplitude correspondant auxdites informations d'amplitude est appliquée à un signal dans un canal cible (15) de ladite pluralité de canaux de fréquence, sur lequel est représenté le canal source, lors de la compression de fréquence.
EP10763664.9A 2010-09-29 2010-09-29 Procédé et dispositif de compression de fréquence Active EP2622879B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2010/064480 WO2012041373A1 (fr) 2010-09-29 2010-09-29 Procédé et dispositif de compression de fréquence

Publications (2)

Publication Number Publication Date
EP2622879A1 true EP2622879A1 (fr) 2013-08-07
EP2622879B1 EP2622879B1 (fr) 2015-11-11

Family

ID=44012481

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10763664.9A Active EP2622879B1 (fr) 2010-09-29 2010-09-29 Procédé et dispositif de compression de fréquence

Country Status (4)

Country Link
US (1) US8923538B2 (fr)
EP (1) EP2622879B1 (fr)
DK (1) DK2622879T3 (fr)
WO (1) WO2012041373A1 (fr)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4051331A (en) 1976-03-29 1977-09-27 Brigham Young University Speech coding hearing aid system utilizing formant frequency transformation
US6577739B1 (en) 1997-09-19 2003-06-10 University Of Iowa Research Foundation Apparatus and methods for proportional audio compression and frequency shifting
JP4694835B2 (ja) * 2002-07-12 2011-06-08 ヴェーデクス・アクティーセルスカプ 補聴器および音声の明瞭さを高める方法
AU2004201374B2 (en) * 2004-04-01 2010-12-23 Phonak Ag Audio amplification apparatus
CN101496420B (zh) 2005-06-08 2012-06-20 加利福尼亚大学董事会 利用信号处理算法改善语音清晰度和听力舒适度的方法、设备和***
KR100678770B1 (ko) * 2005-08-24 2007-02-02 한양대학교 산학협력단 궤환 신호 제거 기능을 구비한 보청기
US8000487B2 (en) * 2008-03-06 2011-08-16 Starkey Laboratories, Inc. Frequency translation by high-frequency spectral envelope warping in hearing assistance devices

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2012041373A1 *

Also Published As

Publication number Publication date
US20130188815A1 (en) 2013-07-25
EP2622879B1 (fr) 2015-11-11
WO2012041373A1 (fr) 2012-04-05
US8923538B2 (en) 2014-12-30
DK2622879T3 (da) 2016-02-15

Similar Documents

Publication Publication Date Title
EP2437258B1 (fr) Procédé et dispositif de compression de fréquence à décalage de fréquence sélectif
DE102010026884B4 (de) Verfahren zum Betreiben einer Hörvorrichtung mit zweistufiger Transformation
EP2919485B1 (fr) Transmission d'un signal à bruits de vent réduits à temps de latence diminué
EP2811762B1 (fr) Système binaural de formation de faisceau fondé sur la logique
EP2172062B1 (fr) Procédé d'adaptation d'un appareil de correction auditive à l'aide d'un modèle perceptif
EP3926982A2 (fr) Procédé de réduction directionnelle du bruit pour un système auditif comprenant un dispositif auditif
EP2981099B1 (fr) Procede et dispositif de suppression de l'effet larsen
EP2114089A1 (fr) Procédé et dispositif de détermination d'un degré de fermeture dans des appareils auditifs
DE102008017550A1 (de) Mehrstufiges Schätzverfahren zur Störgeräuschreduktion und Hörvorrichtung
DE202019107201U1 (de) Binaurales Hörgerät für eine verbesserte räumliche Hörwahrnehmung
EP1912470B1 (fr) Procédé pour la compression dynamique d'un signal audio et appareil auditif correspondant
EP2822300B1 (fr) Reconnaissance de situations d'écoute à l'aide de différentes sources de signal
EP2584795B1 (fr) Procédé de détermination d'une ligne caractéristique de compression
EP2437521B2 (fr) Procédé de compression fréquentielle à l'aide d'une correction harmonique et dispositif correspondant
EP2622879B1 (fr) Procédé et dispositif de compression de fréquence
DE102013207080B4 (de) Binaurale Mikrofonanpassung mittels der eigenen Stimme
EP2190218B1 (fr) Système d'ensemble de filtres avec atténuation de bande affaiblie spécifique pour un dispositif auditif
EP3048813B1 (fr) Procédé et dispositif de suppression du bruit basée sur l'inter-corrélation de bandes secondaires
EP2635048A2 (fr) Amplification d'un signal vocal en fonction du niveau d'entrée
WO2012041372A1 (fr) Procédé de compression de fréquence, dispositif d'adaptation et prothèse auditive
EP4404591A1 (fr) Système auditif binaural comportant deux instruments auditifs ainsi que procédé de fonctionnement d'un tel système auditif
DE102011089865A1 (de) Verfahren zum Anpassen einer Frequenzkompressionseinrichtung einer Hörvorrichtung und entsprechende Anpassungsvorrichtung
DE102008064382A1 (de) Hörvorrichtung mit Transpositionsmöglichkeit und entsprechendes Verfahren
DE102011087692A1 (de) Hörvorrichtung und Verfahren zur Verbesserung der Wahrnehmbarkeit eines Anteils eines Eingangssignals für einen Benutzer der Hörvorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130320

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150611

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 760970

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151215

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502010010654

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160209

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160211

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160212

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160311

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502010010654

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

26N No opposition filed

Effective date: 20160812

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160929

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160929

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 760970

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160929

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20160930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160929

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100929

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151111

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230921

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230919

Year of fee payment: 14

Ref country code: DK

Payment date: 20230921

Year of fee payment: 14

Ref country code: DE

Payment date: 20230919

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20231001

Year of fee payment: 14