EP2658289B1 - Procédé de commande d'une caractéristique de guidage et système auditif - Google Patents

Procédé de commande d'une caractéristique de guidage et système auditif Download PDF

Info

Publication number
EP2658289B1
EP2658289B1 EP13164027.8A EP13164027A EP2658289B1 EP 2658289 B1 EP2658289 B1 EP 2658289B1 EP 13164027 A EP13164027 A EP 13164027A EP 2658289 B1 EP2658289 B1 EP 2658289B1
Authority
EP
European Patent Office
Prior art keywords
signal
hearing
microphone device
value
directional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13164027.8A
Other languages
German (de)
English (en)
Other versions
EP2658289A1 (fr
Inventor
Marc Aubreville
Eghart Fischer
Stefan Wehr
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos Pte Ltd
Original Assignee
Sivantos Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sivantos Pte Ltd filed Critical Sivantos Pte Ltd
Publication of EP2658289A1 publication Critical patent/EP2658289A1/fr
Application granted granted Critical
Publication of EP2658289B1 publication Critical patent/EP2658289B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers

Definitions

  • the present invention relates to a method for controlling a directional characteristic of a microphone device of an optional (binaural) hearing system having a first hearing device and a second hearing device. Moreover, the present invention relates to a corresponding (binaural) hearing system.
  • a hearing device here means any device which can be worn in or on the ear and causes a sound stimulus, in particular a hearing device, a headset, headphones and the like.
  • Hearing aids are portable hearing aids that are used to care for the hearing impaired.
  • different types of hearing aids such as behind-the-ear hearing aids (BTE), hearing aid with external receiver (RIC: receiver in the canal) and in-the-ear hearing aids (ITE), e.g. Concha hearing aids or canal hearing aids (ITE, CIC).
  • BTE behind-the-ear hearing aids
  • RIC hearing aid with external receiver
  • ITE in-the-ear hearing aids
  • ITE in-the-ear hearing aids
  • ITE in-the-ear hearing aids
  • ITE concha hearing aids or canal hearing aids
  • the hearing aids listed by way of example are worn on the outer ear or in the ear canal.
  • bone conduction hearing aids, implantable or vibrotactile hearing aids are also available on the market. The stimulation of the damaged hearing takes place either mechanically or electrically.
  • Hearing aids have in principle as essential components an input transducer, an amplifier and an output transducer.
  • the input transducer is usually a sound receiver, z. As a microphone, and / or an electromagnetic receiver, for. B. an induction coil.
  • the output transducer is usually used as an electroacoustic transducer, z. As miniature speaker, or as an electromechanical transducer, z. B. bone conduction, realized.
  • the amplifier is usually integrated in a signal processing unit. This basic structure is in FIG. 1 shown using the example of a behind-the-ear hearing aid. In a hearing aid housing 1 for Carrying behind the ear, one or more microphones 2 are installed for recording the sound from the environment.
  • a signal processing unit 3 which is also integrated in the hearing aid housing 1, processes the microphone signals and amplifies them.
  • the output signal of the signal processing unit 3 is transmitted to a loudspeaker or earpiece 4, which outputs an acoustic signal.
  • the sound is optionally transmitted via a sound tube, which is fixed with an earmold in the ear canal, to the eardrum of the device carrier.
  • the power supply of the hearing device and in particular the signal processing unit 3 is effected by a likewise integrated into the hearing aid housing 1 battery. 5
  • US 2010/158290 A1 is a hearing aid and a method for operating a hearing aid is known, which has a microphone system that can be switched to a first and a second directional characteristics.
  • a signal-to-noise ratio (SNR) is determined for the first and second directivity characteristics.
  • a switching device Switches the directional microphone to the higher SNR mode.
  • the document US 2008/0086309 A1 relates to a hearing aid and a method for tracking and selecting a speech source in an ambient sound mixture (summary of D2).
  • a preprocessor generates n audio signals from n microphone signals.
  • Post-processing determines for the n audio signals a probability of whether they contain speech. The post-processing then selects the signal with the highest probability for an acoustic output.
  • document US 2006/0160254 A1 relates to a system and a method of communication in which a spectacle frame has at least one directional microphone for receiving voice signals of the wearer and a communication device.
  • One or more directional microphones are provided whose directional characteristics can be controlled.
  • the recorded speech signals are interpreted and evaluated by a controller and the directional characteristics and / or the position of the microphones are set to the voice of the wearer.
  • signal parameters which influence the directional characteristic are set as a function of the result of a signal analysis of the input signal.
  • the signal analysis includes a modulation analysis. Upon recognition of speech by the modulation analysis is switched from an omnidirectional reception to the reception in the direction of the hearing aid wearer.
  • the object of the present invention is therefore to be able to more stably control a hearing system with at least one hearing device with regard to the directional characteristic.
  • a corresponding (optionally binaural) hearing system is to be provided.
  • the signals from two different directions are analyzed with respect to speech features, i. H. one or more properties characteristic of speech, analyzed.
  • This analysis leads to feature values whose difference or other combination can be used to control the directional characteristic of the hearing system.
  • the difference between values characteristic of speech serves as a reliable decision criterion for the formation of the directional characteristic of a hearing system.
  • the first direction is opposite to the second direction.
  • signals from opposite directions are analyzed.
  • This has the advantage that thereby two half-spaces can be analyzed separately from each other, and the directional characteristic can be designed accordingly.
  • the hearing device is intended to be carried in or on the two ears of a user, and the first direction points to the left or the front with respect to the user.
  • the second direction then points to the right or rear with respect to the user.
  • the feature values can each represent a probability with which speech is present in the respective signal of the microphone device. In addition, they can too simply represent an amplitude or level of a signal qualified as speech.
  • the difference between the two feature values can be related to the minimum of the two feature values.
  • the reference should be made by dividing the difference by the minimum of the two feature values. This results in a pure numerical value, in which signal-to-noise ratios are taken into account.
  • the control value can be obtained according to an embodiment by means of a freely selectable assignment rule from the minimum difference.
  • a freely selectable assignment rule from the minimum difference.
  • the decision-making can be made even clearer.
  • a hysteresis can also be installed.
  • the directional characteristic is formed by superimposing a directional signal and an omnidirectional signal of the microphone device, and thereby weighting the directional signal and the omnidirectional signal by means of the control value. This makes it possible that the microphone device is blended from a directional operation in an omnidirectional operation or vice versa.
  • the method can be implemented such that the directionality of the directional characteristic increases with increasing control value on the basis of omnidirectionality.
  • the system can also be designed such that, depending on the increasing control value, it is superimposed from one direction to another direction.
  • a data connection between the at least one and a further hearing device of the hearing system is activated and / or deactivated as a function of the directional characteristic. This makes it possible that, if the automatic control of the directional characteristic specifies an omnidirectional diet of the microphone device, a data exchange between the two hearing devices is prevented, which leads to significant energy savings.
  • a hearing aid system with two hearing aids (first hearing device and second hearing device) is provided.
  • There is a data connection between the two hearing aids so that the output signals of both hearing aids can be processed together.
  • the directional characteristic in the entire room is almost arbitrarily variable, provided that the two hearing aids are intended to be worn in or on the ears of the hearing aid wearer.
  • the directional characteristic can be directed more or less sharply to a source.
  • the microphone device here the directional microphone
  • the directional microphone has a higher sensitivity, while it is more or less damped in other directions.
  • two different output signals of the directional microphone are examined with regard to speech components or speech characteristics.
  • These output signals of the directional microphone come from different operating modes of the directional microphone. For example, they come from the two concrete modes that the reception lobe is on the one hand to the left and the other to the right.
  • the operating modes may also be defined by the directional lobes being directed forward or backward relative to the hearing aid wearer.
  • speech features are examined in the signals from the left and the right and in the other case in the signals from the front and the back.
  • a value f is calculated which indicates how large the difference in the speech characteristics between the two signals is.
  • Speech features are for example the 4 Hz modulation, the so-called voice onset (level increase at the beginning of speech) or a speech-related signal-to-noise ratio.
  • the absolute value of the difference is then normalized with the minimum of the feature values of both speech features.
  • the difference between the two feature values m1 and m2 will be small.
  • the minimum of both values on the other hand, will be relatively high. This leads to a low value f.
  • the directional microphone will not be useful. Moreover, it is also advantageous to switch to omnidirectional operation when the signal-to-noise ratio is low and, for example, strong voice signals are registered from both sides. The omnidirectional operation then leads to improved speech perception. In both cases, the value f is small and it should be generated from a control signal for omnidirectional operation.
  • the value f can be converted into a control value w.
  • the assignment rule may be an analytic function that maps the value f to the control value w.
  • the assignment rule can also be a value table or a lookup table with which the control value w is determined from a value f. Such a lookup table is in FIG. 3 indicated.
  • the microphone device or its directional characteristic can now be controlled.
  • the omnidirectional operation or the directional operation can be switched.
  • the following examples always refer to the fact that is switched back and forth between a directional operation and an omnidirectional operation, for example, using the control value and a certain direction of the directional characteristic can be set.
  • This algorithm ensures that the directional microphone is used only in unique situations, such as having only one speaker in the current listening situation. This facilitates rapid switching in unique situations over the known concepts of slow crossfading to mask switching fluctuations. In multi-speaker situations, the hearing aid remains in omnidirectional mode and does not constantly switch back and forth. This reduces corresponding irritations in the hearing aid wearer.
  • the invention makes it possible that the audio transmission between the two hearing aids is not activated or deactivated when they are in the respective Situation is not necessary or not advantageous. In this way, energy can be saved significantly.
  • a binaural audio data transfer can be dispensed with if omnidirectional operation is desired or set in both hearing aids.
  • the above embodiments relate to binaural hearing systems.
  • the directional characteristic of a microphone device can also be controlled in a monaural hearing system in the manner described.
  • the quotient is supplied on the one hand via an amount unit 15 a changeover switch 16 and on the other hand directly to the changeover switch 16.
  • the changeover switch 16 is driven accordingly.
  • the changeover switch 16 is followed by a smoothing unit 18, with which the value f is smoothed in order to avoid frequent switching between different operating modes of the microphone device.
  • an amount is formed in an absolute value unit 19. If necessary, therefore, the upstream unit 14 can be dispensed with. So far, the function for calculating the value f has now been realized.
  • the lookup table 20 represents an assignment rule here An example of this is in FIG. 3 played. In the concrete example, it is a function, according to the values f to about 0.45, to be transformed to a very small control value w less than 0.1. For values below a predetermined threshold value, an audio data connection can be dispensed with.
  • the microphone device is to be used here essentially in omnidirectional operation. Only from values of f> 0.75 the situation is safely classified as favorable for directional operation, and these values are assigned a high control value close to 1. For values f between 0.45 and 0.75, a transition region which proceeds relatively steeply passes over.
  • two signals can now be weighted according to the formula given above.
  • a directional signal S_dir and an omnidirectional signal S_omni or another signal from a defined direction can thus be mixed with one another.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Claims (9)

  1. Procédé de commande d'une caractéristique directionnelle d'un dispositif à microphone d'un système d'audition présentant au moins un ensemble d'audition, le procédé présentant les étapes suivantes :
    détermination d'une première valeur caractéristique (m1) de la voix dans un premier signal, associé à une première direction, du dispositif de microphone,
    détermination d'une deuxième valeur caractéristique (m2) de la voix dans un deuxième signal, associé à la deuxième direction, du dispositif de microphone,
    obtention d'une valeur de commande (w) à partir des deux valeurs caractéristiques et
    commande de la caractéristique directionnelle du dispositif de microphone à l'aide de la valeur de commande,
    caractérisé en ce que
    pour obtenir la valeur de commande (w), on fait intervenir la différence (10) entre les deux valeurs caractéristiques et le minimum (11) des deux valeurs caractéristiques.
  2. Procédé selon la revendication 1, dans lequel la première direction est opposée à la première direction.
  3. Procédé selon la revendication 2, dans lequel le ou les ensembles d'audition sont portés normalement dans ou sur une oreille d'un utilisateur, la première direction étant tournée vers la gauche ou l'avant de l'utilisateur.
  4. Procédé selon l'une des revendications précédentes, dans lequel les valeurs caractéristiques (m1, m2) représentent chacune une probabilité selon laquelle la voix est présente dans le signal concerné du dispositif de microphone.
  5. Procédé selon l'une des revendications précédentes, dans lequel la valeur de commande est obtenue au moyen d'une prescription d'attribution (20) sélectionnée librement à partir de la différence par rapport au minimum.
  6. Procédé selon l'une des revendications précédentes, dans lequel la caractéristique directionnelle est formée par superposition d'un signal directionnel et d'un signal omnidirectionnel du dispositif à microphone, le signal directionnel et le signal omnidirectionnel étant pondérés à l'aide de la valeur de commande (w).
  7. Procédé selon l'une des revendications précédentes, dans lequel une valeur de directionnalité de la caractéristique directionnelle augmente lorsque la valeur de commande (w) augmente à partir de l'omnidirectionnalité.
  8. Procédé selon l'une des revendications précédentes, dans lequel une liaison de données entre le ou les ensembles d'audition et un autre ensemble d'audition du système d'audition est activée et/ou désactivée en fonction de la valeur de commande (w).
  9. Système d'audition présentant :
    au moins un ensemble d'audition,
    l'ensemble d'audition présentant un dispositif à microphone doté d'une caractéristique directionnelle,
    le dispositif à microphone étant configuré pour déterminer une première valeur caractéristique (m1) de la voix dans un premier signal, associé à une première direction, du dispositif à microphone et pour déterminer une deuxième valeur caractéristique (m2) de la voix dans un deuxième signal, associé à une deuxième direction, du dispositif à microphone et
    un dispositif de commande étant formé dans le ou les ensembles d'audition pour obtenir une valeur de commande (w) à partir des deux valeurs caractéristiques (m1, m2) et pour commander la caractéristique directionnelle du dispositif à microphone à l'aide de la valeur de commande,
    caractérisé en ce que
    le dispositif de commande fait intervenir la différence (10) entre les deux valeurs caractéristiques et le minimum (11) des deux valeurs caractéristiques pour obtenir la valeur de commande (w).
EP13164027.8A 2012-04-25 2013-04-17 Procédé de commande d'une caractéristique de guidage et système auditif Active EP2658289B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102012206759.0A DE102012206759B4 (de) 2012-04-25 2012-04-25 Verfahren zum Steuern einer Richtcharakteristik und Hörsystem

Publications (2)

Publication Number Publication Date
EP2658289A1 EP2658289A1 (fr) 2013-10-30
EP2658289B1 true EP2658289B1 (fr) 2016-07-06

Family

ID=48128164

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13164027.8A Active EP2658289B1 (fr) 2012-04-25 2013-04-17 Procédé de commande d'une caractéristique de guidage et système auditif

Country Status (4)

Country Link
EP (1) EP2658289B1 (fr)
AU (1) AU2013203174B2 (fr)
DE (1) DE102012206759B4 (fr)
DK (1) DK2658289T3 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016225207A1 (de) * 2016-12-15 2018-06-21 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgerätes

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017221006A1 (de) 2017-11-23 2019-05-23 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgerätes
DE102020207579A1 (de) * 2020-06-18 2021-12-23 Sivantos Pte. Ltd. Verfahren zur richtungsabhängigen Rauschunterdrückung für ein Hörsystem, welches eine Hörvorrichtung umfasst

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10114101A1 (de) * 2001-03-22 2002-06-06 Siemens Audiologische Technik Verfahren zum Verarbeiten eines Eingangssignals in einer Signalverarbeitungseinheit eines Hörgerätes sowie Schaltung zur Durchführung des Verfahrens
TWI390945B (zh) * 2004-03-31 2013-03-21 Swisscom Ag 聲波通信用之方法及系統
EP1912472A1 (fr) * 2006-10-10 2008-04-16 Siemens Audiologische Technik GmbH Procédé pour le fonctionnement d'une prothèse auditive and prothèse auditive
EP2107826A1 (fr) * 2008-03-31 2009-10-07 Bernafon AG Système d'assistance auditive directionnelle
DE102008064484B4 (de) * 2008-12-22 2012-01-19 Siemens Medical Instruments Pte. Ltd. Verfahren zum Auswählen einer Vorzugsrichtung eines Richtmikrofons und entsprechende Hörvorrichtung

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016225207A1 (de) * 2016-12-15 2018-06-21 Sivantos Pte. Ltd. Verfahren zum Betrieb eines Hörgerätes

Also Published As

Publication number Publication date
EP2658289A1 (fr) 2013-10-30
AU2013203174B2 (en) 2015-01-22
DE102012206759B4 (de) 2018-01-04
DE102012206759A1 (de) 2013-10-31
AU2013203174A1 (en) 2013-11-14
DK2658289T3 (da) 2016-10-24

Similar Documents

Publication Publication Date Title
EP3222057B1 (fr) Procédé et dispositif de détection rapide de la voix naturelle
EP2603018B1 (fr) Dispositif auditif avec détection d'activité de locuteur et procédé de fonctionnement d'un dispositif auditif
EP1771038B1 (fr) Procédé d'utilisation d'un système de prothèse auditive pour le traitement binaural d'un utilisateur
EP2506603B1 (fr) Système d'aide auditive avec système de microphone directif et procédé de fonctionnement dudit système d'aide auditive avec système de microphone directif
EP2164283B1 (fr) Appareil auditif et fonctionnement d'un appareil auditif doté d'une transposition de fréquence
EP2991379B1 (fr) Procede et dispositif de perception amelioree de sa propre voix
EP3104627B1 (fr) Procédé d'amélioration d'un signal d'enregistrement dans un système auditif
EP1962556A2 (fr) Procédé d'amélioration de la prise de conscience spatiale et dispositif auditif correspondant
DE102007017761A1 (de) Verfahren zur Anpassung eines binauralen Hörgerätesystems
EP2070384B1 (fr) Appareil de correction auditive commandé par un modèle perceptif et procédé correspondant
EP2226795A1 (fr) Dispositif auditif et procédé de réduction d'un bruit parasite pour un dispositif auditif
EP2811762B1 (fr) Système binaural de formation de faisceau fondé sur la logique
DE102013207149A1 (de) Steuerung der Effektstärke eines binauralen direktionalen Mikrofons
EP2182741B1 (fr) Dispositif auditif doté d'une unité de reconnaissance de situation spéciale et procédé de fonctionnement d'un dispositif auditif
DE102007035171A1 (de) Verfahren zum Anpassen eines Hörgeräts mit Hilfe eines perzeptiven Modells
EP2595414A1 (fr) Dispositif auditif avec un système pour réduire un bruit de microphone et procédé de réduction d'un bruit de microphone
EP2658289B1 (fr) Procédé de commande d'une caractéristique de guidage et système auditif
EP2161949A2 (fr) Procédé de fonctionnement d'un dispositif auditif ayant une directivité et dispositif auditif correspondant
EP2200345A1 (fr) Procédé de sélection d'une direction préférentiel d'un microphone directionnel et dispositif auditif correspondant
EP2584795B1 (fr) Procédé de détermination d'une ligne caractéristique de compression
DE102009004185B3 (de) Verfahren zur Signalverarbeitung einer Hörvorrichtung und entsprechende Hörvorrichtung
EP2373063A1 (fr) Dispositif auditif et procédé de réglage de celui-ci pour un fonctionnement sans contre-réaction
DE102007035173A1 (de) Verfahren zum Einstellen eines Hörsystems mit einem perzeptiven Modell für binaurales Hören und entsprechendes Hörsystem
EP4149121A1 (fr) Procédé de fonctionnement d'un appareil auditif
EP3048813A1 (fr) Procédé et dispositif de suppression du bruit basée sur l'inter-corrélation de bandes secondaires

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20140428

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIVANTOS PTE. LTD.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160310

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 811441

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160715

Ref country code: CH

Ref legal event code: EP

Ref country code: CH

Ref legal event code: NV

Representative=s name: E. BLUM AND CO. AG PATENT- UND MARKENANWAELTE , CH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502013003581

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20161017

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160706

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161106

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161006

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161007

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161107

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502013003581

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161006

26N No opposition filed

Effective date: 20170407

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170417

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170430

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 811441

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130417

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180417

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160706

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230417

Year of fee payment: 11

Ref country code: DK

Payment date: 20230419

Year of fee payment: 11

Ref country code: DE

Payment date: 20230418

Year of fee payment: 11

Ref country code: CH

Payment date: 20230502

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230420

Year of fee payment: 11