EP3007461A1 - Réseau de microphones - Google Patents

Réseau de microphones Download PDF

Info

Publication number
EP3007461A1
EP3007461A1 EP14188463.5A EP14188463A EP3007461A1 EP 3007461 A1 EP3007461 A1 EP 3007461A1 EP 14188463 A EP14188463 A EP 14188463A EP 3007461 A1 EP3007461 A1 EP 3007461A1
Authority
EP
European Patent Office
Prior art keywords
microphone
microphone array
differential
sound
indentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP14188463.5A
Other languages
German (de)
English (en)
Other versions
EP3007461B1 (fr
Inventor
Markus Christoph
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harman Becker Automotive Systems GmbH
Original Assignee
Harman Becker Automotive Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harman Becker Automotive Systems GmbH filed Critical Harman Becker Automotive Systems GmbH
Priority to EP14188463.5A priority Critical patent/EP3007461B1/fr
Priority to EP19157791.5A priority patent/EP3506650B1/fr
Publication of EP3007461A1 publication Critical patent/EP3007461A1/fr
Application granted granted Critical
Publication of EP3007461B1 publication Critical patent/EP3007461B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/027—Spatial or constructional arrangements of microphones, e.g. in dummy heads
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/34—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by using a single transducer with sound reflecting, diffracting, directing or guiding means
    • H04R1/38—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by using a single transducer with sound reflecting, diffracting, directing or guiding means in which sound waves act upon both sides of a diaphragm and incorporating acoustic phase-shifting means, e.g. pressure-gradient microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the disclosure relates to a microphone array, in particular to a spherical microphone array for use in a modal beamforming system.
  • a microphone-array-based modal beamforming system commonly comprises a spherical microphone array of a multiplicity of microphones equally distributed over the surface of a solid or virtual sphere to convert sounds into electrical audio signals and a modal beamformer that combines the audio signals generated by the microphones to form an auditory scene representative of at least a portion of an acoustic sound field.
  • This combination enables the reception of acoustic signals dependent on their direction of propagation.
  • microphone arrays are also sometimes referred to as spatial filters.
  • Spherical microphone arrays exhibit low- and high-frequency limitations so that the sound field can only be accurately described over a limited frequency range.
  • Low-frequency limitations essentially result when the directivity of the particular microphones of the array is poor compared to the wavelength and the high amplification necessary in this frequency range; this leads to high amplification of (self) noise and thus to the need to limit the usable frequency range up to a maximum lower frequency.
  • High-frequency issues can be explained by spatial aliasing effects. Similar to temporal aliasing, spatial aliasing occurs when a spatial function (e.g., the spherical harmonics) is under-sampled. For example, at least 16 microphones are needed to distinguish 16 harmonics. In addition, the positions and, depending on the type of sphere used, the directivity of the microphones are important.
  • a spatial aliasing frequency characterizes the upper critical frequency of the frequency range in which the spherical microphone array can be employed without generating any significant artifacts. Reducing the unwanted effects of spatial aliasing is widely desired.
  • a spherical microphone array may include a sound-diffracting structure that has a closed three-dimensional shape with a surface surrounding the shape and at least two differential microphones mounted flush on the surface of the sound-diffracting structure.
  • FIG. 1 A schematic illustration of a six-element 3D microphone array 100 mounted in rigid sphere 101, which forms a sound-diffracting structure, is shown in Figure 1 . Note that only three of the six microphone elements can be seen in the figure (i.e., microphones 102, 103 and 104), with the remaining three microphone elements being hidden on the back side of sphere 100. All six microphone elements are mounted flush on the surface of sphere 100 at points where an inscribed regular octahedron's vertices would contact the spherical surface.
  • the individual microphone elements are differential microphone elements such as those shown in and described below in connection with Figures 8-12 . In other exemplary microphone arrays, other conventional differential microphone elements may be used.
  • FIG. 2 shows a perspective view of a 3D microphone array 200 that has the polyhedral shape of a 60-sided pentakis dodecahedron.
  • microphone array 200 of Figure 2 has a plurality of individual flush-mounted microphone elements, analogous to elements 102, 103 and 104 of Figure 1 , distributed around and integrated into different rigid triangular sections 201 of sphere 200, where zero, one or more microphone elements are mounted flush onto the surface of each different triangular section 201.
  • the microphone elements may be distributed uniformly or non-uniformly around the polyhedron, with each triangular section 201 having the same number of microphone elements or different triangular sections 201having different numbers of microphone elements, including some triangular sections 201 that have no microphone elements.
  • Figure 3 illustrates a 3D microphone array 300 that has a spherical sound-diffracting structure 301 with microphones 302 embedded in cavities whose dimensions and shapes are optimized to tailor the directivity pattern.
  • Figure 3 shows a circular conical cavity; however, a sectoral cavity or any other appropriately shaped cavity may alternatively be used to form an indentation of the spherical surface.
  • the truncated conical shape of microphone array 300 is designed to increase directivity on both horizontal and vertical planes, whereas a sectoral cavity provides higher directivity on the horizontal plane.
  • the cavity shape can be tailored and optimized to give the best compromise in terms of vertical and horizontal directivity. Directivity is achieved in sound-diffracting structure 301 of Figure 3 due to a combination of obstacle size and cavity design.
  • a person of ordinary skill in the art will appreciate that there are a large variety of shapes of indentations that can be designed.
  • the microphone elements in the examples presented in Figures 1-3 are mounted flush on the surface of the sound-diffracting structure (e.g., rigid spheres with or without indentations) as shown in Figures 4-6 .
  • Flush-mounted microphone elements are microphone elements that are mounted or integrated into the structure in such a way that there is substantially no protrusion from the surface.
  • Figure 4 shows details of rigid sphere 400, which has no indentations, in which differential microphone element 401 is mounted flush on surface 402 of rigid sphere 400.
  • Figure 5 shows details of rigid sphere 500, which has indentation 503, in which differential microphone element 501 is mounted flush on surface 502 of indentation 503 and thus of rigid sphere 500.
  • Figure 6 shows details of rigid sphere 600, which has indentation 603, in which two differential microphone elements 601 and 604 are mounted flush on surface 602 of indentation 603 and thus of rigid sphere 600.
  • Omnidirectional microphone elements can also be used instead of two differential microphone elements if their omnidirectional behavior is transformed into differential behavior by a corresponding electronic circuit or by software.
  • the indentations may be shaped, for example, as inverse spherical caps or inverse circular paraboloids.
  • differential microphone elements also known as pressure gradient microphones
  • Equation (1) is the parametric expression of the "limaçon of Pascal" algebraic curve, familiar to those skilled in the art.
  • the two terms in Equation (1) can be seen to be the sum of an omnidirectional sensor (i.e., the first term) and a first-order dipole sensor (i.e., the second term), which is the general form of the first-order array.
  • differential microphone element 900 may have directivity in the approximate shape of a cardioid.
  • Differential microphone element 900 may be a tube-like member (e.g., a substantially u-curved tube 901) with two open ends, also herein referred to as sound inlet ports 902 and 903, and omnidirectional microphone 904 disposed in tube 901 between sound inlet ports 902 and 903 of the tube-like member.
  • Sound inlet ports 902 and 903 are spaced at distance d apart and are defined by juxtaposed end sections of tube 901 that communicate with diaphragm 905 of microphone 904.
  • the two sides 905a and 905b of microphone diaphragm 905 receive sound from the two respective inlet ports 902 and 903.
  • the sound pressure driving the rear of the diaphragm travels through a resistive damping material 906, which is designed to provide a time delay (also referred to as acoustic delay).
  • the dissipative, resistive damping material 906 may be designed to create a proper time delay in order for the net pressure to have the desired directivity.
  • Equation (3) p net ⁇ Pj ⁇ t + d c ⁇ cos ⁇ e j ⁇ t .
  • the net pressure on the directional microphone is proportional to co and thus has a 6 dB per octave slope.
  • the net pressure is also diminished in proportion to distance d between the ports. Reducing the overall size of the sensor thus results in a proportional loss of sensitivity.
  • Differential microphone element 1000 may comprise a substantially u-curved tube 1001, with two sound inlet ports 1002 and 1003, and an omnidirectional microphone 1004 disposed in tube 1001 between sound inlet ports 1002 and 1003 of the tube-like member.
  • Sound inlet ports 1002 and 1003 are spaced at distance d apart, and are defined by juxtaposed end sections of tube 1001 that communicate with diaphragm 1005 of microphone 1004.
  • the two sides 1005a and 1005b of microphone diaphragm 1005 receive sound from the two respective inlet ports 1002 and 1003.
  • the sound pressure driving rear side 1005b of the diaphragm travels a longer way compared to front side 1005a and thus provides a time delay relative to front side 1005a.
  • an electro-acoustic first-order differential microphone element 1100 may include acoustics part 1101 and electronics part 1102. Acoustics part 1101 features two omnidirectional microphones 1103 and 1104 arranged at distance d from each other. Within electronics part 1102, the outputs of omnidirectional microphones 1003 and 1104 are subtracted from each other by differencing amplifier 1105. Before this subtraction, the output of omnidirectional microphone 1104 is passed through delay element 1106 to delay the outputs of the two omnidirectional microphones 1103 and 1104 relative to each other. This element may be, for example, an all-pass filter or time delay circuit. The output of differencing amplifier 1105 is passed through equalizing filter 1107 to compensate for frequency-dependent gain values of the circuit.
  • Figure 12 shows a schematic diagram of another first-order full-band differential microphone element 1200 based on an adaptive back-to-back cardioid system.
  • differential microphone element 1200 signals from two microphones 1201 and 1202 are delayed by time delay T at delay elements 1203 and 1204, respectively.
  • the delayed signal from microphone 1201 is subtracted from the undelayed signal from microphone 1202 at subtraction element 1205 to form a forward-facing cardioid signal.
  • the delayed signal from microphone 1202 is subtracted from the undelayed signal from microphone 1201 at subtraction element 1206 to form a backward-facing cardioid signal.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
EP14188463.5A 2014-10-10 2014-10-10 Réseau de microphones Active EP3007461B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14188463.5A EP3007461B1 (fr) 2014-10-10 2014-10-10 Réseau de microphones
EP19157791.5A EP3506650B1 (fr) 2014-10-10 2014-10-10 Reseau de microphones

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14188463.5A EP3007461B1 (fr) 2014-10-10 2014-10-10 Réseau de microphones

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP19157791.5A Division EP3506650B1 (fr) 2014-10-10 2014-10-10 Reseau de microphones

Publications (2)

Publication Number Publication Date
EP3007461A1 true EP3007461A1 (fr) 2016-04-13
EP3007461B1 EP3007461B1 (fr) 2019-02-27

Family

ID=51663104

Family Applications (2)

Application Number Title Priority Date Filing Date
EP19157791.5A Active EP3506650B1 (fr) 2014-10-10 2014-10-10 Reseau de microphones
EP14188463.5A Active EP3007461B1 (fr) 2014-10-10 2014-10-10 Réseau de microphones

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP19157791.5A Active EP3506650B1 (fr) 2014-10-10 2014-10-10 Reseau de microphones

Country Status (1)

Country Link
EP (2) EP3506650B1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020031719A1 (fr) * 2018-08-08 2020-02-13 日本電信電話株式会社 Dispositif de collecte de son
WO2020186434A1 (fr) * 2019-03-19 2020-09-24 Northwestern Polytechnical University Réseaux de microphones différentiels flexibles à ordre fractionnaire

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0869697A2 (fr) * 1997-04-03 1998-10-07 Lucent Technologies Inc. Réseau de microphones différentiels de premier ordre orientable et variable
EP0664071B1 (fr) * 1993-04-13 2002-07-24 Etymotic Research, Inc Prothese auditive a systeme de commutation de microphone
EP1737268A1 (fr) * 2005-06-23 2006-12-27 AKG Acoustics GmbH Microphones à champ sonore
EP2773131A1 (fr) * 2013-02-27 2014-09-03 Harman Becker Automotive Systems GmbH Réseau de microphones sphériques

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5878147A (en) * 1996-12-31 1999-03-02 Etymotic Research, Inc. Directional microphone assembly
AU2002332475A1 (en) * 2002-08-07 2004-02-25 State University Of Ny Binghamton Differential microphone
GB0315426D0 (en) * 2003-07-01 2003-08-06 Mitel Networks Corp Microphone array with physical beamforming using omnidirectional microphones
EP2262277B1 (fr) * 2007-11-13 2012-01-04 AKG Acoustics GmbH Ensemble de microphones
US9197962B2 (en) * 2013-03-15 2015-11-24 Mh Acoustics Llc Polyhedral audio system based on at least second-order eigenbeams

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0664071B1 (fr) * 1993-04-13 2002-07-24 Etymotic Research, Inc Prothese auditive a systeme de commutation de microphone
EP0869697A2 (fr) * 1997-04-03 1998-10-07 Lucent Technologies Inc. Réseau de microphones différentiels de premier ordre orientable et variable
EP1737268A1 (fr) * 2005-06-23 2006-12-27 AKG Acoustics GmbH Microphones à champ sonore
EP2773131A1 (fr) * 2013-02-27 2014-09-03 Harman Becker Automotive Systems GmbH Réseau de microphones sphériques

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020031719A1 (fr) * 2018-08-08 2020-02-13 日本電信電話株式会社 Dispositif de collecte de son
JPWO2020031719A1 (ja) * 2018-08-08 2021-08-02 日本電信電話株式会社 集音装置
US11510000B2 (en) 2018-08-08 2022-11-22 Nippon Telegraph And Telephone Corporation Sound collection apparatus
JP7389036B2 (ja) 2018-08-08 2023-11-29 日本電信電話株式会社 集音装置
WO2020186434A1 (fr) * 2019-03-19 2020-09-24 Northwestern Polytechnical University Réseaux de microphones différentiels flexibles à ordre fractionnaire
US11956590B2 (en) 2019-03-19 2024-04-09 Northwestern Polytechnical University Flexible differential microphone arrays with fractional order

Also Published As

Publication number Publication date
EP3506650B1 (fr) 2020-04-01
EP3506650A1 (fr) 2019-07-03
EP3007461B1 (fr) 2019-02-27

Similar Documents

Publication Publication Date Title
EP2773131B1 (fr) Antenne microphonique sphérique
US9936291B2 (en) Spherical microphone array including a sound diffracting structure with cavity
US9473841B2 (en) Acoustic source separation
US9445198B2 (en) Polyhedral audio system based on at least second-order eigenbeams
US9774953B2 (en) Microphone array for acoustic source separation
EP0869697B1 (fr) Réseau de microphones différentiels de premier ordre orientable et variable
US8098844B2 (en) Dual-microphone spatial noise suppression
EP2360940A1 (fr) Système de réseau de microphone orientable avec un motif directionnel de premier ordre
KR20010100991A (ko) 고 지향성을 가진 마이크로폰 어레이
Gálvez et al. Personal audio loudspeaker array as a complementary TV sound system for the hard of hearing
Padois et al. Acoustic source localization using a polyhedral microphone array and an improved generalized cross-correlation technique
EP3007461A1 (fr) Réseau de microphones
EP3001697B1 (fr) Système de capture sonore
Meyer Microphone array for hearing aids taking into account the scattering of the head
EP2757811B1 (fr) Formation de faisceau modal
JP7003393B2 (ja) 端末装置、その制御方法および制御プログラム
Lewis Microphone array beamforming
CN108476371A (zh) 声波场生成
Moazzen et al. A nested microphone array for broadband audio signal processing
Papež et al. Enhanced MVDR beamforming for mems microphone array
US11997450B2 (en) Audio systems, devices, and methods
WO2022172401A1 (fr) Dispositif et procédé de conception et programme
US11871181B2 (en) Speaker array, signal processing device, signal processing method, and signal processing program
Gillett Head mounted microphone arrays
Elko et al. Adaptive beamformer for spherical eigenbeamforming microphone arrays

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20161011

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20171005

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20181012

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1103103

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190315

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014041709

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190227

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190627

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190527

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190527

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190528

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190627

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1103103

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014041709

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20191128

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191010

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20141010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230920

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230920

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230920

Year of fee payment: 10