EP2952016B1 - Procédé de traitement du son multicanal dans un système à son multicanal - Google Patents

Procédé de traitement du son multicanal dans un système à son multicanal Download PDF

Info

Publication number
EP2952016B1
EP2952016B1 EP13705936.6A EP13705936A EP2952016B1 EP 2952016 B1 EP2952016 B1 EP 2952016B1 EP 13705936 A EP13705936 A EP 13705936A EP 2952016 B1 EP2952016 B1 EP 2952016B1
Authority
EP
European Patent Office
Prior art keywords
signals
signal
surround
difference
stereo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13705936.6A
Other languages
German (de)
English (en)
Other versions
EP2952016A1 (fr
Inventor
Gunnar Kron
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kronoton GmbH
Original Assignee
Kronoton GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kronoton GmbH filed Critical Kronoton GmbH
Publication of EP2952016A1 publication Critical patent/EP2952016A1/fr
Application granted granted Critical
Publication of EP2952016B1 publication Critical patent/EP2952016B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/02—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems

Definitions

  • the invention relates to a method for multi-channel sound processing in a multi-channel sound system according to the preamble of claim 1.
  • the front signals Lo and Ro, the center signal Co and the surround signals L RO and R RO are derived from stereo signals, ie from the input signals L and R.
  • the respective other signals are subtracted from the signals L, R, L + R and LR with a weighting.
  • frequency-dependent weighting factors are derived in addition to the level ratio calculations.
  • the center signal C is varied only in the level, whereas the two surround signals L and R RO RO in two frequency bands and phase inverted derived.
  • the coefficients a 1 ... A 8 of these weighted summations are derived from level measurements.
  • two control signals from the level difference of a left and right channel D LR and level difference of a sum and difference signal Des are calculated.
  • the two front signals L out and R out are thereby from the two input signals L and R and the subtraction of a weighted sum signal (L + R) and of a weighted difference signal (LR) obtained.
  • the center signal C results from the sum (L + R) and the subtraction of the weighted input signals L and R.
  • the surround signal S is made up of the sum (LR) and the subtraction of the weighted input signals L and R.
  • the weighting coefficients g l , g r , g c and g s are obtained from a level matching of the signals L and R and L + R and LR in a recursive structure.
  • This time-variant multi-channel control ensures a spatial displacement of the signal, if then again a stereo encoding is made.
  • Much more decisive for a spatial resolution improvement of stereo signals is an extraction of directional signal components and their weighting by static or frequency-dependent weighting. Therefore, the document WO 2010/015275 A1 represents a significant advance of the method of the type mentioned, since here the decomposition of stereo signals in spatial proportions takes place in order to assess these with different level controls. Thereafter, the valued spatial signals are reassembled into a stereo signal. Due to the weighting of the spatial signal components, the stereo signal experiences an improvement of the spatial reproduction.
  • US2012 / 0263306 A1 discloses a four-channel stereophonic device. It is therefore an object of the invention to further develop a method of the type mentioned above, that on the basis of an extraction of directional signal components, a further improvement of the spatial reproduction of the input signals L and R is achieved. This object is achieved with the features of claim 1.
  • the derivation of the surround signals from the difference LR has proven to be another important step for improved stereo and spatial expansion.
  • a space signal R is formed into a center signal.
  • the space signal is formed from the difference between the signals L and R (R L ) and / or the difference between the signals R and L (R R ).
  • the inventive method a spatial and Stereo extension of a stereo signal achieved by an extension of the stereo decomposition.
  • the advantage here is a frequency-dependent weighting of the surround signals.
  • a frequency-dependent weighting of the signals S L and S R takes place .
  • the frequency-dependent weighting is preferably carried out by means of a height-helving filter.
  • the signals L and R are expediently added to the signals L P and R P.
  • the invention also provides software residing on a signal processor, i. is imported to the signal processor.
  • the software contains an algorithm which is processed by the signal processor, the algorithm detecting the method.
  • the method begins with the fact that in the context of decoding the input signals L and R, which are present as stereo signals, are divided into three signal components, wherein the signals L and R can be retained.
  • the signal components are the center signal C, the spatial signal R and the surround signals S L and S R.
  • the center signal C is single-channel, ie it contains only the channel C, whereas the space signal R and the surround signal S are two-channel, ie they contain the signals R L and R R and S L and S R.
  • the surround and space signals S L , S R and R L and R R contain the direction and spatial information of the stereo signals L and R.
  • the process section A is followed by the process section B, in which the processing of the channels C, R L , R R , S L and S R takes place.
  • these signals are provided by first level control 1, 2 with a level weighting, which manifests itself in the factor 1.5.
  • the further level controls 3, 4 provide a further variable level weighting, which weights the sound characteristics of the decoded signals to L, R.
  • the filters 5, 6 have a minimum phase shift in the frequency range of preferably 2 kHz, so that extinction effects are minimized in the taking place in process section C encoding, at the same time the actual gain effect is emphasized with a height helving frequency response of, for example, 3 dB, preferably 2KHZ.
  • the surround signals S L , S R are supplied to the level selectors 7, 8 which weight the sound characteristics of the decoded signals to S L , S R.
  • the encoded weighted signals are found L P , R P a post-processing by stereo equalizer 9, 10.
  • a special non-linear characteristic NL is used. This non-linear characteristic maps an input amplitude x to an output amplitude y.
  • the signals L P , R P undergo further post-processing in the method section D such that the level adjusters 11, 12 determine the degree of overtone mixing to the direct signal. Further processing is finally carried out by the level control 13, 14, which make the overall level of the process result adjustable.
  • the present invention is not limited in its execution to the embodiment given above. Rather, a number of variants is conceivable, which make use of the solution shown in other types.
  • ie compressors / limiters are used to further enrich the sound image.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Stereophonic System (AREA)

Claims (11)

  1. Procédé destiné au traitement d'un son multicanal dans un système de son à plusieurs canaux, pour lequel les signaux d'entrée L et R sont décodés, de préférence sous la forme de signaux stéréo ;
    dans lequel au moins deux signaux ayant la forme nL-mR, où n, m = 1, 2, 3, 4 sont formés dans le cadre du décodage à partir des signaux R et L ;
    caractérisé en ce que les signaux d'entrée L et R sont restitués dans l'espace et un signal surround SL est formé à partir de la différence SL = 2L-R et un signal surround SR est formé à partir de la différence SR = 2R-L.
  2. Procédé selon la revendication 1,
    dans lequel un signal spatial R est formé à partir des signaux L et R et est formé en un signal central, dans le cadre du décodage ;
    dans lequel un signal spatial RL est formé à partir de la différence des signaux L et R et/ou un signal spatial RR est formé à partir de la différence des signaux R et L.
  3. Procédé selon la revendication 2,
    dans lequel, dans le cadre d'un encodage, des signaux LP, RP en résultent sous la forme : L P = C + R L + S L = L + R + L − R + 2 L − R = 4 L − R ;
    Figure imgb0017
     et R P = C + R R + S R = L + R + R − L + 2 R − L = 4 R − L .
    Figure imgb0018
  4. Procédé selon la revendication 3,
    dans lequel les signaux RL, RR, C, SL et SR contiennent une pondération de niveau VC, VR, VS.
  5. Procédé selon la revendication 3,
    dans lequel, dans le cadre d'un encodage, des signaux LP, RP en résultent sous la forme : L P = V C C + V R R L + V S S L = V C L + R + V R L − R + V S 2 L − R ,
    Figure imgb0019
     ainsi que R P = V C C + V R R R + V S S R = V C L + R + V R R − L + V S 2 S − L .
    Figure imgb0020
  6. Procédé selon l'une des revendications 3 à 5,
    dans lequel une pondération des signaux SL et SR a lieu, laquelle pondération dépend de la fréquence.
  7. Procédé selon la revendication 6,
    dans lequel la pondération qui dépend de la fréquence a lieu au moyen d'un filtre de dégradé passe-haut (5, 6).
  8. Procédé selon l'une des revendications 3 à 6,
    dans lequel les signaux LP, RP sont filtrés au moyen d'un égaliseur (9, 10).
  9. Procédé selon l'une des revendications 3 à 7,
    dans lequel des tons aigus harmoniques sont ajoutés aux signaux LP, RP.
  10. Procédé selon la revendication 9,
    dans lequel l'ajout des tons aigus harmoniques a lieu au moyen d'un compresseur / limiteur ou d'une courbe caractéristique non linéaire ayant la forme y = tanh ((1 / 7,522 * atan (7,522 * x) * (sign(x) + 1) / 2 + x * (sign(-x) + 1) / 2) / 0,5) * 0,5 ;
    dans lequel cette courbe caractéristique non linéaire représente une amplitude d'entrée x sur une amplitude de sortie y.
  11. Programme logiciel, lequel est importé sur un processeur de signaux,
    caractérisé en ce que ledit programme logiciel contient un algorithme qui est traité par le processeur de signaux ;
    dans lequel l'algorithme détecte le procédé conformément à l'une des revendications 1 à 10.
EP13705936.6A 2013-02-04 2013-02-04 Procédé de traitement du son multicanal dans un système à son multicanal Active EP2952016B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2013/052127 WO2014117867A1 (fr) 2013-02-04 2013-02-04 Procédé de traitement du son multicanal dans un système à son multicanal

Publications (2)

Publication Number Publication Date
EP2952016A1 EP2952016A1 (fr) 2015-12-09
EP2952016B1 true EP2952016B1 (fr) 2018-09-26

Family

ID=47749772

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13705936.6A Active EP2952016B1 (fr) 2013-02-04 2013-02-04 Procédé de traitement du son multicanal dans un système à son multicanal

Country Status (7)

Country Link
US (1) US9628932B2 (fr)
EP (1) EP2952016B1 (fr)
JP (1) JP6438892B2 (fr)
KR (1) KR102089821B1 (fr)
CN (1) CN104969575B (fr)
SG (1) SG11201506075UA (fr)
WO (1) WO2014117867A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9380383B2 (en) 2013-09-06 2016-06-28 Gracenote, Inc. Modifying playback of content using pre-processed profile information
CN110719563B (zh) * 2018-07-13 2021-04-13 海信视像科技股份有限公司 调整立体声声像的方法、获取立体声声像的电路

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2439863A1 (de) * 1973-08-20 1975-03-06 Sansui Electric Co Vierkanal-dekodiermatrix
US20120263306A1 (en) * 2011-04-18 2012-10-18 Paul Blair McGowan Acoustic Spatial Projector

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5046098A (en) 1985-03-07 1991-09-03 Dolby Laboratories Licensing Corporation Variable matrix decoder with three output channels
JPS62146000A (ja) * 1985-12-20 1987-06-30 Sony Corp 音場拡大信号発生回路
JPH05316600A (ja) * 1992-05-12 1993-11-26 Nec Corp サラウンド回路
US5771295A (en) 1995-12-26 1998-06-23 Rocktron Corporation 5-2-5 matrix system
US6697491B1 (en) 1996-07-19 2004-02-24 Harman International Industries, Incorporated 5-2-5 matrix encoder and decoder system
US5970153A (en) 1997-05-16 1999-10-19 Harman Motive, Inc. Stereo spatial enhancement system
EP1025743B1 (fr) * 1997-09-16 2013-06-19 Dolby Laboratories Licensing Corporation Utilisation d'effets de filtrage dans les casques d'ecoute stereophoniques pour ameliorer la spatialisation d'une source autour d'un auditeur
US7035413B1 (en) * 2000-04-06 2006-04-25 James K. Waller, Jr. Dynamic spectral matrix surround system
MXPA03001852A (es) 2000-08-31 2003-09-10 Dolby Lab Licensing Corp Metodo para aparato para descodificacion de matriz de audio.
JP2003333699A (ja) * 2002-05-10 2003-11-21 Pioneer Electronic Corp マトリックス・サラウンドデコード装置
JP4580210B2 (ja) * 2004-10-19 2010-11-10 ソニー株式会社 音声信号処理装置および音声信号処理方法
JP2007311965A (ja) * 2006-05-17 2007-11-29 Pioneer Electronic Corp デジタルオーディオ信号処理装置
DE102008036924B4 (de) 2008-08-08 2011-04-21 Gunnar Kron Verfahren zur Mehrkanalbearbeitung in einem Mehrkanaltonsystem

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2439863A1 (de) * 1973-08-20 1975-03-06 Sansui Electric Co Vierkanal-dekodiermatrix
US20120263306A1 (en) * 2011-04-18 2012-10-18 Paul Blair McGowan Acoustic Spatial Projector

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
UNKNOWN: "A single unit, four-channel pre/main amplifier for the creation of a living presence quadraphonic sound field.", 9 June 2010 (2010-06-09), Internet, XP055333424, Retrieved from the Internet <URL:http://www.vintageshifi.com/repertoire-pdf/pdf/telecharge.php?pdf=Pioneer-QA-800-Brochure.pdf> [retrieved on 20170109] *

Also Published As

Publication number Publication date
JP6438892B2 (ja) 2018-12-19
SG11201506075UA (en) 2015-09-29
CN104969575B (zh) 2018-03-23
KR20150114508A (ko) 2015-10-12
CN104969575A (zh) 2015-10-07
US20150382125A1 (en) 2015-12-31
US9628932B2 (en) 2017-04-18
EP2952016A1 (fr) 2015-12-09
KR102089821B1 (ko) 2020-03-17
JP2016509427A (ja) 2016-03-24
WO2014117867A1 (fr) 2014-08-07

Similar Documents

Publication Publication Date Title
DE69827775T2 (de) Tonkanalsmischung
DE602005006385T2 (de) Vorrichtung und verfahren zum konstruieren eines mehrkanaligen ausgangssignals oder zum erzeugen eines downmix-signals
DE69433258T2 (de) Raumklangsignalverarbeitungsvorrichtung
EP2206113B1 (fr) Dispositif et procédé permettant de générer un signal multicanal par traitement d&#39;un signal vocal
DE602005005186T2 (de) Verfahren und system zur schallquellen-trennung
EP2036400B1 (fr) Génération de signaux décorrélés
DE19715498B4 (de) Stereoklangbildverbesserungsvorrichtungen und -verfahren unter Verwendung von Tabellen
DE112012006457B4 (de) Frequenzcharakteristikmodifikationsgerät
DE112011100216T5 (de) Dynamische Bassverbesserung auf Kompressionsvorrichtungsbasis mit EQ
EP2939445B1 (fr) Production de signaux audio 3d
WO2015049334A1 (fr) Procédé et dispositif de downmixage d&#39;un signal multicanaux et d&#39;upmixage d&#39;un signal downmixé
WO2015049332A1 (fr) Dérivation de signaux multicanaux à partir de deux signaux primaires ou plus
DE102019135690B4 (de) Verfahren und Vorrichtung zur Audiosignalverarbeitung für binaurale Virtualisierung
EP2917908A1 (fr) Codage inverse non linéaire de signaux multicanaux
DE19632734A1 (de) Verfahren und Vorrichtung zum Generieren eines Mehrton-Signals aus einem Mono-Signal
EP2952016B1 (fr) Procédé de traitement du son multicanal dans un système à son multicanal
DE19645867A1 (de) Verfahren zur mehrkanaligen Tonübertragung
DE10148351A1 (de) Verfahren und Vorrichtung zur Auswahl eines Klangalgorithmus
DE112019004139T5 (de) Signalverarbeitungsvorrichtung, signalverarbeitungsverfahren und programm
DE69025092T2 (de) Vorrichtung zum Steuern der akustischen Übertragungsdaten
DE102010015630B3 (de) Verfahren zum Erzeugen eines abwärtskompatiblen Tonformates
WO2015128376A1 (fr) Détermination résiduelle autonome et gain de signaux supplémentaires d&#39;alarmes résiduelles
EP3275212B1 (fr) Procédé d&#39;analyse et de décomposition de signaux audio stéréophoniques
DE756615C (de) Stereophonische UEbertragung von Tonschwingungen
DE112019004193T5 (de) Audiowiedergabevorrichtung, audiowiedergabeverfahren und audiowiedergabeprogramm

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150903

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20160909

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KRONOTON GMBH

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20171201

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1047474

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502013011168

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181227

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190126

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190126

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502013011168

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190627

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1047474

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502013011168

Country of ref document: DE

Representative=s name: MEISSNER BOLTE PATENTANWAELTE RECHTSANWAELTE P, DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CZ

Payment date: 20230227

Year of fee payment: 12

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230608

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240227

Year of fee payment: 12

Ref country code: GB

Payment date: 20240222

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240221

Year of fee payment: 12