EP2245622A1 - Procédés et moyens pour décoder des informations de bruit de fond - Google Patents
Procédés et moyens pour décoder des informations de bruit de fondInfo
- Publication number
- EP2245622A1 EP2245622A1 EP09712583A EP09712583A EP2245622A1 EP 2245622 A1 EP2245622 A1 EP 2245622A1 EP 09712583 A EP09712583 A EP 09712583A EP 09712583 A EP09712583 A EP 09712583A EP 2245622 A1 EP2245622 A1 EP 2245622A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- time
- entering
- phase
- broadband
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 50
- 230000007704 transition Effects 0.000 claims description 31
- 230000002194 synthesizing effect Effects 0.000 abstract description 2
- 230000005540 biological transmission Effects 0.000 description 35
- 230000008859 change Effects 0.000 description 8
- 238000011161 development Methods 0.000 description 5
- 230000018109 developmental process Effects 0.000 description 5
- 238000003786 synthesis reaction Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000007794 irritation Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/012—Comfort noise or silence coding
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
Definitions
- the invention relates to methods and means for decoding background noise information in speech signal coding methods.
- Such a limited frequency range is also provided in many speech signal coding methods for today's digital telecommunications.
- a bandwidth limitation of the analog signal Prior to a coding process, a bandwidth limitation of the analog signal is performed for this purpose.
- a codec is used which, due to the described bandwidth limitation in the frequency range between 300 Hz and 3400 Hz, is also referred to below as narrow-band speech codec (Narrow Band Speech Codec).
- the term codec is understood to mean both the coding rule for the digital coding of audio signals and the decoding rule for the decoding of data with the aim of reconstructing the audio signal.
- a narrowband speech codec is known from ITU-T Recommendation G.729.
- a transmission of a narrow-band voice signal with a data rate of 8 kbit / s is provided.
- Band Speech Codec are known, which provide a coding of one in an extended frequency range to improve the Hor- impressive. Such an extended frequency range lies for example between a frequency of 50 Hz and 7000 Hz.
- a broadband voice codec is for example from the ITU-T Recommendation G.729. EV known.
- Speech codecs made scalable.
- Scalability means that the transmitted coded data contain various demarcated blocks which contain the narrowband component, the broadband component and / or the full bandwidth of the coded voice signal.
- such a scalable design allows for backwards compatibility on the receiver side and, on the other hand, offers a simple possibility of adapting the data rate and the size of transmitted data frames in the transmission channel in the case of limited data transmission capacities.
- a compression of the data to be transmitted is provided. Compression is achieved, for example, by coding methods, in which parameters for an excitation signal and filter parameters are determined for coding the speech data. The filter parameters and parameters specifying the excitation signal are then transmitted to the receiver. There, a synthetic speech signal is synthesized using the codec, which is as similar as possible to the original speech signal with regard to a subjective impression of hearing. With the aid of this method, also known as "analysis-by-synthesis", the determined and digitized samples (samples) are not transmitted themselves but determined parameters which enable a receiver-side synthesis of the speech signal.
- a further measure for reducing the data transmission rate is provided by a method for discontinuous transmission (Discontinuous Transmission), which is also known in the art as DTX.
- the fundamental goal DTX is a reduction in the data transfer rate in the event of a speech break.
- a voice pause detection (VAD) is used on the transmitter side, which detects a pause in speech when the signal falls below a certain signal level.
- VAD voice pause detection
- Comfort noise is noise that is synthesized to fill silence phases on the receiver's side.
- the comfort noise serves as a subjective impression of a continuing connection, without claiming the data transmission rate intended for the transmission of speech signals. In other words, less effort is required to code the speech data for the transmitter-side coding of the noise. For a receiver-side still perceived as realistic synthesis - i.
- Decoding - Comfort noise transmits data at a much lower data rate.
- the data transmitted here are also referred to in the professional world as the SID (Meaning Insertion Description).
- the aforementioned scalable wideband speech codecs usually support different data transmission rates in a bandwidth range of 50 to 7000 Hz.
- Possible data rates for encoding the voice information include 8, 12, 14, 16, ..., 32 kbit / s, which are used, for example, in the G.729.1 standard.
- the data rates of 8 and 12 kbit / s are applied to narrowband signals (50Hz to 4kHz). Data rates greater than 12 kbit / s are applied to the upper frequency band of 4 to 7 kHz.
- a sudden change from a narrowband to a broadband data rate is known to cause a disturbing effect on a human recipient.
- Such a transition occurs, for example, as a result of a truncation of the data stream (bitstream transformation), which is caused, for example, by the transmission network between transmitter and receiver, for example as a result of the establishment of further additional connections or due to a congestion in the transmission network.
- the said clipping leads to a change in the data rate and finally to a transition from a broadband to a narrowband transmission of the speech signal.
- a saving of the data transmission rate for the transmission of the respective data frames is possible.
- the DTX method is used exactly when a corresponding frame is characterized as a speech break.
- a reduced data transmission rate on transmitted frames is achieved due to two factors. First, the encoder does not need to send all inactive frames to the decoder. Second, a transmitted SID frame occupies much fewer bits than a voice data frame.
- VAD Paging detection
- the encoder then sends a specially marked frame, a Silence Insertion Descriptor (SID) frame, to the decoder.
- SID Silence Insertion Descriptor
- the decoder synthesizes comfort noise based on the information contained in a SID frame, and the decoder can determine, based on the SID frame, whether the contained noise information is narrowband or broadband information.
- bit rate switching Changing the bit rate (bit rate switching) between narrowband and wideband information is a common scenario for any scalable wideband speech codec.
- a treatment of a data rate change during a normal speech phase i. in the absence of pauses in speech, although adequately described in the literature, a treatment on entry into a DTX phase is currently still unknown.
- the active speech frames are narrow-band decoded and the background noise is played back in pauses in broadband.
- the object of the invention is to specify a method for changing a data rate of SID frames during a speech pause, which results in an improved quality of the signal synthesized on the decoder.
- a basic idea of the invention is a determination of information about the course of the bandwidth switchover
- information about the percentage of broadband active speech frames in comparison to narrowband active speech frames is collected on the decoder side during the speech phase.
- information on the nature of the background noise is not collected until the time of a change to a speech break, as has hitherto been suggested by the prior art.
- a high percentage of broadband active speech frames indicates that the codec prefers broadband use and therefore there is a need to broadly synthesize noise information during a DTX phase, i. to decode.
- narrow-band noise is generated on the decoder's side when entering a DTX phase, even if the received SID frames require a synthesizer - i. Decoding - would allow a broadband noise.
- the object of the invention to provide a method for changing a data rate of SID frames during a speech break more than solved.
- the change to be made between noise information with different data rate according to the object is refined according to the inventive solution presented here into a determination of a proportion of noise information with different data rates.
- the proportion is adjustable in contrast to a change in any ratio between noise information with different data rate.
- the method according to the invention thus achieves the object of the invention to achieve an improved quality of the signal synthesized on the decoder.
- a decision is made that a noise signal having a certain quality (ie, wideband or narrowband) is synthesized during a speech pause a case may arise in which a truncation occurs in the last few frames during an active speech phase on the part of the network the active data frame took place.
- a predominantly narrow-band decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly wideband decoding.
- Such a transition is thus preferably quasi-continuous, with a Transition to discrete times - hence "quasi" -continuous - is set to a certain share factor.
- the following values for the proportion factor have proven to be particularly advantageous for subjective human hearing: at the time of entering the DTX phase, a proportion factor of 0, and consequently only narrowband noise; at a time of 20 ms after entering the DTX phase, a share factor of 0.09525986892242; at a time of 40 ms after entering the DTX phase, a proportion factor of 0.19753086419753; at a time of 60 ms after entering the DTX phase, a share factor of 0.36595031245237; at a time of 80 ms after entering the DTX phase, a proportion factor of 0.62429507696997; and; at a time of 100 ms after entering the DTX phase, a share factor of 1, hence exclusively broadband
- the codec used preferred a narrow-band reproduction mode and / or a broadband transmission method in the past was not ensured by the transmission network. This may lead to the case that few active speech frames arrive at the receiving decoder as wideband speech frames before receiving first SID frames there.
- a predominantly wideband decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly narrowband decoding.
- Such a transition is preferably quasi-continuous analogous to the development described above, wherein a transition to discrete times is set to a certain proportion factor.
- the proportion factor is set with values as above, but in reverse order.
- Showing: 1 shows a time representation of a data rate between a transmitter and a receiver with a plurality of bandwidth switches and an entry into a speech pause, wherein SID frames are transmitted;
- Fig. 2A is a schematic illustration of a first scenario of bandwidth switching
- FIG. 2B shows a schematic illustration of a second scenario of bandwidth switching
- FIG. 3 A switching process executed on the decoder side with a quasi-continuous transition from a narrow-band to a broad-band noise signal quality.
- FIG. 1 shows a time transmission of voice data frames with a respective data rate DR and, as of a third time t3, a transmission of SID frames.
- a transmission of broadband active speech frames takes place with a data rate of 32 kbit / s. From the time t1, a switchover to a data rate of 22 kbit / s and from a second time t2 to a data rate of 12 kbit / s. A data rate of 12 kbit / s already corresponds to a narrowband speech frame.
- FIG. 2A and FIG. 2B show two possible scenarios for a progression of the data rate DR over time t.
- a transmission is largely narrow-band due to restrictions of the network or due to other circumstances, in the example of FIG. 2A at 8 kbit / s, while at a few points in time, between a first time t 1 and a second time t 2, exceptionally a broadband. dige transmission with 32 kbit / s takes place.
- FIG. 2B again shows a situation in reverse, namely a predominantly wideband transmission mode with 32 kbit / s and an exceptionally short, narrowband transmission method between a fourth time t4 and a fifth time t5.
- information about the proportion of broadband active speech frames in comparison to narrowband active speech frames is collected on the part of the decoder during the speech phase.
- the percentage of broadband active speech frames is to be described as very low, while in the example of FIG. tual proportion of broadband active speech frames.
- FIG. 3 illustrates a design of the noise signal following a scenario according to FIG. 2B, in which a requirement has been determined on the basis of the decoder-side determined percentage share of broadband active speech frames, and broadband noise information during the DTX phase to synthesize.
- Transition from a narrowband speech signal to a broadband noise signal quasi-continuous which has proven to be the most favorable embodiment for a subjective Horempfinden a human recipient, is started at this time TIME with an exclusively narrow-band signal, ie with a proportion HB- SHARE of the wideband noise of 0.
- the wideband noise is 1 or 100%.
- a further embodiment of the invention analogously provides for a transition from a wideband speech signal to a narrowband noise signal.
- a slightly modified scenario is assumed in which, unlike the scenario illustrated in FIG. 2A, shortly before time t3, a change-not shown-to a broadband transmission at 32 kbit / s takes place , Despite this "peak", the percentage of broadband active speech frames remains very low, so that now in transition to the DTX phase, a noise signal is to be synthesized that broadband begins, however - due to the predominantly narrow-band transmission history and thus expected for the future Continuation of the narrow-band transfer character - to be converted into a narrow-band noise signal. To make this transition from a broadband
- an exclusively broadband signal is entered to enter the DTX phase, ie with a HB-SHARE component of the broadband noise of 1.
- the narrow-band noise component is 0
- the values proposed above are advantageously set in an inverse row. This would correspond to a curve mirrored on the ordinate HB-SHARE according to FIG. 3.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Telephonic Communication Services (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102008009720A DE102008009720A1 (de) | 2008-02-19 | 2008-02-19 | Verfahren und Mittel zur Dekodierung von Hintergrundrauschinformationen |
PCT/EP2009/051120 WO2009103609A1 (fr) | 2008-02-19 | 2009-02-02 | Procédés et moyens pour décoder des informations de bruit de fond |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2245622A1 true EP2245622A1 (fr) | 2010-11-03 |
EP2245622B1 EP2245622B1 (fr) | 2016-07-13 |
Family
ID=40790517
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09712583.5A Active EP2245622B1 (fr) | 2008-02-19 | 2009-02-02 | Procédés et moyens pour décoder des informations de bruit de fond |
Country Status (8)
Country | Link |
---|---|
US (1) | US8260606B2 (fr) |
EP (1) | EP2245622B1 (fr) |
JP (1) | JP5006975B2 (fr) |
KR (1) | KR101166650B1 (fr) |
CN (1) | CN101946281B (fr) |
DE (1) | DE102008009720A1 (fr) |
RU (1) | RU2454737C2 (fr) |
WO (1) | WO2009103609A1 (fr) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2980790A1 (fr) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Appareil et procédé de sélection de mode de génération de bruit de confort |
JP2016038513A (ja) * | 2014-08-08 | 2016-03-22 | 富士通株式会社 | 音声切替装置、音声切替方法及び音声切替用コンピュータプログラム |
US10049684B2 (en) * | 2015-04-05 | 2018-08-14 | Qualcomm Incorporated | Audio bandwidth selection |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FI105001B (fi) * | 1995-06-30 | 2000-05-15 | Nokia Mobile Phones Ltd | Menetelmä odotusajan selvittämiseksi puhedekooderissa epäjatkuvassa lähetyksessä ja puhedekooderi sekä lähetin-vastaanotin |
RU2237296C2 (ru) * | 1998-11-23 | 2004-09-27 | Телефонактиеболагет Лм Эрикссон (Пабл) | Кодирование речи с функцией изменения комфортного шума для повышения точности воспроизведения |
US6691084B2 (en) * | 1998-12-21 | 2004-02-10 | Qualcomm Incorporated | Multiple mode variable rate speech coding |
US6631139B2 (en) * | 2001-01-31 | 2003-10-07 | Qualcomm Incorporated | Method and apparatus for interoperability between voice transmission systems during speech inactivity |
EP1808852A1 (fr) * | 2002-10-11 | 2007-07-18 | Nokia Corporation | Procédé d'interopération entre des codecs à large bande à haute vitesse adaptative (AMR-WB) et à large bande à débit binaire variable multimode (VMR-WB) |
JP4438280B2 (ja) * | 2002-10-31 | 2010-03-24 | 日本電気株式会社 | トランスコーダ及び符号変換方法 |
ES2629727T3 (es) | 2005-06-18 | 2017-08-14 | Nokia Technologies Oy | Sistema y método para la transmisión adaptativa de parámetros de ruido de confort durante la transmisión de habla discontinua |
DE602006018618D1 (de) * | 2005-07-22 | 2011-01-13 | France Telecom | Verfahren zum umschalten der raten- und bandbreitenskalierbaren audiodecodierungsrate |
BRPI0520720A2 (pt) | 2005-11-30 | 2009-06-13 | Ericsson Telefon Ab L M | método para transcodificação de fala de um primeiro esquema de codificação de fala para um segundo esquema de codificação de fala, transcodificador de fala, e, sistema de telecomunicação |
US8260609B2 (en) * | 2006-07-31 | 2012-09-04 | Qualcomm Incorporated | Systems, methods, and apparatus for wideband encoding and decoding of inactive frames |
US8032359B2 (en) * | 2007-02-14 | 2011-10-04 | Mindspeed Technologies, Inc. | Embedded silence and background noise compression |
JP5547081B2 (ja) * | 2007-11-02 | 2014-07-09 | 華為技術有限公司 | 音声復号化方法及び装置 |
CN101335000B (zh) * | 2008-03-26 | 2010-04-21 | 华为技术有限公司 | 编码的方法及装置 |
-
2008
- 2008-02-19 DE DE102008009720A patent/DE102008009720A1/de not_active Withdrawn
-
2009
- 2009-02-02 US US12/867,791 patent/US8260606B2/en active Active
- 2009-02-02 WO PCT/EP2009/051120 patent/WO2009103609A1/fr active Application Filing
- 2009-02-02 JP JP2010547138A patent/JP5006975B2/ja not_active Expired - Fee Related
- 2009-02-02 CN CN2009801056374A patent/CN101946281B/zh not_active Expired - Fee Related
- 2009-02-02 EP EP09712583.5A patent/EP2245622B1/fr active Active
- 2009-02-02 KR KR1020107020944A patent/KR101166650B1/ko active IP Right Grant
- 2009-02-02 RU RU2010138566/08A patent/RU2454737C2/ru not_active IP Right Cessation
Non-Patent Citations (1)
Title |
---|
See references of WO2009103609A1 * |
Also Published As
Publication number | Publication date |
---|---|
KR20100125340A (ko) | 2010-11-30 |
CN101946281A (zh) | 2011-01-12 |
JP5006975B2 (ja) | 2012-08-22 |
US8260606B2 (en) | 2012-09-04 |
CN101946281B (zh) | 2012-08-15 |
WO2009103609A1 (fr) | 2009-08-27 |
US20110040560A1 (en) | 2011-02-17 |
KR101166650B1 (ko) | 2012-07-23 |
JP2011512564A (ja) | 2011-04-21 |
DE102008009720A1 (de) | 2009-08-20 |
RU2454737C2 (ru) | 2012-06-27 |
RU2010138566A (ru) | 2012-03-27 |
EP2245622B1 (fr) | 2016-07-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2245621B1 (fr) | Procédé et moyens d encodage d informations de bruit de fond | |
DE69603743T2 (de) | Verfahren und gerät zum kodieren, behandeln und dekodieren von audiosignalen | |
EP0667063B1 (fr) | Procede de transmission et/ou de memorisation de signaux numeriques provenant de plusieurs canaux | |
DE69621613T2 (de) | Anordnung und verfahren zur sprachübertragung und eine derartige anordnung enthaltende fernsprechanlage | |
DE69518174T2 (de) | Rauschkorrektur durch Feststellung der Anwesenheit von Sprachsignalen | |
DE60214599T2 (de) | Skalierbare audiokodierung | |
DE60120504T2 (de) | Verfahren zur transcodierung von audiosignalen, netzwerkelement, drahtloses kommunikationsnetzwerk und kommunikationssystem | |
DE60117471T2 (de) | Breitband-signalübertragungssystem | |
EP1953739B1 (fr) | Procédé et dispositif pour réduire le bruit dans un signal décodé | |
DE60121592T2 (de) | Kodierung und dekodierung eines digitalen signals | |
EP1647010B1 (fr) | Conversion d'un format de fichier audio | |
WO2002063611A1 (fr) | Procede et dispositif pour produire ou decoder un flux de donnees modulable compte tenu d'une banque de bits, codeur et codeur modulable | |
EP0978172B1 (fr) | Procede de masquage des erreurs dans un courant de donnees audio | |
EP2245620B1 (fr) | Procédé et moyens d'encodage d'informations de bruit de fond | |
WO2007087823A1 (fr) | Procédé et dispositifs pour coder un signal audio | |
EP2245622B1 (fr) | Procédés et moyens pour décoder des informations de bruit de fond | |
WO2002058054A1 (fr) | Procede et dispositif pour produire un flux de donnees modulable et procede et dispositif pour decoder un flux de donnees modulable | |
EP1677286A1 (fr) | Procédé pour l'adaptation de paramètres de génération de bruit de confort | |
DE4430864A1 (de) | Verfahren zum unbemerktem Übertragen und/oder Speichern von Zusatzinformationen innerhalb eines quellencodierten, datenreduzierten Audiosignals | |
DE69921643T2 (de) | Av-signalübertragung mit variabler bitrate in einem paketnetz | |
DE60304237T2 (de) | Sprachkodiervorrichtung und Verfahren mit TFO (Tandem Free Operation) Funktion | |
EP1390947B1 (fr) | Procede pour la reception de signaux | |
DE19727938B4 (de) | Verfahren und Vorrichtung zum Codieren von Signalen | |
EP1433166A1 (fr) | Dispositif d'extension vocale et procede pour evaluer un signal vocal a large bande au moyen d'un signal vocal a bande etroite | |
DE10339498A1 (de) | Audiodateiformatumwandlung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100812 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: TADDEI, HERVE Inventor name: SCHANDL, STEFAN Inventor name: SETIAWAN, PANJI |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: UNIFY GMBH & CO. KG |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 502009012809 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019000000 Ipc: G10L0019012000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/24 20130101ALI20150609BHEP Ipc: G10L 19/012 20130101AFI20150609BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150706 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20151012 |
|
INTG | Intention to grant announced |
Effective date: 20160224 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 812878 Country of ref document: AT Kind code of ref document: T Effective date: 20160715 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502009012809 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: FRITZSCHE PATENTANWAELTE, DE Ref country code: DE Ref legal event code: R081 Ref document number: 502009012809 Country of ref document: DE Owner name: UNIFY GMBH & CO. KG, DE Free format text: FORMER OWNER: UNIFY GMBH & CO. KG, 81379 MUENCHEN, DE |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: UNIFY GMBH & CO. KG |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161113 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161013 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161114 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161014 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502009012809 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161013 |
|
26N | No opposition filed |
Effective date: 20170418 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170228 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 812878 Country of ref document: AT Kind code of ref document: T Effective date: 20170202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20090202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240216 Year of fee payment: 16 Ref country code: GB Payment date: 20240222 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240221 Year of fee payment: 16 |