EP2245622B1 - Verfahren und mittel zur dekodierung von hintergrundrauschinformationen - Google Patents
Verfahren und mittel zur dekodierung von hintergrundrauschinformationen Download PDFInfo
- Publication number
- EP2245622B1 EP2245622B1 EP09712583.5A EP09712583A EP2245622B1 EP 2245622 B1 EP2245622 B1 EP 2245622B1 EP 09712583 A EP09712583 A EP 09712583A EP 2245622 B1 EP2245622 B1 EP 2245622B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- time
- entrance
- broadband
- phase
- dtx
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 47
- 230000007704 transition Effects 0.000 claims description 30
- 230000005540 biological transmission Effects 0.000 description 36
- 230000008859 change Effects 0.000 description 9
- 238000003786 synthesis reaction Methods 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 230000002194 synthesizing effect Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000007794 irritation Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000026683 transduction Effects 0.000 description 1
- 238000010361 transduction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/012—Comfort noise or silence coding
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
Definitions
- the invention relates to methods and means for decoding background noise information in speech signal coding methods.
- Such a limited frequency range is also provided in many speech signal coding methods for today's digital telecommunications.
- a Bandeumbleabegrezung the analog signal Prior to a coding process, a Bandeumbleabegrezung the analog signal is performed for this purpose.
- a codec is used which, due to the described bandwidth limitation in the frequency range between 300 Hz and 3400 Hz, is also referred to below as narrow-band speech codec (Narrow Band Speech Codec).
- the term codec is understood to mean both the coding rule for the digital coding of audio signals and the decoding rule for the decoding of data with the aim of reconstructing the audio signal.
- a narrowband speech codec is known from ITU-T Recommendation G.729.
- a transmission of a narrowband speech signal with a data rate of 8 kbit / s is provided.
- broadband speech codecs Wide Band Speech Codec
- Such an extended frequency range lies for example between a frequency of 50 Hz and 7000 Hz.
- a broadband speech codec is known, for example, from the ITU-T Recommendation G.729.EV.
- coding methods for broadband speech codecs are made scalable.
- a scalability it is meant that the transmitted encoded data exhibits various demarcated blocks containing the narrowband portion, wideband portion and / or full bandwidth of the encoded voice signal.
- such a scalable design allows for backward compatibility on the receiver side and, on the other hand, offers a simple possibility of adapting the data rate and the size of transmitted data frames in the transmission channel in the case of limited data transmission capacities in the transmission channel.
- a compression of the data to be transmitted For a reduction of the data transmission rate by a codec is usually provided a compression of the data to be transmitted. Compression is achieved, for example, by coding methods, in which parameters for an excitation signal and filter parameters are determined for coding the speech data. The filter parameters and parameters specifying the excitation signal are then transmitted to the receiver. There, a synthetic speech signal is synthesized using the codec, which is as similar as possible to the original speech signal in terms of a subjective hearing impression. With the help of this method, also referred to as "analysis-by-synthesis", the determined and digitized samples (samples) are not transmitted themselves, but determined parameters which enable a receiver-side synthesis of the speech signal.
- a further measure for reducing the data transmission rate is provided by a method for discontinuous transmission (Discontinuous Transmission), which is also familiar in the art under the term DTX.
- the fundamental goal DTX is a reduction in the data transfer rate in the event of a speech break.
- a voice pause detection (VAD) is used on the part of the transmitter, which detects when a certain signal level falls below a speech break.
- Comfort noise is noise that is synthesized to fill silence phases on the receiver's side.
- the comfort noise serves as a subjective impression of a continuing connection, without claiming the data transmission rate intended for the transmission of speech signals. In other words, less effort is required to code the speech data for the transmitter-side coding of the noise. For a receiver-side still perceived as realistic synthesis - i.
- Decoding - comfort noise transmits data at a much lower data rate.
- the data transmitted here are also referred to in the art as SID (Silence Insertion Description).
- Said scalable wideband speech codecs usually support different data transmission rates in a bandwidth range of 50 to 7000 Hz.
- Possible data rates for encoding the speech information are e.g. 8, 12, 14, 16, ..., 32 kbit / s, which is e.g. are used in standard G.729.1.
- the data rates of 8 and 12 kbit / s are applied to narrowband signals (50Hz to 4kHz).
- Data rates greater than 12 kbit / s are applied to the upper frequency band of 4 to 7 kHz.
- a sudden change from a narrowband to a broadband data rate is known to cause a disturbing effect on a human recipient.
- Such a transition occurs, for example, as a result of a truncation of the data stream (bitstream transduction), which is caused, for example, by the transmission network between transmitter and receiver, for example as a result of the establishment of further additional connections or due to a congestion in the transmission network.
- bitstream transduction causes, for example, by the transmission network between transmitter and receiver, for example as a result of the establishment of further additional connections or due to a congestion in the transmission network.
- the said truncation leads to a change in the data rate and finally to a transition from a broadband to a narrowband transmission of the speech signal.
- a saving of the data transmission rate for the transmission of the respective data frames is possible.
- the DTX method is used exactly when a corresponding frame is characterized as a speech break.
- a reduced data transfer rate on transmitted frames is achieved due to two factors. First, the encoder does not need to send all inactive frames to the decoder. Second, a transmitted SID frame occupies much fewer bits than a voice data frame.
- Such a method requires involvement of a speech pause recognition (VAD) on the encoder side.
- VAD speech pause recognition
- the encoder on the transmitter side is informed whether a current sample containing and to encoded frame contains a speech signal or a speech break with background noise.
- this characterization measures are taken in the encoder which determine the perceptional characteristics of an inactive frame (Inactive Speech Frame).
- perception characteristics include, for example, the average energy and spectral and temporal characteristics.
- the encoder then sends a specially marked frame, a Silence Insertion Descriptor (SID) frame, to the decoder.
- SID Silence Insertion Descriptor
- the decoder synthesizes comfort noise based on the information contained in a SID frame, and the decoder can determine, based on the SID frame, whether the contained noise information is narrowband or broadband information.
- bit rate switching Changing the bit rate (bit rate switching") between narrowband and wideband information is a common scenario for any scalable wideband speech codec.
- the object of the invention is to specify a method for changing a data rate of SID frames during a speech pause, which results in an improved quality of the signal synthesized on the decoder.
- a basic idea of the invention is to carry out a determination of information about the course of the bit rate switching during an active speech phase.
- the scalable nature of the speech signal coding method or codec used according to the invention expresses while the possibility of the codec for bandwidth switching already off.
- the decoder during the speech phase on the part of the decoder, information is collected on the percentage of broadband active speech frames in comparison to narrow-band active speech frames.
- information on the nature of the background noise is not collected until the time of a change to a speech pause, as has hitherto been suggested by the prior art.
- a higher percentage of broadband active speech frames indicates that a broadband use is preferred by the codec and therefore there is a need to broadly synthesize noise information during a DTX phase, i. to decode.
- narrow-band noise is generated on the decoder's side when entering a DTX phase, even if the received SID frames would allow for synthesizing - i.e. decoding - a wideband noise.
- the object of the invention to provide a method for changing a data rate of SID frames during a speech break more than solved.
- the change to be made between noise information with different data rate according to the object is refined according to the inventive solution presented here into a determination of a proportion of noise information with different data rates.
- the proportion is adjustable in contrast to a change in any ratio between noise information with different data rate.
- the adjustability or adaptability of the noise signal quality to the previously raised speech signal quality results for the entire signal, ie noise and speech signal, on the receiver side overall a significantly increased signal quality.
- the method according to the invention thus achieves the object of the invention to achieve an improved quality of the signal synthesized on the decoder.
- a decision is made that a noise signal having a certain quality (ie, wideband or narrowband) is synthesized during a speech pause a case may occur in which a truncation occurs in the last few frames during an active speech phase on the part of the network the active data frame took place.
- a predominantly narrow-band decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly wideband decoding.
- Such a transition is thus preferably quasi-continuous, with a Transition to discrete times - hence "quasi" -continuous - is set to a certain share factor.
- the codec used was a narrow-band playback mode Favor and / or a broadband transmission in the past by the transmission network was not guaranteed. This may lead to the case that few active speech frames arrive at the receiving decoder as wideband speech frames before receiving first SID frames there.
- a predominantly wideband decoding of the background noise information initially takes place, which after a settable period of time transitions into a predominantly narrowband decoding.
- Such a transition is preferably quasi-continuous analogous to the development described above, wherein a transition to discrete times is set to a certain proportion factor.
- the proportional factor is set with values as above, but in reverse order.
- Fig. 1 is a temporal transmission of Pub Schemerah-5 men with a respective data rate DR and, as of a third time t3, a transmission of SID frames shown.
- a transmission of broadband active speech frames with a data rate of 32 kbit / s.
- a switchover to a data rate of 22 kbit / s and from a second time t2 to a data rate of 12 kbit / s.
- a data rate of 12 kbit / s already corresponds to a narrowband speech frame.
- FIG. 2A and FIG. 2B show two possible scenarios for a progression of the data rate DR over time t.
- FIG. 2A is due to limitations of the network or due to other circumstances a transmission largely narrowband, in the example of Fig. 2A with 8. kbit / s, while at a few points in time, between a first time t1 and a second time t2, exceptionally, a broadband transmission with 32 kbit / s takes place.
- FIG. 2B again, there is a reverse situation, namely a predominantly broadband transmission mode with 32 kbit / s and exceptionally short, between a fourth time t4 and a fifth time t5 takes place, narrow-band transmission.
- Fig. 2A the percentage of broadband active speech frames is to be described as very low, while in the example of Fig. 2B a high percentage Proportion of broadband active speech frames.
- Fig. 3 is a noise signal quality HB-SHARE over a time TIME, which is indicated in ms, plotted.
- the Fig. 3 In this case, a design of the noise signal in connection with a scenario according to the preceding FIG. 2B in which, based on the decoder-side determined percentage of broadband active speech frames, a need has been identified for broadband synthesizing noise information during the DTX phase.
- a further embodiment of the invention analogously provides for a transition from a wideband speech signal to a narrowband noise signal.
- Fig. 2A adopted a slightly modified scenario in which, unlike in Fig. 2A represented scenario shortly before the time t3 still not shown - change to a broadband transmission at 32 kbit / s takes place. Despite this "peak", the percentage of broadband active speech frames remains very low, so that now on transition to the DTX phase, a noise signal is to be synthesized that broadband begins, however - due to the predominantly narrow-band transmission history and thus expected for the future Continuation of the narrow-band transmission character - is to be converted into a narrow-band noise signal.
- the entry into the DTX phase is started with an exclusively broadband signal, ie with a HB-SHARE component of the broadband noise of 1.
- the narrow-band noise component 0.
- the values proposed above are advantageously set in an inverse row. This would correspond to a curve mirrored at the ordinate HB-SHARE Fig. 3 ,
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Telephonic Communication Services (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102008009720A DE102008009720A1 (de) | 2008-02-19 | 2008-02-19 | Verfahren und Mittel zur Dekodierung von Hintergrundrauschinformationen |
PCT/EP2009/051120 WO2009103609A1 (de) | 2008-02-19 | 2009-02-02 | Verfahren und mittel zur dekodierung von hintergrundrauschinformationen |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2245622A1 EP2245622A1 (de) | 2010-11-03 |
EP2245622B1 true EP2245622B1 (de) | 2016-07-13 |
Family
ID=40790517
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09712583.5A Active EP2245622B1 (de) | 2008-02-19 | 2009-02-02 | Verfahren und mittel zur dekodierung von hintergrundrauschinformationen |
Country Status (8)
Country | Link |
---|---|
US (1) | US8260606B2 (zh) |
EP (1) | EP2245622B1 (zh) |
JP (1) | JP5006975B2 (zh) |
KR (1) | KR101166650B1 (zh) |
CN (1) | CN101946281B (zh) |
DE (1) | DE102008009720A1 (zh) |
RU (1) | RU2454737C2 (zh) |
WO (1) | WO2009103609A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2805130C1 (ru) * | 2023-02-03 | 2023-10-11 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный радиотехнический университет имени В.Ф. Уткина" (ФГБОУ "РГРТУ", РГРТУ) | Способ построения адаптивного к акустическим шумам кодека речевых сигналов |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2980790A1 (en) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for comfort noise generation mode selection |
JP2016038513A (ja) * | 2014-08-08 | 2016-03-22 | 富士通株式会社 | 音声切替装置、音声切替方法及び音声切替用コンピュータプログラム |
US10049684B2 (en) * | 2015-04-05 | 2018-08-14 | Qualcomm Incorporated | Audio bandwidth selection |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FI105001B (fi) * | 1995-06-30 | 2000-05-15 | Nokia Mobile Phones Ltd | Menetelmä odotusajan selvittämiseksi puhedekooderissa epäjatkuvassa lähetyksessä ja puhedekooderi sekä lähetin-vastaanotin |
RU2237296C2 (ru) * | 1998-11-23 | 2004-09-27 | Телефонактиеболагет Лм Эрикссон (Пабл) | Кодирование речи с функцией изменения комфортного шума для повышения точности воспроизведения |
US6691084B2 (en) * | 1998-12-21 | 2004-02-10 | Qualcomm Incorporated | Multiple mode variable rate speech coding |
US6631139B2 (en) * | 2001-01-31 | 2003-10-07 | Qualcomm Incorporated | Method and apparatus for interoperability between voice transmission systems during speech inactivity |
EP1808852A1 (en) * | 2002-10-11 | 2007-07-18 | Nokia Corporation | Method of interoperation between adaptive multi-rate wideband (AMR-WB) and multi-mode variable bit-rate wideband (VMR-WB) codecs |
JP4438280B2 (ja) * | 2002-10-31 | 2010-03-24 | 日本電気株式会社 | トランスコーダ及び符号変換方法 |
ES2629727T3 (es) | 2005-06-18 | 2017-08-14 | Nokia Technologies Oy | Sistema y método para la transmisión adaptativa de parámetros de ruido de confort durante la transmisión de habla discontinua |
DE602006018618D1 (de) * | 2005-07-22 | 2011-01-13 | France Telecom | Verfahren zum umschalten der raten- und bandbreitenskalierbaren audiodecodierungsrate |
BRPI0520720A2 (pt) | 2005-11-30 | 2009-06-13 | Ericsson Telefon Ab L M | método para transcodificação de fala de um primeiro esquema de codificação de fala para um segundo esquema de codificação de fala, transcodificador de fala, e, sistema de telecomunicação |
US8260609B2 (en) * | 2006-07-31 | 2012-09-04 | Qualcomm Incorporated | Systems, methods, and apparatus for wideband encoding and decoding of inactive frames |
US8032359B2 (en) * | 2007-02-14 | 2011-10-04 | Mindspeed Technologies, Inc. | Embedded silence and background noise compression |
JP5547081B2 (ja) * | 2007-11-02 | 2014-07-09 | 華為技術有限公司 | 音声復号化方法及び装置 |
CN101335000B (zh) * | 2008-03-26 | 2010-04-21 | 华为技术有限公司 | 编码的方法及装置 |
-
2008
- 2008-02-19 DE DE102008009720A patent/DE102008009720A1/de not_active Withdrawn
-
2009
- 2009-02-02 US US12/867,791 patent/US8260606B2/en active Active
- 2009-02-02 WO PCT/EP2009/051120 patent/WO2009103609A1/de active Application Filing
- 2009-02-02 JP JP2010547138A patent/JP5006975B2/ja not_active Expired - Fee Related
- 2009-02-02 CN CN2009801056374A patent/CN101946281B/zh not_active Expired - Fee Related
- 2009-02-02 EP EP09712583.5A patent/EP2245622B1/de active Active
- 2009-02-02 KR KR1020107020944A patent/KR101166650B1/ko active IP Right Grant
- 2009-02-02 RU RU2010138566/08A patent/RU2454737C2/ru not_active IP Right Cessation
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2805130C1 (ru) * | 2023-02-03 | 2023-10-11 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный радиотехнический университет имени В.Ф. Уткина" (ФГБОУ "РГРТУ", РГРТУ) | Способ построения адаптивного к акустическим шумам кодека речевых сигналов |
Also Published As
Publication number | Publication date |
---|---|
KR20100125340A (ko) | 2010-11-30 |
CN101946281A (zh) | 2011-01-12 |
JP5006975B2 (ja) | 2012-08-22 |
US8260606B2 (en) | 2012-09-04 |
CN101946281B (zh) | 2012-08-15 |
EP2245622A1 (de) | 2010-11-03 |
WO2009103609A1 (de) | 2009-08-27 |
US20110040560A1 (en) | 2011-02-17 |
KR101166650B1 (ko) | 2012-07-23 |
JP2011512564A (ja) | 2011-04-21 |
DE102008009720A1 (de) | 2009-08-20 |
RU2454737C2 (ru) | 2012-06-27 |
RU2010138566A (ru) | 2012-03-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2245621B1 (de) | Verfahren und mittel zur enkodierung von hintergrundrauschinformationen | |
EP0667063B1 (de) | Verfahren zur übertragung und/oder speicherung digitaler signale mehrerer kanäle | |
DE69518174T2 (de) | Rauschkorrektur durch Feststellung der Anwesenheit von Sprachsignalen | |
DE69603743T2 (de) | Verfahren und gerät zum kodieren, behandeln und dekodieren von audiosignalen | |
DE69621613T2 (de) | Anordnung und verfahren zur sprachübertragung und eine derartige anordnung enthaltende fernsprechanlage | |
DE60214599T2 (de) | Skalierbare audiokodierung | |
DE60209637T2 (de) | Steuerung eines Konferenzgespräches | |
DE60117471T2 (de) | Breitband-signalübertragungssystem | |
DE60319590T2 (de) | Verfahren zur codierung und decodierung von audio mit variabler rate | |
DE60120504T2 (de) | Verfahren zur transcodierung von audiosignalen, netzwerkelement, drahtloses kommunikationsnetzwerk und kommunikationssystem | |
EP2122888B1 (de) | Vorrichtung und verfahren zum senden einer folge von datenpaketen und decodierer und vorrichtung zum decodieren einer folge von datenpaketen | |
WO2002063611A1 (de) | Verfahren und vorrichtung zum erzeugen bzw. decodieren eines skalierbaren datenstroms unter berücksichtigung einer bitsparkasse, codierer und skalierbarer codierer | |
EP2245620B1 (de) | Verfahren und mittel zur enkodierung von hintergrundrauschinformationen | |
EP2245622B1 (de) | Verfahren und mittel zur dekodierung von hintergrundrauschinformationen | |
WO2002058054A1 (de) | Verfahren und vorrichtung zum erzeugen eines skalierbaren datenstroms und verfahren und vorrichtung zum decodieren eines skalierbaren datenstroms | |
EP1677286A1 (de) | Verfahren zur Anpassung von Comfort Noise Generation Parametern | |
DE4430864A1 (de) | Verfahren zum unbemerktem Übertragen und/oder Speichern von Zusatzinformationen innerhalb eines quellencodierten, datenreduzierten Audiosignals | |
DE69921643T2 (de) | Av-signalübertragung mit variabler bitrate in einem paketnetz | |
DE60304237T2 (de) | Sprachkodiervorrichtung und Verfahren mit TFO (Tandem Free Operation) Funktion | |
EP1433166A1 (de) | Sprachextender und verfahren zum schätzen eines breitbandigen sprachsignals anhand eines schmalbandigen sprachsignals | |
EP1390947B1 (de) | Verfahren zum signalempfang in einem digitalen kommunikationssystem | |
DE19735675C2 (de) | Verfahren zum Verschleiern von Fehlern in einem Audiodatenstrom | |
DE19906223B4 (de) | Verfahren und Funk-Kommunikationssystem zur Sprachübertragung, insbesondere für digitale Mobilkummunikationssysteme | |
EP1354314A2 (de) | Verfahren und vorrichtung zum erzeugen eines skalierbaren datenstroms und verfahren und vorrichtung zum decodieren eines skalierbaren datenstroms unter berücksichtigung einer bitsparkassenfunktion | |
WO2005034091A1 (de) | Verfahren und anordnung zur audioübertragung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100812 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: TADDEI, HERVE Inventor name: SCHANDL, STEFAN Inventor name: SETIAWAN, PANJI |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: UNIFY GMBH & CO. KG |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 502009012809 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019000000 Ipc: G10L0019012000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/24 20130101ALI20150609BHEP Ipc: G10L 19/012 20130101AFI20150609BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150706 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20151012 |
|
INTG | Intention to grant announced |
Effective date: 20160224 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 812878 Country of ref document: AT Kind code of ref document: T Effective date: 20160715 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502009012809 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: FRITZSCHE PATENTANWAELTE, DE Ref country code: DE Ref legal event code: R081 Ref document number: 502009012809 Country of ref document: DE Owner name: UNIFY GMBH & CO. KG, DE Free format text: FORMER OWNER: UNIFY GMBH & CO. KG, 81379 MUENCHEN, DE |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: UNIFY GMBH & CO. KG |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161113 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161013 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161114 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161014 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502009012809 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161013 |
|
26N | No opposition filed |
Effective date: 20170418 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170228 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 812878 Country of ref document: AT Kind code of ref document: T Effective date: 20170202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20090202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240216 Year of fee payment: 16 Ref country code: GB Payment date: 20240222 Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240221 Year of fee payment: 16 |