EP1989705B1 - Method for limiting adaptive excitation gain in an audio decoder - Google Patents
Method for limiting adaptive excitation gain in an audio decoder Download PDFInfo
- Publication number
- EP1989705B1 EP1989705B1 EP07731604A EP07731604A EP1989705B1 EP 1989705 B1 EP1989705 B1 EP 1989705B1 EP 07731604 A EP07731604 A EP 07731604A EP 07731604 A EP07731604 A EP 07731604A EP 1989705 B1 EP1989705 B1 EP 1989705B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- gain
- adaptive excitation
- long
- error indication
- decoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
- 230000005284 excitation Effects 0.000 title claims abstract description 92
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 44
- 238000000034 method Methods 0.000 title claims description 47
- 230000007774 longterm Effects 0.000 claims abstract description 42
- 230000005540 biological transmission Effects 0.000 claims abstract description 19
- 230000005236 sound signal Effects 0.000 claims abstract description 8
- 238000012886 linear function Methods 0.000 claims description 3
- 230000005279 excitation period Effects 0.000 claims 2
- 241000897276 Termes Species 0.000 description 13
- 238000001914 filtration Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 239000013598 vector Substances 0.000 description 8
- 230000015572 biosynthetic process Effects 0.000 description 7
- 238000003786 synthesis reaction Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 4
- 230000001186 cumulative effect Effects 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 239000003607 modifier Substances 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 101100422780 Caenorhabditis elegans sur-5 gene Proteins 0.000 description 1
- 101100379142 Mus musculus Anxa1 gene Proteins 0.000 description 1
- 241001237745 Salamis Species 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001955 cumulated effect Effects 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 235000015175 salami Nutrition 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G10L19/083—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being an excitation gain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/005—Correction of errors induced by the transmission channel, if related to the coding algorithm
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
Definitions
- the present invention relates to a method of limiting adaptive excitation gain in a decoder of an audio signal. It also relates to a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter.
- the invention finds an advantageous application in the field of coding and decoding of digital signals such as audio-frequency signals.
- the invention is particularly well suited to the transmission of speech and / or audio signals over packet networks, of the VoIP type, for example, to provide an acceptable quality during decoding after a loss of packets, in particular avoiding the saturation of the data.
- CELP encoder is the G.729 system recommended in the ITU-T, designed for voiceband speech between 300 and 3400 Hz sampled at 8 kHz and transmitted at a fixed rate of 8 kbit / s with frames of 10 ms.
- the detailed operation of this encoder is specified in the article of A: Salami, C. Laflamme, JP Adoul, A. Kataoka, S. Hayashi, T. Moriya, C. Lamblin, D. Massaloux, S. Proust, P. Kroon and Y. Shoham.
- CS-ACELP a toll quality 8 kb / s speech coder
- FIG. 1 (a) is represented a high level view of a G.729 encoder.
- This figure shows a high-pass filtering 101 of pre-processing for removing frequency signals below 50 Hz.
- the speech signal S (n) thus filtered is then analyzed by the block 102 to determine a filter ( z) Linear Prediction Coding (LPC), which is transmitted to the multiplexer 104 in the form of an index indexing the quantized vector (QV) in a dictionary.
- LPC Linear Prediction Coding
- the original signal S (n) filtered by the filter ⁇ (z) is processed by the block 103 in order to extract the parameters mentioned in the table of the figure 2 . These parameters are then coded and then transmitted to the MUX multiplexer 104.
- the excitation thus decoded is shaped by the synthesis filter 120 LPC 1 / ⁇ (z) whose coefficients are decoded by the block 119 in the domain of the spectral line pairs (LSF) and interpolated by subframe 5. ms.
- the reconstructed signal is then processed by an adaptive post-filter 121 and a post-processing high-pass filter 122.
- the decoder of the Figure 1 (c) therefore relies on the source-filter model to synthesize the signal.
- the CELP type encoders In the case of excitation from the long-term prediction LTP filter, and in order to generate an excitation signal capable of rapidly following the signal attacks, the CELP type encoders generally allow the choice of a gain g p pitch greater than 1. As a result, the decoder is locally unstable. However, this instability is controlled by the synthesis analysis model which permanently minimizes the difference between the LTP excitation signal and the original target signal.
- this instability can lead to significant degradation due to the offset between the encoder and the decoder.
- the gain value g p of pitch not received in a frame is generally replaced by the value of g p in the previous frame, and although the variable nature of the speech signal consists of an alternation periods of voices with a pitch gain close to 1 and unvoiced with a pitch gain of less than 1 allows, in general, to limit the potential problems related to this local instability, it remains nonetheless true that, for certain signals, especially the voiced signals, transmission errors in periodic stationary zones can cause significant damage when, for example, the gain g p of replacement is higher than the actual gain and the affected frame is followed by high gain frames, as happens during attacks. This situation can then quickly lead to a saturation of the LTP filter by cumulative effect linked to the recursive character of long-term predictive filtering.
- a first solution to this problem is to limit the gp pitch gain to 1, but this constraint has the effect of degrading the performance of the CELP coders for attacks.
- the technical problem to be solved by the object of the present invention is to propose a method for limiting adaptive excitation gain in a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter. , following a loss of transmission frame between said encoder and said decoder, which would limit the adaptive excitation g p gain, or pitch gain, only in the case where an instability LTP filter is actually noted, and to ensure the best possible compromise between the quality of the decoding and its robustness vis-à-vis the frame loss.
- frame loss is used here to mean the non-reception of a frame as well as the transmission errors in a frame.
- said arbitrary value is equal to a value of the adaptive excitation gain determined during said lost frame by an error concealment algorithm.
- said arbitrary value is equal to the value of the adaptive excitation gain for the non-lost frame preceding said lost frame.
- said arbitrary value is defined from a voicing detection of the previous frame.
- said arbitrary value is equal to 1, otherwise the arbitrary value is equal to 0.
- the excitation is composed of a random noise.
- the method according to the invention has the advantage of modifying the gain g p of pitch only when a possible instability of the LTP filter is detected at the decoder itself and not at the encoder as in known techniques.
- the method of the invention takes into account both the actual state of the decoder and the exact information on the transmission errors reached.
- the method, object of the invention can be used autonomously, that is to say in coding structures that do not provide for limiting the pitch gain at the coder.
- the invention provides that said adaptive excitation gain is supplied to said decoder by an encoder equipped with a gain limitation device.
- the method according to the invention can therefore also be used in combination with a known taming technique, installed at the encoder.
- the prior technique makes it possible to limit the long sequences of pitch gains greater than 1. Indeed, such sequences cause a large propagation of the error, forcing the method of the invention to modify the signal over long periods.
- a too low trigger threshold of the "taming" technique a priori degrades the signal.
- the invention thus makes it possible to reduce the number of triggers of the "taming" technique a priori by increasing the threshold, because even if this technique does not detect the risk of explosion, the posterior method according to the invention detects it and cure it.
- the order N of the LTP filter can be taken as 1.
- the gain g p of adaptive excitation of a long-term predictive filter of order 1 is limited to the value 1 if said parameter of indication of error is greater than said given threshold.
- the invention provides that a correction factor is applied to the gains g i of adaptive excitation of a long-term predictive filter of order greater than 1 if said error indication parameter is greater than said given threshold.
- said at least one adaptive excitation gain is limited by a linear function of said given threshold if said error indication parameter is greater than said threshold.
- the invention also relates to a program comprising instructions recorded on a computer-readable medium for carrying out the steps of the method according to the invention, when said program is executed on a computer.
- the invention finally relates to a decoder of an audio signal encoded by means of an encoder comprising the features of claim 11.
- Adaptive excitation depends solely on the past excitation and makes it possible to efficiently model the periodic signals, especially voiced signals, where the excitation itself is repeated almost periodically.
- the fixed part c (n) brings the innovation in the total excitation to model the difference between the periods, that is to say to correct the error between the adaptive excitation and the prediction residue.
- this excitation signal is optimized to the encoder using the technique of synthesis analysis.
- the synthesis filtering of this excitation is thus performed with the quantized filter to check the result that will be obtained at the decoder.
- This explains why it is possible to use a locally unstable long-term filtering, that is with a value of g p greater than 1, to model a signal attack because the increase in energy due to this instability is controlled. On the other hand, this control is disturbed by the possible frame losses.
- the error concealment algorithm uses an estimated excitation signal from the past excitation signal.
- the decoder comprises a processing line of the excitation signal from the demultiplexer 112 constituted by the blocks 211 to 215.
- This processing line of the decoder thus described also serves to illustrate the main steps of the adaptive excitation gain limiting method according to the invention.
- a module 213 calculates from the values of the function x t (n) provided by the module 212, an error indication parameter S t .
- a comparator 214 checks whether the parameter S t does not exceed a certain threshold S 0 . In case of overshoot and if the decoded pitch gain g p is greater than 1, the value of g p is limited, because in this case there is a risk of saturation of the LTP filter.
- the error indication parameter S t may be the sum of the values of the function x t (n) , or the maximum value, the average or the sum of the squares of these values.
- the comparator 214 is followed by a discriminator 215 able to determine the value g ' t of the pitch gain to be applied to the block 117 for the current frame, namely the decoded pitch value g p or a limited value.
- the LTP, P and g p parameters are transmitted for each 5 ms subframe containing 40 samples.
- the treatment to avoid saturation of the LTP filter, which is the subject of the invention, is also carried out at the rate of the subframes.
- the error indication parameter S t for example the sum of the function x t (n) , is calculated for each subframe.
- the memory of the signal x t (n) is updated with the new value g ' t .
- the pitch gain of the current sub-frame is less than 1 or the value of S t is less than 80, corresponding to a cumulative error in the long-term weak synthesis filter, the value is not modified.
- the decoded pitch gain and g ' t g t .
- the long-term filter of the encoder is a filter of order 1.
- the pseudo-LTP filter used to define the error indication function may be the equivalent filter of order 1 or more advantageously a filter identical to that used in the encoder, in particular of the same order.
- the equivalent filter of order 1 is always used.
- the gain g ' t can be calculated in the same way as for a filter of order 1. It then applies the corrective factor g ' t / g e to the gains g i of the higher order filter.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Description
La présente invention concerne un procédé de limitation de gain d'excitation adaptative dans un décodeur d'un signal audio. Elle concerne également un décodeur d'un signal audio codé au moyen d'un codeur comprenant un filtre prédictif à long terme.The present invention relates to a method of limiting adaptive excitation gain in a decoder of an audio signal. It also relates to a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter.
L'invention trouve une application avantageuse dans le domaine du codage et du décodage de signaux numériques tels que les signaux audiofréquences.The invention finds an advantageous application in the field of coding and decoding of digital signals such as audio-frequency signals.
L'invention est particulièrement bien adaptée à la transmission de signaux de parole et/ou audio sur réseaux de paquets, de type voix sur IP par exemple, pour fournir une qualité acceptable lors du décodage après une perte de paquets en évitant notamment la saturation des filtres prédictifs à long terme (LTP pour « Long Term Prediction ») utilisés au décodage dans le contexte de codage CELP (« Code Exciting Linear Prediction »).The invention is particularly well suited to the transmission of speech and / or audio signals over packet networks, of the VoIP type, for example, to provide an acceptable quality during decoding after a loss of packets, in particular avoiding the saturation of the data. Long Term Prediction (LTP) filters used for decoding in the Code Exciting Linear Prediction (CELP) context.
On peut citer comme exemple de codeur CELP le système G.729 recommandé à l'UIT-T, conçu pour des signaux de parole en bande téléphonique entre 300 et 3400 Hz échantillonnés à 8 kHz et transmis à un débit fixe de 8 kbit/s avec des trames de 10 ms. Le fonctionnement détaillé de ce codeur est spécifié dans l'article de
Sur la
Le signal original S(n) filtré par le filtre Â(z), appelé alors excitation, est traité par le bloc 103 de manière à en extraire les paramètres mentionnés sur le tableau de la
Le fonctionnement du bloc 103 de codage de l'excitation est détaillé à la
- dans une première étape, un filtrage de prédiction à long terme (LTP) est effectué par les
106, 107, 110 Le filtre LTP du codeur G.729 est un filtre d'ordre égal à 1. La période P d'excitation adaptative, ou période de « pitch », exprimée en valeur entière P0 complétée éventuellement par une valeur fractionnaire P0 _fractionnaire, ainsi que le gain gp d'excitation adaptative, ou gain de « pitch », sont déterminés par analyse par synthèse de façon à minimiser l'erreur entre le signal d'excitation cible issu dublocs bloc 105 et le signal synthétisé donné par x(n) = gp.x(n-P), n représentant un échantillon du signal, - puis, dans une deuxième étape, la différence résiduelle entre ces deux signaux est modélisée, d'une part, par un code fixe c(n), ou code innovateur, extrait d'un dictionnaire innovateur ACELP 108 à quatre impulsions ± 1, et, d'autre part, par un gain gc d'excitation fixe 109. Le code fixe c(n) et la gain gc sont déterminés en minimisant en 111' l'erreur entre le signal résiduel issu de l'étage de LTP précédent et le signal gc.c(n),
- enfin, dans une dernière étape, les paramètres résultant, à savoir la période P de pitch, le code fixe c(n) et les gains gp de pitch et gc d'excitation fixe, sont codés et transmis au
multiplexeur 104.
- in a first step, a long-term prediction filtering (LTP) is performed by the
106, 107, 110 The LTP filter of the G.729 encoder is a filter of order equal to 1. The period P of adaptive excitation , or "pitch" period, expressed as an integer value P 0 supplemented optionally by a fractional fraction P 0 -fractional value, as well as the gain g p of adaptive excitation, or "pitch" gain, are determined by synthesis analysis of minimizing the error between the target excitation signal fromblocks block 105 and the synthesized signal given by x (n) = g p .x (nP) , n representing a sample of the signal, - then, in a second step, the residual difference between these two signals is modeled, on the one hand, by a fixed code c (n) , or innovative code, extracted from an innovatory dictionary ACELP 108 with four pulses ± 1, and on the other hand, by a fixed
excitation gain g c 109. The fixed code c (n) and the gain g c are determined by minimizing the error between the residual signal from the LTP stage at 111 '. previous and the signal g c .c (n), - finally, in a last step, the resulting parameters, namely the pitch period P , the fixed code c (n) and the gains g p of pitch and g c of fixed excitation, are coded and transmitted to the
multiplexer 104.
La
- une première contribution résultant du
décodage 115 de la période P de pitch et dudécodage 118 du gain gp de pitch pour reconstituer en sortie des 116, 117 le signal LTP d'excitation adaptative x(n) = gp.x(n-P),blocs - une deuxième contribution résultant du
décodage 113 de l'excitation fixe c(n) mise à l'échelle par le gain ge décodé par lebloc 118 pour reconstituer l'excitation fixe ge .c(n). - ces deux contributions sont ensuite additionnées pour fournir l'excitation décodée x(n) = gp.x(n-P) + ge.c(n).
- a first contribution resulting from the
decoding 115 of the pitch period P and thedecoding 118 of the gain g p of pitch to reconstitute at the output of the 116, 117 the adaptive excitation LTP signal x (n) = g p .x (nP ) ,blocks - a second contribution resulting from the
decoding 113 of the fixed excitation c (n) scaled by the gain g e decoded by theblock 118 to reconstitute the fixed excitation g e . c (n) . - these two contributions are then added to provide the decoded excitation x (n) = g p .x (nP) + g e .c (n).
L'excitation ainsi décodée est mise en forme par le filtre 120 de synthèse LPC 1/Â(z) dont les coefficients sont décodés par le bloc 119 dans le domaine des paires de raies spectrales (LSF) et interpolés par sous-trame de 5 ms. Afin d'améliorer la qualité et masquer certains artefacts de codage, le signal reconstruit est ensuite traité par un post-filtre adaptatif 121 et un filtre passe-haut 122 de post-traitement. Le décodeur de la
Dans le cas de l'excitation issue du filtre LTP de prédiction à long terme, et dans le but de générer un signal d'excitation capable de suivre rapidement les attaques du signal, les codeurs de type CELP autorisent généralement le choix d'un gain gp de pitch supérieur à 1. En conséquence, le décodeur est localement instable. Cependant, cette instabilité est contrôlée par le modèle d'analyse par synthèse qui minimise en permanence l'écart entre le signal d'excitation LTP et le signal cible original.In the case of excitation from the long-term prediction LTP filter, and in order to generate an excitation signal capable of rapidly following the signal attacks, the CELP type encoders generally allow the choice of a gain g p pitch greater than 1. As a result, the decoder is locally unstable. However, this instability is controlled by the synthesis analysis model which permanently minimizes the difference between the LTP excitation signal and the original target signal.
Lors d'erreurs de transmission ou de perte de trames, cette instabilité peut entraîner d'importantes dégradations dues au décalage entre codeur et décodeur. En effet, dans ces circonstances, la valeur de gain gp de pitch non reçue dans une trame est généralement remplacée par la valeur de gp dans la trame précédente, et, bien que la nature variable du signal de parole constitué d'une alternance de périodes voisées avec un gain de pitch proche de 1 et non voisées avec un gain de pitch inférieur à 1 permet, en général, de limiter les problèmes potentiels liés à cette instabilité locale, il n'en reste pas moins vrai cependant que, pour certains signaux, notamment les signaux voisés, des erreurs de transmission dans des zones stationnaires périodiques peuvent provoquer des dégradations importantes lorsque par exemple le gain gp de remplacement est plus élevé que le gain réel et que la trame affectée est suivie de trames à gain élevé, comme cela se produit lors des attaques. Cette situation peut alors entraîner rapidement une saturation du filtre LTP par effet cumulatif lié au caractère récursif du filtrage prédictif à long terme.During transmission or frame loss errors, this instability can lead to significant degradation due to the offset between the encoder and the decoder. Indeed, in these circumstances, the gain value g p of pitch not received in a frame is generally replaced by the value of g p in the previous frame, and although the variable nature of the speech signal consists of an alternation periods of voices with a pitch gain close to 1 and unvoiced with a pitch gain of less than 1 allows, in general, to limit the potential problems related to this local instability, it remains nonetheless true that, for certain signals, especially the voiced signals, transmission errors in periodic stationary zones can cause significant damage when, for example, the gain g p of replacement is higher than the actual gain and the affected frame is followed by high gain frames, as happens during attacks. This situation can then quickly lead to a saturation of the LTP filter by cumulative effect linked to the recursive character of long-term predictive filtering.
Une première solution à ce problème est de limiter le gain gp de pitch à 1, mais cette contrainte a pour effet de dégrader les performances des codeurs CELP pour les attaques.A first solution to this problem is to limit the gp pitch gain to 1, but this constraint has the effect of degrading the performance of the CELP coders for attacks.
D'autres solutions proposent de ne limiter le gain gp de pitch à une valeur inférieure ou égale à 1 que lorsque cela est jugé nécessaire. En particulier:
- La méthode décrite dans le brevet américain n° 5,960,386 peut se décomposer en plusieurs étages situés au codeur. Tout d'abord, une procédure de détection d'une possible instabilité utilisant le gain de pitch préalablement calculé et une moyenne des gains de pitch précédents. Ensuite, dans le cas où il n'y a pas de risque d'instabilité, le gain de pitch préalablement calculé est conservé. Dans le cas contraire, une procédure itérative de contrôle du gain de pitch permet d'adapter ce gain pour éliminer le risque d'instabilité.
- Dans les brevets américains n°
5,893,060 5,987,406 - Dans l'article de R. Salami précité et le brevet américain n°
5'708757 valeur 1, cette vérification est beaucoup plus compliquée pour un filtre à long terme d'ordre supérieur. En effet, la stabilité d'un filtre à long terme utilisant un jeu de gain dépend également de la nature du signal, par exemple du pitch. Donc, le même jeu de gain peut être stable dans une situation et instable dans une autre. C'est pourquoi il est difficile d'estimer la propagation d'une erreur, car la nature d'erreur potentielle ne peut pas être connue au codeur, et il n'est pas simple de détecter les zones potentiellement instables ni de déterminer l'atténuation à appliquer pour rétablir la stabilité du filtre. La solution mise en oeuvre dans la norme G.723.1 est de trouver, par apprentissage, pour chaque vecteur de gain possible du codeur un gain moyen équivalent d'ordre 1. Ces valeurs sont stockées dans un tableau. On utilise donc ce filtre équivalent d'ordre 1 pour estimer l'erreur maximum potentielle accumulée dans le filtre à long terme, et ainsi identifier les zones instables où il faut limiter le gain en cas d'une erreur accumulée importante et calculer le gain à appliquer pour rendre le filtre stable.
- The method described in US Patent No. 5,960,386 can be broken down into several stages located at the encoder. First, a procedure for detecting a possible instability using the previously calculated pitch gain and an average of the previous pitch gains. Then, in the case where there is no risk of instability, the previously calculated pitch gain is retained. In the opposite case, an iterative procedure for controlling the pitch gain makes it possible to adapt this gain to eliminate the risk of instability.
- In US Patents No.
5893060 5987406 - In the article by R. Salami supra and US Patent No.
5'708757 value 1, this check is much more complicated for a filter with long-term higher order. Indeed, the stability of a long-term filter using a gain game also depends on the nature of the signal, for example the pitch. So the same winning game can be stable in one situation and unstable in another. This is why it is difficult to estimate the propagation of an error, because the nature of potential error can not be known to the coder, and it is not easy to detect potentially unstable areas or to determine the attenuation to apply to restore the stability of the filter. The solution implemented in the G.723.1 standard is to find, by learning, for each vector of possible gain of the encoder an equivalent average gain oforder 1. These values are stored in a table. This equivalent filter oforder 1 is then used to estimate the maximum potential error accumulated in the long-term filter, and thus to identify the unstable zones where the gain must be limited in the event of a large accumulated error and to calculate the gain at apply to make the filter stable.
Toutefois, les solutions proposées par ces techniques connues pour éviter le risque de saturation des filtres LTP en cas de pertes ou d'erreurs de transmission posent les problèmes suivants :
- La décision de modifier le gain gp associé à la prédiction à long terme étant réalisée au codeur a priori, il n'est pas possible de contrôler complètement l'état du décodeur et son comportement après une perte de trame, lesquels sont par hypothèse ignorés du codeur. Aussi, les techniques existantes peuvent continuer à générer des dégradations audio au décodage lors d'erreurs de transmission, ceci malgré la décision prise par le codeur de modifier le gain.
- La limitation à 1 du gain gp de pitch associée aux techniques décrites plus haut peut entraîner une légère dégradation de la qualité par exemple sur les attaques qui génèrent normalement des gains supérieurs à 1. Le choix du seuil de déclenchement est en effet un compromis entre qualité et sécurité. Un seuil bas déclencherait la limitation trop souvent, entraînant une dégradation inutile, surtout en cas d'absence d'erreurs de transmission. Inversement, un seuil plus élevé ne garantirait pas une protection suffisante en cas de taux d'erreur élevés.
- Since the decision to modify the gain g p associated with the long-term prediction is carried out at the coder a priori, it is not possible to control completely the state of the decoder and its behavior after a loss of frame, which are supposedly ignored by the encoder. Also, existing techniques can continue to generate audio degradations during decoding during transmission errors, despite the decision made by the coder to change the gain.
- The limitation to 1 of the gain g p of pitch associated with the techniques described above can lead to a slight deterioration of the quality, for example on the attacks which normally generate gains greater than 1. The choice of the triggering threshold is indeed a compromise between quality and safety. A low threshold would trigger the limitation too often, causing unnecessary degradation, especially in the absence of transmission errors. Conversely, a higher threshold would not guarantee sufficient protection in case of high error rates.
Aussi, le problème technique à résoudre par l'objet de la présente invention est de proposer un procédé de limitation de gain d'excitation adaptative dans un décodeur d'un signal audio codé au moyen d'un codeur comprenant un filtre prédictif à long terme, à la suite d'une perte de trame de transmission entre ledit codeur et ledit décodeur, qui permettrait de ne limiter le gain gp d'excitation adaptative, ou gain de pitch, que dans le cas où une instabilité du filtre LTP est effectivement constatée, et d'assurer le meilleur compromis possible entre la qualité du décodage et sa robustesse vis-à-vis des pertes de trame.Also, the technical problem to be solved by the object of the present invention is to propose a method for limiting adaptive excitation gain in a decoder of an audio signal encoded by means of an encoder comprising a long-term predictive filter. , following a loss of transmission frame between said encoder and said decoder, which would limit the adaptive excitation g p gain, or pitch gain, only in the case where an instability LTP filter is actually noted, and to ensure the best possible compromise between the quality of the decoding and its robustness vis-à-vis the frame loss.
La solution au problème technique posé consiste, selon la présente invention, en ce que ledit procédé comprend les étapes correspondantes à la revendication 1.The solution to the technical problem posed consists, in the present invention, in that said method comprises the steps corresponding to claim 1.
D'une manière générale, on entend ici par « perte de trame » aussi bien la non-réception d'une trame que des erreurs de transmission dans une trame.In general, the term "frame loss" is used here to mean the non-reception of a frame as well as the transmission errors in a frame.
Selon un mode de réalisation, ladite valeur arbitraire est égale à une valeur du gain d'excitation adaptative déterminée lors de ladite trame perdue par un algorithme de dissimulation d'erreur.According to one embodiment, said arbitrary value is equal to a value of the adaptive excitation gain determined during said lost frame by an error concealment algorithm.
A titre d'exemple d'algorithme de dissimulation d'erreur, ladite valeur arbitraire est égale à la valeur du gain d'excitation adaptative pour la trame non perdue précédant ladite trame perdue.As an example of an error concealment algorithm, said arbitrary value is equal to the value of the adaptive excitation gain for the non-lost frame preceding said lost frame.
Selon un autre exemple, ladite valeur arbitraire est définie à partir d'une détection de voisement de la trame précédente. Pour une trame voisée, ladite valeur arbitraire est égale à 1, sinon la valeur arbitraire est égale à 0. Dans ce dernier cas, l'excitation est composée d'un bruit aléatoire.In another example, said arbitrary value is defined from a voicing detection of the previous frame. For a voiced frame, said arbitrary value is equal to 1, otherwise the arbitrary value is equal to 0. In the latter case, the excitation is composed of a random noise.
Comme on le verra en détail plus loin, le procédé conforme à l'invention présente l'avantage de ne modifier le gain gp de pitch que lorsqu'une possible instabilité du filtre LTP est détectée au décodeur lui-même et non au codeur comme dans les techniques connues. De plus, le procédé de l'invention prend en compte à la fois l'état réel du décodeur et l'information exacte sur les erreurs de transmission parvenues.As will be seen in detail below, the method according to the invention has the advantage of modifying the gain g p of pitch only when a possible instability of the LTP filter is detected at the decoder itself and not at the encoder as in known techniques. In addition, the method of the invention takes into account both the actual state of the decoder and the exact information on the transmission errors reached.
Le procédé, objet de l'invention, peut être utilisée de manière autonome, c'est-à-dire dans des structures de codage qui ne prévoient pas de limitation du gain de pitch au niveau du codeur.The method, object of the invention, can be used autonomously, that is to say in coding structures that do not provide for limiting the pitch gain at the coder.
Cependant, et de manière avantageuse, l'invention prévoit que ledit gain d'excitation adaptative est fourni audit décodeur par un codeur équipé d'un dispositif de limitation de gain. Le procédé conforme à l'invention peut donc être aussi utilisé en combinaison avec une technique de « taming » a priori connue, installée au codeur. Les avantages des deux techniques sont alors cumulés : la technique a priori permet de limiter les trop longues séquences de gains de pitch supérieurs à 1. En effet, de telles séquences entraînent une importante propagation de l'erreur, contraignant le procédé de l'invention à modifier le signal sur de longues périodes. Cependant un seuil trop bas de déclenchement de la technique de « taming » a priori dégrade le signal. L'invention permet alors de réduire le nombre de déclenchements de la technique de « taming » a priori en augmentant le seuil, car même si cette technique ne détecte pas le risque d'explosion, le procédé a posteriori selon l'invention le détecte et y remédie.However, and advantageously, the invention provides that said adaptive excitation gain is supplied to said decoder by an encoder equipped with a gain limitation device. The method according to the invention can therefore also be used in combination with a known taming technique, installed at the encoder. The advantages of the two techniques are then cumulated: the prior technique makes it possible to limit the long sequences of pitch gains greater than 1. Indeed, such sequences cause a large propagation of the error, forcing the method of the invention to modify the signal over long periods. However, a too low trigger threshold of the "taming" technique a priori degrades the signal. The invention thus makes it possible to reduce the number of triggers of the "taming" technique a priori by increasing the threshold, because even if this technique does not detect the risk of explosion, the posterior method according to the invention detects it and cure it.
Selon l'invention, ladite fonction d'indication d'erreur est de la forme :
où:
- N est l'ordre du filtre prédictif à long terme, généralement impair,
- les gains git sont égaux aux gains d'excitation adaptative gi dudit filtre prédictif à long terme pour les trames reçues ou aux gains d'excitation adaptative g i_FEC (FEC pour « Frame Erasure Concealment») dudit filtre prédictif à long terme dans la trame précédente pour les trames perdues,
- et(n) vaut 0 pour les trames reçues et 1 pour les trames perdues.
- P est la période d'excitation adaptative.
or:
- N is the order of the long-term, generally odd, predictive filter
- the gains g it are equal to the adaptive excitation gains g i of said long-term predictive filter for the received frames or to the adaptive excitation gains g i _ FEC (FEC for "Frame Erasure Concealment") of said long-term predictive filter in the previous frame for lost frames,
- e t (n) is 0 for received frames and 1 for lost frames.
- P is the period of adaptive excitation.
Bien entendu, dans le cas le plus simple, l'ordre N du filtre LTP peut être pris égal à 1.Of course, in the simplest case, the order N of the LTP filter can be taken as 1.
Dans un premier mode de mise en oeuvre du procédé conforme à l'invention, le gain gp d'excitation adaptative d'un filtre prédictif à long terme d'ordre 1 est limité à la valeur 1 si ledit paramètre d'indication d'erreur est supérieur audit seuil donné.In a first embodiment of the method according to the invention, the gain g p of adaptive excitation of a long-term predictive filter of
De même, l'invention prévoit qu'un facteur correctif est appliqué aux gains gi d'excitation adaptative d'un filtre prédictif à long terme d'ordre supérieur à 1 si ledit paramètre d'indication d'erreur est supérieur audit seuil donné.Likewise, the invention provides that a correction factor is applied to the gains g i of adaptive excitation of a long-term predictive filter of order greater than 1 if said error indication parameter is greater than said given threshold. .
Dans un deuxième mode de mise en oeuvre, ledit au moins un gain d'excitation adaptative est limité par une fonction linéaire dudit seuil donné si ledit paramètre d'indication d'erreur est supérieur audit seuil. Cette disposition avantageuse permet de rendre la limitation de gain plus progressive et d'éviter un effet de seuil brutal.In a second embodiment, said at least one adaptive excitation gain is limited by a linear function of said given threshold if said error indication parameter is greater than said threshold. This provision advantage makes it possible to make the gain limitation more progressive and to avoid a sudden threshold effect.
L'invention concerne également un programme comprenant des instructions enregistrées sur un support lisible par un ordinateur pour mettre en oeuvre les étapes du procédé selon l'invention, lorsque ledit programme est exécuté sur un ordinateur.The invention also relates to a program comprising instructions recorded on a computer-readable medium for carrying out the steps of the method according to the invention, when said program is executed on a computer.
L'invention concerne enfin un décodeur d'un signal audio codé au moyen d'un codeur comprenant les caractéristiques de la revendication 11.The invention finally relates to a decoder of an audio signal encoded by means of an encoder comprising the features of claim 11.
La description qui va suivre en regard des dessins annexés, donnés à titre d'exemples non limitatifs, fera bien comprendre en quoi consiste l'invention et comment elle peut être réalisée.
- La
figure 1 (a) est un schéma de haut niveau d'un codeur G.729. - La
figure 1 (b) est un schéma détaillé du bloc de codage de l'excitation du codeur de lafigure 1 (a) . - La
figure 1 (c) est un schéma du décodeur associé au codeur de lafigure 1 (a) . - La
figure 2 est un tableau donnant les divers paramètres de codage du codeur de lafigure 1 (a) - La
figure 3 est un schéma d'un décodeur conforme à l'invention.
- The
Figure 1 (a) is a high-level schema of a G.729 encoder. - The
Figure 1 (b) is a detailed diagram of the coding block of the encoder excitation of theFigure 1 (a) . - The
Figure 1 (c) is a diagram of the decoder associated with the coder of theFigure 1 (a) . - The
figure 2 is a table giving the various coding parameters of the coder of theFigure 1 (a) - The
figure 3 is a diagram of a decoder according to the invention.
L'invention va maintenant être décrite de manière détaillée dans le cadre d'un décodeur G.729 et d'un filtrage de prédiction à long terme LTP d'ordre N=1. Le cas d'un filtre LTP d'ordre N quelconque sera traité à la fin de la présente description.The invention will now be described in detail in the context of a G.729 decoder and long-term prediction filtering LTP of order N = 1. The case of an LTP filter of any order N will be treated at the end of the present description.
On rappelle que le signal d'excitation xc(n) issu du bloc 103 de codage de l'excitation de la
où :
- gp est le gain de l'excitation adaptative ou gain de pitch,
- P est la valeur du pitch ou longueur de la période. Le codeur G.729 utilise une résolution fractionnelle par pas de 1/3 pour les petites valeurs de pitch (P < 85) pour mieux modéliser les sons voisés aigus. L'excitation adaptative avec un pitch fractionnel est obtenue par interpolation avec sur-échantillonnage,
- gc est le gain de l'excitation fixe,
- c(n) est le mot de code fixe, ou innovateur.
or :
- g p is the gain of the adaptive excitation or pitch gain,
- P is the value of the pitch or length of the period. The G.729 encoder uses fractional resolution in 1/3 increments for small pitch values ( P <85) to better model high-pitched voices. Adaptive excitation with a fractional pitch is obtained by interpolation with oversampling,
- g c is the gain of the fixed excitation,
- c (n) is the fixed code word, or innovator.
L'excitation adaptative dépend uniquement de l'excitation passée et permet de modéliser efficacement les signaux périodiques, notamment voisés, où l'excitation elle-même se répète quasi périodiquement. La partie fixe c(n) apporte l'innovation dans l'excitation totale pour modéliser la différence entre les périodes, c'est-à-dire pour corriger l'erreur entre l'excitation adaptative et le résidu de prédiction.Adaptive excitation depends solely on the past excitation and makes it possible to efficiently model the periodic signals, especially voiced signals, where the excitation itself is repeated almost periodically. The fixed part c (n) brings the innovation in the total excitation to model the difference between the periods, that is to say to correct the error between the adaptive excitation and the prediction residue.
Comme on l'a vu plus haut, ce signal d'excitation est optimisé au codeur en utilisant la technique d'analyse par synthèse. On effectue donc le filtrage de synthèse de cette excitation avec le filtre quantifié pour vérifier le résultat qu'on obtiendra au décodeur. Ceci explique pourquoi il est possible d'utiliser un filtrage à long terme localement instable, c'est-à-dire avec une valeur de gp supérieur à 1, pour modéliser une attaque du signal car l'augmentation de l'énergie due à cette instabilité est contrôlée. Par contre, ce contrôle est perturbé par les éventuelles pertes de trame.As seen above, this excitation signal is optimized to the encoder using the technique of synthesis analysis. The synthesis filtering of this excitation is thus performed with the quantized filter to check the result that will be obtained at the decoder. This explains why it is possible to use a locally unstable long-term filtering, that is with a value of g p greater than 1, to model a signal attack because the increase in energy due to this instability is controlled. On the other hand, this control is disturbed by the possible frame losses.
Au décodeur, dans le cas d'une trame perdue, ou erronée, l'algorithme de dissimulation des erreurs utilise un signal d'excitation estimé à partir du signal d'excitation passé. Typiquement, on réutilise uniquement le filtrage à long terme LTP en gardant la dernière valeur du pitch correctement décodéeAt the decoder, in the case of a lost frame, or erroneous, the error concealment algorithm uses an estimated excitation signal from the past excitation signal. Typically, we only reuse the filtering long-term LTP by keeping the last value of the pitch correctly decoded
. On injecte donc une perturbation dans le signal d'excitation du décodeur, noté xd(n). Pour les trames valides suivantes, même si il est possible de décoder correctement tous les paramètres gp , P, gc et c(n) de génération de l'excitation, l'excitation obtenue ne sera pas exacte car l'excitation passée xd(n-P) est perturbée. L'erreur injectée pendant la trame perdue peut donc se propager par la suite sur de nombreuses trames à cause de la récursivité du filtrage à long terme dans les périodes voisées, en particulier quand gp est proche de 1. Par contre, quand gp a une valeur faible ou égale à zéro pendant plusieurs zones non-voisées, l'effet de la perturbation s'affaiblit ou s'annule car le poids du code innovateur c(n) est plus important que le poids du passé.. A disturbance is thus injected into the decoder excitation signal, denoted x d (n). For the following valid frames, even if it is possible to correctly decode all the excitation parameters g p , p , g c and c (n) , the excitation obtained will not be exact because the excitation is past x d (nP) is disturbed. The error injected during the lost frame can therefore propagate later on many frames because of the recursion of the long-term filtering in the voiced periods, in particular when g p is close to 1. By cons, when g p has a low or zero value during several voiceless zones, the effect of the perturbation weakens or vanishes because the weight of the innovating code c (n) is greater than the weight of the past.
Il est donc essentiel de pouvoir estimer l'importance de l'erreur accumulée dans la partie adaptative, due aux erreurs de transmission. A cet effet, il est proposé de modifier selon la
On peut voir sur la
Le bloc 211 est destiné à détecter si une trame est correctement reçue ou non. Ce bloc de détection est suivi d'un module 212 qui effectue une opération analogue à un filtrage à long terme LTP. Plus précisément, le module 212 calcule une fonction xt(n) d'indication d'erreur dont les valeurs sont représentatives de l'erreur accumulée au décodage sur l'excitation adaptative à la suite d'une perte de transmission. Dans un mode de réalisation, cette fonction est donnée par :
où et(n) est égal à :
- 1 pour les trames non reçues ou erronées afin de modéliser l'erreur injectée dans la boucle adaptative,
- 0 pour les trames valides, quand l'erreur se propage uniquement à cause de la récursivité du filtre à long terme.
gt est égal à : - gp_FEC , valeur du gain de pitch de la trame précédente pour les trames non reçues,
- gp pour les trames valides.
where e t (n) is equal to:
- 1 for frames not received or erroneous in order to model the error injected into the adaptive loop,
- 0 for valid frames, when the error propagates only because of the long-term filter recursion.
g t is equal to: - g p_FEC , value of the pitch gain of the previous frame for the frames not received,
- g p for valid frames.
Ensuite, un module 213 calcule à partir des valeurs de la fonction xt(n) fournies par le module 212, un paramètre St d'indication d'erreur. Pour une trame valide, un comparateur 214 vérifie si le paramètre St ne dépasse pas un certain seuil S0 . En cas de dépassement et si le gain gp de pitch décodé est supérieur à 1, la valeur de gp est limitée, car dans ce cas il y a risque de saturation du filtre LTP.Then, a
Le paramètre St d'indication d'erreur peut être la somme des valeurs de la fonction xt(n), ou bien la valeur maximale, la moyenne ou la somme des carrés de ces valeurs.The error indication parameter S t may be the sum of the values of the function x t (n) , or the maximum value, the average or the sum of the squares of these values.
Le comparateur 214 est suivi d'un discriminateur 215 apte à déterminer la valeur g't du gain de pitch à appliquer au bloc 117 pour la trame en cours, à savoir la valeur gp de pitch décodée ou une valeur limitée.The
Dans le cas où le paramètre St dépasse le seuil S0 et si le gain gp de pitch décodé est supérieur à 1, le gain g't peut être limité systématiquement à 1 par exemple, quelle que soit l'ampleur du dépassement. Mais on peut également prévoir une limitation plus progressive qui consiste à définir le gain g't comme une fonction linéaire du paramètre St de la forme :
S étant un coefficient arbitraire permettant d'ajuster la pente de la variation de g't avec St .In the case where the parameter S t exceeds the threshold S 0 and the decoded pitch gain g p is greater than 1, the gain g ' t can be systematically limited to 1 for example, regardless of the magnitude of the overshoot. But we can also provide a more progressive limitation which consists in defining the gain g ' t as a linear function of the parameter S t of the form:
S being an arbitrary coefficient for adjusting the slope of the variation of g ' t with S t .
Il est également possible de prévoir une limitation du gain par rapport à deux seuils successifs, avec une limitation linéaire entre les deux seuils et une limitation à 1 au-delà du deuxième, comme cela est illustré dans l'exemple suivant.It is also possible to provide a limitation of the gain with respect to two successive thresholds, with a linear limitation between the two thresholds and a limitation to 1 beyond the second, as illustrated in the following example.
A titre d'exemple pratique, pour une trame valide, les paramètres LTP, P et gp , sont transmis pour chaque sous-trame de 5 ms contenant 40 échantillons. Le traitement pour éviter la saturation du filtre LTP, objet de l'invention, est également réalisé à la cadence des sous-trames. Le paramètre St d'indication d'erreur, par exemple la somme de la fonction xt(n), est calculé pour chaque sous-trame. La valeur de ce paramètre est limitée à 120, ce qui correspond à une valeur moyenne de 3 :
Si le gain de pitch de la sous-trame courante est supérieur à 1 et la valeur de St est supérieure à un seuil de 80, correspondant à une valeur moyenne des échantillons xt(n) supérieure à 2, ce qui montre que l'erreur cumulée est importante, on diminue la valeur du gain de pitch selon l'équation suivante:
Pour la valeur maximale de St (St = 120) le nouveau gain de pitch sera g't =1, pour les autres valeurs de St 80 <St <120, 1 >g't >gt .For the maximum value of S t ( S t = 120) the new pitch gain will be g ' t = 1, for the other values of S t 80 < S t <120, 1>g' t > g t .
Quand la valeur du gain de pitch est modifiée par le procédé décrit ci-dessus, on effectue une mise à jour de la mémoire du signal xt(n) avec la nouvelle valeur g't .When the value of the pitch gain is modified by the method described above, the memory of the signal x t (n) is updated with the new value g ' t .
Au contraire, si le gain de pitch de la sous-trame actuelle est inférieur à 1 ou la valeur de St est inférieure à 80, correspondant à une erreur cumulée dans le filtre de synthèse à long terme faible, on ne modifie pas la valeur du gain de pitch décodée et g't =gt .On the contrary, if the pitch gain of the current sub-frame is less than 1 or the value of S t is less than 80, corresponding to a cumulative error in the long-term weak synthesis filter, the value is not modified. the decoded pitch gain and g ' t = g t .
Finalement, pour générer l'excitation du filtre de synthèse, à la place du gain de pitch décodé on utilise g't :
Dans l'exemple de réalisation présenté ici, le filtre à long terme du codeur est un filtre d'ordre 1. Cependant, si le codeur utilise un filtre à long terme LTP d'ordre N supérieur, comme par exemple pour le codeur G.723.1, le pseudo-filtre LTP utilisé pour définir la fonction d'indication d'erreur peut être le filtre équivalent d'ordre 1 ou plus avantageusement un filtre identique à celui utilisé dans le codeur, en particulier de même ordre. Pour identifier pendant les trames valides les zones instables où il convient de limiter le gain en cas d'une erreur cumulée importante et pour déterminer l'atténuation nécessaire, on utilise toujours le filtre équivalent d'ordre 1.In the exemplary embodiment presented here, the long-term filter of the encoder is a filter of
Dans le cas où le paramètre St dépasse le seuil S0 et si le gain équivalent gc est supérieur à 1, le gain g't peut être calculé de la même manière que pour un filtre d'ordre 1. On applique alors le facteur correctif g' t/ ge aux gains gi du filtre d'ordre supérieur.In the case where the parameter S t exceeds the threshold S 0 and if the equivalent gain g c is greater than 1, the gain g ' t can be calculated in the same way as for a filter of
Claims (11)
- Method for limiting the adaptive excitation gain in a decoder of an audio signal coded by a coder comprising a long-term predictive filter, following transmission frame loss between said coder and said decoder, characterized in that said method comprises the steps consisting, in the decoder, in:- detecting whether a frame is correctly received or not,- N is the order of the long-term predictive filter,- the gains git are equal to the adaptive excitation gains of said long-term predictive filter for the frames received or to the adaptive excitation gains of said long-term predictive filter in the preceding frame for the frames lost,- et(n) has the value 0 for the frames received and 1 for the frames lost.- P is the adaptive excitation period decoded for the frames received or most recently correctly decoded for the frames lost,- calculating, during the decoding, the values of said error indication function,- calculating an error indication parameter on the basis of said values of the error indication function,- comparing said error indication parameter to at least one given threshold,- applying a limitation to at least one adaptive excitation gain in case of a positive comparison if a gain equivalent to said at least one adaptive excitation gain is greater than a given value.
- Method according to Claim 1, characterized in that said equivalent gain is the adaptive excitation gain gp of a 1st order long-term predictive filter.
- Method according to Claim 1, characterized in that said equivalent gain is the equivalent gain ge of a long-term predictive filter of an order greater than 1.
- Method according to any one of Claims 1 to 3, characterized in that said error indication parameter is a parameter representative of the energy of said error indication function.
- Method according to Claim 4, characterized in that said representative parameter is given by the sum of the values of the error indication function.
- Method according to any one of Claims 1 to 5, characterized in that the adaptive excitation gain gp of a first order long-term predictive filter is limited to the value 1 if said error indication parameter is greater than said given threshold.
- Method according to any one of Claims 1 to 5, characterized in that a corrective factor is applied to the adaptive excitation gains gi of a long-term predictive filter of an order greater than 1 if said error indication parameter is greater than said given threshold.
- Method according to any one of Claims 1 to 5, characterized in that said at least one adaptive excitation gain is limited by a linear function of said given threshold if said error indication parameter is greater than said threshold.
- Method according to any one of Claims 1 to 8, characterized in that said adaptive excitation gain is supplied to said decoder by a coder equipped with a gain limiting device.
- Program comprising instructions stored on a computer-readable medium for implementing the steps of the method according to Claims 1 to 9, when said program is executed on a computer.
- Decoder of an audio signal coded by a coder comprising a long-term predictive filter, characterized in that said decoder comprises:- a block (211) for detecting transmission frame losses,- a module (222) for calculating values of an error indication function, the error indication function being of the form:
in which:- N is the order of the long-term predictive filter,- the gains g it are equal to the adaptive excitation gains of said long-term predictive filter for the frames received or to the adaptive excitation gains of said long-term predictive filter in the preceding frame for the frames lost,- et(n) has the value 0 for the frames received and 1 for the frames lost,- P is the adaptive excitation period decoded for the frames received or most recently correctly decoded for the frames lost,- a module (213) for calculating an error indication parameter on the basis of said values of the error indication function,- a comparator (214) for comparing said error indication parameter to at least one given threshold,- a discriminator (215) suitable for determining, according to the result supplied by the comparator (214), a value of at least one adaptive excitation gain to be used by the decoder.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0650688A FR2897977A1 (en) | 2006-02-28 | 2006-02-28 | Coded digital audio signal decoder`s e.g. G.729 decoder, adaptive excitation gain limiting method for e.g. voice over Internet protocol network, involves applying limitation to excitation gain if excitation gain is greater than given value |
PCT/FR2007/050779 WO2007099244A2 (en) | 2006-02-28 | 2007-02-13 | Method for limiting adaptive excitation gain in an audio decoder |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1989705A2 EP1989705A2 (en) | 2008-11-12 |
EP1989705B1 true EP1989705B1 (en) | 2012-08-15 |
Family
ID=36407997
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07731604A Not-in-force EP1989705B1 (en) | 2006-02-28 | 2007-02-13 | Method for limiting adaptive excitation gain in an audio decoder |
Country Status (7)
Country | Link |
---|---|
US (1) | US8180632B2 (en) |
EP (1) | EP1989705B1 (en) |
JP (1) | JP4988774B2 (en) |
KR (1) | KR101372460B1 (en) |
CN (1) | CN101395659B (en) |
FR (1) | FR2897977A1 (en) |
WO (1) | WO2007099244A2 (en) |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7877253B2 (en) * | 2006-10-06 | 2011-01-25 | Qualcomm Incorporated | Systems, methods, and apparatus for frame erasure recovery |
CN101604525B (en) * | 2008-12-31 | 2011-04-06 | 华为技术有限公司 | Pitch gain obtaining method, pitch gain obtaining device, coder and decoder |
WO2011047887A1 (en) * | 2009-10-21 | 2011-04-28 | Dolby International Ab | Oversampling in a combined transposer filter bank |
CN101969372B (en) * | 2010-10-29 | 2012-11-28 | 上海交通大学 | Frame loss prediction based cellular network uplink video communication QoS (Quality of Service) optimization method |
PT2676267T (en) | 2011-02-14 | 2017-09-26 | Fraunhofer Ges Forschung | Encoding and decoding of pulse positions of tracks of an audio signal |
MY164797A (en) | 2011-02-14 | 2018-01-30 | Fraunhofer Ges Zur Foederung Der Angewandten Forschung E V | Apparatus and method for processing a decoded audio signal in a spectral domain |
CN103620672B (en) * | 2011-02-14 | 2016-04-27 | 弗劳恩霍夫应用研究促进协会 | For the apparatus and method of the error concealing in low delay associating voice and audio coding (USAC) |
BR112012029132B1 (en) | 2011-02-14 | 2021-10-05 | Fraunhofer - Gesellschaft Zur Förderung Der Angewandten Forschung E.V | REPRESENTATION OF INFORMATION SIGNAL USING OVERLAY TRANSFORMED |
AU2012217216B2 (en) | 2011-02-14 | 2015-09-17 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Apparatus and method for coding a portion of an audio signal using a transient detection and a quality result |
EP2676266B1 (en) | 2011-02-14 | 2015-03-11 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Linear prediction based coding scheme using spectral domain noise shaping |
KR102138320B1 (en) | 2011-10-28 | 2020-08-11 | 한국전자통신연구원 | Apparatus and method for codec signal in a communication system |
US9449607B2 (en) | 2012-01-06 | 2016-09-20 | Qualcomm Incorporated | Systems and methods for detecting overflow |
US9842598B2 (en) | 2013-02-21 | 2017-12-12 | Qualcomm Incorporated | Systems and methods for mitigating potential frame instability |
EP2922055A1 (en) | 2014-03-19 | 2015-09-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus, method and corresponding computer program for generating an error concealment signal using individual replacement LPC representations for individual codebook information |
EP2922054A1 (en) | 2014-03-19 | 2015-09-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus, method and corresponding computer program for generating an error concealment signal using an adaptive noise estimation |
EP2922056A1 (en) | 2014-03-19 | 2015-09-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus, method and corresponding computer program for generating an error concealment signal using power compensation |
EP2980795A1 (en) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoding and decoding using a frequency domain processor, a time domain processor and a cross processor for initialization of the time domain processor |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5479559A (en) * | 1993-05-28 | 1995-12-26 | Motorola, Inc. | Excitation synchronous time encoding vocoder and method |
US5708757A (en) * | 1996-04-22 | 1998-01-13 | France Telecom | Method of determining parameters of a pitch synthesis filter in a speech coder, and speech coder implementing such method |
US5960386A (en) * | 1996-05-17 | 1999-09-28 | Janiszewski; Thomas John | Method for adaptively controlling the pitch gain of a vocoder's adaptive codebook |
US5987406A (en) * | 1997-04-07 | 1999-11-16 | Universite De Sherbrooke | Instability eradication for analysis-by-synthesis speech codecs |
JP4464488B2 (en) * | 1999-06-30 | 2010-05-19 | パナソニック株式会社 | Speech decoding apparatus, code error compensation method, speech decoding method |
US6636829B1 (en) * | 1999-09-22 | 2003-10-21 | Mindspeed Technologies, Inc. | Speech communication system and method for handling lost frames |
US6574593B1 (en) * | 1999-09-22 | 2003-06-03 | Conexant Systems, Inc. | Codebook tables for encoding and decoding |
CA2388439A1 (en) * | 2002-05-31 | 2003-11-30 | Voiceage Corporation | A method and device for efficient frame erasure concealment in linear predictive based speech codecs |
JP4733939B2 (en) * | 2004-01-08 | 2011-07-27 | パナソニック株式会社 | Signal decoding apparatus and signal decoding method |
WO2006009074A1 (en) * | 2004-07-20 | 2006-01-26 | Matsushita Electric Industrial Co., Ltd. | Audio decoding device and compensation frame generation method |
WO2006098274A1 (en) * | 2005-03-14 | 2006-09-21 | Matsushita Electric Industrial Co., Ltd. | Scalable decoder and scalable decoding method |
US7831421B2 (en) * | 2005-05-31 | 2010-11-09 | Microsoft Corporation | Robust decoder |
CN101213590B (en) * | 2005-06-29 | 2011-09-21 | 松下电器产业株式会社 | Scalable decoder and disappeared data interpolating method |
-
2006
- 2006-02-28 FR FR0650688A patent/FR2897977A1/en not_active Withdrawn
-
2007
- 2007-02-13 US US12/224,566 patent/US8180632B2/en not_active Expired - Fee Related
- 2007-02-13 KR KR1020087023810A patent/KR101372460B1/en active IP Right Grant
- 2007-02-13 EP EP07731604A patent/EP1989705B1/en not_active Not-in-force
- 2007-02-13 CN CN2007800071077A patent/CN101395659B/en not_active Expired - Fee Related
- 2007-02-13 WO PCT/FR2007/050779 patent/WO2007099244A2/en active Application Filing
- 2007-02-13 JP JP2008556824A patent/JP4988774B2/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
JP4988774B2 (en) | 2012-08-01 |
KR101372460B1 (en) | 2014-03-11 |
EP1989705A2 (en) | 2008-11-12 |
JP2009528563A (en) | 2009-08-06 |
CN101395659A (en) | 2009-03-25 |
KR20080102262A (en) | 2008-11-24 |
WO2007099244A2 (en) | 2007-09-07 |
CN101395659B (en) | 2012-11-07 |
FR2897977A1 (en) | 2007-08-31 |
WO2007099244A3 (en) | 2007-10-25 |
US20090204412A1 (en) | 2009-08-13 |
US8180632B2 (en) | 2012-05-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1989705B1 (en) | Method for limiting adaptive excitation gain in an audio decoder | |
CA2285650C (en) | Method for decoding an audio signal with transmission error correction | |
EP1316087B1 (en) | Transmission error concealment in an audio signal | |
EP2586133B1 (en) | Controlling a noise-shaping feedback loop in a digital audio signal encoder | |
EP1994531B1 (en) | Improved celp coding or decoding of a digital audio signal | |
EP2867893B1 (en) | Effective pre-echo attenuation in a digital audio signal | |
FR2907586A1 (en) | Digital audio signal e.g. speech signal, synthesizing method for adaptive differential pulse code modulation type decoder, involves correcting samples of repetition period to limit amplitude of signal, and copying samples in replacing block | |
WO2008049221A1 (en) | Method and device for coding transition frames in speech signals | |
EP2080194B1 (en) | Attenuation of overvoicing, in particular for generating an excitation at a decoder, in the absence of information | |
EP2153438B1 (en) | Post-processing for reducing quantification noise of an encoder during decoding | |
FR2977439A1 (en) | WINDOW WINDOWS IN ENCODING / DECODING BY TRANSFORMATION WITH RECOVERY, OPTIMIZED IN DELAY. | |
EP0801790A1 (en) | Speech coding method using synthesis analysis | |
FR3024582A1 (en) | MANAGING FRAME LOSS IN A FD / LPD TRANSITION CONTEXT | |
EP2347411B1 (en) | Pre-echo attenuation in a digital audio signal | |
EP3138095A1 (en) | Improved frame loss correction with voice information | |
EP2652735B1 (en) | Improved encoding of an improvement stage in a hierarchical encoder | |
CA2304013A1 (en) | Method for conditioning a digital speech signal | |
EP2589045B1 (en) | Adaptive linear predictive coding/decoding | |
EP2162883B1 (en) | Limitation of distortion introduced by a post-processing step during digital signal decoding |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080911 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20111013 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 571182 Country of ref document: AT Kind code of ref document: T Effective date: 20120815 Ref country code: CH Ref legal event code: EP Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602007024781 Country of ref document: DE Effective date: 20121011 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20120815 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 571182 Country of ref document: AT Kind code of ref document: T Effective date: 20120815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121215 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121217 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121116 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121126 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20130516 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121115 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PUE Owner name: ORANGE, FR Free format text: FORMER OWNER: FRANCE TELECOM, FR |
|
BERE | Be: lapsed |
Owner name: FRANCE TELECOM Effective date: 20130228 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602007024781 Country of ref document: DE Effective date: 20130516 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130228 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130213 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130213 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20070213 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20160121 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20160121 Year of fee payment: 10 Ref country code: GB Payment date: 20160127 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602007024781 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20170213 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20171031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170901 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170213 |