EP1825461B1 - Verfahren und vorrichtung zur künstlichen erweiterung der bandbreite von sprachsignalen - Google Patents
Verfahren und vorrichtung zur künstlichen erweiterung der bandbreite von sprachsignalen Download PDFInfo
- Publication number
- EP1825461B1 EP1825461B1 EP06840370A EP06840370A EP1825461B1 EP 1825461 B1 EP1825461 B1 EP 1825461B1 EP 06840370 A EP06840370 A EP 06840370A EP 06840370 A EP06840370 A EP 06840370A EP 1825461 B1 EP1825461 B1 EP 1825461B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- bandwidth
- extension
- envelope
- decoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000003595 spectral effect Effects 0.000 claims abstract description 73
- 230000002123 temporal effect Effects 0.000 claims abstract description 71
- 230000005284 excitation Effects 0.000 claims description 33
- 238000012937 correction Methods 0.000 claims description 15
- 238000001914 filtration Methods 0.000 claims description 12
- 230000015572 biosynthetic process Effects 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 7
- FGUUSXIOTUKUDN-IBGZPJMESA-N C1(=CC=CC=C1)N1C2=C(NC([C@H](C1)NC=1OC(=NN=1)C1=CC=CC=C1)=O)C=CC=C2 Chemical compound C1(=CC=CC=C1)N1C2=C(NC([C@H](C1)NC=1OC(=NN=1)C1=CC=CC=C1)=O)C=CC=C2 FGUUSXIOTUKUDN-IBGZPJMESA-N 0.000 claims description 3
- 238000013139 quantization Methods 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 claims 4
- 238000007493 shaping process Methods 0.000 description 28
- 230000005540 biological transmission Effects 0.000 description 14
- 230000003321 amplification Effects 0.000 description 10
- 238000003199 nucleic acid amplification method Methods 0.000 description 10
- 238000004422 calculation algorithm Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000006872 improvement Effects 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 230000035807 sensation Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- OVOUKWFJRHALDD-UHFFFAOYSA-N 2-[2-(2-acetyloxyethoxy)ethoxy]ethyl acetate Chemical compound CC(=O)OCCOCCOCCOC(C)=O OVOUKWFJRHALDD-UHFFFAOYSA-N 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000012804 iterative process Methods 0.000 description 1
- 238000012567 pattern recognition method Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/06—Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
Definitions
- the invention relates to a method and a device for artificially expanding the bandwidth of speech signals.
- Speech signals cover a wide frequency range, which ranges from the basic speech frequency, which is dependent on the speaker in the range between 80 to 160 Hz, to the frequencies beyond 10 kHz.
- the basic speech frequency which is dependent on the speaker in the range between 80 to 160 Hz
- the frequencies beyond 10 kHz for voice communication over certain transmission media, such as telephones, only a limited portion is transmitted for bandwidth efficiency, ensuring a sentence intelligibility of about 98%.
- a speech signal can essentially be subdivided into three frequency ranges.
- Each of these frequency ranges characterizes specific speech characteristics as well as subjective sensations.
- lower frequencies below about 300 Hz arise substantially during voiced speech sections, such as vowels.
- This frequency range in this case contains tonal components, i. H. in particular the basic voice frequency and, depending on the pitch, possibly some harmonics.
- these depth frequencies are essential.
- the speech base frequency can be perceived by a human listener due to the psychoacoustic property of the virtual pitch sensation even in the absence of the depth frequencies from the harmonic structure in higher frequency ranges.
- average frequencies in the range of about 300 Hz to about 3.4 kHz are basically for voice activities present in the voice signal.
- Their time-variant spectral coloring by several formants as well as the temporal and spectral fine structure characterize the respective spoken sound or phoneme.
- the middle frequencies carry the bulk of the information relevant to the intelligibility of the language.
- the speech quality is a subjective quantity with a plurality of components, of which the intelligibility of the speech signal is the most important for such a speech communication system.
- parameters of the broadband model are determined from short segments of a narrowband speech signal using pattern recognition methods, which are then used to estimate the missing signal components of the speech.
- a broadband counterpart with frequency components in the range from 50 Hz to 7 kHz is generated from the narrow-band speech signal and an improvement of the subjectively perceived speech quality is effected.
- codecs include both an encoder and a decoder.
- Any digital telephone whether built for a fixed or mobile network, includes such a codec that converts analog to digital signals and digital to analog.
- Such a codec can be implemented in hardware or in software.
- components of an extension band for example in the frequency range of 6.4 to 7 kHz, are encoded and decoded using the LPC encoding technique already mentioned.
- an LPC analysis of the extension band of the input signal is performed in an encoder and the LPC coefficients and the amplification factors of subframes of a residual signal are encoded.
- the remainder of the expansion band is generated and the transmitted gain factors and the LPC synthesis filters are used to generate an output signal.
- the procedure described above can be applied either directly to the broadband input signal or else to a subband signal of the extension band that has been downsampled in the limit range or in the critical range.
- the extended aacPlus encoding standard uses SBR (Spectral Band Replication) technology.
- the broadband audio signal is split into frequency subbands by means of a 64-channel QMF filter bank.
- a sophisticated and technically advanced parametric coding is applied to the sub-bands of the signal components, requiring and using a large number of detectors and estimators to control the bitstream contents.
- the method according to the invention makes it possible to achieve an improvement in speech intelligibility and speech quality in the transmission of speech signals, whereby speech signals are also understood as audio signals.
- the inventive method is also very robust against interference during transmission.
- the signal components required for the bandwidth extension are determined by filtering, in particular bandpass filtering, from the wideband input speech signal, whereby a simple and low-cost selection of the required signal components can be performed.
- Determining the temporal envelopes in step c) is preferably carried out independently of the determination of the spectral envelopes in step d). As a result, the determination of the envelope takes place in a precise manner, whereby a mutual influence can be avoided.
- step e prior to encoding the temporal envelope and the spectral envelope in step e), quantization of the temporal envelope and the spectral envelope is performed.
- the signal powers of spectral subbands of the signal components intended for bandwidth expansion are determined in step d) for determining the spectral envelopes. The determination of the characterization of the temporal and the spectral envelope can thereby be carried out very accurately.
- signal segments of the bandwidth extension are preferably used generated signal components, these signal segments in particular transformed, in particular FF (Fast Fourier) transformed, are.
- the signal powers of temporal signal segments of the signal components intended for bandwidth expansion are advantageously determined in step c) for determining the temporal envelopes. In a labor-saving manner, the determination of the required parameters can thereby be carried out.
- step f) the encoded information for reconstructing the temporal envelope and the spectral envelope are decoded.
- An excitation signal is advantageously generated in a decoder from a signal transmitted to the decoder, the transmitted signal having such a signal power in the frequency range which corresponds to that of the extension signal of the wideband input speech signal, which enables generation of an excitation signal.
- a modulated narrowband signal having a band range with frequencies below the frequencies of the band range of the extension band of the wideband input speech signal for generating the excitation signal is preferably transmitted to the decoder.
- the excitation signal preferably has harmonics of the fundamental frequency of the signal transmitted to the decoder.
- a first correction factor is advantageously determined. Furthermore, a reconstructing shaping of the temporal envelope, in particular by a multiplication of the first correction factor with the excitation signal, is carried out from the first correction factor and the excitation signal. In addition, the reconstructed shaping of the temporal envelopes is filtered in an advantageous manner and impulse responses are generated during filtering. From the impulse responses and the reconstructed shaping the temporal envelope, a reconstructive shaping of the spectral envelope is performed. Furthermore, the signal components of the expansion band of the wideband input speech signal are reconstructed from the reconstructed shaping of the spectral envelope. The reconstruction of the temporal and the spectral envelopes can be carried out very reliably and very accurately.
- a narrow-band signal having a band range with frequencies below the frequencies of the extension band of the broadband input signal is transmitted to the decoder.
- the bandwidth-expanded output speech signal is advantageously determined from the narrow-band signal transmitted to the decoder and the reconstructed shaping of the spectral envelope, in particular from a summation of these two signals, and is provided as the output signal of the decoder.
- an output signal can be generated and provided which ensures high speech intelligibility and speech quality.
- the steps a) to e) are preferably carried out in an encoder, which is preferably arranged in a transmitter.
- the encoded information generated in step e) is advantageously transmitted as a digital signal to the decoder.
- At least step f) is preferably performed in a receiver with the decoder located in the receiver.
- all steps a) to f) of the method according to the invention are carried out in a receiver.
- steps a) to e) in the receiver are replaced by an estimation method (to be implemented differently).
- the steps a) to e) can also be carried out separately in a transmitter.
- the wideband input speech signal advantageously comprises a bandwidth between about 50 Hz and about 7 kHz.
- the extension band of the wideband input speech signal preferably comprises the frequency range of about 3.4 kHz to about 7 kHz.
- the narrowband signal comprises a signal range of the wideband input speech signal of about 50 Hz to about 3.4 kHz.
- the inventive device enables improved speech quality and improved speech intelligibility of speech signals during transmission in communication devices, such as mobile devices or ISDN devices.
- the means in a) to d) are advantageously designed as encoders.
- the encoder can be in a transmitter or in a receiver, wherein the decoder is arranged in a receiver.
- Advantageous embodiments of the method according to the invention can, insofar as it is transferable, also be regarded as advantageous embodiments of the device according to the invention.
- speech signals also includes audio signals.
- the same or functionally identical elements are provided with the same reference numerals.
- FIG. 2 shows a schematic block diagram representation of an encoder 1 of a device according to the invention for artificially expanding the bandwidth of speech signals.
- the coder 1 can be implemented as an algorithm both in hardware and in software.
- the encoder 1 comprises a block 11 which is used for bandpass filtering of a broadband input speech signal s wb i k is trained.
- the encoder 1 comprises a block 12 and a block 13, which are connected to the block 11.
- Block 12 is designed to determine the temporal envelope of the signal components intended for bandwidth expansion, which are determined from an extension band of the wideband input speech signal.
- the block 13 is configured to determine the spectral envelope of the bandwidth expansion signal components determined from the extension band of the wideband input speech signal.
- the block 12 and the block 13 are connected to a block 14, wherein the block 14 for quantizing the temporal envelope and the spectral envelope, which are generated by the blocks 12 and 13, is formed.
- FIG. 1 Furthermore, a block 2 is shown, which is designed as a band-pass filter, and to which the wideband input speech signal s wb i k is created.
- the block 2 is further connected to a further block 3, wherein the block 3 is formed as a further encoder.
- the encoder 1 and the blocks 2 and 3 are arranged in a first telephone set.
- the wideband input speech signal in the embodiment has a bandwidth of about 50 Hz to about 7 kHz.
- this wideband input speech signal s wb i k applied to the bandpass filter or the block 11 of the encoder 1.
- the signal components required for bandwidth expansion from the expansion band which in the exemplary embodiment comprises a bandwidth of about 3.4 kHz to about 7 kHz, are determined.
- the signal components required for the bandwidth expansion are characterized by the signal s eb ( k ) and are transmitted as an output signal of the block 11 to the two blocks 12 and 13.
- the temporal envelope is determined from this signal s eb ( k ).
- the spectral envelope of the signal components which are characterized by the signal s eb ( k ) is determined in block 13.
- the signal s eb ( k ) characterizing the signal components required for the bandwidth extension is first segmented and these windowed signal segments are transformed.
- the segmentation of the signal s eb ( k ) takes place in frames with a length of each k samples. All subsequent steps and subalgorithms are performed frame by frame.
- Each speech frame eg with 10 ms or 20 ms or 30 ms duration
- the windowed signal segments are then transformed.
- a transformation into the frequency domain is carried out by means of an FFT (Fast Fourier Transform).
- N f denotes the FFT length or frame size
- p denotes the frame index
- M f denotes the overlap of the frames of the windowed signal segments.
- w f ( ⁇ ) denotes the window function.
- ⁇ denotes the index of the corresponding subband
- EB ⁇ characterizes that set which contains all FFT interval ranges i with non-zero coefficients in the ⁇ th frequency space window w ⁇ ( i ).
- the signal powers P f ( ⁇ , ⁇ ) of the subbands according to formula 2) characterize the information of the spectral envelopes which are transmitted to a decoder.
- the determination of the time envelopes in the time period is performed in a manner similar to the determination of the spectral envelopes and is based on short-term windowed ones Segments of the bandpass filtered wideband input speech signal s wb i k , Thus, signal segments of the signal s eb ( k ) are also taken into account in the determination of the time envelopes.
- N t denotes the frame length
- ⁇ denotes the frame index
- M t again denotes the overlap of the frames of the signal segments. It should be noted that in general the frame length N t and the overlap of the frames M t used to extract the temporal envelope are respectively smaller and much smaller than the corresponding quantities N f and M f which are used for the determination for the Spectral envelopes are used.
- An alternative for extracting the temporal envelope parameters from the signal s eb ( k ) is to perform a Hilbert transform (90 ° phase shift filter) of the signal s eb ( k ).
- a summation of the short-segment signal powers of the filtered parts and the original parts of the signal s eb ( k ) gives the short term envelope, which is down-sampled to determine the signal powers P t ( v ).
- the signal powers P t (v) of the signal segments then characterize the information of the temporal envelope.
- the output of the block 14 is a digital signal BWE which characterizes a bit stream containing encoded form information of the temporal envelope and the spectral envelope.
- This digital signal BWE is transmitted to a decoder, which will be explained in more detail below. It should be noted that in the case of a redundancy between the extracted parameters of the signal strengths according to formulas 2) and 3), a common coding, such as may be made possible, for example, by vector quantization, can be carried out.
- the broadband input speech signal s wb i k also transferred to the block 2.
- the signal components of a narrowband range of the wideband input speech signal s wb i k filtered.
- the narrowband range is in the embodiment between 50 Hz and 3.4 kHz.
- the output signal of the block 2 is a narrowband signal s nb ( k ) and is transmitted to the block 3, which is formed in the embodiment as a further encoder.
- the narrow-band signal s nb ( k ) is encoded and transmitted as a digital signal BWN as a bit stream to the decoder explained below.
- FIG. 2 shows a schematic block diagram representation of such a decoder 5 of a device according to the invention for artificially expanding the bandwidth of speech signals.
- the digital signal BWN is first transmitted to a further decoder 4 which decodes the information contained in the digital signal BWN and in turn generates the narrowband signal s nb ( k ) from it.
- the decoder 4 generates a further signal s si ( k ) containing side information. These side information may be, for example, gain factors or filter coefficients.
- This signal s si ( k ) is transmitted to a block 51 of the decoder 5.
- the block 51 is formed in the embodiment for generating an excitation signal in the frequency range of the extension band, for which purpose the information of the signal s si ( k ) are taken into account.
- the decoder 5 which is arranged in the embodiment in a receiver, a block 52, which is designed for decoding the signal BWE transmitted over a transmission path between the encoder 1 and the decoder 2. It should be noted that also the digital signal BWN is transmitted via this transmission path between the encoder 1 and the decoder 5. As from the illustration in FIG. 2 As can be seen, both block 51 and block 52 are connected to decoder areas 53-55. The functional principle of the decoder 5 or the sub-steps of the method according to the invention carried out in the decoder 5 are explained in more detail below.
- the information contained in the encoded digital signal BWE is decoded in block 52 and the signal powers calculated according to formulas 2) and 3) and which characterize the temporal envelope and the spectral envelope are reconstructed.
- the excitation signal s exc ( k ) generated in block 51 is the input signal for the reconstructing shaping of the temporal envelope and the spectral envelope.
- This excitation signal s exc ( k ) can essentially be an arbitrary signal, with the essential prerequisite for this signal being that there is sufficient signal power in the frequency range of the extension band of the wideband input spectral signal s wb i k having.
- the excitation signal s exc (k) is a modulated version of the narrowband signal s nb (k) or any noise are used.
- this excitation signal is s exc ( k ) for the fine structuring of the spectral envelope and the temporal envelope in the signal components of the extension band of a wideband output speech signal s wb ° k responsible.
- this excitation signal s exc ( k ) in such Is generated such that it has the harmonics of the fundamental frequency of the narrowband signal s nb ( k ).
- ⁇ k is a proportional or real-valued shift of the fundamental frequency
- b of the LTB-gain of an adaptive code book in a CELP narrowband decoder then, for example, excitation with a harmonic frequencies (at an integer multiple of the instantaneous fundamental frequency by a LTP synthesis filter of a bandpass filter frequency range of the extension band) from an arbitrary signal n eb ( k ).
- the LTP amplification factor can be reduced or limited by the function f (b) in order to be able to prevent overstimulation of the generated signal components of the expansion band. It should be noted that a multiplicity of further alternatives can be carried out in order to be able to carry out synthetic broadband excitation by means of parameters of a narrow-band codec.
- Another way to generate an excitation signal is to modulate the narrowband signal s nb ( k ) with a sine function at a fixed frequency or by directly using an arbitrary signal n eb ( k ), as already defined above was, is performed. It should be emphasized that the method used for generating the excitation signal s exc ( k ) is completely independent of the generation of the digital signal BWE and the format of this digital signal BWE and the decoding of this digital signal BWE. Therefore, can In this regard, an independent setting be performed.
- the digital signal BWE is decoded in the block 52 and the parameters of the signal power characterizing the temporal envelope and the spectral envelope, which are calculated in accordance with the formulas 2) and 3), are output in accordance with the signals s p t (v ) and s p f ( ⁇ , ⁇ ) .
- a reconstructive shaping of the temporal envelope is performed in the embodiment first. This is done in the decoder area 53.
- the excitation signal s exc ( k ) and the signal s p t (v) are transmitted to this decoder region 53.
- the excitation signal s exc ( k ) is transmitted both to a block 531 and to a multiplier 532.
- the signal s p t (v) is also transmitted to the block 531.
- a scalar correction factor g 1 (k) is generated from these signals transmitted to block 531.
- This scalar correction factor g 1 (k) is transferred from the block 531 to the multiplier 532.
- the excitation signal s exc ( k ) is then multiplied by this scalar correction factor g 1 (k) and an output signal s exc ' k which characterizes the reconstructed shaping of the temporal envelopes.
- This output signal s exc ' k has the approximately correct temporal envelope, but is still inaccurate or imprecise with respect to the correct frequency, which in a subsequent step, the performing a reconstructed shaping of the spectral envelope is required to adapt this imprecise frequency to the required frequency.
- the output signal s exc ' k to a second decoder region 54 of the decoder 5, to which the signal s p t ( ⁇ , ⁇ ) is transmitted.
- the second decoder area 54 has a block 541 and a Block 542, wherein the block 541 for filtering the output signal s exc ' k is designed. From the output signal s exc ' k and the signal s p t ( ⁇ , ⁇ ) , an impulse response h (k) is generated, which is transmitted from block 541 to block 542. In this block 542 then becomes the output signal s exc ' k and the impulse response h (k) performs the reconstructive shaping of the spectral envelope. This reconstructed spectral envelope is then given by the output signal s exc " k of the block 542.
- a reconstructing shaping of the temporal envelope in a third decoder region 55 of the decoder 5 is carried out again.
- This reconstructing shaping of the temporal envelope takes place analogously as it is carried out in the first decoder region 53.
- a second scalar correction factor g 2 (k) is generated by the block 551, a second scalar correction factor g 2 (k), which is transmitted to a multiplier 552.
- the signal s eb ( k ) characterizing the signal components required for the bandwidth extension is then provided.
- This signal s eb ( k ) is transmitted to a summer 56, to which also the narrowband signal s nb ( k ) is transmitted.
- the summation of the narrowband signal s nb ( k ) and the signal s eb ( k ) produces the bandwidth-extended output signal s wb ° k generated and provided as an output signal of the decoder 5.
- FIG. 2 As shown in the embodiment shown only by way of example and for the invention already a single reconstructive shaping of the temporal envelope, as is performed in the first decoder region 53, and a single reconstructive shaping of the spectral envelope, as performed in the second decoder region 54 is sufficient. It should also be noted that it can also be provided that the reconstructive shaping of the spectral envelope in the second decoder area 54 is performed before the reconstruction of the temporal envelope in the first decoder area 53. This means that the second decoder region 54 is arranged before the first decoder region 53 in such an embodiment.
- alternating execution of a reconstructing shaping of the temporal envelope and a reconstructing shaping of the spectral envelope is continued again and, for example, in the in FIG. 2 a further decoder region is arranged following the third decoder region 55, in which a reconstructing shaping of the spectral envelope is again carried out.
- the invention is advantageously used in the exemplary embodiment for a wideband input speech signal having a frequency range of about 50 Hz to 7 kHz.
- the invention is provided in the exemplary embodiment for the artificial extension of the bandwidth of speech signals, wherein the extension band is predetermined by the frequency range of about 3.4 kHz to about 7 kHz.
- the invention is used for an extension band, which is located in a low-frequency frequency range.
- the extension band may comprise a frequency range of about 50 Hz or even lower frequencies, up to a frequency range of about 3.4 kHz.
- the method according to the invention for the artificial extension of the bandwidth of speech signals can also be used such that the extension band comprises a frequency range which is at least partially above a frequency of about 7 kHz and for example up to 8 kHz, in particular 10 kHz , or even higher.
- a reconstructive shaping of the temporal envelope in the first decoder area 53 according to FIG. 2 is generated by a multiplication of the scalar first correction factor g 1 (k) and the excitation signal s exc ( k ).
- the first scalar correction factor or gain g 1 (k) should have strict low-pass frequency characteristics.
- the excitation signal s exc ( k ) is segmented and analyzed in a manner already described above for the segmentation and the analysis of the extraction of the temporal envelope or the generation of the signal s p t (v) is performed from the signal s eb ( k ) in the encoder 1 by means of the block 12.
- the ratio between the decoded signal power as calculated by Formula 3) and the analyzed signal strength result P t exc ⁇ results in a desired gain ⁇ (v) for the ⁇ th signal segment.
- the amplification factor or first correction factor g 1 (k) is calculated by interpolation and low-pass filtering.
- the low-pass filtering is of crucial importance to the influence of this Amplification factor or this first correction factor g 1 (k) to limit the spectral envelope.
- the reconstructive shaping of the spectral envelope of the required signal components of the expansion band is achieved by filtering the output signal s exc ' k . which characterizes the reconstructed shaping of the temporal envelopes.
- the filter operation can be implemented in the period or in the frequency domain.
- the corresponding frequency characteristic H (z) can be smoothed.
- the output signal becomes s exc ' k of the first decoder section 53 is analyzed to obtain the signal powers of the P f exc ⁇ ⁇ ⁇ to be able to find.
- the frequency characteristic H (p, i) of the shape filters of the spectral envelope can be calculated by interpolation of the amplification factor ⁇ ( ⁇ , ⁇ ) and with a smoothing taking into account the frequency. If the spectral envelope shaping filter is to be used in the period, for example by a linear phase FIR filter, the filter coefficients can be calculated by an inverse FF transformation of the frequency characteristic H ( ⁇ , i) and a subsequent windowing.
- the reconstructive shaping of the temporal envelope affects the reconstructive shaping of the spectral envelope and vice versa. Therefore, it is advantageous that, as explained in the embodiment and in FIG. 2 shown, performing an alternating performance of reconstructing a temporal envelope and a spectral envelope in an iterative process. Thereby, a significantly improved coincidence of the temporal and spectral envelopes of the signal components of the enhancement band which are reconstructed in the decoder and the corresponding temporal and spectral envelopes produced in the coder can be achieved.
- a one-and-a-half iteration (reconstruction of the temporal envelopes, reconstruction of the spectral envelopes and re-reconstruction of the temporal envelopes) is performed.
- Bandwidth expansion facilitates the generation of an excitation signal having harmonics at the correct frequency, for example at an integer multiple of the fundamental frequency of the current sound. It should be noted that the invention can also be applied to downsampled subband components of the broadband input signal. This is advantageous when a low computational effort is required.
- the encoder 1 and the blocks 2 and 3 are arranged in a transmitter, wherein logically, the process steps carried out in the blocks 2 and 3 and the encoder 1 are then also carried out in the transmitter.
- the block 4 as well as the decoder 5 may advantageously be arranged in a receiver, whereby it is also clear that the preliminary steps carried out in the decoder 5 and in the block 4 are executed in the receiver.
- the invention can also be implemented in such a way that the method steps carried out in the coder 1 are carried out in the decoder 5 and are thus carried out exclusively in the receiver. It can be provided that the signal powers, which are calculated according to the formulas 2) and 3), in the decoder 5 estimated.
- the block 52 is designed to estimate these parameters of the signal powers.
- This embodiment allows the concealment of potential transmission errors of the side information transmitted in the digital signal BWE. By temporarily estimating lost parameters of an envelope, for example by data loss, annoying switching of the signal bandwidth can be prevented.
- the inventive method and the device according to the invention is very robust against interference of the excitation signal, for example, such a disturbance of a received narrow-band signal can be caused by transmission errors.
- the invention allows the frequency shaping to be performed by linear phase FIR filters rather than LPC synthesis filters. This can also be achieved that typical artifacts ("filter ringing") can be reduced.
- the invention allows a very flexible and modular design, which also allows the individual blocks in the receiver or in the decoder 5 can be easily replaced or adjusted.
- no change of the transmitter or the encoder 1 or the format of the transmission signal with which the coded information is transmitted to the decoder 5 or the receiver is required for such a change or adjustment.
- different decoders can be operated with the method according to the invention, whereby a restoration of the broadband input signal with different precision depending on the available computing power can be performed.
- the received parameters characterizing the spectral and temporal envelopes can be used not only for bandwidth extension but also for supporting subsequent signal processing blocks such as post-filtering or additional coding stages such as transform coders. can be used.
- the resulting narrowband speech signal s nb ( k ), as available to the bandwidth expansion algorithm, may be present, for example, after a reduction of the sampling frequency by a factor of 2 at a sampling rate of 8 kHz.
- the invention and the underlying principle of bandwidth expansion it is possible to generate broadband excitation of information of the G.729A + standard.
- the data rate of the side information transmitted in the digital signal BWE can be about 2 kbit / s.
- a relatively low-complexity calculation system or a relatively low complex computational effort is required, which is less than 3 WMOPS.
- the method and device of the invention is very robust to baseband disturbances of the G.729A + standard.
- the invention may also be used advantageously for use in voice-over-IP.
- the inventive method and device according to the invention is compatible with TDAC envelopes.
- the invention also has a very modular and flexible structure and a modular and flexible design.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
- Machine Translation (AREA)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PL06840370T PL1825461T3 (pl) | 2005-07-13 | 2006-06-30 | Sposób i urządzenie do sztucznego rozszerzania szerokości pasma sygnałów mowy |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102005032724A DE102005032724B4 (de) | 2005-07-13 | 2005-07-13 | Verfahren und Vorrichtung zur künstlichen Erweiterung der Bandbreite von Sprachsignalen |
PCT/EP2006/063742 WO2007073949A1 (de) | 2005-07-13 | 2006-06-30 | Verfahren und vorrichtung zur künstlichen erweiterung der bandbreite von sprachsignalen |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1825461A1 EP1825461A1 (de) | 2007-08-29 |
EP1825461B1 true EP1825461B1 (de) | 2008-09-03 |
Family
ID=36994160
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06840370A Not-in-force EP1825461B1 (de) | 2005-07-13 | 2006-06-30 | Verfahren und vorrichtung zur künstlichen erweiterung der bandbreite von sprachsignalen |
Country Status (12)
Country | Link |
---|---|
US (1) | US8265940B2 (zh) |
EP (1) | EP1825461B1 (zh) |
JP (1) | JP4740260B2 (zh) |
KR (1) | KR100915733B1 (zh) |
CN (2) | CN101676993B (zh) |
AT (1) | ATE407424T1 (zh) |
CA (1) | CA2580622C (zh) |
DE (2) | DE102005032724B4 (zh) |
DK (1) | DK1825461T3 (zh) |
ES (1) | ES2309969T3 (zh) |
PL (1) | PL1825461T3 (zh) |
WO (1) | WO2007073949A1 (zh) |
Families Citing this family (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5547081B2 (ja) * | 2007-11-02 | 2014-07-09 | 華為技術有限公司 | 音声復号化方法及び装置 |
CA2708861C (en) * | 2007-12-18 | 2016-06-21 | Lg Electronics Inc. | A method and an apparatus for processing an audio signal |
DE602008005250D1 (de) * | 2008-01-04 | 2011-04-14 | Dolby Sweden Ab | Audiokodierer und -dekodierer |
KR101261677B1 (ko) * | 2008-07-14 | 2013-05-06 | 광운대학교 산학협력단 | 음성/음악 통합 신호의 부호화/복호화 장치 |
WO2010028297A1 (en) * | 2008-09-06 | 2010-03-11 | GH Innovation, Inc. | Selective bandwidth extension |
US8532983B2 (en) * | 2008-09-06 | 2013-09-10 | Huawei Technologies Co., Ltd. | Adaptive frequency prediction for encoding or decoding an audio signal |
US8515747B2 (en) * | 2008-09-06 | 2013-08-20 | Huawei Technologies Co., Ltd. | Spectrum harmonic/noise sharpness control |
US8407046B2 (en) * | 2008-09-06 | 2013-03-26 | Huawei Technologies Co., Ltd. | Noise-feedback for spectral envelope quantization |
WO2010031003A1 (en) | 2008-09-15 | 2010-03-18 | Huawei Technologies Co., Ltd. | Adding second enhancement layer to celp based core layer |
US8577673B2 (en) * | 2008-09-15 | 2013-11-05 | Huawei Technologies Co., Ltd. | CELP post-processing for music signals |
US9947340B2 (en) | 2008-12-10 | 2018-04-17 | Skype | Regeneration of wideband speech |
CN101751926B (zh) | 2008-12-10 | 2012-07-04 | 华为技术有限公司 | 信号编码、解码方法及装置、编解码*** |
WO2010070770A1 (ja) * | 2008-12-19 | 2010-06-24 | 富士通株式会社 | 音声帯域拡張装置及び音声帯域拡張方法 |
JP4921611B2 (ja) * | 2009-04-03 | 2012-04-25 | 株式会社エヌ・ティ・ティ・ドコモ | 音声復号装置、音声復号方法、及び音声復号プログラム |
JP4932917B2 (ja) * | 2009-04-03 | 2012-05-16 | 株式会社エヌ・ティ・ティ・ドコモ | 音声復号装置、音声復号方法、及び音声復号プログラム |
WO2011035813A1 (en) * | 2009-09-25 | 2011-03-31 | Nokia Corporation | Audio coding |
KR101613684B1 (ko) * | 2009-12-09 | 2016-04-19 | 삼성전자주식회사 | 음향 신호 보강 처리 장치 및 방법 |
JP5652658B2 (ja) * | 2010-04-13 | 2015-01-14 | ソニー株式会社 | 信号処理装置および方法、符号化装置および方法、復号装置および方法、並びにプログラム |
US9093080B2 (en) * | 2010-06-09 | 2015-07-28 | Panasonic Intellectual Property Corporation Of America | Bandwidth extension method, bandwidth extension apparatus, program, integrated circuit, and audio decoding apparatus |
US20130108073A1 (en) * | 2010-07-09 | 2013-05-02 | Bang & Olufsen A/S | Method and apparatus for providing audio from one or more speakers |
US8560330B2 (en) * | 2010-07-19 | 2013-10-15 | Futurewei Technologies, Inc. | Energy envelope perceptual correction for high band coding |
US8868432B2 (en) * | 2010-10-15 | 2014-10-21 | Motorola Mobility Llc | Audio signal bandwidth extension in CELP-based speech coder |
US8924200B2 (en) * | 2010-10-15 | 2014-12-30 | Motorola Mobility Llc | Audio signal bandwidth extension in CELP-based speech coder |
KR20120046627A (ko) * | 2010-11-02 | 2012-05-10 | 삼성전자주식회사 | 화자 적응 방법 및 장치 |
CN102610231B (zh) * | 2011-01-24 | 2013-10-09 | 华为技术有限公司 | 一种带宽扩展方法及装置 |
US9117455B2 (en) * | 2011-07-29 | 2015-08-25 | Dts Llc | Adaptive voice intelligibility processor |
JP6200034B2 (ja) * | 2012-04-27 | 2017-09-20 | 株式会社Nttドコモ | 音声復号装置 |
JP5997592B2 (ja) | 2012-04-27 | 2016-09-28 | 株式会社Nttドコモ | 音声復号装置 |
US9258428B2 (en) | 2012-12-18 | 2016-02-09 | Cisco Technology, Inc. | Audio bandwidth extension for conferencing |
WO2014118179A1 (en) * | 2013-01-29 | 2014-08-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoders, audio decoders, systems, methods and computer programs using an increased temporal resolution in temporal proximity of onsets or offsets of fricatives or affricates |
KR101798126B1 (ko) * | 2013-01-29 | 2017-11-16 | 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. | 주파수 향상 오디오 신호를 생성하는 디코더, 디코딩 방법, 인코딩된 신호를 생성하는 인코더, 및 컴팩트 선택 사이드 정보를 이용한 인코딩 방법 |
EP2784775B1 (en) * | 2013-03-27 | 2016-09-14 | Binauric SE | Speech signal encoding/decoding method and apparatus |
CN104217727B (zh) * | 2013-05-31 | 2017-07-21 | 华为技术有限公司 | 信号解码方法及设备 |
US9666202B2 (en) | 2013-09-10 | 2017-05-30 | Huawei Technologies Co., Ltd. | Adaptive bandwidth extension and apparatus for the same |
US10163447B2 (en) * | 2013-12-16 | 2018-12-25 | Qualcomm Incorporated | High-band signal modeling |
EP3199956B1 (en) * | 2016-01-28 | 2020-09-09 | General Electric Technology GmbH | Apparatus for determination of the frequency of an electrical signal and associated method |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3946821B2 (ja) * | 1996-12-13 | 2007-07-18 | 東北リコー株式会社 | 排版装置 |
DE19706516C1 (de) * | 1997-02-19 | 1998-01-15 | Fraunhofer Ges Forschung | Verfahren und Vorricntungen zum Codieren von diskreten Signalen bzw. zum Decodieren von codierten diskreten Signalen |
SE512719C2 (sv) * | 1997-06-10 | 2000-05-02 | Lars Gustaf Liljeryd | En metod och anordning för reduktion av dataflöde baserad på harmonisk bandbreddsexpansion |
US5890125A (en) * | 1997-07-16 | 1999-03-30 | Dolby Laboratories Licensing Corporation | Method and apparatus for encoding and decoding multiple audio channels at low bit rates using adaptive selection of encoding method |
US6978236B1 (en) * | 1999-10-01 | 2005-12-20 | Coding Technologies Ab | Efficient spectral envelope coding using variable time/frequency resolution and time/frequency switching |
CA2290037A1 (en) * | 1999-11-18 | 2001-05-18 | Voiceage Corporation | Gain-smoothing amplifier device and method in codecs for wideband speech and audio signals |
DE10041512B4 (de) * | 2000-08-24 | 2005-05-04 | Infineon Technologies Ag | Verfahren und Vorrichtung zur künstlichen Erweiterung der Bandbreite von Sprachsignalen |
US20020031129A1 (en) * | 2000-09-13 | 2002-03-14 | Dawn Finn | Method of managing voice buffers in dynamic bandwidth circuit emulation services |
DE10102173A1 (de) * | 2001-01-18 | 2002-07-25 | Siemens Ag | Verfahren und Anordnung zum Umsetzen von parametrisch codier-ten Sprachsignalen verschiedener Bandbreite in Sprachsignale |
JP2003044098A (ja) * | 2001-07-26 | 2003-02-14 | Nec Corp | 音声帯域拡張装置及び音声帯域拡張方法 |
US6895375B2 (en) * | 2001-10-04 | 2005-05-17 | At&T Corp. | System for bandwidth extension of Narrow-band speech |
US20030187663A1 (en) | 2002-03-28 | 2003-10-02 | Truman Michael Mead | Broadband frequency translation for high frequency regeneration |
ATE315308T1 (de) * | 2002-09-12 | 2006-02-15 | Siemens Ag | Kommunikationsendgerät mit bandbreitenerweiterung und echokompensation |
DE10252070B4 (de) * | 2002-11-08 | 2010-07-15 | Palm, Inc. (n.d.Ges. d. Staates Delaware), Sunnyvale | Kommunikationsendgerät mit parametrierter Bandbreitenerweiterung und Verfahren zur Bandbreitenerweiterung dafür |
US20040138876A1 (en) * | 2003-01-10 | 2004-07-15 | Nokia Corporation | Method and apparatus for artificial bandwidth expansion in speech processing |
US20050004793A1 (en) * | 2003-07-03 | 2005-01-06 | Pasi Ojala | Signal adaptation for higher band coding in a codec utilizing band split coding |
WO2006107837A1 (en) * | 2005-04-01 | 2006-10-12 | Qualcomm Incorporated | Methods and apparatus for encoding and decoding an highband portion of a speech signal |
-
2005
- 2005-07-13 DE DE102005032724A patent/DE102005032724B4/de not_active Expired - Fee Related
-
2006
- 2006-06-30 US US11/662,592 patent/US8265940B2/en not_active Expired - Fee Related
- 2006-06-30 PL PL06840370T patent/PL1825461T3/pl unknown
- 2006-06-30 EP EP06840370A patent/EP1825461B1/de not_active Not-in-force
- 2006-06-30 AT AT06840370T patent/ATE407424T1/de not_active IP Right Cessation
- 2006-06-30 JP JP2007551692A patent/JP4740260B2/ja not_active Expired - Fee Related
- 2006-06-30 ES ES06840370T patent/ES2309969T3/es active Active
- 2006-06-30 CN CN200910208032XA patent/CN101676993B/zh not_active Expired - Fee Related
- 2006-06-30 CN CNB2006800007998A patent/CN100568345C/zh not_active Expired - Fee Related
- 2006-06-30 CA CA2580622A patent/CA2580622C/en not_active Expired - Fee Related
- 2006-06-30 DK DK06840370T patent/DK1825461T3/da active
- 2006-06-30 KR KR1020077005783A patent/KR100915733B1/ko not_active IP Right Cessation
- 2006-06-30 DE DE502006001491T patent/DE502006001491D1/de active Active
- 2006-06-30 WO PCT/EP2006/063742 patent/WO2007073949A1/de active IP Right Grant
Also Published As
Publication number | Publication date |
---|---|
ES2309969T3 (es) | 2008-12-16 |
JP2008513848A (ja) | 2008-05-01 |
CN101676993B (zh) | 2012-05-30 |
CA2580622A1 (en) | 2007-01-13 |
KR20070090143A (ko) | 2007-09-05 |
CA2580622C (en) | 2011-05-10 |
CN100568345C (zh) | 2009-12-09 |
ATE407424T1 (de) | 2008-09-15 |
DK1825461T3 (da) | 2009-01-26 |
DE102005032724B4 (de) | 2009-10-08 |
DE502006001491D1 (de) | 2008-10-16 |
PL1825461T3 (pl) | 2009-02-27 |
US8265940B2 (en) | 2012-09-11 |
JP4740260B2 (ja) | 2011-08-03 |
CN101676993A (zh) | 2010-03-24 |
WO2007073949A1 (de) | 2007-07-05 |
CN101061535A (zh) | 2007-10-24 |
US20080126081A1 (en) | 2008-05-29 |
DE102005032724A1 (de) | 2007-02-01 |
KR100915733B1 (ko) | 2009-09-04 |
EP1825461A1 (de) | 2007-08-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1825461B1 (de) | Verfahren und vorrichtung zur künstlichen erweiterung der bandbreite von sprachsignalen | |
DE10041512B4 (de) | Verfahren und Vorrichtung zur künstlichen Erweiterung der Bandbreite von Sprachsignalen | |
DE69816810T2 (de) | Systeme und verfahren zur audio-kodierung | |
DE60024501T2 (de) | Verbesserung der perzeptuellen Qualität von SBR (Spektralbandreplikation) UND HFR (Hochfrequenzen-Rekonstruktion) Kodierverfahren mittels adaptivem Addieren von Grundrauschen und Begrenzung der Rauschsubstitution | |
DE69916321T2 (de) | Kodierung eines verbesserungsmerkmals zur leistungsverbesserung in der kodierung von kommunikationssignalen | |
DE60029990T2 (de) | Glättung des verstärkungsfaktors in breitbandsprach- und audio-signal dekodierer | |
DE60202881T2 (de) | Wiederherstellung von hochfrequenzkomponenten | |
DE69634645T2 (de) | Verfahren und Vorrichtung zur Sprachkodierung | |
DE60218385T2 (de) | Nachfilterung von kodierter Sprache im Frequenzbereich | |
DE60216214T2 (de) | Verfahren zur Erweiterung der Bandbreite eines schmalbandigen Sprachsignals | |
DE69509555T2 (de) | Verfahren zur veränderung eines sprachsignales mittels grundfrequenzmanipulation | |
DE60101148T2 (de) | Vorrichtung und verfahren zur sprachsignalmodifizierung | |
DE60317722T2 (de) | Verfahren zur Reduzierung von Aliasing-Störungen, die durch die Anpassung der spektralen Hüllkurve in Realwertfilterbanken verursacht werden | |
EP1979901B1 (de) | Verfahren und anordnungen zur audiosignalkodierung | |
DE69608947T2 (de) | Verfahren zur Analyse eines Audiofrequenzsignals durch lineare Prädiktion, und Anwendung auf ein Verfahren zur Kodierung und Dekodierung eines Audiofrequenzsignals | |
DE69926821T2 (de) | Verfahren zur signalgesteuerten Schaltung zwischen verschiedenen Audiokodierungssystemen | |
DE60122203T2 (de) | Verfahren und system zur erzeugung von behaglichkeitsrauschen bei der sprachkommunikation | |
DE60128121T2 (de) | Wahrnehmungsbezogen verbesserte aufbesserung kodierter akustischer signale | |
EP1386307B2 (de) | Verfahren und vorrichtung zur bestimmung eines qualitätsmasses eines audiosignals | |
EP2867894B1 (de) | Vorrichtung, verfahren und computerprogramm für frei wählbare frequenzverschiebungen in der subband-domäne | |
EP2784775B1 (en) | Speech signal encoding/decoding method and apparatus | |
DE69713712T2 (de) | Sprachkodierer mit Sinusanalyse und Grundfrequenzsteuerung | |
DE69820362T2 (de) | Nichtlinearer Filter zur Geräuschunterdrückung in linearen Prädiktions-Sprachkodierungs-Vorrichtungen | |
DE60124079T2 (de) | Sprachverarbeitung | |
DE69612958T2 (de) | Verfahren und vorrichtung zur resynthetisierung eines sprachsignals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20070222 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: CH Ref legal event code: NV Representative=s name: SIEMENS SCHWEIZ AG |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REF | Corresponds to: |
Ref document number: 502006001491 Country of ref document: DE Date of ref document: 20081016 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2309969 Country of ref document: ES Kind code of ref document: T3 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
REG | Reference to a national code |
Ref country code: PL Ref legal event code: T3 |
|
NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PCAR Free format text: SIEMENS SCHWEIZ AG;INTELLECTUAL PROPERTY FREILAGERSTRASSE 40;8047 ZUERICH (CH) |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20081203 Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20090203 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20090103 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
26N | No opposition filed |
Effective date: 20090604 |
|
BERE | Be: lapsed |
Owner name: SIEMENS A.G. Effective date: 20090630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20090630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20090630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20090630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20081204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20090630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20090304 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20080903 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20120626 Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130630 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20140605 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20140618 Year of fee payment: 9 Ref country code: PL Payment date: 20140523 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20140904 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20140617 Year of fee payment: 9 Ref country code: ES Payment date: 20140725 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20150608 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20150821 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20150630 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: EUG |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20160229 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150630 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150630 Ref country code: SE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150701 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20160801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150701 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 502006001491 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20160630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160630 |