EP0877355A3 - Speech coding - Google Patents

Speech coding Download PDF

Info

Publication number
EP0877355A3
EP0877355A3 EP98104785A EP98104785A EP0877355A3 EP 0877355 A3 EP0877355 A3 EP 0877355A3 EP 98104785 A EP98104785 A EP 98104785A EP 98104785 A EP98104785 A EP 98104785A EP 0877355 A3 EP0877355 A3 EP 0877355A3
Authority
EP
European Patent Office
Prior art keywords
frame
pitch
autocorrelation function
lag parameter
speech coding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP98104785A
Other languages
German (de)
French (fr)
Other versions
EP0877355B1 (en
EP0877355A2 (en
Inventor
Ari Lakaniemi
Janne Vainio
Pasi Ojala
Petri Haavisto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Oyj
Original Assignee
Nokia Mobile Phones Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from FI971976A external-priority patent/FI971976A/en
Application filed by Nokia Mobile Phones Ltd filed Critical Nokia Mobile Phones Ltd
Publication of EP0877355A2 publication Critical patent/EP0877355A2/en
Publication of EP0877355A3 publication Critical patent/EP0877355A3/en
Application granted granted Critical
Publication of EP0877355B1 publication Critical patent/EP0877355B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/09—Long term prediction, i.e. removing periodical redundancies, e.g. by using adaptive codebook or pitch predictor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/15—Correlation function computation including computation of convolution operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L2019/0001—Codebooks
    • G10L2019/0011—Long term prediction filters, i.e. pitch estimation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/06—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being correlation coefficients

Abstract

A method of speech coding a sampled speech signal using long term prediction (LTP). A LTP pitch-lag parameter is determined for each frame of the speech signal by first determining the autocorrelation function for the frame within the signal, between predefined maximum and minimum delays. The autocorrelation function is then weighted to emphasise the function for delays in the neighbourhood of the pitch-lag parameter determined for the most recent voiced frame. The maximum value for the weighted autocorrelation function is then found and identified as the pitch-lag parameter for the frame.
EP98104785A 1997-05-07 1998-03-17 Speech coding Expired - Lifetime EP0877355B1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
FI971976 1997-05-07
FI971976A FI971976A (en) 1997-05-07 1997-05-07 Speech coding
FI980502 1998-03-05
FI980502A FI113903B (en) 1997-05-07 1998-03-05 Speech coding

Publications (3)

Publication Number Publication Date
EP0877355A2 EP0877355A2 (en) 1998-11-11
EP0877355A3 true EP0877355A3 (en) 1999-06-16
EP0877355B1 EP0877355B1 (en) 2003-05-14

Family

ID=26160386

Family Applications (1)

Application Number Title Priority Date Filing Date
EP98104785A Expired - Lifetime EP0877355B1 (en) 1997-05-07 1998-03-17 Speech coding

Country Status (10)

Country Link
US (1) US6199035B1 (en)
EP (1) EP0877355B1 (en)
JP (3) JPH1124699A (en)
KR (2) KR100653926B1 (en)
CN (1) CN1120471C (en)
AU (1) AU739238B2 (en)
DE (1) DE69814517T2 (en)
ES (1) ES2198615T3 (en)
FI (1) FI113903B (en)
WO (1) WO1998050910A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9190066B2 (en) 1998-09-18 2015-11-17 Mindspeed Technologies, Inc. Adaptive codebook gain control for speech coding

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6415252B1 (en) * 1998-05-28 2002-07-02 Motorola, Inc. Method and apparatus for coding and decoding speech
US6507814B1 (en) * 1998-08-24 2003-01-14 Conexant Systems, Inc. Pitch determination using speech classification and prior pitch estimation
JP3180786B2 (en) * 1998-11-27 2001-06-25 日本電気株式会社 Audio encoding method and audio encoding device
US7117149B1 (en) * 1999-08-30 2006-10-03 Harman Becker Automotive Systems-Wavemakers, Inc. Sound source classification
US6959274B1 (en) 1999-09-22 2005-10-25 Mindspeed Technologies, Inc. Fixed rate speech compression system and method
US6782360B1 (en) * 1999-09-22 2004-08-24 Mindspeed Technologies, Inc. Gain quantization for a CELP speech coder
US7124075B2 (en) * 2001-10-26 2006-10-17 Dmitry Edward Terez Methods and apparatus for pitch determination
KR100463417B1 (en) * 2002-10-10 2004-12-23 한국전자통신연구원 The pitch estimation algorithm by using the ratio of the maximum peak to candidates for the maximum of the autocorrelation function
US8271279B2 (en) 2003-02-21 2012-09-18 Qnx Software Systems Limited Signature noise removal
US7895036B2 (en) * 2003-02-21 2011-02-22 Qnx Software Systems Co. System for suppressing wind noise
US8326621B2 (en) 2003-02-21 2012-12-04 Qnx Software Systems Limited Repetitive transient noise removal
US7725315B2 (en) * 2003-02-21 2010-05-25 Qnx Software Systems (Wavemakers), Inc. Minimization of transient noises in a voice signal
US8073689B2 (en) 2003-02-21 2011-12-06 Qnx Software Systems Co. Repetitive transient noise removal
US7885420B2 (en) * 2003-02-21 2011-02-08 Qnx Software Systems Co. Wind noise suppression system
US7949522B2 (en) 2003-02-21 2011-05-24 Qnx Software Systems Co. System for suppressing rain noise
TWI241557B (en) * 2003-07-21 2005-10-11 Ali Corp Method for estimating a pitch estimation of the speech signals
JP4490090B2 (en) 2003-12-25 2010-06-23 株式会社エヌ・ティ・ティ・ドコモ Sound / silence determination device and sound / silence determination method
US8543390B2 (en) * 2004-10-26 2013-09-24 Qnx Software Systems Limited Multi-channel periodic signal enhancement system
US8170879B2 (en) * 2004-10-26 2012-05-01 Qnx Software Systems Limited Periodic signal enhancement system
US7716046B2 (en) * 2004-10-26 2010-05-11 Qnx Software Systems (Wavemakers), Inc. Advanced periodic signal enhancement
US7610196B2 (en) * 2004-10-26 2009-10-27 Qnx Software Systems (Wavemakers), Inc. Periodic signal enhancement system
US7680652B2 (en) 2004-10-26 2010-03-16 Qnx Software Systems (Wavemakers), Inc. Periodic signal enhancement system
US7949520B2 (en) * 2004-10-26 2011-05-24 QNX Software Sytems Co. Adaptive filter pitch extraction
US8306821B2 (en) * 2004-10-26 2012-11-06 Qnx Software Systems Limited Sub-band periodic signal enhancement system
US8284947B2 (en) * 2004-12-01 2012-10-09 Qnx Software Systems Limited Reverberation estimation and suppression system
US7933767B2 (en) * 2004-12-27 2011-04-26 Nokia Corporation Systems and methods for determining pitch lag for a current frame of information
US7386445B2 (en) * 2005-01-18 2008-06-10 Nokia Corporation Compensation of transient effects in transform coding
US8027833B2 (en) * 2005-05-09 2011-09-27 Qnx Software Systems Co. System for suppressing passing tire hiss
US8311819B2 (en) * 2005-06-15 2012-11-13 Qnx Software Systems Limited System for detecting speech with background voice estimates and noise estimates
US8170875B2 (en) 2005-06-15 2012-05-01 Qnx Software Systems Limited Speech end-pointer
US9058812B2 (en) * 2005-07-27 2015-06-16 Google Technology Holdings LLC Method and system for coding an information signal using pitch delay contour adjustment
EP2228789B1 (en) * 2006-03-20 2012-07-25 Mindspeed Technologies, Inc. Open-loop pitch track smoothing
US7844453B2 (en) 2006-05-12 2010-11-30 Qnx Software Systems Co. Robust noise estimation
US8010350B2 (en) * 2006-08-03 2011-08-30 Broadcom Corporation Decimated bisectional pitch refinement
US7752038B2 (en) * 2006-10-13 2010-07-06 Nokia Corporation Pitch lag estimation
US8335685B2 (en) 2006-12-22 2012-12-18 Qnx Software Systems Limited Ambient noise compensation system robust to high excitation noise
US8326620B2 (en) 2008-04-30 2012-12-04 Qnx Software Systems Limited Robust downlink speech and noise detector
US8386246B2 (en) * 2007-06-27 2013-02-26 Broadcom Corporation Low-complexity frame erasure concealment
US8850154B2 (en) 2007-09-11 2014-09-30 2236008 Ontario Inc. Processing system having memory partitioning
US8904400B2 (en) * 2007-09-11 2014-12-02 2236008 Ontario Inc. Processing system having a partitioning component for resource partitioning
US8694310B2 (en) 2007-09-17 2014-04-08 Qnx Software Systems Limited Remote control server protocol system
US8209514B2 (en) * 2008-02-04 2012-06-26 Qnx Software Systems Limited Media processing system having resource partitioning
GB2466675B (en) 2009-01-06 2013-03-06 Skype Speech coding
GB2466672B (en) 2009-01-06 2013-03-13 Skype Speech coding
GB2466674B (en) 2009-01-06 2013-11-13 Skype Speech coding
GB2466671B (en) 2009-01-06 2013-03-27 Skype Speech encoding
GB2466669B (en) * 2009-01-06 2013-03-06 Skype Speech coding
GB2466670B (en) 2009-01-06 2012-11-14 Skype Speech encoding
GB2466673B (en) 2009-01-06 2012-11-07 Skype Quantization
CN102016530B (en) * 2009-02-13 2012-11-14 华为技术有限公司 Method and device for pitch period detection
US8452606B2 (en) 2009-09-29 2013-05-28 Skype Speech encoding using multiple bit rates
US9384759B2 (en) 2012-03-05 2016-07-05 Malaspina Labs (Barbados) Inc. Voice activity detection and pitch estimation
US9020818B2 (en) 2012-03-05 2015-04-28 Malaspina Labs (Barbados) Inc. Format based speech reconstruction from noisy signals
US9437213B2 (en) 2012-03-05 2016-09-06 Malaspina Labs (Barbados) Inc. Voice signal enhancement
US9123328B2 (en) * 2012-09-26 2015-09-01 Google Technology Holdings LLC Apparatus and method for audio frame loss recovery
EP3399522B1 (en) * 2013-07-18 2019-09-11 Nippon Telegraph and Telephone Corporation Linear prediction analysis device, method, program, and storage medium
ES2819032T3 (en) 2013-12-19 2021-04-14 Ericsson Telefon Ab L M Background noise estimation in audio signals

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0628947A1 (en) * 1993-06-10 1994-12-14 SIP SOCIETA ITALIANA PER l'ESERCIZIO DELLE TELECOMUNICAZIONI P.A. Method and device for speech signal pitch period estimation and classification in digital speech coders
EP0666557A2 (en) * 1994-02-08 1995-08-09 AT&T Corp. Decomposition in noise and periodic signal waveforms in waveform interpolation
EP0747882A2 (en) * 1995-06-07 1996-12-11 AT&T IPM Corp. Pitch delay modification during frame erasures

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4486900A (en) 1982-03-30 1984-12-04 At&T Bell Laboratories Real time pitch detection by stream processing
JP2585214B2 (en) * 1986-02-21 1997-02-26 株式会社日立製作所 Pitch extraction method
US4969192A (en) 1987-04-06 1990-11-06 Voicecraft, Inc. Vector adaptive predictive coder for speech and audio
CA2010830C (en) 1990-02-23 1996-06-25 Jean-Pierre Adoul Dynamic codebook for efficient speech coding based on algebraic codes
JPH04264600A (en) * 1991-02-20 1992-09-21 Fujitsu Ltd Voice encoder and voice decoder
US5179594A (en) * 1991-06-12 1993-01-12 Motorola, Inc. Efficient calculation of autocorrelation coefficients for CELP vocoder adaptive codebook
US5339384A (en) * 1992-02-18 1994-08-16 At&T Bell Laboratories Code-excited linear predictive coding with low delay for speech or audio signals
FI95085C (en) 1992-05-11 1995-12-11 Nokia Mobile Phones Ltd A method for digitally encoding a speech signal and a speech encoder for performing the method
US5327520A (en) * 1992-06-04 1994-07-05 At&T Bell Laboratories Method of use of voice message coder/decoder
FI91345C (en) 1992-06-24 1994-06-10 Nokia Mobile Phones Ltd A method for enhancing handover
CA2102080C (en) * 1992-12-14 1998-07-28 Willem Bastiaan Kleijn Time shifting for generalized analysis-by-synthesis coding
JP3321933B2 (en) * 1993-10-19 2002-09-09 ソニー株式会社 Pitch detection method
FI98163C (en) 1994-02-08 1997-04-25 Nokia Mobile Phones Ltd Coding system for parametric speech coding
JP3418005B2 (en) * 1994-08-04 2003-06-16 富士通株式会社 Voice pitch detection device
US5781880A (en) * 1994-11-21 1998-07-14 Rockwell International Corporation Pitch lag estimation using frequency-domain lowpass filtering of the linear predictive coding (LPC) residual
US5664053A (en) 1995-04-03 1997-09-02 Universite De Sherbrooke Predictive split-matrix quantization of spectral parameters for efficient coding of speech

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0628947A1 (en) * 1993-06-10 1994-12-14 SIP SOCIETA ITALIANA PER l'ESERCIZIO DELLE TELECOMUNICAZIONI P.A. Method and device for speech signal pitch period estimation and classification in digital speech coders
EP0666557A2 (en) * 1994-02-08 1995-08-09 AT&T Corp. Decomposition in noise and periodic signal waveforms in waveform interpolation
EP0747882A2 (en) * 1995-06-07 1996-12-11 AT&T IPM Corp. Pitch delay modification during frame erasures

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9190066B2 (en) 1998-09-18 2015-11-17 Mindspeed Technologies, Inc. Adaptive codebook gain control for speech coding
US9269365B2 (en) 1998-09-18 2016-02-23 Mindspeed Technologies, Inc. Adaptive gain reduction for encoding a speech signal

Also Published As

Publication number Publication date
AU739238B2 (en) 2001-10-04
WO1998050910A1 (en) 1998-11-12
KR100653926B1 (en) 2006-12-05
JP2009223326A (en) 2009-10-01
CN1255226A (en) 2000-05-31
EP0877355B1 (en) 2003-05-14
KR100653932B1 (en) 2006-12-04
US6199035B1 (en) 2001-03-06
CN1120471C (en) 2003-09-03
DE69814517T2 (en) 2004-04-08
AU6403298A (en) 1998-11-27
FI113903B (en) 2004-06-30
EP0877355A2 (en) 1998-11-11
DE69814517D1 (en) 2003-06-18
ES2198615T3 (en) 2004-02-01
KR20040037265A (en) 2004-05-04
KR20010006394A (en) 2001-01-26
FI980502A (en) 1998-11-08
JPH1124699A (en) 1999-01-29
JP4866438B2 (en) 2012-02-01
JP2004038211A (en) 2004-02-05
FI980502A0 (en) 1998-03-05

Similar Documents

Publication Publication Date Title
EP0877355A3 (en) Speech coding
CA2476248A1 (en) System and method for reducing delay in a speech coding system
EP0785541B1 (en) Usage of voice activity detection for efficient coding of speech
EP0788091A3 (en) Speech encoding and decoding method and apparatus therefor
EP1411427A3 (en) Method of drawing in a window
EP1763020A3 (en) Variable rate vocoder
EP0714089A3 (en) Code-excited linear predictive coder and decoder with conversion filter for converting stochastic and impulse excitation signals
EP1850326A3 (en) Frame erasure compensation method in a variable rate speech coder
EP1103955A3 (en) Multiband harmonic transform coder
EP1308932A3 (en) Adaptive postfiltering methods and systems for decoding speech
EP0932141A3 (en) Method for signal controlled switching between different audio coding schemes
CA2176665A1 (en) Method of adapting the noise masking level in an analysis-by-synthesis speech coder employing a short-term perceptual weighting filter
EP0955627A3 (en) Subframe-based correlation
EP1391879A3 (en) Speech coding apparatus, linear prediction coefficient analyzing apparatus and noise reducing apparatus
EP0814458A3 (en) Improvements in or relating to speech coding
EP0764940A3 (en) am improved RCELP coder
EP0762386A3 (en) Method and apparatus for CELP coding an audio signal while distinguishing speech periods and non-speech periods
EP1959434A3 (en) Speech encoder
EP0867857A3 (en) Enrolment in speech recognition
EP0867861A3 (en) Speech-responsive voice messaging system and method
EP1796083A3 (en) Method and apparatus for predictively quantizing voiced speech
WO1999018565A3 (en) Speech coding
EP0722165A3 (en) Estimation of excitation parameters
EP0898267A3 (en) Speech coding method and system
EP0911807A3 (en) Sound synthesizing method and apparatus, and sound band expanding method and apparatus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE ES FR GB IT NL SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LI LU MC NL PT

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

17P Request for examination filed

Effective date: 19991216

AKX Designation fees paid

Free format text: DE ES FR GB IT NL SE

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: NOKIA CORPORATION

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

RIC1 Information provided on ipc code assigned before grant

Free format text: 7G 10L 19/08 A

17Q First examination report despatched

Effective date: 20020502

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Designated state(s): DE ES FR GB IT NL SE

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 69814517

Country of ref document: DE

Date of ref document: 20030618

Kind code of ref document: P

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

ET Fr: translation filed
REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2198615

Country of ref document: ES

Kind code of ref document: T3

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20040217

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 69814517

Country of ref document: DE

Representative=s name: BECKER, KURIG, STRAUS, DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

Owner name: NOKIA TECHNOLOGIES OY, FI

Effective date: 20150318

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 69814517

Country of ref document: DE

Representative=s name: BECKER, KURIG, STRAUS, DE

Effective date: 20150312

Ref country code: DE

Ref legal event code: R081

Ref document number: 69814517

Country of ref document: DE

Owner name: NOKIA TECHNOLOGIES OY, FI

Free format text: FORMER OWNER: NOKIA CORP., 02610 ESPOO, FI

Effective date: 20150312

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20150910 AND 20150916

REG Reference to a national code

Ref country code: ES

Ref legal event code: PC2A

Owner name: NOKIA TECHNOLOGIES OY

Effective date: 20151124

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 19

REG Reference to a national code

Ref country code: NL

Ref legal event code: PD

Owner name: NOKIA TECHNOLOGIES OY; FI

Free format text: DETAILS ASSIGNMENT: VERANDERING VAN EIGENAAR(S), OVERDRACHT; FORMER OWNER NAME: NOKIA CORPORATION

Effective date: 20151111

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20170320

Year of fee payment: 20

Ref country code: SE

Payment date: 20170313

Year of fee payment: 20

Ref country code: FR

Payment date: 20170213

Year of fee payment: 20

Ref country code: DE

Payment date: 20170314

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20170315

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20170320

Year of fee payment: 20

Ref country code: ES

Payment date: 20170214

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 69814517

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MK

Effective date: 20180316

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20180316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20180316

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20200803

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20180318