EP3414706A4 - Method and apparatus for infrared thermal image contour extraction - Google Patents

Method and apparatus for infrared thermal image contour extraction Download PDF

Info

Publication number
EP3414706A4
EP3414706A4 EP16838049.1A EP16838049A EP3414706A4 EP 3414706 A4 EP3414706 A4 EP 3414706A4 EP 16838049 A EP16838049 A EP 16838049A EP 3414706 A4 EP3414706 A4 EP 3414706A4
Authority
EP
European Patent Office
Prior art keywords
thermal image
infrared thermal
contour extraction
image contour
extraction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP16838049.1A
Other languages
German (de)
French (fr)
Other versions
EP3414706B1 (en
EP3414706A1 (en
Inventor
Jianting Wang
Jianzi HE
Junning Su
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Beijing BOE Multimedia Technology Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Beijing BOE Multimedia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd, Beijing BOE Multimedia Technology Co Ltd filed Critical BOE Technology Group Co Ltd
Publication of EP3414706A1 publication Critical patent/EP3414706A1/en
Publication of EP3414706A4 publication Critical patent/EP3414706A4/en
Application granted granted Critical
Publication of EP3414706B1 publication Critical patent/EP3414706B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143—Sensing or illuminating at different wavelengths
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • G06V10/507—Summing image-intensity values; Histogram projection analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
EP16838049.1A 2016-02-03 2016-08-15 Method and apparatus for infrared thermal image contour extraction Active EP3414706B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610078144.8A CN105678310B (en) 2016-02-03 2016-02-03 Thermal-induced imagery contour extraction method and device
PCT/CN2016/095261 WO2017133217A1 (en) 2016-02-03 2016-08-15 Method and apparatus for infrared thermal image contour extraction

Publications (3)

Publication Number Publication Date
EP3414706A1 EP3414706A1 (en) 2018-12-19
EP3414706A4 true EP3414706A4 (en) 2019-09-04
EP3414706B1 EP3414706B1 (en) 2020-10-28

Family

ID=56303549

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16838049.1A Active EP3414706B1 (en) 2016-02-03 2016-08-15 Method and apparatus for infrared thermal image contour extraction

Country Status (4)

Country Link
US (1) US10509981B2 (en)
EP (1) EP3414706B1 (en)
CN (1) CN105678310B (en)
WO (1) WO2017133217A1 (en)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105678310B (en) * 2016-02-03 2019-08-06 北京京东方多媒体科技有限公司 Thermal-induced imagery contour extraction method and device
CN107742316B (en) * 2016-12-13 2020-04-10 腾讯科技（深圳）有限公司 Image splicing point acquisition method and acquisition device
CN107395965B (en) * 2017-07-14 2019-11-29 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN107317971A (en) * 2017-07-27 2017-11-03 广东欧珀移动通信有限公司 Image defogging processing method, device, storage medium and mobile terminal
CN107767364B (en) * 2017-09-12 2021-03-23 中国林业科学研究院林业研究所 Method for accurately extracting temperature of tree canopy based on infrared thermal image
WO2019084803A1 (en) * 2017-10-31 2019-05-09 深圳市大疆创新科技有限公司 Photovoltaic panel recognition method, ground station, control apparatus, and unmanned aerial vehicle
CN108550154A (en) * 2018-04-11 2018-09-18 中国科学院西双版纳热带植物园 A kind of method of accurately measuring karst earth's surface bare rock accounting
CN109915888B (en) * 2018-06-04 2021-04-27 新昌县馁侃农业开发有限公司 Electric oil heater
EP3588221A1 (en) * 2018-06-29 2020-01-01 Saint-Gobain Glass France Method for real-time monitoring of thermal time evolution of a furnace adapted to the thermal softening of flat glass articles
CN109724364B (en) * 2018-11-13 2020-11-20 徐州云创物业服务有限公司 Deposited article capacity analysis platform
EP3898029A1 (en) * 2018-12-18 2021-10-27 Marposs Societa' Per Azioni Thermographic check of a mold in a foundry
CN109541590B (en) * 2018-12-19 2020-07-10 北京科技大学 Blast furnace burden surface point cloud imaging method
CN109714482B (en) * 2018-12-28 2021-03-30 重庆蓝岸通讯技术有限公司 Intelligent answering and hanging up talking device
US11346938B2 (en) 2019-03-15 2022-05-31 Msa Technology, Llc Safety device for providing output to an individual associated with a hazardous environment
CN110018656A (en) * 2019-04-04 2019-07-16 黄山学院 A kind of intelligent cooking control system and control method having thermal image
US11538157B1 (en) * 2019-06-27 2022-12-27 Jeffrey Norman Schoess Imaging system and method for assessing wounds
CN110660065B (en) * 2019-09-29 2023-10-20 云南电网有限责任公司电力科学研究院 Infrared fault detection and identification algorithm
CN111047601A (en) * 2019-11-22 2020-04-21 重庆邮电大学 Local window size self-adaptive industrial CT image segmentation method
CN111028309B (en) * 2019-12-06 2023-07-14 深圳大学 Insect density map construction method and device based on LoRa node
CN112991468A (en) * 2019-12-17 2021-06-18 深圳君正时代集成电路有限公司 Method for identifying infrared picture and visible light picture by using wavelength information
CN111310726B (en) * 2020-03-13 2023-04-07 长光(滁州)高端智能装备研究院 Visual identification and positioning method for ground wire in data wire
CN111415364B (en) * 2020-03-29 2024-01-23 中国科学院空天信息创新研究院 Conversion method, system and storage medium for image segmentation sample in computer vision
CN111651630B (en) * 2020-05-31 2023-12-26 广西电网有限责任公司南宁供电局 Method for improving storage efficiency of acquisition dynamic infrared thermal map by adopting key data frame
CN114972367B (en) * 2021-02-25 2024-06-07 上海复旦微电子集团股份有限公司 Method, apparatus, device and computer readable storage medium for segmenting images
CN113763266B (en) * 2021-08-11 2023-11-17 浙江大学 Honey pomelo longitudinal section and transverse section skin thickness measuring method based on image processing
CN113963369B (en) * 2021-10-26 2024-05-14 上海品览数据科技有限公司 Method for extracting skeleton line of space contour of plan view
CN114264378A (en) * 2021-12-20 2022-04-01 红原县雪月天佑农牧科技有限公司 Intelligent livestock management system and method
CN114659472A (en) * 2022-03-24 2022-06-24 山东省产品质量检验研究院 Surface area rapid test system and method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150169980A1 (en) * 2012-06-26 2015-06-18 Honda Motor Co., Ltd. Object recognition device

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101131365A (en) * 2006-08-23 2008-02-27 宝山钢铁股份有限公司 Automatic recognition method for sintered ore essential mineral phase
US9036902B2 (en) * 2007-01-29 2015-05-19 Intellivision Technologies Corporation Detector for chemical, biological and/or radiological attacks
CN102034106B (en) * 2010-12-20 2012-08-08 浙江工业大学 Image treatment-based method for extracting flame outline
AU2010257454B2 (en) * 2010-12-24 2014-03-06 Canon Kabushiki Kaisha Summary view of video objects sharing common attributes
JP5826081B2 (en) * 2012-03-19 2015-12-02 株式会社Pfu Image processing apparatus, character recognition method, and computer program
US9854154B2 (en) * 2012-05-23 2017-12-26 Mission Infrared Electro Optics Technology Co., Ltd Infrared recording device and infrared recording method
US20150244946A1 (en) * 2013-11-04 2015-08-27 Sos Agaian Method and systems for thermal image / video measurements and processing
WO2015120913A1 (en) * 2014-02-17 2015-08-20 Metaio Gmbh Method and device for detecting a touch between a first object and a second object
US20150245787A1 (en) * 2014-03-03 2015-09-03 Xerox Corporation Real-time video processing for respiratory function analysis
US10874340B2 (en) * 2014-07-24 2020-12-29 Sackett Solutions & Innovations, LLC Real time biometric recording, information analytics and monitoring systems for behavioral health management
CN104599271B (en) * 2015-01-20 2017-04-12 中国科学院半导体研究所 CIE Lab color space based gray threshold segmentation method
CN104952060B (en) * 2015-03-19 2017-10-31 杭州电子科技大学 A kind of infrared pedestrian's area-of-interest adaptivenon-uniform sampling extracting method
CN105096333A (en) * 2015-09-06 2015-11-25 河海大学常州校区 Segmentation method for infrared thermal imaging image of forest fire
US10074028B2 (en) * 2015-10-20 2018-09-11 Arizona Board Of Regents On Behalf Of Arizona State University Real-time diet assessment and food identification using thermal imaging
CN105678310B (en) * 2016-02-03 2019-08-06 北京京东方多媒体科技有限公司 Thermal-induced imagery contour extraction method and device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150169980A1 (en) * 2012-06-26 2015-06-18 Honda Motor Co., Ltd. Object recognition device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JAFFERY ZAINUL ABDIN ET AL: "Design of early fault detection technique for electrical assets using infrared thermograms", INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, JORDAN HILL, OXFORD, GB, vol. 63, 16 July 2014 (2014-07-16), pages 753 - 759, XP029044749, ISSN: 0142-0615, DOI: 10.1016/J.IJEPES.2014.06.049 *
See also references of WO2017133217A1 *

Also Published As

Publication number Publication date
EP3414706B1 (en) 2020-10-28
EP3414706A1 (en) 2018-12-19
WO2017133217A1 (en) 2017-08-10
CN105678310B (en) 2019-08-06
US10509981B2 (en) 2019-12-17
CN105678310A (en) 2016-06-15
US20180046878A1 (en) 2018-02-15

Similar Documents

Publication Publication Date Title
EP3414706A4 (en) Method and apparatus for infrared thermal image contour extraction
EP3534326A4 (en) Method and apparatus for merging infrared image and visible light image
EP3548854A4 (en) Method and apparatus for enhanced photo-thermal imaging and spectroscopy
EP3446282A4 (en) Image processing apparatus and method
EP3468178A4 (en) Image defogging method and image capture apparatus implementing image defogging
SG11201708080VA (en) Method and device for image haze removal
EP3340609C0 (en) Apparatus and method for processing image
EP3172894A4 (en) Image photographing apparatus and image photographing method
GB201503912D0 (en) Method and apparatus for processing spectral images
EP3565249A4 (en) Image processing apparatus and method
EP3139589A4 (en) Image processing apparatus and image processing method
EP3218879A4 (en) Image capturing apparatus and method
EP3440829A4 (en) Apparatus and method for processing image
EP3158729A4 (en) Image processing apparatus and image processing method thereof
EP3195589A4 (en) Method for capturing image and image capturing apparatus
EP3101892A4 (en) Image processing apparatus and method
EP3525164A4 (en) Image processing apparatus and image processing method
EP3493156A4 (en) Image processing apparatus and image processing method
EP3262844A4 (en) Image processing apparatus and method
EP3253044A4 (en) Method and apparatus for taking pictures
EP3125104A4 (en) Image forming apparatus and image forming method
EP3338629A4 (en) Image processing apparatus and image processing method thereof
EP3506623A4 (en) Image processing apparatus and method
EP3240290A4 (en) Image processing apparatus and image processing method
EP3416138A4 (en) Method and apparatus for processing image

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170302

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20190806

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/46 20060101AFI20190731BHEP

Ipc: G06T 7/136 20170101ALI20190731BHEP

Ipc: G06T 7/13 20170101ALI20190731BHEP

Ipc: G06T 7/194 20170101ALI20190731BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200513

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1328950

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016046860

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1328950

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201028

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20201028

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210301

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210128

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210129

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210128

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210228

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016046860

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602016046860

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06K0009460000

Ipc: G06V0030180000

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210831

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20210815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210228

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210815

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210815

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210815

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20160815

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230822

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201028