CN103676036B - Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how - Google Patents

Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how Download PDF

Info

Publication number
CN103676036B
CN103676036B CN201310693520.0A CN201310693520A CN103676036B CN 103676036 B CN103676036 B CN 103676036B CN 201310693520 A CN201310693520 A CN 201310693520A CN 103676036 B CN103676036 B CN 103676036B
Authority
CN
China
Prior art keywords
micro
image
fibre faceplate
lens
fibre
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310693520.0A
Other languages
Chinese (zh)
Other versions
CN103676036A (en
Inventor
金伟其
裘溯
米凤文
李力
王霞
林青
张笑颜
刘军
刘志刚
倪宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201310693520.0A priority Critical patent/CN103676036B/en
Publication of CN103676036A publication Critical patent/CN103676036A/en
Application granted granted Critical
Publication of CN103676036B publication Critical patent/CN103676036B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Telescopes (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

The present invention relates to a kind of many visual fields bionic compound eyes Low Light Level Imaging System of micro-the fibre faceplate based on how, belong to optical image technology field.The present invention's design how micro-optical fiber panel structure and corresponding optical system, fibre faceplate is coupled with CCD/CMOS image device, realize carrying out imaging to multiple sub-visual field on single image device, much more micro-light cone/fibre faceplate each visual field can generating portion overlapping, make subimage can piece into a width Large visual angle (>=100 °) image together, and the overlapping part of each subimage can be utilized to obtain target three-dimensional information.Realize the lll night vision imaging system of a kind of miniaturization, lightweight, Large visual angle (>=100 °), simplify system architecture, reduce system cost.

Description

Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how
Technical field
The present invention relates to a kind of many visual fields bionic compound eyes Low Light Level Imaging System of micro-the fibre faceplate based on how, belong to optical image technology field.
Background technology
Artificial bionic compound eye technology is conducive to the imaging system obtaining miniaturization, lightweight, Large visual angle, and can obtain target three dimensional local information, can be widely used in the field such as Large visual angle watch-dog, fast target positioning system, have broad application prospects.Therefore, all kinds of artificial bionic compound eye technology is one of focus direction of association area research.
Traditional Large visual angle imaging system generally adopts fish eye lens or adopts multiple cameras.Fish eye lens volume weight is large, and imaging distortion is serious, can not obtain target three dimensional local information; Adopt the Large visual angle observing system complex structure of multiple cameras formation, cost is high, data volume is large.Therefore, adopt artificial compound eye technology on single detector, obtain multiple sub-view field image, be that a kind of easy miniaturization, lightweight, cost are low, the scheme of structure simple possible, and target three-dimensional information can be obtained fast, there is boundless application prospect.
In recent years, Japan, Germany, Britain and each research institution domestic are studied artificial compound eye technology.Domestic and international researchist adopts microlens array structure mostly, and each lenticule becomes a low resolution subimage on the detector, and subimage can adopt super resolution technology to synthesize a panel height image in different resolution.Japanese JunTanida in 2000 etc. propose a kind of TOMBO based on dragonfly compound eye structural (ThinObservationModulebyBoundOptics) compound eye imaging system.This system adopts dull and stereotyped microlens array, introduces intermediate light separation layer and is separated to realize each optical channel, be similar to as each passage adds an aperture diaphragm, control areas imaging between lenticule with detection flat board.A same part for all passages almost simultaneously object observing, each passage can obtain the image of a low resolution, finally by the Super-resolution Reconstruction of the method realize target pictures such as Super-resolution Image Restoration.This research group in 2004, on the basis of TOMBO system, also been proposed the color imaging method of compound eye.
The German Research group that DuparreJ. in 2004 leads, based on the design concept of coordination compound eye, proposes and has made bionical coordination compound eye imaging system AACO (ArtificialAppositionCompoundEyeObjective).This system is also based on dull and stereotyped microlens array, structurally similar to TOMBO, and difference is that microlens array and optical confinement layer are produced in the both sides of same glass substrate, and is closely connected with light sensor array.The thickness of this system only has 320 μm, and visual field can reach 21 °, F=2.6.After this, this group proposes again to replace common even microlens array with microlens array of warbling, and under the prerequisite ensureing image quality, system dimension is reduced further.Also proposed " bunch eye " structure based on Superposition compound eye design concept the same year, it still adopts planar structure, but introduces field lens array in system, thus obtains the visual field larger than AACO.What above bionic compound eyes adopted is dull and stereotyped microlens array, although structure comparatively curved surface easily realize, visual field is also restricted, generally about about 20 °.If visual field need be expanded further, other auxiliary optical component need be added after microlens array.DuparreJ. people is waited namely to utilize three layer flat plate microlens array by field expander to 70 ° × 15 °.DuparreJ. in 2007 etc. are used for curved-surface structure coordination compound eye design concept, propose the artificial compound eye imaging system SACE of sphere (ShericalArtificialCompoundEye).SACE is primarily of microlens array, relay optics and sensor array are formed, and microlens array is used for curved-surface structure by first time, laser microlithography is utilized microlens array 112 × 112 to be engraved in groove surface or the convex surface of a thin meniscus lens, lenticule and sensor one_to_one corresponding, by relay optics by image transfer to sensor array, the visual field that each micro mirror is corresponding different, constitutes multiple optical channels of different directions.SACE can obtain the imaged viewing angle larger than AACO, and visual field reaches 38 ° × 38 °.
Applied optics National Key Laboratory of Changchun Inst. of Optics and Fine Mechanics, Chinese Academy of Sciences Zhang Hongxin in 2006 etc. devise a kind of plyability bionic compound eyes structure, the public same detector array of multiple ommatidium, and multiple ommatidium all has contribution to the brightness value of pixel single on detector.In this research, researchist uses Zemax to carry out trace to light path, has carried out initial analysis to system.
Within 2010, Sichuan University adopts the structure similar with SACE, with plano-convex BK7 glass for substrate, devises spherical micro mirror array system.System primarily of plano-convex micro mirror array, separating layer and sensor array composition, not only by field expander to 60 °, and be convenient to system install.In addition, system without additional relay optical element, can direct imaging on flat surface sensor; The separating layer that system is introduced can limit areas imaging better, makes the independence imaging of each visual field.
The people such as the advanced Research of Integration institute Di Si in Chinese Academy of Sciences Shenzhen in 2010 have carried out Curve guide impeller to above-mentioned optical micro lens array structure, propose the design proposal making non-homogeneous microlens array on curved substrate.The focal length of lens changes with the difference of its present position, to guarantee that each lens all can obtain good image quality on photo-detector.Ray tracing result shows, the program significantly improves the image quality of peripheral field.
In the bionic compound eyes imaging system adopting microlens array to realize, each aperture of lens is very little, some is even in micron dimension, by optics microfabrication precision and the restriction of debuging level, add that detector array supporting with it also needs special processing, therefore this compound eye system also rarely practical application at present.
In recent years, also certain company domestic is had to propose to adopt the compound eye system structure (patent publication No.: CN102819053A) of ball end face light cone fit lens array, but in this system architecture, lens numbers is many, size is little, be difficult to lay diaphragm between each lens, to ensure that the light between each lens can be isolated mutually, unlikelyly affect image quality.
Summary of the invention
The object of the invention is the processing conditions restriction for existing bionic compound eyes system and image quality deficiency, propose a kind of many visual fields bionic compound eyes Low Light Level Imaging System of micro-the fibre faceplate based on how.
The design concept of bionic compound eyes imaging system of the present invention is: design how micro-optical fiber panel structure and corresponding optical system, fibre faceplate is coupled with CCD/CMOS image device, realize carrying out imaging to multiple sub-visual field on single image device, much more micro-light cone/fibre faceplate each visual field can generating portion overlapping, make subimage can piece into a width Large visual angle (>=100 °) image together, and the overlapping part of each subimage can be utilized to obtain target three-dimensional information.
Many visual fields bionic compound eyes imaging system of micro-fibre faceplate based on how, its composition comprises multiple aperture optical system, how micro-fibre faceplate, image intensifying CCD/CMOS, three-dimensional focus adjusting mechanism and image acquisition and processing plate.Wherein, image intensifying CCD/CMOS comprises image intensifier, coupled system and video camera; Image acquisition and processing plate comprises image capture module, image collages module and target three-positional fix module.
The annexation of above-mentioned each ingredient is: multiple aperture optical system is positioned at how micro-fibre faceplate upper end, how micro-fibre faceplate is connected with the image intensifier direct-coupling of image intensifying CCD/CMOS, the image on multiple micro-via fibre optic image transmission to image intensifier cathode plane; Wherein, the image intensifier of image intensifying CCD/CMOS, coupled system are connected from top to bottom in turn with video camera; The image that video camera exports reaches image processing board through video line.
Described multiple aperture optical system comprises n non-spherical lens, multiple diaphragm, a lens case support, and wherein lens case support adopts spherical lens bracket or turtleback shape lens bracket.N lens are used for optical imagery, n lens are fixed on support, wherein, consider that how each micro-normal direction is different from shaft axis of optic fibre angular separation in micro-fibre faceplate, n non-spherical lens focal length is identical, bore is different, for the lens that micro-the employing bore that angle is less is less, for the lens that micro-the employing bore that angle is larger is larger, the size of bore makes the imaging uniform-illumination on each micro-; Use diaphragm interval between adjacent two lens, avoid image that each lens become to interfere with each other.
Described how micro-fibre faceplate is on ordinary optic fibre panel end, process n micro-, and micro-quantity is consistent with lens numbers.Requirement on machining accuracy is lower than ± 0.05mm.Lens in the corresponding multiple aperture optical system in each micro-position, realize imaging function jointly.How the image that obtains of micro-fibre faceplate is optical system coupled or couple directly on image intensifier cathode plane by multiple aperture, is strengthened, image intensifier video screen gets a distinct image by image intensifier to image.
Described image intensifying CCD/CMOS is with fibre faceplate window, and fibre faceplate window is positioned at image intensifier cathode plane position.Image exports coupled system to from image intensifier video screen, coupled system adopts optical coupling system or light-cone QCD sum rules system, under the unconfined conditions such as system bulk, length, video screen output intensity, adopt optical coupled, under requiring more harsh condition, light-cone QCD sum rules is being adopted to system bulk, length, video screen output intensity.Video camera adopts ccd video camera or cmos camera.
Described image acquisition and processing plate comprises image processing algorithm, completes image acquisition, image collages and target three-positional fix function.
Beneficial effect
The present invention realizes the lll night vision imaging system of a kind of miniaturization, lightweight, Large visual angle (>=100 °), and on single image device, realize the imaging of multiple sub-eye pattern picture, and the overlapping part of each subimage can be utilized to obtain target three-dimensional information, simplify system architecture, reduce system cost.
Accompanying drawing explanation
Fig. 1 is the structural representation of the many visual fields bionic compound eyes Low Light Level Imaging System that the present invention is based on how micro-fibre faceplate;
Fig. 2 is how micro-fibre faceplate Machine Design figure in embodiment; Wherein, (a) is side view, and (b) is front elevation;
Fig. 3 is the structural representation of how micro-light cone in embodiment; Wherein, wherein, (a) is side view, and (b) is front elevation;
Label declaration: 1-how micro-fibre faceplate, 2-multiple aperture optical system, 3-image intensifier, 4-CCD/CMOS video camera, 5-is coupled light cone, the three-dimensional focus adjusting mechanism of 6-, 7-optical mount, 8-camera lens mounting hole, 9-diaphragm.
Embodiment
In order to further illustrate object of the present invention, design proposal and advantage, below in conjunction with the drawings and specific embodiments, the present invention is further illustrated.
Specific implementation method described in the present embodiment and accompanying drawing are exemplary, only for explaining the present invention, instead of limitation of the present invention.
As shown in Figure 1, for of the present invention a kind of based on how many visual fields of micro-light cone/fibre faceplate, the embodiment of the simultaneous type that partly overlaps bionic compound eyes imaging system, primarily of multiple aperture optical system, how micro-fibre faceplate, image intensifying CCD/CMOS, three-dimensional focus adjusting mechanism and image acquisition and processing plate are formed.
In the present embodiment, described multiple aperture optical system adopt 9 lens be used for optical imagery, 9 lens are fixed on a spherical lens bracket or Polyhedral lens bracket, each lens of optical system directly with the diaphragm interval (as shown in Figure 2) being installed on optical lens holder inside, in order to avoid each sub-eye pattern picture interferes with each other in imaging process.
Described how micro-fibre faceplate end face is processed to 9 micro-, as shown in Figure 3.Each micro-forms 9 sub-eyes with the lens corresponding matching of 9 in multiple aperture optical system, realizes imaging function.
9 sub-eye pattern pictures pass picture to single CCD/CMOS image device through fibre faceplate, and single imager part produces 9 little images in compound eye visual field.It is overlapping to there is part in 9 sub-eye pattern pictures, utilizes overlapping part 9 sub-image collages can be become a width Large visual angle image, and utilizes the overlapping part of each sub-eye pattern picture, can realize binocular/multi-view stereo vision, judge target location.
Above-described specific descriptions; the object of inventing, technical scheme and beneficial effect are further described; be understood that; the foregoing is only specific embodiments of the invention; the protection domain be not intended to limit the present invention; within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (4)

1. many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how, is characterized in that: comprise multiple aperture optical system, how micro-fibre faceplate, image intensifying CCD/CMOS, three-dimensional focus adjusting mechanism and image acquisition and processing plate; Wherein, image intensifying CCD/CMOS comprises image intensifier, coupled system and video camera;
The annexation of above-mentioned each ingredient is: multiple aperture optical system is positioned at how micro-fibre faceplate upper end, how micro-fibre faceplate is connected with the image intensifier direct-coupling of image intensifying CCD/CMOS, the image on multiple micro-via fibre optic image transmission to image intensifier cathode plane; Wherein, the image intensifier of image intensifying CCD/CMOS, coupled system are connected from top to bottom in turn with video camera; The image that video camera exports reaches image processing board through video line;
Described multiple aperture optical system comprises n non-spherical lens, multiple diaphragm, a lens case support, and wherein lens case support adopts spherical lens bracket or turtleback shape lens bracket; N non-spherical lens is fixed on support, wherein, how in micro-fibre faceplate, each micro-normal direction is different from shaft axis of optic fibre angular separation, n non-spherical lens focal length is identical, bore is different, for the lens that micro-the employing bore that angle is less is less, for the lens that micro-the employing bore that angle is larger is larger, the size of bore makes the imaging uniform-illumination on each micro-; Diaphragm interval is used between adjacent two lens;
Described how micro-fibre faceplate is ordinary optic fibre panel end is processed n micro-, and micro-quantity is consistent with lens numbers; The corresponding multiple aperture optical system lens in each micro-position, common imaging; How the image that obtains of micro-fibre faceplate is optical system coupled or couple directly on image intensifier cathode plane by multiple aperture, is strengthened, image intensifier video screen gets a distinct image by image intensifier to image;
Described image intensifying CCD/CMOS is with fibre faceplate window, and fibre faceplate window is positioned at image intensifier cathode plane position; Image exports coupled system to from image intensifier video screen, and coupled system adopts optical coupling system or light-cone QCD sum rules system;
Described image acquisition and processing plate comprises image processing algorithm, completes image acquisition, image collages and target three-positional fix function.
2. many visual fields bionic compound eyes Low Light Level Imaging System of micro-the fibre faceplate based on how according to claim 1, is characterized in that: micro-requirement on machining accuracy is lower than ± 0.05mm.
3. many visual fields bionic compound eyes Low Light Level Imaging System of micro-the fibre faceplate based on how according to claim 1, it is characterized in that: under the unconfined conditions such as system bulk, length, video screen output intensity, adopt optical coupled, under requiring more harsh condition, light-cone QCD sum rules is being adopted to system bulk, length, video screen output intensity; Video camera adopts ccd video camera or cmos camera.
4. many visual fields bionic compound eyes Low Light Level Imaging System of micro-the fibre faceplate based on how according to claim 1, is characterized in that: how micro-fibre faceplate each visual field can generating portion overlapping, piece into the image of width visual field >=100 ° together.
CN201310693520.0A 2013-12-17 2013-12-17 Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how Expired - Fee Related CN103676036B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310693520.0A CN103676036B (en) 2013-12-17 2013-12-17 Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310693520.0A CN103676036B (en) 2013-12-17 2013-12-17 Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how

Publications (2)

Publication Number Publication Date
CN103676036A CN103676036A (en) 2014-03-26
CN103676036B true CN103676036B (en) 2015-09-02

Family

ID=50314141

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310693520.0A Expired - Fee Related CN103676036B (en) 2013-12-17 2013-12-17 Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how

Country Status (1)

Country Link
CN (1) CN103676036B (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104165626B (en) * 2014-06-18 2019-08-13 长春理工大学 Bionic compound eyes imageable target positioning system
CN104375270B (en) * 2014-09-22 2017-05-17 北京理工大学 Design method of multi-aperture partial overlapping bionic compound eye imaging optical system
CN104601871A (en) * 2015-02-16 2015-05-06 杭州清渠科技有限公司 Image acquiring method based on fly-eye lens
CN104599322A (en) * 2015-02-16 2015-05-06 杭州清渠科技有限公司 Super-resolution three-dimensional image reconstruction method based on fly-eye lens
WO2017015164A1 (en) * 2015-07-17 2017-01-26 Bio-Rad Laboratories, Inc. Contact imaging devices for fluorescence applications
CN105578003A (en) * 2015-12-17 2016-05-11 沈阳理工大学 Multichannel large-visual-angle bionic compound eye imaging detection apparatus
CN105911640A (en) * 2016-06-01 2016-08-31 浙江工商大学 All-fiber bionic compound eye imaging system
CN106546994B (en) * 2016-10-13 2019-03-01 中国科学院上海技术物理研究所 Airbound target detection method based on two-way alertness quantum dot compound eye system
CN106526606B (en) * 2016-10-13 2019-01-01 中国科学院上海技术物理研究所 Two-way alertness quantum dot laser space tracking detection system based on bionic compound eyes
CN107302695A (en) * 2017-05-31 2017-10-27 天津大学 A kind of electronics compound eye system based on bionic visual mechanism
CN108181666B (en) * 2017-12-26 2020-02-18 中国科学院上海技术物理研究所 Wide-area coverage narrow-area multi-point key reconnaissance detection method
CN108965678A (en) * 2018-09-04 2018-12-07 北京理工大学 A kind of multiple aperture becomes the bionical thermal imaging method of spatial resolution and device
CN109870805A (en) * 2019-04-12 2019-06-11 吉林大学 A kind of Conformal Optical System and its design method based on multiple aperture
CN110595625B (en) * 2019-09-17 2021-02-02 北京理工大学 Cross-shaped five-aperture view field partially-overlapped bionic thermal imaging system
CN110769135A (en) * 2019-10-17 2020-02-07 天津大学 Bionic compound eye image acquisition device
CN114559983A (en) * 2020-11-27 2022-05-31 南京拓控信息科技股份有限公司 Omnibearing dynamic three-dimensional image detection device for subway train body

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7587109B1 (en) * 2008-09-02 2009-09-08 Spectral Imaging Laboratory Hybrid fiber coupled artificial compound eye
CN102819053A (en) * 2012-07-12 2012-12-12 南京迈得特光学有限公司 Large field-of-view bionic compound eye visual system adopting dome light cone
CN102937733A (en) * 2012-10-24 2013-02-20 江苏大学 Adjustable compound eye structure optical receiver with visible light wireless communication large view field

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7587109B1 (en) * 2008-09-02 2009-09-08 Spectral Imaging Laboratory Hybrid fiber coupled artificial compound eye
CN102819053A (en) * 2012-07-12 2012-12-12 南京迈得特光学有限公司 Large field-of-view bionic compound eye visual system adopting dome light cone
CN102937733A (en) * 2012-10-24 2013-02-20 江苏大学 Adjustable compound eye structure optical receiver with visible light wireless communication large view field

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Miniature imaging devices for airborne platforms;L.C.Laycock,et al;《Electro-Optical and Infrared Systems》;20071231;第7113卷;全文 *
多孔径仿生复眼成像***技术进展综述;金伟其等;《光学与光电技术》;20111231;第9卷(第6期);第10页第2段至第12页第3段,附图8-10 *
阴浩等.像增强型CCD成像***的分辨力分析.《光子学报》.2010,第39卷第96-100页. *

Also Published As

Publication number Publication date
CN103676036A (en) 2014-03-26

Similar Documents

Publication Publication Date Title
CN103676036B (en) Many visual fields bionic compound eyes Low Light Level Imaging System of micro-fibre faceplate based on how
CN107991838B (en) Self-adaptive three-dimensional imaging system
CN109031642A (en) A kind of display methods and system and device of general stereoscopic micro- Glassless
CN106338819A (en) Digital viewing full-view-field AR (augmented reality) multimedia telescope
TW201222139A (en) Stereoscopic imaging apparatus
CN107948470A (en) Camera module and mobile equipment
CN109975968A (en) A kind of stereomicroscope with full filed angle stereovision function
CN107707795A (en) A kind of dual camera imaging acquisition method
CN107613173A (en) A kind of dual camera imaging acquisition system
JP2018152748A (en) Imaging/display device of stereoscopic image and head mount device
CN102256100A (en) Two-way imaging-display system based on micro lens array and panel display integration
CN109270678A (en) A kind of novel high-resolution light field microscope structure
CN206584106U (en) A kind of video is micro-, photography large visual field optical system
CN208675366U (en) Double-colored camera
WO2019223090A1 (en) Intelligent mixed reality telescope
JP2003307800A (en) Device for photographing and displaying three- dimensional image
CN207283666U (en) Dual camera imaging acquisition system
CN108769501A (en) Double-colored camera
CN201828766U (en) Deformable digital three-dimensional camera
CN208239718U (en) A kind of Intelligent Hybrid reality telescope
CN209311704U (en) A kind of thermal imaging fusion night vision device
CN102346289B (en) The low distortion wide angle monitoring lens in a kind of large visual field
CN106249382B (en) A kind of video is micro-, large visual field optical system of photographing
CN207833091U (en) Double mirror and thermal infrared imager
CN207516656U (en) A kind of imaging device for different visual angles imaging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150902

Termination date: 20211217

CF01 Termination of patent right due to non-payment of annual fee