CN107194940A - A kind of coloured image contour extraction method based on color space and line segment - Google Patents

A kind of coloured image contour extraction method based on color space and line segment Download PDF

Info

Publication number
CN107194940A
CN107194940A CN201710366047.3A CN201710366047A CN107194940A CN 107194940 A CN107194940 A CN 107194940A CN 201710366047 A CN201710366047 A CN 201710366047A CN 107194940 A CN107194940 A CN 107194940A
Authority
CN
China
Prior art keywords
point
fcr
lsd
traversal
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710366047.3A
Other languages
Chinese (zh)
Inventor
夏旸
王硕
单联强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Computer Technology and Applications
Original Assignee
Beijing Institute of Computer Technology and Applications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Computer Technology and Applications filed Critical Beijing Institute of Computer Technology and Applications
Priority to CN201710366047.3A priority Critical patent/CN107194940A/en
Publication of CN107194940A publication Critical patent/CN107194940A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

The present invention relates to a kind of coloured image contour extraction method based on color space and line segment, belong to technical field of image processing.The method of the present invention has carried out further amendment and optimization to color space division result, eliminates obvious non-profile information, and real edge, stronger in the reliability of final result closer in image.Experimental study shows, compared with traditional edge detection algorithm, and the present invention to different images without carrying out threshold value setting, so as to improve the uniformity and robustness of contour detecting.

Description

A kind of coloured image contour extraction method based on color space and line segment
Technical field
The present invention relates to technical field of image processing, and in particular to a kind of coloured image wheel based on color space and line segment Wide extracting method.
Background technology
In image procossing, profile has very important effect:It denotes the area-of-interest in image.The inspection of profile The initial step for being typically feature extraction and identification is surveyed, in human face analysis and Medical Image Processing, image outline is follow-up place Reason provides important information.It is basis and the important component of many computer visions and Video Applications, meanwhile, it is also One of classic problem of computer vision.
Profile is connected by edge pixel and formed.Profile can be disconnected or closing.Disk wheel Exterior feature corresponds to the border in region, and the pixel in region can be filled up by filling algorithm;The profile of disconnection is probably region The part on border, it is also possible to image linear feature.Contrast between region is too weak or edge detection threshold sets too high It is likely to produce the profile of interruption.
The first step of existing contour detecting algorithm is typically rim detection, and conventional Local Edge Detection method is main Have:First differential, second differential and template operation etc., relatively more representational is Canny boundary operators.Although rim detection is calculated Method can extract the edge pixel for including profile information according to the difference between pixel, but can't generally be formed in cognition and have The profile of effect, it does not assign target as an entirety.One profile corresponds generally to a series of point, that is, in image A curve.Method for expressing may be different according to different situations.In addition, during the setting of threshold value is edge detection algorithm The problem of can not avoiding, too high threshold value can cause the loss of marginal information;Too low threshold value can then retain excessive details letter Breath, when extracting profile, these detailed information can influence the accuracy and continuity of profile.
The content of the invention
(1) technical problem to be solved
The technical problem to be solved in the present invention is:How the uniformity and robustness of contour detecting is lifted.
(2) technical scheme
In order to solve the above-mentioned technical problem, the invention provides a kind of coloured image profile based on color space and line segment Extracting method, comprises the following steps:
S1, image segmentation is carried out based on color feature space obtain the edge point set FCR of target image;
S2, the edge point set LSD based on the line segment detecting method extraction target image;
S3, common factor is taken to set FCR and LSD, the gradient magnitude size of pressing that obtained point is concentrated is ranked up, simultaneously It is not access to set institute's access state a little;Define the queue structure being initially empty;
S4, since the maximum point of gradient magnitude, depth-first traversal is carried out with queue structure:Face in current point Pc 8- In domain, if there is the point for belonging to FCR edges, queue structure is added using the point as new point, and using the point newly added as Pc;If failing to face in domain in 8- and finding the marginal point that FCR is indicated, find in the nearest LSD testing results point in Pc peripheries, if most Near LSD testing results point is Pn, if the Euclidean distance between Pc and Pn is less than predetermined threshold value T, Pn is also added to currently In queue structure, and it regard Pn as Pc;Depth-first traversal is carried out in this way, until traveling through all FCR point sets;
S5, FCR and LSD are occured simultaneously in point and the point in obtained queue structure take union, be used as the target figure The contours extract result of picture.
Preferably, in step S4, the point faced 8- in domain, if finding multiple qualified, preferential choose meets variables D The point of the current direction of growth of record;The variables D is recorded be newly joined queue respectively by two component dx, dy compositions, dx, dy Offset of the point relative to a upper addition point in the horizontal direction and the vertical direction in structure, if only one of which in queue structure Then dx is put, dy records offset of the addition point relative to initial point.Two-dimensional Cartesian coordinate system is set up by initial point of current point, It is positive direction on the right side of horizontal direction, left side is negative direction, and vertical direction top is positive direction, is issued as negative direction.
Preferably, it is 2 also in current traversal point periphery radius in profile along along FCR result set growth courses in step S4 Look for whether there is LSD testing results point in the range of the diamond structure of pixel, if without LSD testing results point, record variable Err Value Jia 1, when Err exceedes predetermined threshold value, is judged to traveling through the flase drop scope for entering FCR, then removes and currently travel through point, from upper One traversal point restarts traversal;Variable Err initial values are 0.
(3) beneficial effect
The method of the present invention has carried out further amendment and optimization to color space division result, eliminates obvious non- Profile information, real edge, stronger in the reliability of final result closer in image.Experimental study shows, with tradition Edge detection algorithm compare, the present invention to different image without carrying out threshold value setting, so as to improve the one of contour detecting Cause property and robustness.
Brief description of the drawings
Fig. 1 is profile direction of growth update method schematic diagram;
The original image that Fig. 2 uses for experiment;
Fig. 3 is that LSD detects the edge result obtained;
Fig. 4 is the edge extracting result that color space is merged;
Fig. 5 is contours extract result of the invention.
Embodiment
To make the purpose of the present invention, content and advantage clearer, with reference to the accompanying drawings and examples, to the present invention's Embodiment is described in further detail.
The invention provides a kind of coloured image contour extraction method based on color space and line segment, including following step Suddenly:
S1, image segmentation is carried out based on color feature space obtain the edge point set FCR of target image;
Cluster based on color space has been primarily focused in the integration to division result with fusion method.It is existing Clustering method is more ripe, and specific algorithm refers to MIGNOTTE M.Segmentation by fusion of histogram based K-Means Clusters in different color spaces.IEEE Transactions on Image Processing,vol.17,MAY2008:780-787.
Color space effectively can be divided into by several disjoint areas using K-Means clusters by the color to pixel Domain, because the limitation of each color space is, it is necessary to using multiple color spaces, repeat this process and generate Ns cluster result, And this Ns result is merged.In view of the contact of pixel spatially, by removing small piece in division result of isolated area, Make division result that spatially also there is continuity, so as to reach segmentation purpose.
S2, the edge point set LSD based on the line segment detecting method extraction target image;
Traditional line segment detecting method carries out Hough transform after usually first carrying out Canny rim detections, so as to extract The straight line constituted containing the marginal point for having more than a certain threshold value, by intercepting these line segmentations into line segment one by one. The defect of Hough transform is computationally intensive, takes very big memory space;Because the presence of quantization error causes parameter not Ghost peak in certainty and parameter space etc..
For this problem, the quick line segment detecting method LSD that this step is used does not utilize gradient magnitude information, but sharp With the direction of gradient.The close point of gradient direction is connected into the region with unified direction by this method by iteration first, The minimum rectangle structure in this region can be surrounded by finding again, so as to complete the detection of line segment structure.In addition, the method is also containing wrong Controlling mechanism is missed, so that the correctness of testing result is ensure that, the image-region for including a large amount of textures, especially comprising big The region of isotropic feature is measured, (the inspection that usual Hough transform occurs to such region of line segment structure is not will detect that Survey result undesirable).
The quick Line Segment Detection Algorithm that this step is used (R.GROMPONE VON GIOI, J.JAKUBOWICZ, J.M.MOREL,G.RANDALL.LSD:A fast line segment detector with a false detection control[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.32,no.4,APRIL 2010:722-732.) in be described later in detail.
The extracting method of profile is divided into 2 classes on the whole:Top-down splitting method and bottom-up merging method. The division of above-mentioned color space belongs to top-down approach with merging, and line segment detecting method then belongs to Bottom-up approach.Two kinds Method obtains profile information from different approaches respectively.
Color space fusion method is more protruded in terms of image overall profile is obtained, before this has been mainly used in image The difference of scape and background color, but easily there is deviation in detail section.The result of Line segment detection be in image have it is similar Gradient direction, and Grad exceedes a series of line segment structures of certain numerical value, and is not complete profile.But, so Obtained result can not as image profile, it is still necessary to go to the part unless profile.The advantage of two methods is to be not required to Adjusting thresholds are carried out to different types of image, the present invention wishes on the premise of this characteristic is kept, as precisely as possible Find the profile in image.Therefore, the present invention obtains preliminary profile results using color space segmentation, recycles Line segment detection It is modified, to determine final profile.
Due to the difference of color space and line segment detecting method in itself, the division result to same image generally there are Difference, for the point P at same coordinate (x, y) place, there is following situation:
②P∈LSD&&P∈FCR;
LSD represents to merge identified edge point set with color space by Line segment detection respectively with FCR herein.
For situation 1. and 2., the conclusion drawn due to two methods is consistent, therefore need not carry out specially treated;For 3. and 4., two methods obtain opposite result, then next need to carry out further judgement to confirm whether P points are to be sought A part for the profile looked for.
S3, common factor is taken to set FCR and LSD, the gradient magnitude size of pressing that obtained point is concentrated is ranked up, simultaneously It is not access to set institute's access state a little;Define the queue structure Queue (n) being initially empty;
S4, since the maximum point of gradient magnitude, depth-first traversal is carried out with queue structure:Face in current point Pc 8- In domain, if there is the point for belonging to FCR edges, queue knot is added using the point as new point (status indication be do not access point) Structure, and it regard the point newly added as Pc;If failing to face in domain in 8- and finding the marginal point that FCR is indicated, find on Pc peripheries most Near LSD testing results point, if nearest LSD testing results point is Pn, if the Euclidean distance between Pc and Pn is less than default threshold Pn, then be also added in current queue structure by value T, and using Pn as Pc, if finding multiple nearest Pn, takes Euclidean distance That minimum Pn is used as Pc;Depth-first traversal is carried out in this way, until traveling through all FCR point sets;
In step S4, in secret one assumes it is that the image outline point obtained by FCR is all accurate, therefore traversed All FCR result points have all been added in final image outline in journey.In fact, by the FCR point sets obtained and differing Surely it is entirely the part of image outline, therefore needs in ergodic process priority and choice.Specifically, on edge During the edge point set traversal that FCR is obtained, the direction that a variables D records marginal growth, the then point faced 8- in domain, if looking for are set up To multiple qualified, then the point for the current direction of growth for meeting or being recorded close to variables D is preferentially chosen, if meeting or approaching Degree is identical, then chooses the point of first discovery, the order of lookup can be from top to bottom, from left to right;The variables D is by two Individual component dx, dy are constituted, and dx, dy records the point being newly joined in queue structure relative to a upper addition point in the horizontal direction respectively With the offset in vertical direction, the dx if only one of which point in queue structure, dy record addition point relative to initial point Offset, it is positive direction to be set up by initial point of current point on the right side of two-dimensional Cartesian coordinate system, horizontal direction, and left side is negative direction, It is positive direction above vertical direction, issues as negative direction.As shown in figure 1, the P that sets up an office is initial point, if being then moved to point A, dx =+1, dy=0;If being moved to point B, dx=+1, dy=+1;If being moved to point C, dx=0, dy=(- 1).Remaining is similarly.
Due to variables D represent be contour line change trend, we are not relevant for profile specifically moves how many, be The symbol for being concerned about (dx, the dy) that is recorded in its direction, variables D is to illustrate the direction preferentially chosen.
It is 2 pixels also in current traversal point periphery radius in profile along along FCR result set growth courses in step S4 Look for whether there is LSD testing results point in the range of diamond structure, if without LSD testing results point, record variable Err values Jia 1, When Err exceedes predetermined threshold value, it is judged to traveling through the flase drop scope for entering FCR, then removes current traversal point, from upper one time Go through and a little restart traversal;Variable Err initial values are 0.
In profile along along FCR result set growth courses, it is necessary to record the result for whether having LSD in current traversal point peripheral point Point, in case profile grows to FCR flase drop scope.Therefore, in the present invention, use using current traversal point periphery radius as 2 pixels Diamond structure element strel in the range of look for whether there are LSD result points, see formula (1).Central point is the point currently traversed Position, if for, without LSD result points, record variable Err values Jia 1, when Err is more than certain threshold value, are then determined as in 1 point in figure Traversal enters FCR flase drop scope, and algorithm is recalled.
S5, FCR and LSD are occured simultaneously in point and the point in obtained queue structure take union, be used as the target figure The contours extract result of picture.
If obtaining multiple contours extract results, the image outline obtained after completion above step still cannot function as final As a result, it is contemplated that the continuity of profile is, it is necessary to remove isolated profile point.Therefore, obtained profile information is also counted Length, i.e., the number of pixel in profile, remove length be less than predetermined threshold value profile, you can obtain final result.
The experimental result of the above method is given below, and is compared with single use FCR and LSD test result.It is real The original image used is tested as shown in Fig. 2 from Berkeley image data bases.
The present invention is tested to the image in image data base, and the result of four width images is given here.Examination In testing, using tri- color spaces of RGB, HSV, LAB, Line segment detection angle threshold is set to 22.5 °, and final profile removes the stage Threshold value is set to 8.
Line segment detection result is as shown in Figure 3.It can be seen from the second width figure in some cases in result containing more with wheel The detailed information of wide unrelated marginal information, especially interior of articles, thus cannot function as generating unique foundation of final profile:
Color space segmentation result is as shown in figure 4, for the sake of substantially, overstriking has been carried out to edge.Note the 3rd width image The lower left corner occur in that obvious flase drop.
The final profile obtained by this paper algorithms is as shown in Figure 5.
Method proposed by the present invention has carried out further repairing to color space division result it can be seen from experimental result Just with optimization, obvious non-profile information is eliminated, the real edge closer in image, in the reliability of final result more By force.Experimental study shows that compared with traditional edge detection algorithm, the advantage of this paper algorithms is without to different images Threshold value setting is carried out, so as to improve the uniformity and robustness of contour detecting.
Described above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, without departing from the technical principles of the invention, some improvement and deformation can also be made, these improve and deformed Also it should be regarded as protection scope of the present invention.

Claims (3)

1. a kind of coloured image contour extraction method based on color space and line segment, it is characterised in that comprise the following steps:
S1, image segmentation is carried out based on color feature space obtain the edge point set FCR of target image;
S2, the edge point set LSD based on the line segment detecting method extraction target image;
S3, common factor is taken to set FCR and LSD, the gradient magnitude size of pressing that obtained point is concentrated is ranked up, and is set simultaneously Access state a little not access;Define the queue structure being initially empty;
S4, since the maximum point of gradient magnitude, depth-first traversal is carried out with queue structure:Face domain in current point Pc 8- It is interior, if there is the point for belonging to FCR edges, queue structure is added using the point as new point, and regard the point newly added as Pc; If failing to face in domain in 8- and finding the marginal point that FCR is indicated, find in the nearest LSD testing results point in Pc peripheries, if recently LSD testing results point be Pn, if Euclidean distance between Pc and Pn is less than predetermined threshold value T, Pn is also added to current team In array structure, and it regard Pn as Pc;Depth-first traversal is carried out in this way, until traveling through all FCR point sets;
S5, FCR and LSD are occured simultaneously in point and the point in obtained queue structure take union, be used as the target image Contours extract result.
2. the method as described in claim 1, it is characterised in that in step S4, the point faced 8- in domain, if finding multiple meet Condition, the preferential point for choosing the current direction of growth for meeting variables D record;The variables D is by two component dx, dy compositions, Dx, dy record the point that is newly joined in queue structure relative to a upper addition point in the horizontal direction and the vertical direction inclined respectively Shifting amount, the dx if only one of which point in queue structure, dy record addition point relative to initial point offset, using current point as It is positive direction that initial point, which is set up on the right side of two-dimensional Cartesian coordinate system, horizontal direction, and left side is for pros above negative direction, vertical direction To issuing as negative direction.
3. the method as described in claim 1, it is characterised in that in step S4, in profile along along FCR result set growth courses, Also in current traversal point periphery radius to look for whether there is LSD testing results point in the range of the diamond structure of 2 pixels, if nothing LSD testing results point, then record variable Err values Jia 1, Err exceed predetermined threshold value when, be judged to traveling through the mistake for entering FCR Scope is examined, then removes current traversal point, traversal is restarted from upper one traversal point;Variable Err initial values are 0.
CN201710366047.3A 2017-05-23 2017-05-23 A kind of coloured image contour extraction method based on color space and line segment Pending CN107194940A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710366047.3A CN107194940A (en) 2017-05-23 2017-05-23 A kind of coloured image contour extraction method based on color space and line segment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710366047.3A CN107194940A (en) 2017-05-23 2017-05-23 A kind of coloured image contour extraction method based on color space and line segment

Publications (1)

Publication Number Publication Date
CN107194940A true CN107194940A (en) 2017-09-22

Family

ID=59875795

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710366047.3A Pending CN107194940A (en) 2017-05-23 2017-05-23 A kind of coloured image contour extraction method based on color space and line segment

Country Status (1)

Country Link
CN (1) CN107194940A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109299665A (en) * 2018-08-29 2019-02-01 上海悠络客电子科技股份有限公司 A kind of humanoid profile based on LSD algorithm describes method
CN110853056A (en) * 2019-10-31 2020-02-28 广州华多网络科技有限公司 Method, device and equipment for generating image segmentation information and storage medium
CN110853063A (en) * 2019-10-31 2020-02-28 广州华多网络科技有限公司 Image segmentation information processing method, device, equipment and storage medium
CN115511835A (en) * 2022-09-28 2022-12-23 西安航空学院 Image processing test platform

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102156882A (en) * 2011-04-14 2011-08-17 西北工业大学 Method for detecting airport target based on high-resolution remote sensing image
CN103714538A (en) * 2013-12-20 2014-04-09 中联重科股份有限公司 Road edge detection method, device and vehicle

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102156882A (en) * 2011-04-14 2011-08-17 西北工业大学 Method for detecting airport target based on high-resolution remote sensing image
CN103714538A (en) * 2013-12-20 2014-04-09 中联重科股份有限公司 Road edge detection method, device and vehicle

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
夏旸等: "基于颜色与线段的图像轮廓提取算法", 《信息安全与通信保密》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109299665A (en) * 2018-08-29 2019-02-01 上海悠络客电子科技股份有限公司 A kind of humanoid profile based on LSD algorithm describes method
CN109299665B (en) * 2018-08-29 2023-04-14 上海悠络客电子科技股份有限公司 Human-shaped contour description method based on LSD algorithm
CN110853056A (en) * 2019-10-31 2020-02-28 广州华多网络科技有限公司 Method, device and equipment for generating image segmentation information and storage medium
CN110853063A (en) * 2019-10-31 2020-02-28 广州华多网络科技有限公司 Image segmentation information processing method, device, equipment and storage medium
CN110853063B (en) * 2019-10-31 2023-04-07 广州方硅信息技术有限公司 Image segmentation information processing method, device, equipment and storage medium
CN110853056B (en) * 2019-10-31 2023-09-19 广州方硅信息技术有限公司 Method, device, equipment and storage medium for generating image segmentation information
CN115511835A (en) * 2022-09-28 2022-12-23 西安航空学院 Image processing test platform
CN115511835B (en) * 2022-09-28 2023-07-25 西安航空学院 Image processing test platform

Similar Documents

Publication Publication Date Title
CN105913093B (en) A kind of template matching method for Text region processing
JP6710135B2 (en) Cell image automatic analysis method and system
CN114581742B (en) Linearity-based connected domain clustering fusion method, device, system and medium
CN107194940A (en) A kind of coloured image contour extraction method based on color space and line segment
TW202144766A (en) Two-dimensional PCB appearance defect real-time automatic detection technology based on deep learning
Huyan et al. Illumination compensation model with k-means algorithm for detection of pavement surface cracks with shadow
CN113724231A (en) Industrial defect detection method based on semantic segmentation and target detection fusion model
Zhou et al. Optic disc and cup segmentation in retinal images for glaucoma diagnosis by locally statistical active contour model with structure prior
CN107705301A (en) A kind of highway graticule damage testing method based on unmanned plane highway map picture
US6606408B1 (en) Image segmenting apparatus and method
Khosravi et al. Performance evaluation of object-based and pixel-based building detection algorithms from very high spatial resolution imagery
Jiao et al. Color image-guided boundary-inconsistent region refinement for stereo matching
CN108875454A (en) Traffic sign recognition method, device and vehicle
Vajravelu et al. Machine learning techniques to detect bleeding frame and area in wireless capsule endoscopy video
Choi et al. Localizing slab identification numbers in factory scene images
CN112085723A (en) Automatic detection method for spring jumping fault of truck bolster
CN113011498B (en) Feature point extraction and matching method, system and medium based on color image
CN114742803A (en) Platelet aggregation detection method combining deep learning and digital image processing algorithm
Kim License plate location method unaffected by variation in size and aspect ratio
CN113506297A (en) Printing data identification method based on big data processing
Campadelli et al. A color based method for face detection
Xu et al. A multitarget visual attention based algorithm on crack detection of industrial explosives
CN116681707B (en) Cornea fluorescein staining image identification grading method
CN110458042A (en) A kind of number of probes detection method in fluorescence CTC
Lertchuwongsa et al. Enhancing a disparity map by color segmentation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170922