CN108009532A - Personal identification method and terminal based on 3D imagings - Google Patents
Personal identification method and terminal based on 3D imagings Download PDFInfo
- Publication number
- CN108009532A CN108009532A CN201711454066.8A CN201711454066A CN108009532A CN 108009532 A CN108009532 A CN 108009532A CN 201711454066 A CN201711454066 A CN 201711454066A CN 108009532 A CN108009532 A CN 108009532A
- Authority
- CN
- China
- Prior art keywords
- point
- dimensional feature
- target image
- projection
- models
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Bioinformatics & Computational Biology (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Geometry (AREA)
- Processing Or Creating Images (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a kind of personal identification method based on 3D imagings and terminal, the personal identification method to include:Obtain the 3D models of head portrait side;Three-dimensional feature point is obtained on the 3D models;The target signature point with the three-dimensional feature point position correspondence is obtained on the head portrait of target image;The three-dimensional feature point and target signature point are contrasted to obtain the similarity value of head portrait in target image;The identity of head portrait in target image is judged according to the similarity value.Identity in the personal identification method and terminal recognition image of the present invention is more accurate, and identifies that the species of image is more, and identification face is wider, and the application environment of identification is more.
Description
Technical field
The present invention relates to a kind of personal identification method and terminal based on 3D imagings.
Background technology
Recognition of face, is a kind of biological identification technology that the facial feature information based on people carries out identification.With shooting
Machine or camera collection image or video flowing containing face, and automatic detect and track face in the picture, and then to detection
The face that arrives carries out a series of correlation techniques of face, usually also referred to as Identification of Images, face recognition.
The research of face identification system is started from the 1960s, with computer technology and optical imagery skill after the eighties
The development of art is improved, and actually enters the primary application stage then 90 year later stage, and with the U.S., Germany and Japan
Based on technology is realized;The successful key of face identification system is the core algorithm for whether possessing tip, and has recognition result
There are practical discrimination and recognition speed;" face identification system " is integrated with artificial intelligence, machine recognition, machine learning, mould
A variety of professional techniques such as type theory, expert system, Computer Vision, while theory and the realization of median processing need to be combined,
It is the more recent application of living things feature recognition, the realization of its core technology, presents conversion of the weak artificial intelligence to strong artificial intelligence.
In the prior art, the front of people can only be identified when passing through recognition of face, and recognition accuracy is poor, and application field is narrow
It is narrow.
The content of the invention
The technical problem to be solved in the present invention is in order to overcome the recognition accuracy of recognition of face in the prior art poor, apply
The defects of field is narrow, there is provided it is a kind of more accurate, and identify that the species of image is more, identification face is wider array of to be imaged based on 3D
Personal identification method and terminal.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of personal identification method based on 3D imagings, its feature are that the personal identification method includes:
Obtain the 3D models of head portrait side;
Three-dimensional feature point is obtained on the 3D models;
The target signature point with the three-dimensional feature point position correspondence is obtained on the head portrait of target image;
The three-dimensional feature point and target signature point are contrasted to obtain the similarity value of head portrait in target image;
The identity of head portrait in target image is judged according to the similarity value.
It is preferred that the target signature point is two dimensional character point, it is described to contrast the three-dimensional feature point and target signature point
Included with obtaining the similarity value of target image:
The 3D models are projected on an objective plane, the projection and the angle of head portrait in the target image
Match somebody with somebody;
The projection properties point of the three-dimensional feature spot projection is obtained on the objective plane;
The projection properties point and two dimensional character point are contrasted to obtain the similarity value of head portrait in target image.
It is preferred that described project the 3D models on an objective plane includes:
Searched in pre- warehousing and determine objective plane, the 3D models are prestored in each unit plane in the pre- warehousing
On projection, pass through to contrast the two dimensional character point of target signature point and three-dimensional feature point after the projection of each unit plane and search
The objective plane.
It is preferred that the target signature point is three-dimensional feature point, it is described to contrast the three-dimensional feature point and target signature point
Included with obtaining the similarity value of target image:
The three-dimensional feature of 3D models and target image point is connected to obtain connecting line two-by-two respectively;
By the length ratio of the 3D models adjacent connecting lines and angulation adjacent connection corresponding with target image
The length ratio and angulation of line are compared to obtain the similarity value.
It is preferred that the three-dimensional feature point includes the characteristic point on ear profile, nose characteristic point, eye feature point, mouth
Characteristic point and head contour characteristic point.
The present invention also provides a kind of identity recognition terminal based on 3D imagings, its feature is, the identity recognition terminal
Including an acquisition module, a generation module, a processing module, a contrast module and a judgment module,
The acquisition module is used for the 3D models for obtaining head portrait side;
The generation module is used to obtain three-dimensional feature point on the 3D models;
The processing module is used to obtain the target with the three-dimensional feature point position correspondence on the head portrait of target image
Characteristic point;
The contrast module is used to contrast the three-dimensional feature point and target signature point to obtain head portrait in target image
Similarity value;
The judgment module is used for the identity that head portrait in target image is judged according to the similarity value.
It is preferred that the target signature point is two dimensional character point, the identity recognition terminal further include a projection module with
An and computing module;
The projection module is used to project the 3D models on an objective plane, the projection and the target image
The angle automatching of middle head portrait;
The computing module is used for the projection properties point that the three-dimensional feature spot projection is obtained on the objective plane;
The contrast module is used to contrast the projection properties point and two dimensional character point to obtain head in target image
The similarity value of picture.
It is preferred that the projection module is additionally operable to search in pre- warehousing and definite objective plane, it is pre- in the pre- warehousing
Deposit projection of the 3D models on each unit plane, by by target signature point and three-dimensional feature point in each unit plane
The objective plane is searched in two dimensional character point contrast after projection.
It is preferred that the target signature point is three-dimensional feature point, the identity recognition terminal further includes an execution module,
The execution module is used to respectively connect the three-dimensional feature of 3D models and target image point two-by-two to obtain connection
Line;
The contrast module is used for the length ratio and angulation and target image of the 3D models adjacent connecting lines
In corresponding adjacent connecting lines length ratio and angulation compare to obtain the similarity value.
It is preferred that the three-dimensional feature point includes the characteristic point on ear profile, nose characteristic point, eye feature point, mouth
Characteristic point and head contour characteristic point.
On the basis of common knowledge of the art, above-mentioned each optimum condition, can be combined, each preferably real up to the present invention
Example.
The positive effect of the present invention is:Identity in the personal identification method and terminal recognition image of the present invention is more
It is accurate to add, and identifies that the species of image is more, and identification face is wider, and the application environment of identification is more.
Brief description of the drawings
Fig. 1 is the flow chart of the personal identification method of the embodiment of the present invention 1.
Fig. 2 is the flow chart of the personal identification method of the embodiment of the present invention 2.
Embodiment
The present invention is further illustrated below by the mode of embodiment, but does not therefore limit the present invention to the reality
Apply among a scope.
Embodiment 1
The present embodiment provides a kind of identity recognition terminal, the identity recognition terminal can be mobile phone, access control system or with
Monitor the computer of connection.
By the identity recognition terminal, user can be with the head portrait identity in recognition target image, or judges the head portrait
Whether it is legal personage etc..
The identity recognition terminal is sentenced including an acquisition module, a generation module, a processing module, a contrast module, one
Disconnected module, a projection module and a computing module.
The acquisition module is used for the 3D models for obtaining head portrait side.
The generation module is used to obtain three-dimensional feature point on the 3D models.
The three-dimensional feature point include ear profile on characteristic point, nose characteristic point, eye feature point, mouth characteristic point and
Head contour characteristic point.
The processing module is used to obtain the target with the three-dimensional feature point position correspondence on the head portrait of target image
Characteristic point.The target signature point is two dimensional character point.
The projection module is additionally operable to that objective plane is searched and determined in pre- warehousing.
The projection module is used to project the 3D models on an objective plane, the projection and the target image
The angle automatching of middle head portrait.
Prestore projection of the 3D models on each unit plane in the pre- warehousing, by by target signature point and three
The objective plane is searched in two dimensional character point contrast of the dimensional feature point after the projection of each unit plane.
The computing module is used for the projection properties point that the three-dimensional feature spot projection is obtained on the objective plane.
The contrast module is used to contrast the projection properties point and two dimensional character point to obtain head in target image
The similarity value of picture.
The judgment module is used for the identity that head portrait in target image is judged according to the similarity value.
Using above-mentioned identity recognition terminal, the present embodiment also provides a kind of personal identification method, including:
Step 100, the 3D models for obtaining head portrait side.
The side is the side face of people.
Step 101, obtain three-dimensional feature point on the 3D models.
Step 102, acquisition and the target signature point of the three-dimensional feature point position correspondence on the head portrait of target image.
In the present embodiment, target image is two dimensional image, the mark in two dimensional image it can be seen that, the feature that shows
Point is target signature point.For example, have the characteristic point of left ear, auris dextra in 3D models, but target image only shows auris dextra, then by energy
The characteristic point see, shown is marked.
Step 103, search in pre- warehousing and determine objective plane, by the 3D models in the objective plane upslide
Shadow, the projection and the angle automatching of head portrait in the target image.
Prestore projection of the 3D models on each unit plane in the pre- warehousing, by by target signature point and three
The objective plane is searched in two dimensional character point contrast of the dimensional feature point after the projection of each unit plane.
The unit plane can be started with datum plane, and gradually raise up 5 degree of plane, often raises up 5 degree just around benchmark
An axis rotates 360 degree in plane, and it is a unit plane often to rotate 5 degree.
Projection on unit plane determines the position of a secondary 3D model projections back picture and the head in the target image
Image position, angle are similar.The present embodiment determines the unit plane by characteristic point, for example, target signature point is eye
Eyeball characteristic point, mouth characteristic point and left ear characteristic point, then objective plane should be that the image after 3D model projections has eyes
Characteristic point, mouth characteristic point and left ear characteristic point, i.e., in the projection with eye feature point, mouth characteristic point and left ear characteristic point
Objective plane is determined in image, while also obtain the projection on objective plane.
Step 104, the projection properties point for obtaining on the objective plane three-dimensional feature spot projection.
Step 105, contrast the projection properties point and two dimensional character point to obtain the similar of head portrait in target image
Angle value.
Step 106, the identity for judging according to the similarity value head portrait in target image.
Identity in the personal identification method and terminal recognition image of the present embodiment is more accurate, and identifies the kind of image
Class is more, and identification face is wider, and the application environment of identification is more.
Embodiment 2
The present embodiment is substantially the same manner as Example 1, the difference is that only:
The target signature point is three-dimensional feature point, and the identity recognition terminal further includes an execution module.
The execution module is used to respectively connect the three-dimensional feature of 3D models and target image point two-by-two to obtain connection
Line;
By the length ratio of the 3D models adjacent connecting lines and angulation adjacent connection corresponding with target image
The length ratio and angulation of line are compared to obtain the similarity value.
Referring to Fig. 2, the personal identification method of the present embodiment replaces with the step 103 of embodiment 1:
Step 1031, connect the three-dimensional feature of 3D models and target image point to obtain connecting line two-by-two respectively.
It is step 1032, the length ratio of the 3D models adjacent connecting lines and angulation is corresponding with target image
The length ratio and angulation of adjacent connecting lines are compared to obtain the similarity value, then perform step 106.The step
Rapid 106 be the step 106 in embodiment 1.
Characteristic point is three-dimensional feature point in the present embodiment, and the angle of adjacent two connecting line compositions is the angle of three dimensions
Degree, judges to realize the identification of 3D models by the contrast of the length to three dimensions angle and connecting line.
Although the foregoing describing the embodiment of the present invention, it will be appreciated by those of skill in the art that these
It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back
On the premise of from the principle of the present invention and essence, various changes or modifications can be made to these embodiments, but these are changed
Protection scope of the present invention is each fallen within modification.
Claims (10)
1. a kind of personal identification method based on 3D imagings, it is characterised in that the personal identification method includes:
Obtain the 3D models of head portrait side;
Three-dimensional feature point is obtained on the 3D models;
The target signature point with the three-dimensional feature point position correspondence is obtained on the head portrait of target image;
The three-dimensional feature point and target signature point are contrasted to obtain the similarity value of head portrait in target image;
The identity of head portrait in target image is judged according to the similarity value.
2. personal identification method as claimed in claim 1, it is characterised in that the target signature point is two dimensional character point, institute
State the contrast three-dimensional feature point and target signature point is included with obtaining the similarity value of target image:
The 3D models are projected on an objective plane, the projection and the angle automatching of head portrait in the target image;
The projection properties point of the three-dimensional feature spot projection is obtained on the objective plane;
The projection properties point and two dimensional character point are contrasted to obtain the similarity value of head portrait in target image.
3. personal identification method as claimed in claim 2, it is characterised in that it is described by the 3D models on an objective plane
Projection includes:
Searched in pre- warehousing and determine objective plane, the 3D models are prestored on each unit plane in the pre- warehousing
Projection, described in the two dimensional character point contrast of target signature point and three-dimensional feature point after the projection of each unit plane is searched
Objective plane.
4. personal identification method as claimed in claim 1, it is characterised in that the target signature point is three-dimensional feature point, institute
State the contrast three-dimensional feature point and target signature point is included with obtaining the similarity value of target image:
The three-dimensional feature of 3D models and target image point is connected to obtain connecting line two-by-two respectively;
By the length ratio of the 3D models adjacent connecting lines and angulation adjacent connecting lines corresponding with target image
Length ratio and angulation are compared to obtain the similarity value.
5. personal identification method as claimed in claim 1, it is characterised in that the three-dimensional feature point is included on ear profile
Characteristic point, nose characteristic point, eye feature point, mouth characteristic point and head contour characteristic point.
6. it is a kind of based on 3D imaging identity recognition terminal, it is characterised in that the identity recognition terminal include an acquisition module,
One generation module, a processing module, a contrast module and a judgment module,
The acquisition module is used for the 3D models for obtaining head portrait side;
The generation module is used to obtain three-dimensional feature point on the 3D models;
The processing module is used to obtain the target signature with the three-dimensional feature point position correspondence on the head portrait of target image
Point;
The contrast module is used to contrast the three-dimensional feature point and target signature point to obtain the similar of head portrait in target image
Angle value;
The judgment module is used for the identity that head portrait in target image is judged according to the similarity value.
7. identity recognition terminal as claimed in claim 6, it is characterised in that the target signature point is two dimensional character point, institute
State identity recognition terminal and further include a projection module and a computing module;
The projection module is used to project the 3D models on an objective plane, the projection and head in the target image
The angle automatching of picture;
The computing module is used for the projection properties point that the three-dimensional feature spot projection is obtained on the objective plane;
The contrast module is used to contrast the projection properties point and two dimensional character point to obtain head portrait in target image
Similarity value.
8. identity recognition terminal as claimed in claim 7, it is characterised in that the projection module is additionally operable to look into pre- warehousing
Look for and determine objective plane, prestore projection of the 3D models on each unit plane in the pre- warehousing, by by target
The objective plane is searched in two dimensional character point contrast of the characteristic point with three-dimensional feature point after the projection of each unit plane.
9. identity recognition terminal as claimed in claim 6, it is characterised in that the target signature point is three-dimensional feature point, institute
State identity recognition terminal and further include an execution module,
The execution module is used to connect the three-dimensional feature of 3D models and target image point to obtain connecting line two-by-two respectively;
The contrast module be used for by the length ratio of the 3D models adjacent connecting lines and angulation with it is right in target image
The length ratio and angulation for the adjacent connecting lines answered are compared to obtain the similarity value.
10. identity recognition terminal as claimed in claim 6, it is characterised in that the three-dimensional feature point is included on ear profile
Characteristic point, nose characteristic point, eye feature point, mouth characteristic point and head contour characteristic point.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711454066.8A CN108009532A (en) | 2017-12-28 | 2017-12-28 | Personal identification method and terminal based on 3D imagings |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711454066.8A CN108009532A (en) | 2017-12-28 | 2017-12-28 | Personal identification method and terminal based on 3D imagings |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108009532A true CN108009532A (en) | 2018-05-08 |
Family
ID=62062044
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711454066.8A Pending CN108009532A (en) | 2017-12-28 | 2017-12-28 | Personal identification method and terminal based on 3D imagings |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108009532A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110188604A (en) * | 2019-04-18 | 2019-08-30 | 盎锐(上海)信息科技有限公司 | Face identification method and device based on 2D and 3D image |
CN110188616A (en) * | 2019-05-05 | 2019-08-30 | 盎锐(上海)信息科技有限公司 | Space modeling method and device based on 2D and 3D image |
CN110414423A (en) * | 2019-07-25 | 2019-11-05 | 上海鹰瞳医疗科技有限公司 | Personal identification method and equipment |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7415152B2 (en) * | 2005-04-29 | 2008-08-19 | Microsoft Corporation | Method and system for constructing a 3D representation of a face from a 2D representation |
CN101510257A (en) * | 2009-03-31 | 2009-08-19 | 华为技术有限公司 | Human face similarity degree matching method and device |
CN102194131A (en) * | 2011-06-01 | 2011-09-21 | 华南理工大学 | Fast human face recognition method based on geometric proportion characteristic of five sense organs |
CN102254154A (en) * | 2011-07-05 | 2011-11-23 | 南京大学 | Method for authenticating human-face identity based on three-dimensional model reconstruction |
CN102982165A (en) * | 2012-12-10 | 2013-03-20 | 南京大学 | Large-scale human face image searching method |
CN105654048A (en) * | 2015-12-30 | 2016-06-08 | 四川川大智胜软件股份有限公司 | Multi-visual-angle face comparison method |
-
2017
- 2017-12-28 CN CN201711454066.8A patent/CN108009532A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7415152B2 (en) * | 2005-04-29 | 2008-08-19 | Microsoft Corporation | Method and system for constructing a 3D representation of a face from a 2D representation |
CN101510257A (en) * | 2009-03-31 | 2009-08-19 | 华为技术有限公司 | Human face similarity degree matching method and device |
CN102194131A (en) * | 2011-06-01 | 2011-09-21 | 华南理工大学 | Fast human face recognition method based on geometric proportion characteristic of five sense organs |
CN102254154A (en) * | 2011-07-05 | 2011-11-23 | 南京大学 | Method for authenticating human-face identity based on three-dimensional model reconstruction |
CN102982165A (en) * | 2012-12-10 | 2013-03-20 | 南京大学 | Large-scale human face image searching method |
CN105654048A (en) * | 2015-12-30 | 2016-06-08 | 四川川大智胜软件股份有限公司 | Multi-visual-angle face comparison method |
Non-Patent Citations (2)
Title |
---|
谢剑斌等: "《视觉感知与智能视频监控》", 31 March 2012, 长沙:国防科技大学出版社 * |
赵坚勇: "《应用电视技术》", 31 December 2013, 西安:西安电子科技大学出版社 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110188604A (en) * | 2019-04-18 | 2019-08-30 | 盎锐(上海)信息科技有限公司 | Face identification method and device based on 2D and 3D image |
CN110188616A (en) * | 2019-05-05 | 2019-08-30 | 盎锐(上海)信息科技有限公司 | Space modeling method and device based on 2D and 3D image |
CN110188616B (en) * | 2019-05-05 | 2023-02-28 | 上海盎维信息技术有限公司 | Space modeling method and device based on 2D and 3D images |
CN110414423A (en) * | 2019-07-25 | 2019-11-05 | 上海鹰瞳医疗科技有限公司 | Personal identification method and equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107609383B (en) | 3D face identity authentication method and device | |
CN107748869B (en) | 3D face identity authentication method and device | |
TWI751161B (en) | Terminal equipment, smart phone, authentication method and system based on face recognition | |
CN107633165B (en) | 3D face identity authentication method and device | |
CN105574518B (en) | Method and device for detecting living human face | |
CN109271950B (en) | Face living body detection method based on mobile phone forward-looking camera | |
CN105740778B (en) | Improved three-dimensional human face in-vivo detection method and device | |
CN105740779B (en) | Method and device for detecting living human face | |
TW202006602A (en) | Three-dimensional living-body face detection method, face authentication recognition method, and apparatuses | |
CN108470169A (en) | Face identification system and method | |
US20170091550A1 (en) | Multispectral eye analysis for identity authentication | |
WO2016010720A1 (en) | Multispectral eye analysis for identity authentication | |
WO2016010724A1 (en) | Multispectral eye analysis for identity authentication | |
Medioni et al. | Identifying noncooperative subjects at a distance using face images and inferred three-dimensional face models | |
Boehnen et al. | A fast multi-modal approach to facial feature detection | |
TWI335544B (en) | Iris recognition system | |
CN106991390A (en) | A kind of hand-held testimony of a witness Compare System and method based on deep learning | |
CN109190522B (en) | Living body detection method based on infrared camera | |
CN110866454B (en) | Face living body detection method and system and computer readable storage medium | |
CN108197549A (en) | Face identification method and terminal based on 3D imagings | |
CN106650574A (en) | Face identification method based on PCANet | |
CN112818722A (en) | Modular dynamically configurable living body face recognition system | |
WO2020079741A1 (en) | Iris authentication device, iris authentication method, and recording medium | |
CN108009532A (en) | Personal identification method and terminal based on 3D imagings | |
CN108537131A (en) | A kind of recognition of face biopsy method based on human face characteristic point and optical flow field |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180508 |