CN108009532A - Personal identification method and terminal based on 3D imagings - Google Patents

Personal identification method and terminal based on 3D imagings Download PDF

Info

Publication number
CN108009532A
CN108009532A CN201711454066.8A CN201711454066A CN108009532A CN 108009532 A CN108009532 A CN 108009532A CN 201711454066 A CN201711454066 A CN 201711454066A CN 108009532 A CN108009532 A CN 108009532A
Authority
CN
China
Prior art keywords
point
dimensional feature
target image
projection
models
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711454066.8A
Other languages
Chinese (zh)
Inventor
吴跃华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Angrui Shanghai Information Technology Co Ltd
Original Assignee
Angrui Shanghai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Angrui Shanghai Information Technology Co Ltd filed Critical Angrui Shanghai Information Technology Co Ltd
Priority to CN201711454066.8A priority Critical patent/CN108009532A/en
Publication of CN108009532A publication Critical patent/CN108009532A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/165Detection; Localisation; Normalisation using facial parts and geometric relationships

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a kind of personal identification method based on 3D imagings and terminal, the personal identification method to include:Obtain the 3D models of head portrait side;Three-dimensional feature point is obtained on the 3D models;The target signature point with the three-dimensional feature point position correspondence is obtained on the head portrait of target image;The three-dimensional feature point and target signature point are contrasted to obtain the similarity value of head portrait in target image;The identity of head portrait in target image is judged according to the similarity value.Identity in the personal identification method and terminal recognition image of the present invention is more accurate, and identifies that the species of image is more, and identification face is wider, and the application environment of identification is more.

Description

Personal identification method and terminal based on 3D imagings
Technical field
The present invention relates to a kind of personal identification method and terminal based on 3D imagings.
Background technology
Recognition of face, is a kind of biological identification technology that the facial feature information based on people carries out identification.With shooting Machine or camera collection image or video flowing containing face, and automatic detect and track face in the picture, and then to detection The face that arrives carries out a series of correlation techniques of face, usually also referred to as Identification of Images, face recognition.
The research of face identification system is started from the 1960s, with computer technology and optical imagery skill after the eighties The development of art is improved, and actually enters the primary application stage then 90 year later stage, and with the U.S., Germany and Japan Based on technology is realized;The successful key of face identification system is the core algorithm for whether possessing tip, and has recognition result There are practical discrimination and recognition speed;" face identification system " is integrated with artificial intelligence, machine recognition, machine learning, mould A variety of professional techniques such as type theory, expert system, Computer Vision, while theory and the realization of median processing need to be combined, It is the more recent application of living things feature recognition, the realization of its core technology, presents conversion of the weak artificial intelligence to strong artificial intelligence.
In the prior art, the front of people can only be identified when passing through recognition of face, and recognition accuracy is poor, and application field is narrow It is narrow.
The content of the invention
The technical problem to be solved in the present invention is in order to overcome the recognition accuracy of recognition of face in the prior art poor, apply The defects of field is narrow, there is provided it is a kind of more accurate, and identify that the species of image is more, identification face is wider array of to be imaged based on 3D Personal identification method and terminal.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of personal identification method based on 3D imagings, its feature are that the personal identification method includes:
Obtain the 3D models of head portrait side;
Three-dimensional feature point is obtained on the 3D models;
The target signature point with the three-dimensional feature point position correspondence is obtained on the head portrait of target image;
The three-dimensional feature point and target signature point are contrasted to obtain the similarity value of head portrait in target image;
The identity of head portrait in target image is judged according to the similarity value.
It is preferred that the target signature point is two dimensional character point, it is described to contrast the three-dimensional feature point and target signature point Included with obtaining the similarity value of target image:
The 3D models are projected on an objective plane, the projection and the angle of head portrait in the target image Match somebody with somebody;
The projection properties point of the three-dimensional feature spot projection is obtained on the objective plane;
The projection properties point and two dimensional character point are contrasted to obtain the similarity value of head portrait in target image.
It is preferred that described project the 3D models on an objective plane includes:
Searched in pre- warehousing and determine objective plane, the 3D models are prestored in each unit plane in the pre- warehousing On projection, pass through to contrast the two dimensional character point of target signature point and three-dimensional feature point after the projection of each unit plane and search The objective plane.
It is preferred that the target signature point is three-dimensional feature point, it is described to contrast the three-dimensional feature point and target signature point Included with obtaining the similarity value of target image:
The three-dimensional feature of 3D models and target image point is connected to obtain connecting line two-by-two respectively;
By the length ratio of the 3D models adjacent connecting lines and angulation adjacent connection corresponding with target image The length ratio and angulation of line are compared to obtain the similarity value.
It is preferred that the three-dimensional feature point includes the characteristic point on ear profile, nose characteristic point, eye feature point, mouth Characteristic point and head contour characteristic point.
The present invention also provides a kind of identity recognition terminal based on 3D imagings, its feature is, the identity recognition terminal Including an acquisition module, a generation module, a processing module, a contrast module and a judgment module,
The acquisition module is used for the 3D models for obtaining head portrait side;
The generation module is used to obtain three-dimensional feature point on the 3D models;
The processing module is used to obtain the target with the three-dimensional feature point position correspondence on the head portrait of target image Characteristic point;
The contrast module is used to contrast the three-dimensional feature point and target signature point to obtain head portrait in target image Similarity value;
The judgment module is used for the identity that head portrait in target image is judged according to the similarity value.
It is preferred that the target signature point is two dimensional character point, the identity recognition terminal further include a projection module with An and computing module;
The projection module is used to project the 3D models on an objective plane, the projection and the target image The angle automatching of middle head portrait;
The computing module is used for the projection properties point that the three-dimensional feature spot projection is obtained on the objective plane;
The contrast module is used to contrast the projection properties point and two dimensional character point to obtain head in target image The similarity value of picture.
It is preferred that the projection module is additionally operable to search in pre- warehousing and definite objective plane, it is pre- in the pre- warehousing Deposit projection of the 3D models on each unit plane, by by target signature point and three-dimensional feature point in each unit plane The objective plane is searched in two dimensional character point contrast after projection.
It is preferred that the target signature point is three-dimensional feature point, the identity recognition terminal further includes an execution module,
The execution module is used to respectively connect the three-dimensional feature of 3D models and target image point two-by-two to obtain connection Line;
The contrast module is used for the length ratio and angulation and target image of the 3D models adjacent connecting lines In corresponding adjacent connecting lines length ratio and angulation compare to obtain the similarity value.
It is preferred that the three-dimensional feature point includes the characteristic point on ear profile, nose characteristic point, eye feature point, mouth Characteristic point and head contour characteristic point.
On the basis of common knowledge of the art, above-mentioned each optimum condition, can be combined, each preferably real up to the present invention Example.
The positive effect of the present invention is:Identity in the personal identification method and terminal recognition image of the present invention is more It is accurate to add, and identifies that the species of image is more, and identification face is wider, and the application environment of identification is more.
Brief description of the drawings
Fig. 1 is the flow chart of the personal identification method of the embodiment of the present invention 1.
Fig. 2 is the flow chart of the personal identification method of the embodiment of the present invention 2.
Embodiment
The present invention is further illustrated below by the mode of embodiment, but does not therefore limit the present invention to the reality Apply among a scope.
Embodiment 1
The present embodiment provides a kind of identity recognition terminal, the identity recognition terminal can be mobile phone, access control system or with Monitor the computer of connection.
By the identity recognition terminal, user can be with the head portrait identity in recognition target image, or judges the head portrait Whether it is legal personage etc..
The identity recognition terminal is sentenced including an acquisition module, a generation module, a processing module, a contrast module, one Disconnected module, a projection module and a computing module.
The acquisition module is used for the 3D models for obtaining head portrait side.
The generation module is used to obtain three-dimensional feature point on the 3D models.
The three-dimensional feature point include ear profile on characteristic point, nose characteristic point, eye feature point, mouth characteristic point and Head contour characteristic point.
The processing module is used to obtain the target with the three-dimensional feature point position correspondence on the head portrait of target image Characteristic point.The target signature point is two dimensional character point.
The projection module is additionally operable to that objective plane is searched and determined in pre- warehousing.
The projection module is used to project the 3D models on an objective plane, the projection and the target image The angle automatching of middle head portrait.
Prestore projection of the 3D models on each unit plane in the pre- warehousing, by by target signature point and three The objective plane is searched in two dimensional character point contrast of the dimensional feature point after the projection of each unit plane.
The computing module is used for the projection properties point that the three-dimensional feature spot projection is obtained on the objective plane.
The contrast module is used to contrast the projection properties point and two dimensional character point to obtain head in target image The similarity value of picture.
The judgment module is used for the identity that head portrait in target image is judged according to the similarity value.
Using above-mentioned identity recognition terminal, the present embodiment also provides a kind of personal identification method, including:
Step 100, the 3D models for obtaining head portrait side.
The side is the side face of people.
Step 101, obtain three-dimensional feature point on the 3D models.
Step 102, acquisition and the target signature point of the three-dimensional feature point position correspondence on the head portrait of target image.
In the present embodiment, target image is two dimensional image, the mark in two dimensional image it can be seen that, the feature that shows Point is target signature point.For example, have the characteristic point of left ear, auris dextra in 3D models, but target image only shows auris dextra, then by energy The characteristic point see, shown is marked.
Step 103, search in pre- warehousing and determine objective plane, by the 3D models in the objective plane upslide Shadow, the projection and the angle automatching of head portrait in the target image.
Prestore projection of the 3D models on each unit plane in the pre- warehousing, by by target signature point and three The objective plane is searched in two dimensional character point contrast of the dimensional feature point after the projection of each unit plane.
The unit plane can be started with datum plane, and gradually raise up 5 degree of plane, often raises up 5 degree just around benchmark An axis rotates 360 degree in plane, and it is a unit plane often to rotate 5 degree.
Projection on unit plane determines the position of a secondary 3D model projections back picture and the head in the target image Image position, angle are similar.The present embodiment determines the unit plane by characteristic point, for example, target signature point is eye Eyeball characteristic point, mouth characteristic point and left ear characteristic point, then objective plane should be that the image after 3D model projections has eyes Characteristic point, mouth characteristic point and left ear characteristic point, i.e., in the projection with eye feature point, mouth characteristic point and left ear characteristic point Objective plane is determined in image, while also obtain the projection on objective plane.
Step 104, the projection properties point for obtaining on the objective plane three-dimensional feature spot projection.
Step 105, contrast the projection properties point and two dimensional character point to obtain the similar of head portrait in target image Angle value.
Step 106, the identity for judging according to the similarity value head portrait in target image.
Identity in the personal identification method and terminal recognition image of the present embodiment is more accurate, and identifies the kind of image Class is more, and identification face is wider, and the application environment of identification is more.
Embodiment 2
The present embodiment is substantially the same manner as Example 1, the difference is that only:
The target signature point is three-dimensional feature point, and the identity recognition terminal further includes an execution module.
The execution module is used to respectively connect the three-dimensional feature of 3D models and target image point two-by-two to obtain connection Line;
By the length ratio of the 3D models adjacent connecting lines and angulation adjacent connection corresponding with target image The length ratio and angulation of line are compared to obtain the similarity value.
Referring to Fig. 2, the personal identification method of the present embodiment replaces with the step 103 of embodiment 1:
Step 1031, connect the three-dimensional feature of 3D models and target image point to obtain connecting line two-by-two respectively.
It is step 1032, the length ratio of the 3D models adjacent connecting lines and angulation is corresponding with target image The length ratio and angulation of adjacent connecting lines are compared to obtain the similarity value, then perform step 106.The step Rapid 106 be the step 106 in embodiment 1.
Characteristic point is three-dimensional feature point in the present embodiment, and the angle of adjacent two connecting line compositions is the angle of three dimensions Degree, judges to realize the identification of 3D models by the contrast of the length to three dimensions angle and connecting line.
Although the foregoing describing the embodiment of the present invention, it will be appreciated by those of skill in the art that these It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back On the premise of from the principle of the present invention and essence, various changes or modifications can be made to these embodiments, but these are changed Protection scope of the present invention is each fallen within modification.

Claims (10)

1. a kind of personal identification method based on 3D imagings, it is characterised in that the personal identification method includes:
Obtain the 3D models of head portrait side;
Three-dimensional feature point is obtained on the 3D models;
The target signature point with the three-dimensional feature point position correspondence is obtained on the head portrait of target image;
The three-dimensional feature point and target signature point are contrasted to obtain the similarity value of head portrait in target image;
The identity of head portrait in target image is judged according to the similarity value.
2. personal identification method as claimed in claim 1, it is characterised in that the target signature point is two dimensional character point, institute State the contrast three-dimensional feature point and target signature point is included with obtaining the similarity value of target image:
The 3D models are projected on an objective plane, the projection and the angle automatching of head portrait in the target image;
The projection properties point of the three-dimensional feature spot projection is obtained on the objective plane;
The projection properties point and two dimensional character point are contrasted to obtain the similarity value of head portrait in target image.
3. personal identification method as claimed in claim 2, it is characterised in that it is described by the 3D models on an objective plane Projection includes:
Searched in pre- warehousing and determine objective plane, the 3D models are prestored on each unit plane in the pre- warehousing Projection, described in the two dimensional character point contrast of target signature point and three-dimensional feature point after the projection of each unit plane is searched Objective plane.
4. personal identification method as claimed in claim 1, it is characterised in that the target signature point is three-dimensional feature point, institute State the contrast three-dimensional feature point and target signature point is included with obtaining the similarity value of target image:
The three-dimensional feature of 3D models and target image point is connected to obtain connecting line two-by-two respectively;
By the length ratio of the 3D models adjacent connecting lines and angulation adjacent connecting lines corresponding with target image Length ratio and angulation are compared to obtain the similarity value.
5. personal identification method as claimed in claim 1, it is characterised in that the three-dimensional feature point is included on ear profile Characteristic point, nose characteristic point, eye feature point, mouth characteristic point and head contour characteristic point.
6. it is a kind of based on 3D imaging identity recognition terminal, it is characterised in that the identity recognition terminal include an acquisition module, One generation module, a processing module, a contrast module and a judgment module,
The acquisition module is used for the 3D models for obtaining head portrait side;
The generation module is used to obtain three-dimensional feature point on the 3D models;
The processing module is used to obtain the target signature with the three-dimensional feature point position correspondence on the head portrait of target image Point;
The contrast module is used to contrast the three-dimensional feature point and target signature point to obtain the similar of head portrait in target image Angle value;
The judgment module is used for the identity that head portrait in target image is judged according to the similarity value.
7. identity recognition terminal as claimed in claim 6, it is characterised in that the target signature point is two dimensional character point, institute State identity recognition terminal and further include a projection module and a computing module;
The projection module is used to project the 3D models on an objective plane, the projection and head in the target image The angle automatching of picture;
The computing module is used for the projection properties point that the three-dimensional feature spot projection is obtained on the objective plane;
The contrast module is used to contrast the projection properties point and two dimensional character point to obtain head portrait in target image Similarity value.
8. identity recognition terminal as claimed in claim 7, it is characterised in that the projection module is additionally operable to look into pre- warehousing Look for and determine objective plane, prestore projection of the 3D models on each unit plane in the pre- warehousing, by by target The objective plane is searched in two dimensional character point contrast of the characteristic point with three-dimensional feature point after the projection of each unit plane.
9. identity recognition terminal as claimed in claim 6, it is characterised in that the target signature point is three-dimensional feature point, institute State identity recognition terminal and further include an execution module,
The execution module is used to connect the three-dimensional feature of 3D models and target image point to obtain connecting line two-by-two respectively;
The contrast module be used for by the length ratio of the 3D models adjacent connecting lines and angulation with it is right in target image The length ratio and angulation for the adjacent connecting lines answered are compared to obtain the similarity value.
10. identity recognition terminal as claimed in claim 6, it is characterised in that the three-dimensional feature point is included on ear profile Characteristic point, nose characteristic point, eye feature point, mouth characteristic point and head contour characteristic point.
CN201711454066.8A 2017-12-28 2017-12-28 Personal identification method and terminal based on 3D imagings Pending CN108009532A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711454066.8A CN108009532A (en) 2017-12-28 2017-12-28 Personal identification method and terminal based on 3D imagings

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711454066.8A CN108009532A (en) 2017-12-28 2017-12-28 Personal identification method and terminal based on 3D imagings

Publications (1)

Publication Number Publication Date
CN108009532A true CN108009532A (en) 2018-05-08

Family

ID=62062044

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711454066.8A Pending CN108009532A (en) 2017-12-28 2017-12-28 Personal identification method and terminal based on 3D imagings

Country Status (1)

Country Link
CN (1) CN108009532A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110188604A (en) * 2019-04-18 2019-08-30 盎锐(上海)信息科技有限公司 Face identification method and device based on 2D and 3D image
CN110188616A (en) * 2019-05-05 2019-08-30 盎锐(上海)信息科技有限公司 Space modeling method and device based on 2D and 3D image
CN110414423A (en) * 2019-07-25 2019-11-05 上海鹰瞳医疗科技有限公司 Personal identification method and equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7415152B2 (en) * 2005-04-29 2008-08-19 Microsoft Corporation Method and system for constructing a 3D representation of a face from a 2D representation
CN101510257A (en) * 2009-03-31 2009-08-19 华为技术有限公司 Human face similarity degree matching method and device
CN102194131A (en) * 2011-06-01 2011-09-21 华南理工大学 Fast human face recognition method based on geometric proportion characteristic of five sense organs
CN102254154A (en) * 2011-07-05 2011-11-23 南京大学 Method for authenticating human-face identity based on three-dimensional model reconstruction
CN102982165A (en) * 2012-12-10 2013-03-20 南京大学 Large-scale human face image searching method
CN105654048A (en) * 2015-12-30 2016-06-08 四川川大智胜软件股份有限公司 Multi-visual-angle face comparison method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7415152B2 (en) * 2005-04-29 2008-08-19 Microsoft Corporation Method and system for constructing a 3D representation of a face from a 2D representation
CN101510257A (en) * 2009-03-31 2009-08-19 华为技术有限公司 Human face similarity degree matching method and device
CN102194131A (en) * 2011-06-01 2011-09-21 华南理工大学 Fast human face recognition method based on geometric proportion characteristic of five sense organs
CN102254154A (en) * 2011-07-05 2011-11-23 南京大学 Method for authenticating human-face identity based on three-dimensional model reconstruction
CN102982165A (en) * 2012-12-10 2013-03-20 南京大学 Large-scale human face image searching method
CN105654048A (en) * 2015-12-30 2016-06-08 四川川大智胜软件股份有限公司 Multi-visual-angle face comparison method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
谢剑斌等: "《视觉感知与智能视频监控》", 31 March 2012, 长沙:国防科技大学出版社 *
赵坚勇: "《应用电视技术》", 31 December 2013, 西安:西安电子科技大学出版社 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110188604A (en) * 2019-04-18 2019-08-30 盎锐(上海)信息科技有限公司 Face identification method and device based on 2D and 3D image
CN110188616A (en) * 2019-05-05 2019-08-30 盎锐(上海)信息科技有限公司 Space modeling method and device based on 2D and 3D image
CN110188616B (en) * 2019-05-05 2023-02-28 上海盎维信息技术有限公司 Space modeling method and device based on 2D and 3D images
CN110414423A (en) * 2019-07-25 2019-11-05 上海鹰瞳医疗科技有限公司 Personal identification method and equipment

Similar Documents

Publication Publication Date Title
CN107609383B (en) 3D face identity authentication method and device
CN107748869B (en) 3D face identity authentication method and device
TWI751161B (en) Terminal equipment, smart phone, authentication method and system based on face recognition
CN107633165B (en) 3D face identity authentication method and device
CN105574518B (en) Method and device for detecting living human face
CN109271950B (en) Face living body detection method based on mobile phone forward-looking camera
CN105740778B (en) Improved three-dimensional human face in-vivo detection method and device
CN105740779B (en) Method and device for detecting living human face
TW202006602A (en) Three-dimensional living-body face detection method, face authentication recognition method, and apparatuses
CN108470169A (en) Face identification system and method
US20170091550A1 (en) Multispectral eye analysis for identity authentication
WO2016010720A1 (en) Multispectral eye analysis for identity authentication
WO2016010724A1 (en) Multispectral eye analysis for identity authentication
Medioni et al. Identifying noncooperative subjects at a distance using face images and inferred three-dimensional face models
Boehnen et al. A fast multi-modal approach to facial feature detection
TWI335544B (en) Iris recognition system
CN106991390A (en) A kind of hand-held testimony of a witness Compare System and method based on deep learning
CN109190522B (en) Living body detection method based on infrared camera
CN110866454B (en) Face living body detection method and system and computer readable storage medium
CN108197549A (en) Face identification method and terminal based on 3D imagings
CN106650574A (en) Face identification method based on PCANet
CN112818722A (en) Modular dynamically configurable living body face recognition system
WO2020079741A1 (en) Iris authentication device, iris authentication method, and recording medium
CN108009532A (en) Personal identification method and terminal based on 3D imagings
CN108537131A (en) A kind of recognition of face biopsy method based on human face characteristic point and optical flow field

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180508