CN110226162A - Personal identification method, device and electronic equipment - Google Patents

Personal identification method, device and electronic equipment Download PDF

Info

Publication number
CN110226162A
CN110226162A CN201880000006.5A CN201880000006A CN110226162A CN 110226162 A CN110226162 A CN 110226162A CN 201880000006 A CN201880000006 A CN 201880000006A CN 110226162 A CN110226162 A CN 110226162A
Authority
CN
China
Prior art keywords
electronic equipment
image
face
objects
profile information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880000006.5A
Other languages
Chinese (zh)
Inventor
田浦延
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Fushi Technology Co Ltd
Original Assignee
Shenzhen Fushi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Fushi Technology Co Ltd filed Critical Shenzhen Fushi Technology Co Ltd
Publication of CN110226162A publication Critical patent/CN110226162A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses a kind of personal identification method, device and electronic equipments, the personal identification method includes: S1, when electronic equipment needs to carry out identification, the 2D image of electronic equipment objects in front is obtained, and obtain the surface profile information of electronic equipment objects in front;S2 matches the 2D image of acquisition with preset 2D image template;S3 judges whether the object in front of electronic equipment is three-dimensional face according to the surface profile information of the objects in front of acquisition;S4, the object in front of electronic equipment are three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determine that the identity of objects in front is legal.The identity recognition device runs the personal identification method, and electronic equipment includes the identity recognition device.

Description

Personal identification method, device and electronic equipment Technical field
The present invention relates to a kind of personal identification method, device and electronic equipments.
Background technique
With comprehensive screen development trend of smart phone, the screen accounting of mobile phone front is higher and higher, therefore other assemblies, such as key, fingerprint recognition mould group etc. can not be arranged because spatial position is limited in mobile phone front again.Since fingerprint recognition mould group can not be arranged, in order to realize identification, industry, which is proposed, obtains facial information using the front camera of mobile phone front, and carries out face recognition.
But the safety of existing facial recognition techniques also needs to improve.
Summary of the invention
Embodiment of the present invention aims to solve at least one of the technical problems existing in the prior art.For this purpose, embodiment of the present invention needs to provide a kind of personal identification method, device and electronic equipment.
The present invention provides a kind of personal identification method, comprising the following steps:
S1 obtains the 2D image of electronic equipment objects in front, and obtain the surface profile information of electronic equipment objects in front when electronic equipment needs to carry out identification;
S2 matches the 2D image of acquisition with preset 2D image template;
S3 judges whether the object in front of electronic equipment is three-dimensional face according to the surface profile information of the objects in front of acquisition;
S4, the object in front of electronic equipment are three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determine that the identity of objects in front is legal.
In embodiment of the present invention, in the success of 2D images match, and when judging the object in front for three-dimensional face, just determine that the identity of objects in front is legal, had so both prevented people to carry out face recognition using photo, and had improved safety, and do not have to carry out face recognition based on 3D rendering information again, to simplify the data processing of face recognition, face recognition speed is also speeded up, the user experience is improved.
In some embodiments, the 2D image that electronic equipment objects in front is obtained in the step S1 includes: the 2D image that electronic equipment objects in front is acquired by the imaging sensor of electronic equipment.
In some embodiments, the surface profile information that electronic equipment objects in front is obtained in the step S1 includes: that the Infrared projector of controlling electronic devices projects the object in front of infrared beam to electronic equipment, the infrared sensor of controlling electronic devices obtains object to the reflected optical signal of infrared beam, and forms infrared image.
In some embodiments, the step S3 includes: to analyze the infrared image, obtains the depth information that the object face in front of electronic equipment presets feature;The depth information that feature is preset according to object face obtained judges whether the object in front of electronic equipment is three-dimensional face.
In some embodiments, the infrared beam of the Infrared projector projection forms a pattern, and the pattern includes dot matrix, striped formula, the one or more of speckle formula.
In some embodiments, further comprise before the step S1: judging the current working status of electronic equipment;According to the current working status of electronic equipment, it is determined whether need to carry out identification.
In some embodiments, the current working status of the electronic equipment includes breath screen state, the non-unlocked state of bright screen, bright screen unlocked state;The current working status according to electronic equipment, it is determined whether needing to carry out identification includes:
When electronic equipment is in breath screen state, screen wake operation is judged whether there is;When determining has screen wake operation, determination needs to carry out identification;
When electronic equipment is in the non-unlocked state of bright screen, determination needs to carry out identification;
When electronic equipment is in bright screen unlocked state, the authentication request that judgement is currently initiated with the presence or absence of application program, authentication request, determination need to carry out identification if it exists.
In some embodiments, the screen wake operation include: pick up electronic equipment, touch the display screen of electronic equipment, object close to electronic equipment front preset range, pressing electronic functionalities key it is one or more.
In some embodiments, the 2D image of electronic equipment objects in front and surface profile information are while obtaining or successively obtaining in the step S1.
In some embodiments, the step S3 includes: to match the surface profile information of acquisition with the contour mould prestored, judges whether the object in front of electronic equipment is three-dimensional face.
In some embodiments, the contour mould prestored includes the depth reference information that object face presets feature;The step S3 further comprises: extracting the depth information of the default feature of face from the surface profile information obtained, and it is preset the corresponding depth reference information of feature with the face and is compared, judge whether the object in front of electronic equipment is three-dimensional face.
Due in present embodiment, not only whether judgment object has 3D attribute, but also the face contour template by registering is compared, the face contour template of the registration includes the corresponding face contour information of the object, therefore embodiment of the present invention judges will be more accurate for whether judgment object has 3D attribute.
Embodiment of the present invention provides a kind of identity recognition device, including imaging sensor, profile information acquisition device and identification processor;The identification processor is used for: when electronic equipment needs to carry out identification, the 2D image that described image sensor obtains electronic equipment objects in front is controlled, and the control profile information acquisition device obtains the surface profile information of electronic equipment objects in front;The 2D image of acquisition is matched with preset 2D image template;According to the surface profile information of the objects in front of acquisition, judge whether electronic equipment objects in front is three-dimensional face;Object in front of electronic equipment is three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determines that the identity of objects in front is legal.
In embodiment of the present invention, in the success of 2D images match, and when judging the object in front for three-dimensional face, just determine that the identity of objects in front is legal, had so both prevented people to carry out face recognition using photo, and had improved safety, and do not have to carry out face recognition based on 3D rendering information again, to simplify the data processing of face recognition, face recognition speed is also speeded up, the user experience is improved.
In some embodiments, described image sensor includes that RGB sensor, infrared sensor or both combine.
In some embodiments, the 2D image of the electronic equipment objects in front is the face-image of object.
In some embodiments, the profile information acquisition device includes Depth Imaging sensor, for obtaining the profile information of body surface.
In some embodiments, the profile information acquisition device includes Infrared projector and infrared sensor;The Infrared projector is used to project the body surface in front of infrared beam to electronic equipment, and the infrared sensor forms infrared image for obtaining body surface to the reflected optical signal of infrared beam.
In some embodiments, the infrared sensor is further used for when environment light is weak, obtains the 2D image of electronic equipment objects in front.
In some embodiments, the identification processor is further used for: analyzing the infrared image, obtains the depth information that the object face in front of electronic equipment presets feature;The depth information that feature is preset according to object face obtained judges whether the object in front of electronic equipment is three-dimensional face.
In some embodiments, the infrared beam of the Infrared projector projection forms a pattern, and the pattern includes dot matrix, striped formula, the one or more of speckle formula.
In some embodiments, the identification processor is used for while controlling or successively controlling described image sensor and the progress information collection of profile information acquisition device.
In some embodiments, the identification processor is further used for: the surface profile information of acquisition being matched with the contour mould prestored, judges whether the object in front of electronic equipment is three-dimensional face.
In some embodiments, the contour mould prestored includes the depth reference information that object face presets feature;The identification processor is further used for: the depth information of the default feature of face is extracted from the surface profile information obtained, and it is preset into the corresponding depth reference information of feature with the face and is compared, judge whether the object in front of electronic equipment is three-dimensional face.
Due in present embodiment, not only whether judgment object has 3D attribute, but also the face contour template by registering is compared, the face contour template of the registration includes the corresponding face contour information of the object, therefore embodiment of the present invention judges will be more accurate for whether judgment object has 3D attribute.
Embodiment of the present invention also provides a kind of electronic equipment, the identity recognition device including above-mentioned any one embodiment.
In some embodiments, the electronic equipment further comprises processor, and the processor is used to judge the current working status of electronic equipment, according to the current working status of electronic equipment, it is determined whether need to carry out identification.
In some embodiments, the current working status of the electronic equipment includes breath screen state, the non-unlocked state of bright screen, bright screen unlocked state;The processor is further used for:
When electronic equipment is in breath screen state, screen wake operation is judged whether there is;When determining has screen wake operation, start the identity recognition device;
When electronic equipment is in the non-unlocked state of bright screen, start the identity recognition device;
When electronic equipment is in bright screen unlocked state, the authentication request that judgement is currently initiated with the presence or absence of application program, authentication request, starts the identity recognition device if it exists.
The additional aspect and advantage of embodiment of the present invention will be set forth in part in the description, and partially will become apparent from the description below, or the practice of embodiment is recognized through the invention.
Detailed description of the invention
The above-mentioned and/or additional aspect and advantage of embodiment of the present invention will be apparent and are readily appreciated that in the description from combination following accompanying drawings to embodiment, in which:
Fig. 1 is the flow diagram of the personal identification method of first embodiment of the invention;
Fig. 2 is the refinement flow diagram that the surface profile information of electronic equipment objects in front is obtained in the personal identification method of an embodiment of the present invention;
Fig. 3 is the flow diagram of the personal identification method of second embodiment of the invention;
Fig. 4 is the functional block diagram of the identity recognition device of an embodiment of the present invention;
Fig. 5 is that the electronic equipment of an embodiment of the present invention is the structural schematic diagram of mobile terminal.
Specific embodiment
Embodiments of the present invention are described below in detail, the example of the embodiment is shown in the accompanying drawings, and in which the same or similar labels are throughly indicated same or similar element or elements with the same or similar functions.It is exemplary below with reference to the embodiment of attached drawing description, for explaining only the invention, and is not considered as limiting the invention.
In the description of the present invention, it is to be understood that, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance or implicitly indicate the quantity of indicated technical characteristic." first " is defined as a result, the feature of " second " can explicitly or implicitly include one or more feature.In the description of the present invention, the meaning of " plurality " is two or more, unless otherwise specifically defined." contact " or " touch " includes directly contact or mediate contact.
In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, term " installation ", " connected ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected;It can be mechanical connection, be also possible to be electrically connected or can be in communication with each other;It can be directly connected, the connection inside two elements or the interaction relationship of two elements can also be can be indirectly connected through an intermediary.For the ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific conditions.
Following disclosure provides many different embodiments or example is used to realize different structure of the invention.In order to simplify disclosure of the invention, hereinafter to the component of specific examples and being set for describing.Certainly, they are merely examples, and is not intended to limit the present invention.In addition, the present invention repeat reference numerals and/or reference letter, this repetition can be for purposes of simplicity and clarity, itself not indicate the relationship between discussed various embodiments and/or setting in different examples.In addition, the present invention provides various specific techniques and material example, but those of ordinary skill in the art may be aware that other techniques application and/or other materials use.
Further, described feature, structure can be incorporated in any suitable manner in one or more embodiments.In the following description, many details are provided to provide and fully understand to embodiments of the present invention.However, one of ordinary skill in the art would recognize that, without one or more in the specific detail, or using other structures, constituent element etc., technical solution of the present invention can also be practiced.In other cases, known features or operation are not shown in detail or describe to avoid the fuzzy present invention.
Face recognition method refers to the facial information that object is acquired by camera, and collected facial information is matched with the face template of registration, and successful match then determines that the identity of object is legal, and it fails to match then determines that the identity of object is illegal.
Here object is for example including human body or other organisms.Facial information is for example including 2D image information or 3D rendering information.When carrying out face recognition based on 2D image information, it can be realized using existing camera, do not need that photographic device additionally is arranged.But other people utilize an object mug shot, it is easy to carry out identity validation, thus safety is not high.When carrying out face recognition based on 3D rendering information, needs to be arranged special 3D photographic device and carry out Image Acquisition, and the matching process of 3D rendering information is extremely complex and time-consuming, although the safety is improved, recognition speed is slower, and user experience is poor.
In this regard, a kind of faster personal identification method of and recognition speed higher embodiment of the present invention proposes safety.Referring to Fig.1, Fig. 1 is the flow diagram of the personal identification method of an embodiment of the present invention.The personal identification method the following steps are included:
S1 obtains the 2D image of electronic equipment objects in front, and obtain the surface profile information of electronic equipment objects in front when electronic equipment needs to carry out identification;
The personal identification method runs on an electronic equipment.The electronic equipment for example but is not limited to the electronic products of the suitable types such as consumer electrical product, household formula electronic product, vehicular electronic product, financial terminal product.Wherein, consumer electrical product for example mobile phone, tablet computer, laptop, tabletop display, computer all-in-one machine etc..Household formula electronic product for example intelligent door lock, TV, refrigerator, wearable device etc..Vehicular electronic product for example automatic navigator, vehicle-carrying DVD etc..Financial terminal product for example ATM machine, the terminal of self-service transacting business etc..
Electronic equipment front is equipped with corresponding sensing equipment, when being located in front of electronic equipment for object, obtains the 2D image of electronic equipment objects in front and the surface profile information of electronic equipment objects in front.The 2D image of object carries out Image Acquisition for example including the face-image of object, by imaging sensor.Imaging sensor such as RGB sensor, infrared sensor or both combines.Characteristic information and depths of features information of the surface profile information for example including object face, such as be acquired by depth image sensor.
It should be noted that above-mentioned acquisition electronic equipment objects in front 2D image and obtain surface profile information sequence without limitation, such as can for simultaneously obtain or successively acquisition.
S2 matches the 2D image of acquisition with preset 2D image template;
By taking face-image as an example, before the use, user needs to carry out facial information registration to electronic equipment, forms face template, and store, the matching of 2D image when with for face recognition.Mode of the images match for example, by using facial feature extraction, corresponding facial characteristics is first extracted from 2D image, such as eyes, nose, eyebrow, lip, lower jaw etc., then the facial characteristics extracted is compared with the corresponding facial characteristics in 2D image template, the successful match if comparing unanimously, if comparison is inconsistent, it fails to match.
S3 judges whether the object face in front of electronic equipment is three-dimensional face according to the surface profile information of the objects in front of acquisition;
Corresponding 3D attribute, such as depths of features information are extracted from the surface profile information of the objects in front obtained, to judge whether the object face in front of the electronic equipment is three-dimensional face, is so avoided that people carry out face recognition using photo.
S4, the object in front of electronic equipment are three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determine that the identity of objects in front is legal.
In embodiment of the present invention, in the success of 2D images match, and when judging the object in front for three-dimensional face, just determine that the identity of objects in front is legal, had so both prevented people to carry out face recognition using photo, and had improved safety, and do not have to carry out face recognition based on 3D rendering information again, to simplify the data processing of face recognition, face recognition speed is also speeded up, the user experience is improved.
It in some embodiments, is the refinement flow diagram that the surface profile information of electronic equipment objects in front is obtained in the personal identification method of an embodiment of the present invention referring to Fig. 2, Fig. 2.The surface profile information of acquisition electronic equipment objects in front includes: in above-mentioned steps S1
S11, the Infrared projector of controlling electronic devices project the object in front of infrared beam to electronic equipment;
S12 obtains object to the reflected optical signal of infrared beam by the infrared sensor of electronic equipment, and forms infrared image.
The Infrared projector and infrared sensor are set to electronic equipment front, and the Infrared projector and infrared sensor are provided separately.Certainly, the Infrared projector and infrared sensor also can integrate together, to facilitate installation, while save installation space.The Infrared projector is for projecting object of the infrared beam in front of electronic equipment, it will be reflected when the infrared beam is on the object in front of the electronic equipment, and reflected optical signal is sensed by the infrared sensor of electronic equipment, and forms infrared image.
In some embodiments, Infrared projector is for example including light source, collimation camera lens and diffractive-optical element (DOE), and wherein light source is for generating an infrared laser beam;Collimation camera lens calibrates infrared laser beam, forms less parallel light;Diffractive-optical element is modulated the infrared laser beam after calibration, forms corresponding speckle pattern.And the pattern is for example including dot matrix, striped formula, the one or more of speckle formula.Certainly, it may also include other coding patterns.It should be noted that the infrared beam of Infrared projector projection is formed by numerous luminous point, luminous point is more, then the resolution ratio for the infrared image that infrared sensor obtains is higher.
Further, above-mentioned steps S3 includes: to analyze infrared image, the depth information that the object face in front of electronic equipment presets feature is obtained, the depth information of feature is preset according to object face obtained, judges whether the object in front of electronic equipment is three-dimensional face.
Object face presets feature such as eyes, nose, lip, lower jaw, cheekbone etc..Object face presets the depth information of feature for example including the depth of eyes and nose, lip, lower jaw, the height of cheekbone etc..Since photo or picture are flat image, when other people hold photo or picture progress identification, the depth information of feature is preset according to object face obtained, can judge the object in front of electronic equipment not is three-dimensional face.Because of the infrared image according to acquisition, the depth information that object face presets feature can not be extracted.
In present embodiment, the corresponding depth threshold of feature is preset by setting object plane portion to judge whether the object in front of electronic equipment is three-dimensional face.That is, it is compared with preset depth threshold after obtaining the depth information of the default feature of the object face in front of electronic equipment, to judge whether the object in front of electronic equipment is three-dimensional face.
In foregoing invention embodiment, the depth information of feature is preset by object face to judge whether the object in front of electronic equipment has 3D attribute, such as judges whether in front of electronic equipment be a true face, rather than photo or picture.Therefore, the judgement of embodiment of the present invention 3D rendering information compared with prior art, it is simpler, processing speed is not only accelerated, but also the user experience is improved.
Certainly, ground is changed, when carrying out the registration of face template, the contour mould of face contour information can also be formed, and store.When obtaining the stereo profile information of electronic equipment objects in front, it is matched with the contour mould prestored, to judge whether the object in front of electronic equipment is three-dimensional face.Specifically, which presets the depth reference information of feature for example including object face.When obtaining the surface profile information of electronic equipment objects in front, the depth information of the default feature of face is extracted from the surface profile information, and it is compared with depth reference information corresponding with the facial characteristics in the contour mould prestored, to judge whether the object in front of electronic equipment is three-dimensional face.
Due in present embodiment, not only whether judgment object has 3D attribute, but also the face contour template by registering is compared, the face contour template of the registration includes the corresponding face contour information of the object, therefore embodiment of the present invention judges will be more accurate for whether judgment object has 3D attribute.
Further, referring to Fig. 3, Fig. 3 is the flow diagram of the personal identification method of second embodiment of the invention.In the personal identification method of the electronic equipment, before above-mentioned steps S1 further include:
Step S5 judges the current working status of electronic equipment;
Current working status divides according to the display state of display screen, for example including breath screen state, the non-unlocked state of bright screen, bright screen three kinds of unlocked state.Wherein breath screen state refers to that display screen is non-lit up and is in OFF state.The bright non-unlocked state of screen refers to that display screen is lit, but shows the non-unlock interface of screen display.Under the state, electronic equipment is not unlocked, cannot be introduced into the homepage of electronic equipment.Unlocked state refers to that display screen is lit to bright screen, and shows corresponding interface according to specific operation.Electronic equipment is unlocked under the state, and the electronic equipment can be used normally in user.
Step S6, according to the current working status of electronic equipment, it is determined whether need to carry out identification.
Specifically, when electronic equipment is in breath screen state, user may use the electronic equipment at any time, therefore in order to the operation of quick response user, certain sensors on the electronic equipment are still within working condition, to monitor the service condition of electronic equipment, screen wake operation is judged whether there is.For example, touch sensor, gravity sensor, range sensor etc..Screen wake operation includes picking up electronic equipment, the display screen for touching electronic equipment, object close to equipment front preset range, the one or more for the function button for pressing electronic equipment.It is understood that the screen wake operation of the electronic equipment can flexible setting according to the needs of users.
By taking touch sensor as an example, in embodiment of the present invention, when electronic equipment is in breath screen state, the touch sensing module of controlling electronic devices executes touch detection, and the touch action (such as common touch operation, pressing operation, slide) on display screen is detected and responded.When electronic equipment is in breath screen state, which will carry out touch detection with the first scan frequency (power consumption state).When detecting object touch display screen, it is determined that need to carry out identification.When electronic equipment is in the non-unlocked state of bright screen or bright screen unlocked state, touch sensing module carries out touch detection again with the second scan frequency (higher power consumption state or normal power consumption state), thus power consumption when reducing electronic equipment breath screen state.Wherein the first scan frequency is less than the second scan frequency.Certainly, ground is changed, which can also carry out touch detection always with normal power consumption state.
When electronic equipment is in the non-unlocked state of bright screen, user may use the electronic equipment at any time in this case, it is thus determined that needing to carry out identification, and enter step S1.
When electronic equipment is in bright screen unlocked state, then further to judge that the authentication request currently initiated with the presence or absence of application program to operating system, such as payment application initiate the authentication request for being used for mobile payment.Authentication request if it exists, it is determined that need to carry out identification, and enter step S1, otherwise electronic equipment is normally operated.
In some embodiments, further comprise after above-mentioned steps S4: after identification success, controlling the electronic equipment and carry out corresponding operation.Such as controlling electronic devices unlock, progress payment transaction operation etc..
Accordingly, an embodiment of the present invention proposes a kind of identity recognition device to execute the method for above embodiment.Referring to Fig. 4, Fig. 4 is the functional block diagram of the identity recognition device of an embodiment of the present invention.The identity recognition device includes imaging sensor 10, profile information acquisition device 20 and identification processor 30.Imaging sensor 10 is used to obtain the 2D image of electronic equipment objects in front, and profile information acquisition device 20 is used to obtain the surface profile information of electronic equipment objects in front.Identification processor 30 is used for when electronic equipment needs to carry out identification, controls imaging sensor 10 and profile information acquisition device 20 starts, to obtain the 2D image of electronic equipment objects in front, surface profile information.And identification processor 30 matches the 2D image of acquisition with preset 2D image template, according to the surface profile information of the objects in front of acquisition, judges whether electronic equipment objects in front is three-dimensional face;Object in front of electronic equipment is three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determines that the identity of objects in front is legal.
In embodiment of the present invention, in the success of 2D images match, and when judging the object in front for three-dimensional face, just determine that the identity of objects in front is legal, had so both prevented people to carry out face recognition using photo, and had improved safety, and do not have to carry out face recognition based on 3D rendering information again, to simplify the data processing of face recognition, face recognition speed is also speeded up, the user experience is improved.
In some embodiments, imaging sensor 10 is combined including RGB sensor, infrared sensor or both.If imaging sensor 10 includes infrared sensor, which can also acquire the image of object in visible light deficiency, to adapt to the scene of wider range.
In some embodiments, profile information acquisition device 20 includes Depth Imaging sensor, for obtaining the profile information of body surface.
Depth Imaging sensor can be divided into active and passive type.Wherein active sensor is mainly to objective emission energy beam (such as laser, electromagnetic wave, ultrasonic wave), and detects reflected optical signal.Passive sensor then utilizes ambient environmental conditions to be imaged.Active Depth Imaging sensor is used in embodiment of the present invention, to obtain the profile information on electronic equipment objects in front surface.
In some embodiments, profile information acquisition device 20 includes Infrared projector and infrared sensor, Infrared projector is used to project the body surface in front of infrared beam to electronic equipment, infrared sensor forms infrared image for obtaining body surface to the reflected optical signal of infrared beam.
In present embodiment, Infrared projector and infrared sensor are provided separately.Certainly, Infrared projector and infrared sensor also can integrate together, to facilitate installation, while save installation space.
Above-mentioned Infrared projector is for example including light source, collimation camera lens and diffractive-optical element (DOE).Wherein light source is for generating an infrared laser beam;Collimation camera lens calibrates infrared laser beam, forms less parallel light;Diffractive-optical element is modulated the infrared laser beam after calibration, forms corresponding speckle pattern.And the mode that the pattern is combined for example including dot matrix, striped formula or both.Certainly, it may also include other coding patterns.It should be noted that the infrared beam of Infrared projector projection is formed by numerous luminous point, luminous point is more, then the resolution ratio for the infrared image that infrared sensor obtains is higher.
In some embodiments, above-mentioned infrared sensor is both used to acquire body surface to the reflected optical signal of infrared beam, forms the profile information of body surface, and can be used for the 2D image of acquisition electronic equipment objects in front.Certainly, in order to avoid information collection conflict, the profile information and 2D image for acquiring body surface carry out timesharing.
Further, identification processor 30 is used for: being analyzed infrared image, the depth information that the object face in front of electronic equipment presets feature is obtained, the depth information of feature is preset according to object face obtained, judges whether the object in front of electronic equipment is three-dimensional face.
Above-mentioned object face presets feature such as eyes, nose, lip, lower jaw, cheekbone etc..Object face presets the depth information of feature for example including the depth of eyes and nose, lip, lower jaw, the height of cheekbone etc..Since photo or picture are flat image, when other people hold photo or picture progress identification, the depth information of feature is preset according to object face obtained, can judge the object in front of electronic equipment not is three-dimensional face.Because of the infrared image according to acquisition, the depth information that object face presets feature can not be extracted.
In present embodiment, the corresponding depth threshold of feature is preset by setting object plane portion to judge whether the object in front of electronic equipment is three-dimensional face.That is, it is compared with preset depth threshold after obtaining the depth information of the default feature of the object face in front of electronic equipment, to judge whether the object in front of electronic equipment is three-dimensional face.
In foregoing invention embodiment, the depth information of feature is preset by object face to judge whether the object in front of electronic equipment has 3D attribute, such as judges whether in front of electronic equipment be a true face, rather than photo or picture.Therefore, the judgement of embodiment of the present invention 3D rendering information compared with prior art, it is simpler, processing speed is not only accelerated, but also the user experience is improved.
Certainly, ground is changed, when carrying out the registration of face template, the contour mould of face contour information can also be formed, and store.In this way, identification processor 30 is matched when receiving the surface profile information of electronic equipment objects in front, by it with the profile prestored, to judge whether the object in front of electronic equipment is three-dimensional face.Specifically, which presets the depth reference information of feature for example including object face.Identification processor 30 is used for: when obtaining the surface profile information of electronic equipment objects in front, the depth information of the default feature of face is extracted from the surface profile information, and it is compared with depth reference information corresponding with the facial characteristics in the contour mould prestored, to judge whether the object in front of electronic equipment is three-dimensional face.
Due in present embodiment, not only whether judgment object has 3D attribute, but also the face contour template by registering is compared, the face contour template of the registration includes the corresponding face contour information of the object, therefore embodiment of the present invention judges will be more accurate for whether judgment object has 3D attribute.
Further, above-mentioned identification processor 30 is also used to: the current working status of electronic equipment is judged, according to the current working status of electronic equipment, it is determined whether needs to carry out identification.
Current working status divides according to the display state of display screen, for example including breath screen state, the non-unlocked state of bright screen, bright screen three kinds of unlocked state.Wherein breath screen state refers to that display screen is non-lit up and is in OFF state.The bright non-unlocked state of screen refers to that display screen is lit, but shows the non-unlock interface of screen display.Under the state, electronic equipment is not unlocked, cannot be introduced into the homepage of electronic equipment.Unlocked state refers to that display screen is lit to bright screen, and shows corresponding interface according to specific operation.Electronic equipment is unlocked under the state, and the electronic equipment can be used normally in user.
Specifically, when electronic equipment is in breath screen state, user may use the electronic equipment at any time, therefore in order to the operation of quick response user, certain sensors on the electronic equipment are still within working condition, to monitor the service condition of electronic equipment, screen wake operation is judged whether there is.For example, touch sensor, gravity sensor, range sensor etc..Screen wake operation includes picking up electronic equipment, the display screen for touching electronic equipment, object close to equipment front preset range, the one or more for the function button for pressing electronic equipment.It is understood that the screen wake operation of the electronic equipment can flexible setting according to the needs of users.
By taking touch sensor as an example, in embodiment of the present invention, when electronic equipment is in breath screen state, the touch sensing module of controlling electronic devices executes touch detection, and the touch action (such as common touch operation, pressing operation, slide) on display screen is detected and responded.When electronic equipment is in breath screen state, which will carry out touch detection with the first scan frequency (power consumption state).When detecting object touch display screen, it is determined that need to carry out identification.When electronic equipment is in the non-unlocked state of bright screen or bright screen unlocked state, touch sensing module carries out touch detection again with the second scan frequency (higher power consumption state or normal power consumption state), thus power consumption when reducing electronic equipment breath screen state.Wherein the first scan frequency is less than the second scan frequency.Certainly, ground is changed, which can also carry out touch detection always with normal power consumption state.
When electronic equipment is in the non-unlocked state of bright screen, user may use the electronic equipment at any time in this case, it is thus determined that needing to carry out identification.
When electronic equipment is in bright screen unlocked state, then further to judge that the authentication request currently initiated with the presence or absence of application program to operating system, such as payment application initiate the authentication request for being used for mobile payment.Authentication request if it exists, it is determined that need to carry out identification, otherwise electronic equipment is normally operated.
Above-mentioned personal identification method is mainly used in the electronic equipment shielded comprehensively, it is of course also possible to be applied in other non-electronic equipments shielded comprehensively.When needing to carry out identification, start the face recognition function of electronic equipment, face recognition is carried out to the user of electronic equipment to realize, to determine the legal identity of user, controlling electronic devices carries out corresponding operation, such as unlock, progress mobile payment etc. after being determined as legal identity.It illustrates by mobile terminal of electronic equipment, is the structural schematic diagram of mobile terminal referring to the electronic equipment that Fig. 5, Fig. 5 are an embodiment of the present invention.The mobile terminal 100 includes processor 101, memory 102, display device 103, facial information acquisition device 104.Processor 101 is used for when electronic equipment needs to carry out identification, starts facial information acquisition device 104.Facial information acquisition device 104 is acquired the 2D image and surface profile information of electronic equipment objects in front, and sends collected information to processor 101.Whether processor 101 respectively matches 2D image, and judge in front of electronic equipment to be three-dimensional face according to surface profile information;It is three-dimensional face in front of the success of 2D images match and electronic equipment, it is determined that the identity of electronic equipment objects in front is legal, and otherwise the identity of electronic equipment objects in front is illegal.
It should be noted that in some embodiments, can combine or omit one or more modular constructions, such as processor 101 and memory 102 are integrated into control chip etc..In addition, the mobile terminal 100 may include the other component (for example, telecommunication circuit, power supply, bus, microphone, camera etc.) for not combining or being not included in component shown in Fig. 5.Moreover, for sake of simplicity, illustrating only the section components of mobile terminal in Fig. 5.
Specifically, processor 101 includes the operation and performance to control mobile terminal 100 and any processing circuit for being arranged.The processor 101 be used to run operating system, app application, media play application or any other application software, and the interactive operation etc. being used for the treatment of between user.The processor 101 is, for example, the control IC of each processing circuit integration together, or be include distribution setting everywhere in manage circuit processor cluster, such as the central processor CPU of each component of centralized control electronic equipment, for the image processor GPU of graphics process in electronic equipment.It is, of course, also possible to other application specific processors are arranged, for example, each sensor for monitoring electronic equipment testing result coprocessor, for the baseband processor of electronic equipment communication, for electronic equipment carry out identification processor of identification etc..
For memory 102 for example including one or more computer storage mediums, which includes the storage unit or their any combination of hard disk, floppy disk, Flash, ROM, RAM and any other suitable type.Memory 102 is used to store any program's code file, such as operating system, application software and functional module etc. called for processor 101.The memory 102 is also used to the processing data and processing result of the processing of storage processor 101, such as using data, user's operation information, information-setting by user, multi-medium data etc..It is understood that the memory 102 can be separately provided, can also be integrated with processor 101.
Further, the computer storage medium in the memory 102 is stored with multiple program's code files, and device 101 for processing calls, to execute the solution lock control method of above embodiment description, to realize the solution lock control under electronic equipment breath screen state.
Display device 103 controls the display driver circuit for example including LCD display, OLED display screen and corresponding display driver circuit, processor 101, to drive display screen to be shown accordingly.It is understood that if electronic equipment further includes graphics processor, after graphics process being carried out by graphics processor, then display screen is driven to be shown accordingly by display driver circuit.
Facial information acquisition device 104 is, for example, at least partly structure of the identity recognition device of above embodiment description, to acquire the facial information of electronic equipment objects in front, the profile information of the 2D face-image of imaging sensor acquisition, the body surface of profile information acquisition device acquisition is specifically included.Wherein imaging sensor and profile information acquisition device certainly, alternatively, may be located on side area or the bottom section of mobile terminal 100 for example positioned at the top area of mobile terminal 100.
In embodiment of the present invention, in the success of 2D images match, and when judging the object in front for three-dimensional face, just determine that the identity of objects in front is legal, had so both prevented people to carry out face recognition using photo, and had improved safety, and do not have to carry out face recognition based on 3D rendering information again, to simplify the data processing of face recognition, face recognition speed is also speeded up, the user experience is improved.
Further, above-mentioned processor 101 is also used to: the current working status of electronic equipment is judged, according to the current working status of electronic equipment, it is determined whether needs to carry out identification.
Current working status divides according to the display state of display screen, for example including breath screen state, the non-unlocked state of bright screen, bright screen three kinds of unlocked state.Wherein breath screen state refers to that display screen is non-lit up and is in OFF state.The bright non-unlocked state of screen refers to that display screen is lit, but shows the non-unlock interface of screen display.Under the state, electronic equipment is not unlocked, cannot be introduced into the homepage of electronic equipment.Unlocked state refers to that display screen is lit to bright screen, and shows corresponding interface according to specific operation.Electronic equipment is unlocked under the state, and the electronic equipment can be used normally in user.
Specifically, when electronic equipment is in breath screen state, user may use the electronic equipment at any time, therefore in order to the operation of quick response user, certain sensors on the electronic equipment are still within working condition, to monitor the service condition of electronic equipment, screen wake operation is judged whether there is.For example, touch sensor, gravity sensor, range sensor etc..Screen wake operation includes picking up electronic equipment, the display screen for touching electronic equipment, object close to equipment front preset range, the one or more for the function button for pressing electronic equipment.It is understood that the screen wake operation of the electronic equipment can flexible setting according to the needs of users.
By taking the touch sensor 105 being arranged on electronic equipment as an example, in embodiment of the present invention, when electronic equipment is in breath screen state, the touch sensing module of controlling electronic devices executes touch detection, and the touch action (such as common touch operation, pressing operation, slide) on display screen is detected and responded.When electronic equipment is in breath screen state, which will carry out touch detection with the first scan frequency (power consumption state).When detecting object touch display screen, it is determined that need to carry out identification.When electronic equipment is in the non-unlocked state of bright screen or bright screen unlocked state, touch sensing module carries out touch detection again with the second scan frequency (higher power consumption state or normal power consumption state), thus power consumption when reducing electronic equipment breath screen state.Wherein the first scan frequency is less than the second scan frequency.Certainly, ground is changed, which can also carry out touch detection always with normal power consumption state.
When electronic equipment is in the non-unlocked state of bright screen, user may use the electronic equipment at any time in this case, it is thus determined that needing to carry out identification.
When electronic equipment is in bright screen unlocked state, then further to judge that the authentication request currently initiated with the presence or absence of application program to operating system, such as payment application initiate the authentication request for being used for mobile payment.Authentication request if it exists, it is determined that need to carry out identification, otherwise electronic equipment is normally operated.
In the description of this specification, the description of reference term " embodiment ", " certain embodiments ", " exemplary embodiment ", " example ", " specific example " or " some examples " etc. means to be contained at least one embodiment or example of the invention in conjunction with the embodiment or example particular features, structures, materials, or characteristics described.In the present specification, schematic expression of the above terms are not necessarily referring to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be combined in any suitable manner in any one or more embodiments or example.
Although embodiments of the present invention have been shown and described above, it can be understood that, above embodiment is exemplary, it is not considered as limiting the invention, those skilled in the art can be changed above embodiment within the scope of the invention, modify, replacement and variant.

Claims (25)

  1. The personal identification method of a kind of electronic equipment, comprising the following steps:
    S1 obtains the 2D image of electronic equipment objects in front, and obtain the surface profile information of electronic equipment objects in front when electronic equipment needs to carry out identification;
    S2 matches the 2D image of acquisition with preset 2D image template;
    S3 judges whether the object in front of electronic equipment is three-dimensional face according to the surface profile information of the objects in front of acquisition;
    S4, the object in front of electronic equipment are three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determine that the identity of objects in front is legal.
  2. Personal identification method as described in claim 1, it is characterised in that: the 2D image that electronic equipment objects in front is obtained in the step S1 includes: the 2D image that electronic equipment objects in front is acquired by the imaging sensor of electronic equipment.
  3. Personal identification method as described in claim 1, it is characterized by: the surface profile information for obtaining electronic equipment objects in front in the step S1 includes: the object in front of the Infrared projector projection infrared beam to electronic equipment of controlling electronic devices, the infrared sensor of controlling electronic devices obtains object to the reflected optical signal of infrared beam, and forms infrared image.
  4. Personal identification method as claimed in claim 3, it is characterised in that: the step S3 includes: to analyze the infrared image, obtains the depth information that the object face in front of electronic equipment presets feature;The depth information that feature is preset according to object face obtained judges whether the object in front of electronic equipment is three-dimensional face.
  5. Personal identification method as claimed in claim 4, it is characterised in that: the infrared beam of the Infrared projector projection forms a pattern, and the pattern includes dot matrix, striped formula, the one or more of speckle formula.
  6. Personal identification method as described in claim 1, it is characterised in that: further comprise before the step S1: judging the current working status of electronic equipment;According to the current working status of electronic equipment, it is determined whether need to carry out identification.
  7. Personal identification method as claimed in claim 6, it is characterised in that: the current working status of the electronic equipment includes breath screen state, the non-unlocked state of bright screen, bright screen unlocked state;The current working status according to electronic equipment, it is determined whether needing to carry out identification includes:
    When electronic equipment is in breath screen state, screen wake operation is judged whether there is;When determining has screen wake operation, determination needs to carry out identification;
    When electronic equipment is in the non-unlocked state of bright screen, determination needs to carry out identification;
    When electronic equipment is in bright screen unlocked state, the authentication request that judgement is currently initiated with the presence or absence of application program, authentication request, determination need to carry out identification if it exists.
  8. Personal identification method as claimed in claim 7, it is characterised in that: the screen wake operation include: pick up electronic equipment, touch the display screen of electronic equipment, object close to electronic equipment front preset range, pressing electronic functionalities key it is one or more.
  9. Personal identification method as described in claim 1, it is characterised in that: the 2D image of electronic equipment objects in front and surface profile information are while obtaining or successively obtaining in the step S1.
  10. Personal identification method as described in claim 1, it is characterised in that: the step S3 includes: to match the surface profile information of acquisition with the contour mould prestored, judges whether the object in front of electronic equipment is three-dimensional face.
  11. Personal identification method as claimed in claim 10, it is characterised in that: the contour mould prestored includes the depth reference information that object face presets feature;The step S3 further comprises: extracting the depth information of the default feature of face from the surface profile information obtained, and it is preset the corresponding depth reference information of feature with the face and is compared, judge whether the object in front of electronic equipment is three-dimensional face.
  12. A kind of identity recognition device, including imaging sensor, profile information acquisition device and identification processor;The identification processor is used for: when electronic equipment needs to carry out identification, the 2D image that described image sensor obtains electronic equipment objects in front is controlled, and the control profile information acquisition device obtains the surface profile information of electronic equipment objects in front;The 2D image of acquisition is matched with preset 2D image template;According to the surface profile information of the objects in front of acquisition, judge whether electronic equipment objects in front is three-dimensional face;Object in front of electronic equipment is three-dimensional face, and when the 2D image obtained and preset 2D image template successful match, determines that the identity of objects in front is legal.
  13. Identity recognition device as claimed in claim 12, it is characterised in that: described image sensor includes that RGB sensor, infrared sensor or both combine.
  14. Identity recognition device as claimed in claim 12, it is characterised in that: the 2D image of the electronic equipment objects in front is the face-image of object.
  15. Identity recognition device as claimed in claim 12, it is characterised in that: the profile information acquisition device includes Depth Imaging sensor, for obtaining the profile information of body surface.
  16. Identity recognition device as claimed in claim 12, it is characterised in that: the profile information acquisition device includes Infrared projector and infrared sensor;The Infrared projector is used to project the body surface in front of infrared beam to electronic equipment, and the infrared sensor forms infrared image for obtaining body surface to the reflected optical signal of infrared beam.
  17. Identity recognition device as claimed in claim 16, it is characterised in that: the infrared sensor is further used for when environment light is weak, obtains the 2D image of electronic equipment objects in front.
  18. Identity recognition device as claimed in claim 16, it is characterised in that: the identification processor is further used for: analyzing the infrared image, obtains the depth information that the object face in front of electronic equipment presets feature;The depth information that feature is preset according to object face obtained judges whether the object in front of electronic equipment is three-dimensional face.
  19. Identity recognition device as claimed in claim 16, it is characterised in that: the infrared beam of the Infrared projector projection forms a pattern, and the pattern includes dot matrix, striped formula, the one or more of speckle formula.
  20. Identity recognition device as claimed in claim 12, it is characterised in that: the identification processor is used for while controlling or successively controlling described image sensor and the progress information collection of profile information acquisition device.
  21. Identity recognition device as claimed in claim 12, it is characterised in that: the identification processor is further used for: the surface profile information of acquisition is matched with the contour mould prestored, judges whether the object in front of electronic equipment is three-dimensional face.
  22. Identity recognition device as claimed in claim 21, it is characterised in that: the contour mould prestored includes the depth reference information that object face presets feature;The identification processor is further used for: the depth information of the default feature of face is extracted from the stereo profile information obtained, and it is preset into the corresponding depth reference information of feature with the face and is compared, judge whether the object in front of electronic equipment is three-dimensional face.
  23. A kind of electronic equipment, it is characterised in that: including identity recognition device described in any one of claim 12-22.
  24. Electronic equipment as claimed in claim 23, it is characterized by: the electronic equipment further comprises processor, the processor is used to judge the current working status of electronic equipment, according to the current working status of electronic equipment, it is determined whether need to carry out identification.
  25. Electronic equipment as claimed in claim 24, it is characterised in that: the current working status of the electronic equipment includes breath screen state, the non-unlocked state of bright screen, bright screen unlocked state;The processor is further used for:
    When electronic equipment is in breath screen state, screen wake operation is judged whether there is;When determining has screen wake operation, start the identity recognition device;
    When electronic equipment is in the non-unlocked state of bright screen, start the identity recognition device;
    When electronic equipment is in bright screen unlocked state, the authentication request that judgement is currently initiated with the presence or absence of application program, authentication request, starts the identity recognition device if it exists.
CN201880000006.5A 2018-01-04 2018-01-04 Personal identification method, device and electronic equipment Pending CN110226162A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/071362 WO2019134095A1 (en) 2018-01-04 2018-01-04 Identity recognition method and apparatus, and electronic device

Publications (1)

Publication Number Publication Date
CN110226162A true CN110226162A (en) 2019-09-10

Family

ID=67143529

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880000006.5A Pending CN110226162A (en) 2018-01-04 2018-01-04 Personal identification method, device and electronic equipment

Country Status (2)

Country Link
CN (1) CN110226162A (en)
WO (1) WO2019134095A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105912912A (en) * 2016-05-11 2016-08-31 青岛海信电器股份有限公司 Method and system for user to log in terminal by virtue of identity information
US9734435B2 (en) * 2015-12-31 2017-08-15 Microsoft Technology Licensing, Llc Recognition of hand poses by classification using discrete values
CN107506752A (en) * 2017-09-18 2017-12-22 艾普柯微电子(上海)有限公司 Face identification device and method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102164113A (en) * 2010-02-22 2011-08-24 深圳市联通万达科技有限公司 Face recognition login method and system
CN102004904B (en) * 2010-11-17 2013-06-19 东软集团股份有限公司 Automatic teller machine-based safe monitoring device and method and automatic teller machine
CN103268474A (en) * 2013-05-03 2013-08-28 中国科学院上海光学精密机械研究所 Three-dimensional scanning imaging device of mobile phone or tablet personal computer

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9734435B2 (en) * 2015-12-31 2017-08-15 Microsoft Technology Licensing, Llc Recognition of hand poses by classification using discrete values
CN105912912A (en) * 2016-05-11 2016-08-31 青岛海信电器股份有限公司 Method and system for user to log in terminal by virtue of identity information
CN107506752A (en) * 2017-09-18 2017-12-22 艾普柯微电子(上海)有限公司 Face identification device and method

Also Published As

Publication number Publication date
WO2019134095A1 (en) 2019-07-11

Similar Documents

Publication Publication Date Title
WO2019200578A1 (en) Electronic apparatus, and identity recognition method thereof
US11383676B2 (en) Vehicles, vehicle door unlocking control methods and apparatuses, and vehicle door unlocking systems
EP3647129A1 (en) Vehicle, vehicle door unlocking control method and apparatus, and vehicle door unlocking system
WO2018121428A1 (en) Living body detection method, apparatus, and storage medium
CN208172794U (en) Electronic equipment
Corcoran et al. Real-time eye gaze tracking for gaming design and consumer electronics systems
US9607138B1 (en) User authentication and verification through video analysis
JP6005750B2 (en) Authentication apparatus and authentication method
US9750420B1 (en) Facial feature selection for heart rate detection
CN108881604A (en) Light-intensity test method, apparatus and intelligent terminal
KR20160147943A (en) Display-integrated user-classification, security and fingerprint system
KR20140001163A (en) Facial recognition
JP2002507035A (en) How to authenticate the validity of an image recorded for personal identification
KR20120139100A (en) Apparatus and method for security management using face recognition
KR101640014B1 (en) Iris recognition apparatus for detecting false face image
CN112106046A (en) Electronic device for performing biometric authentication and method of operating the same
CN110619239A (en) Application interface processing method and device, storage medium and terminal
CN208240050U (en) A kind of gate inhibition's all-in-one machine
KR20150001940A (en) An ATM capable of controlling the display interface using face recognition and the control method thereof
WO2019196075A1 (en) Electronic device and facial recognition method therefor
CN108513706A (en) Electronic equipment and its face recognition method
CN108566777A (en) Identification authentication method, identification authentication device and electronic equipment
CN112818733B (en) Information processing method, device, storage medium and terminal
CN110287861B (en) Fingerprint identification method and device, storage medium and electronic equipment
CN109960912A (en) Electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination