CN104536389A - 3D face identification technology based intelligent household system and realization method thereof - Google Patents

3D face identification technology based intelligent household system and realization method thereof Download PDF

Info

Publication number
CN104536389A
CN104536389A CN201410690271.4A CN201410690271A CN104536389A CN 104536389 A CN104536389 A CN 104536389A CN 201410690271 A CN201410690271 A CN 201410690271A CN 104536389 A CN104536389 A CN 104536389A
Authority
CN
China
Prior art keywords
microprocessor
dimensional face
database
recognition technology
intelligent domestic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410690271.4A
Other languages
Chinese (zh)
Inventor
张会林
孙利华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Fufeng Technology Co Ltd
Original Assignee
Suzhou Fufeng Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Fufeng Technology Co Ltd filed Critical Suzhou Fufeng Technology Co Ltd
Priority to CN201410690271.4A priority Critical patent/CN104536389A/en
Publication of CN104536389A publication Critical patent/CN104536389A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses a 3D face identification technology based intelligent household system and a realization method thereof. A laser scanner is used to extract 3D face features of a person who enters an identification area, the 3D face data is sent to a microprocessor, and the microprocessor is combined with a database to carry out 3D face identification; if a coupling result is correct, the microprocessor a door lock of an entrance guard system to open the door, and automatically implement corresponding operations on the intelligent household according to data stored in the database or presets by users; a mobile-phone client displays the operation states of the system, or an instruction is manually sent to the microprocessor so that the intelligent household implements corresponding operations; and if the coupling result is incorrect, a coupling error is prompted, face images are sent to the mobile-phone client to notify the user via the network, and the user can send an access inhibition command via the mobile-phone client. The 3D face identification technology based intelligent household system and the realization method thereof have the advantages that the safety of the intelligent household system and the house are ensured, different functions of the household are integrated, the cost is saved and the quality of life is improved.

Description

A kind of intelligent domestic system based on three-dimensional face recognition technology and implementation method
Technical field
The present invention relates to Intelligent Recognition field, particularly relate to a kind of intelligent domestic system based on three-dimensional face recognition technology and implementation method.
Background technology
Smart Home is platform with house, has both Architectural Equipment, network service, information household appliances and equipment automatization, efficient, comfortable, safety, facility that collecting system, structure, service, management are integrated, the living environment of environmental protection.Smart Home utilizes advanced computer technology, the network communications technology and comprehensive wiring technology, the each subsystem relevant with life staying idle at home is organically combined, the life style of people is optimized by overall management, people are helped effectively to arrange the time, strengthen the security of life staying idle at home, even economize on the use of funds for various energy expenditure.
But domestic market Smart Home product functions is independent, single, can not whole household System conformity to one; Function is solidified, and correspondingly can not adjust according to different users, different personal preferences custom; Current product is all applied as ordinary sensors technology such as infrared sensings, and there is great deficiency security aspect.
Summary of the invention
For solving the deficiencies in the prior art, the object of the present invention is to provide a kind of intelligent domestic system based on three-dimensional face recognition technology and implementation method.
In order to realize above-mentioned target, the present invention adopts following technical scheme: a kind of intelligent domestic system based on three-dimensional face recognition technology, it is characterized in that, the three-dimensional face features's database, gate control system, Smart Home and the cell-phone customer terminal that comprise microprocessor, be connected respectively with microprocessor; The laser scanner that described gate control system comprises door, door lock and is arranged on above described door; Described cell-phone customer terminal is connected with described microprocessor by network.
Aforesaid a kind of intelligent domestic system based on three-dimensional face recognition technology, it is characterized in that, described Smart Home comprises lamp, water heater, air-conditioning, curtain, music player.
Based on the implementation method of a kind of intelligent domestic system based on three-dimensional face recognition technology of above-mentioned arbitrary claim, it is characterized in that, comprise step:
1) laser scanner carries out three-dimensional face features's extraction to the personnel entering identified region, and three-dimensional face data are sent to microprocessor, and microprocessor carries out three-dimensional face identification in conjunction with database;
2) if matching result is correct, then the door-lock opening door of Microprocessor S3C44B0X gate control system, microprocessor is automatically put according to the setting in the past of preserving in database or user preset and is carried out corresponding operating to Smart Home; Cell-phone customer terminal shows the running status of each system, or manually transmission instruction operates accordingly to Microprocessor S3C44B0X Smart Home;
3) if matching result mistake, prompting matching error, then send to cell-phone customer terminal to inform user by network facial image, and user can select to send order opening gate by cell-phone customer terminal.
Aforesaid a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology, it is characterized in that, the three-dimensional face identification method in described step 1) comprises:
1) face three-dimensional feature data are obtained;
2) pretreatment operation is carried out to the data obtained; Described pretreatment operation comprises Face datection and particular point location; Described Face datection comprise carry out successively data de-noising, Mesh smoothing, lattice simplified operation;
3) from pretreated extracting data feature;
4) compare with character pair in database, determine that whether coupling is successful according to similarity threshold.
Aforesaid a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology, it is characterized in that, step 2) described particular point location takes the method that the zone boundary based on organ distributed knowledge is extracted, utilize the dynamic parameter template of organ further, through boundary curve matching, energy function optimized algorithm, the signature analysis of calmodulin binding domain CaM internal point obtains stable organ key feature points.
Aforesaid a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology, is characterized in that, in step 3), feature extraction comprises straight line Euclidean distance, curve distance, area, angle and volume five kinds of features.
Aforesaid a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology, it is characterized in that, the aspect ratio in step 4) differentiates the similarity of mainly carrying out in face to be compared and database between pre-stored data according to the Euclidean distance between proper vector; Setting similarity threshold judges to treat whether judgement sample is similar to Sample Storehouse, thus completes three-dimensional identification.
The beneficial effect that the present invention reaches: different users can be identified by three-dimensional face identification, the personal preference's custom according to user adjusts accordingly to domestic environment, more can embody the intellectuality of system; Three-dimensional face identification after stranger enters identification range, can communicate with user mobile phone client after can not identifying human face data, ensure that the security of whole system and family; By each Function Integration Mechanism of family to together, save cost, improved the quality of living.
Accompanying drawing explanation
Fig. 1 is the intelligent domestic system structural representation based on three-dimensional face recognition technology;
Fig. 2 is the intelligent domestic system implementation method process flow diagram based on three-dimensional face recognition technology;
Fig. 3 is three-dimensional face identification process figure in the Smart Home implementation method based on three-dimensional face recognition technology.
Embodiment
Below in conjunction with accompanying drawing, the invention will be further described.Following examples only for technical scheme of the present invention is clearly described, and can not limit the scope of the invention with this.
As shown in Figure 1, a kind of intelligent domestic system based on three-dimensional face recognition technology, the three-dimensional face features's database, gate control system, Smart Home and the cell-phone customer terminal that comprise microprocessor, be connected respectively with microprocessor; The laser scanner that described gate control system comprises door, door lock and is arranged on above described door; Described cell-phone customer terminal is connected with described microprocessor by network;
Described Smart Home comprises lamp, water heater, air-conditioning, curtain, music player etc.
As shown in Figure 2, a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology,
1) laser scanner carries out three-dimensional face features's extraction to the personnel entering identified region, and three-dimensional face data are sent to microprocessor, and microprocessor carries out three-dimensional face identification in conjunction with database;
2) if matching result is correct, then the door-lock opening door of Microprocessor S3C44B0X gate control system, microprocessor is automatically put according to the setting in the past of preserving in database or user preset and is carried out corresponding operating to Smart Home; Cell-phone customer terminal shows the running status of each system, or manually transmission instruction operates accordingly to Microprocessor S3C44B0X Smart Home;
3) if matching result mistake, prompting matching error, then send to cell-phone customer terminal to inform user by network facial image, and user can select to send order opening gate by cell-phone customer terminal.
As shown in Figure 3, the three-dimensional face identification method in step 1) comprises:
1) face three-dimensional feature data are obtained;
2) pretreatment operation is carried out to the data obtained; Described pretreatment operation comprises Face datection and particular point location; Described Face datection comprise carry out successively data de-noising, Mesh smoothing, lattice simplified operation;
3) from pretreated extracting data feature;
4) compare with character pair in database, determine that whether coupling is successful according to similarity threshold.
Above-mentioned steps 2) in described data de-noising be remove utilize structured light technique or stereovision technique to collect original 3D data with noise spot, a lot of cavity such as existed or cusp.Median filter method Be very effective in the salt-pepper noise of process two dimensional image, data de-noising of the present invention adopts the method for medium filtering.
Described Mesh smoothing is the situation in order to improve owing to there is error in grid data gatherer process, improves mesh quality, so that subsequent treatment.Select weighting Laplacian method method when keeping grid search-engine, simply, fast can carry out filtering to data.
Described lattice simplified object is: for input grid model, produce and its corresponding shape that substantially holds its shape, relative sparse simplification approximate model, keeps topological structure constant simultaneously.The present invention adopts PM algorithm, and PM algorithm is the typical method in Edge collapse algorithm, and its adopts energy function optimization method to carry out abbreviation model, by introducing distance energy, represents ability and spring energy, makes simplified model be that the optimization of master mould approaches.
Described particular point location takes the method that the zone boundary based on organ distributed knowledge is extracted, utilize the dynamic parameter template of organ further, through boundary curve matching, energy function optimized algorithm, the signature analysis of calmodulin binding domain CaM internal point obtains stable organ key feature points.
In step 3), feature extraction comprises straight line Euclidean distance, curve distance, area, angle and volume five kinds of features.
Straight line Euclidean distance feature mainly calculates the straight line Euclidean distance on three-dimensional face between two unique points; Curve distance mainly calculates the curve distance between eyes on three-dimensional face, nose, each particular point of face; Angle character mainly calculates the angle between eyes on three-dimensional face, nose, each particular point of face; Volume characteristic mainly calculates the volume of three-dimensional face nose, and area features mainly calculates the area of three-dimensional face nose.
Aspect ratio in step 4) differentiates the similarity of mainly carrying out in face to be compared and database between pre-stored data according to the Euclidean distance between proper vector.
Measure the structural feature obtained proper vector in characteristic extraction step, carry out the measuring similarity foundation between face according to the Euclidean distance between proper vector.
Setting similarity threshold judges to treat whether judgement sample is similar to Sample Storehouse.When being less than threshold value, think that both are similar, on the contrary dissimilar, thus complete three-dimensional identification.
Can identify different users by three-dimensional face identification, the personal preference's custom according to user adjusts accordingly to domestic environment, more can embody the intellectuality of system; Three-dimensional face identification after stranger enters identification range, can communicate with user mobile phone client after can not identifying human face data, ensure that the security of whole system and family; By device by each Function Integration Mechanism of family to together, saved cost, improved the quality of living.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the prerequisite not departing from the technology of the present invention principle; can also make some improvement and distortion, these improve and distortion also should be considered as protection scope of the present invention.

Claims (7)

1. based on an intelligent domestic system for three-dimensional face recognition technology, it is characterized in that, the three-dimensional face features's database, gate control system, Smart Home and the cell-phone customer terminal that comprise microprocessor, be connected respectively with microprocessor; The laser scanner that described gate control system comprises door, door lock and is arranged on above described door; Described cell-phone customer terminal is connected with described microprocessor by network.
2. a kind of intelligent domestic system based on three-dimensional face recognition technology according to claim 1, it is characterized in that, described Smart Home comprises lamp, water heater, air-conditioning, curtain, music player.
3., based on the implementation method of a kind of intelligent domestic system based on three-dimensional face recognition technology described in above-mentioned arbitrary claim, it is characterized in that, comprise step:
1) laser scanner carries out three-dimensional face features's extraction to the personnel entering identified region, and three-dimensional face data are sent to microprocessor, and microprocessor carries out three-dimensional face identification in conjunction with database;
2) if matching result is correct, then the door-lock opening door of Microprocessor S3C44B0X gate control system, microprocessor is automatically put according to the setting in the past of preserving in database or user preset and is carried out corresponding operating to Smart Home; Cell-phone customer terminal shows the running status of each system, or manually transmission instruction operates accordingly to Microprocessor S3C44B0X Smart Home;
3) if matching result mistake, prompting matching error, then send to cell-phone customer terminal to inform user by network facial image, and user can select to send order opening gate by cell-phone customer terminal.
4. a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology according to claim 3, it is characterized in that, the three-dimensional face identification method in described step 1) comprises:
1) face three-dimensional feature data are obtained;
2) pretreatment operation is carried out to the data obtained; Described pretreatment operation comprises Face datection and particular point location; Described Face datection comprise carry out successively data de-noising, Mesh smoothing, lattice simplified operation;
3) from pretreated extracting data feature;
4) compare with character pair in database, determine that whether coupling is successful according to similarity threshold.
5. a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology according to claim 4, it is characterized in that, step 2) described particular point location takes the method that the zone boundary based on organ distributed knowledge is extracted, utilize the dynamic parameter template of organ further, through boundary curve matching, energy function optimized algorithm, the signature analysis of calmodulin binding domain CaM internal point obtains stable organ key feature points.
6. a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology according to claim 4, is characterized in that, in step 3), feature extraction comprises straight line Euclidean distance, curve distance, area, angle and volume five kinds of features.
7. a kind of intelligent domestic system implementation method based on three-dimensional face recognition technology according to claim 4, it is characterized in that, the aspect ratio in step 4) differentiates the similarity of mainly carrying out in face to be compared and database between pre-stored data according to the Euclidean distance between proper vector; Setting similarity threshold judges to treat whether judgement sample is similar to Sample Storehouse, thus completes three-dimensional identification.
CN201410690271.4A 2014-11-27 2014-11-27 3D face identification technology based intelligent household system and realization method thereof Pending CN104536389A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410690271.4A CN104536389A (en) 2014-11-27 2014-11-27 3D face identification technology based intelligent household system and realization method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410690271.4A CN104536389A (en) 2014-11-27 2014-11-27 3D face identification technology based intelligent household system and realization method thereof

Publications (1)

Publication Number Publication Date
CN104536389A true CN104536389A (en) 2015-04-22

Family

ID=52851932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410690271.4A Pending CN104536389A (en) 2014-11-27 2014-11-27 3D face identification technology based intelligent household system and realization method thereof

Country Status (1)

Country Link
CN (1) CN104536389A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104820829A (en) * 2015-05-08 2015-08-05 常州大学 Novel face recognition algorithm based on depth data and application thereof in intelligent permission assignment system
CN105867151A (en) * 2016-04-21 2016-08-17 湖南中迪科技有限公司 Intelligent face recognition household door system and working method
WO2017031769A1 (en) * 2015-08-27 2017-03-02 罗旭宜 Method for matching facial features to button set-up, and game system
CN106558133A (en) * 2016-11-29 2017-04-05 特斯联(北京)科技有限公司 A kind of reservation of resources method and system based on the current equipment of intelligence
CN106845460A (en) * 2017-03-15 2017-06-13 深圳汇通智能化科技有限公司 A kind of intelligent domestic system based on recognition of face
CN107703792A (en) * 2017-09-11 2018-02-16 广东欧珀移动通信有限公司 The control method and device of intelligent appliance
CN108376237A (en) * 2018-01-17 2018-08-07 南京邮电大学 A kind of house visiting management system and management method based on 3D identifications
CN109118625A (en) * 2018-08-07 2019-01-01 河南云拓智能科技有限公司 The control method of machine is controlled in a kind of cloud intelligence
CN109450748A (en) * 2018-10-25 2019-03-08 广州宏亮信息技术有限公司 Smart home system
CN109739101A (en) * 2018-12-30 2019-05-10 武汉市新源科创科技有限公司 Intelligent home control system based on recognition of face
CN110619320A (en) * 2019-09-28 2019-12-27 华东理工大学 Intelligent control method for intelligent bathing machine and bathing machine
CN111075321A (en) * 2019-12-18 2020-04-28 张语骞 Anti-theft safety door system with positioning and alarming functions and using method thereof
CN113536844A (en) * 2020-04-16 2021-10-22 中移(成都)信息通信科技有限公司 Face comparison method, device, equipment and medium
CN116841270A (en) * 2023-09-01 2023-10-03 贵州通利数字科技有限公司 Intelligent production line scheduling method and system based on Internet of things

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020071033A1 (en) * 2000-12-12 2002-06-13 Philips Electronics North America Corporation Apparatus and methods for resolution of entry/exit conflicts for security monitoring systems
CN102915582A (en) * 2012-09-24 2013-02-06 南京信息工程大学 Face recognition-based residence visitor system
CN103268477A (en) * 2013-05-15 2013-08-28 苏州福丰科技有限公司 Three-dimensional face recognition system based on embedded platform
CN103345232A (en) * 2013-07-15 2013-10-09 孟凡忠 Individualized intelligent home control method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020071033A1 (en) * 2000-12-12 2002-06-13 Philips Electronics North America Corporation Apparatus and methods for resolution of entry/exit conflicts for security monitoring systems
CN102915582A (en) * 2012-09-24 2013-02-06 南京信息工程大学 Face recognition-based residence visitor system
CN103268477A (en) * 2013-05-15 2013-08-28 苏州福丰科技有限公司 Three-dimensional face recognition system based on embedded platform
CN103345232A (en) * 2013-07-15 2013-10-09 孟凡忠 Individualized intelligent home control method and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
廖冬,谷刚: "《基于人脸识别技术的智能家电分类控制研究》", 《工业控制计算机》 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104820829A (en) * 2015-05-08 2015-08-05 常州大学 Novel face recognition algorithm based on depth data and application thereof in intelligent permission assignment system
WO2017031769A1 (en) * 2015-08-27 2017-03-02 罗旭宜 Method for matching facial features to button set-up, and game system
CN105867151A (en) * 2016-04-21 2016-08-17 湖南中迪科技有限公司 Intelligent face recognition household door system and working method
CN106558133A (en) * 2016-11-29 2017-04-05 特斯联(北京)科技有限公司 A kind of reservation of resources method and system based on the current equipment of intelligence
CN106845460B (en) * 2017-03-15 2020-09-25 江苏安威士智能安防有限公司 Intelligent household system based on face recognition
CN106845460A (en) * 2017-03-15 2017-06-13 深圳汇通智能化科技有限公司 A kind of intelligent domestic system based on recognition of face
CN107703792A (en) * 2017-09-11 2018-02-16 广东欧珀移动通信有限公司 The control method and device of intelligent appliance
CN108376237A (en) * 2018-01-17 2018-08-07 南京邮电大学 A kind of house visiting management system and management method based on 3D identifications
CN109118625A (en) * 2018-08-07 2019-01-01 河南云拓智能科技有限公司 The control method of machine is controlled in a kind of cloud intelligence
CN109450748A (en) * 2018-10-25 2019-03-08 广州宏亮信息技术有限公司 Smart home system
CN109739101A (en) * 2018-12-30 2019-05-10 武汉市新源科创科技有限公司 Intelligent home control system based on recognition of face
CN110619320A (en) * 2019-09-28 2019-12-27 华东理工大学 Intelligent control method for intelligent bathing machine and bathing machine
CN111075321A (en) * 2019-12-18 2020-04-28 张语骞 Anti-theft safety door system with positioning and alarming functions and using method thereof
CN113536844A (en) * 2020-04-16 2021-10-22 中移(成都)信息通信科技有限公司 Face comparison method, device, equipment and medium
CN113536844B (en) * 2020-04-16 2023-10-31 中移(成都)信息通信科技有限公司 Face comparison method, device, equipment and medium
CN116841270A (en) * 2023-09-01 2023-10-03 贵州通利数字科技有限公司 Intelligent production line scheduling method and system based on Internet of things
CN116841270B (en) * 2023-09-01 2023-11-14 贵州通利数字科技有限公司 Intelligent production line scheduling method and system based on Internet of things

Similar Documents

Publication Publication Date Title
CN104536389A (en) 3D face identification technology based intelligent household system and realization method thereof
CN104582187B (en) Based on the record of recognition of face and Expression Recognition and lamp light control system and method
CN107818308A (en) A kind of recognition of face intelligence comparison method, electronic installation and computer-readable recording medium
CN102163283B (en) Method for extracting face characteristic based on local three-value mode
CN107578519A (en) A kind of intelligent access control system and intelligent entrance guard method for unlocking
CN107472195A (en) A kind of car door automatic opening system and method based on facial image track identification
CN105096420A (en) Access control system and data processing method for same
CN107016346A (en) gait identification method and system
CN104077516A (en) Biometric authentication method and terminal
CN104751040A (en) Fingerprint detection method based on intelligent mobile information equipment
CN205427946U (en) Hotel moves in management system
WO2021175068A1 (en) Information pushing method, system and device for hotel
CN108181837B (en) Control method and control device
CN106789456A (en) A kind of home equipment control method and device
CN103970804A (en) Information inquiring method and device
CN107490979A (en) Home terminal control method, equipment and system
CN104599365A (en) Flat open induction door control system and method based on three-dimensional facial image recognition
CN110936920A (en) Vehicle trunk opening method and device, vehicle and storage medium
CN205140028U (en) Gate inhibition system
CN109343481B (en) Method and device for controlling device
CN110781778A (en) Access control method and device, storage medium and home system
CN104361339A (en) Palm image extracting and identification method
CN105260638A (en) Controller iris control method and system, integrated controller and air conditioner
CN116149236B (en) Application operation and maintenance management intelligent monitoring system and method based on block chain
CN108022335B (en) Access control method and device and access control system

Legal Events

Date Code Title Description
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20150422