CN109828375A - A kind of display of new line monitors integrated system with face - Google Patents
A kind of display of new line monitors integrated system with face Download PDFInfo
- Publication number
- CN109828375A CN109828375A CN201910244800.0A CN201910244800A CN109828375A CN 109828375 A CN109828375 A CN 109828375A CN 201910244800 A CN201910244800 A CN 201910244800A CN 109828375 A CN109828375 A CN 109828375A
- Authority
- CN
- China
- Prior art keywords
- master controller
- face
- sensitive chip
- display
- transceiver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 claims description 9
- 230000004297 night vision Effects 0.000 claims description 5
- 230000035945 sensitivity Effects 0.000 claims description 4
- 238000013442 quality metrics Methods 0.000 claims description 3
- 238000013461 design Methods 0.000 abstract description 9
- 238000011161 development Methods 0.000 abstract description 4
- 230000001737 promoting effect Effects 0.000 abstract description 2
- 230000008901 benefit Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- HEZMWWAKWCSUCB-PHDIDXHHSA-N (3R,4R)-3,4-dihydroxycyclohexa-1,5-diene-1-carboxylic acid Chemical compound O[C@@H]1C=CC(C(O)=O)=C[C@H]1O HEZMWWAKWCSUCB-PHDIDXHHSA-N 0.000 description 1
- 241000736199 Paeonia Species 0.000 description 1
- 235000006484 Paeonia officinalis Nutrition 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The present invention relates to a kind of displays of new line to monitor integrated system with face, including master controller, CMOS sensitive chip, CAN transceiver and energy supply control module device, energy supply control module device is respectively master controller, CMOS sensitive chip, CAN transceiver power supply, the port I/O one of master controller connects ON/OFF key, the two connection mode selection key of the port I/O of master controller, the PWM interface one of master controller connects brightness regulation knob, the PWM interface two of master controller connects image height adjusting knob, the port I/O three of master controller connects energy supply control module device, master controller is separately connected new line display video playback unit device, reflector alignment module device, the output end of CMOS sensitive chip connects master controller；Connection and reasonable arrangement of the present invention, compatibility is strong, modular design save the cost, can make vehicle while promoting configuration, shortens the development cycle, and feasibility is high, easy to implement.
Description
[technical field]
The present invention relates to technical field of automotive electronics, specifically a kind of new line display monitors integrated system with face.
[background technique]
Currently, vehicle comes back, display is segmented into two classes: common 2D new line is shown and augmented reality AR comes back display, 2D lift
Head display by the focus of lens synthesize include image information light beam, by lens and after light beam thrown in a manner of directional light
It is incident upon in projection screen and forms real image.AR HUD is one virtual image of generation at 2 to 2.5 meters of Chinese herbaceous peony different from the place of 2D HUD,
This virtual image is to lead to front windshield by the image played on the TFT display screen of AR HUD to be reflected into front of pilot's line of vision.
The head-up-display system of augmented reality AR should include four primary clusterings: video playback unit, reflecting mirror and adjustment mechanism, front
Wind glass (as radiation shield) and video generate control unit.
Face monitoring technology is mainly used for two aspects, and one is for reaching onboard system as the function of face recognition
Propertyization setting and application.The other is as safety assist (ADAS) function, constantly monitor driver in driving procedure whether
Fatigue, when detecting that driver is drowsy, which should issue an alert indicate that driver.Face monitoring technology utilizes camera shooting
The facial characteristics and eye feature of head observerpilot, the main face mask including driver, feature locations, the blink period,
In a short time every etc..And be compared with normal condition, carry out the identification of driver.It should include three main group that face, which monitors system,
Part: camera unit, image identification unit and infrared emission unit (being used under the conditions of night vision).
New line is shown and face monitoring has in common that two aspects: the optical design of one side new line display is necessary
The image for playing video playback unit is correctly reflected within the eye movement range (Eye Box) of human eye, and face monitoring
Optical design then must be such that the image of face is correctly reflected into camera unit, and the light path design of the two is consistent, therefore light
Learn mirror adjustment mechanism, front windshield (as radiation shield) can share.On the other hand, come back the video playing list of display
Emitting portion of the member as the display that comes back, the receiving portion that the camera unit of face monitoring is monitored as face can be placed on
The same position, therefore the control module that can integrate as unification, can be referred to as Image Acquisition and video playing mould here
Block；The video generation control unit of display that comes back simultaneously and the image identification unit of face monitoring can also be designed to unified one
A circuit can be referred to as double mode governor circuit here.If can provide it is a kind of be utilized come back display and recognition of face share
Technology, and be integrated in a component, it will have very important significance.
[summary of the invention]
A kind of display of new line is provided and monitors integrated system with face present invention aim to solve above-mentioned deficiency,
Not only connection and reasonable arrangement, compatibility is strong, and modular design save the cost, can make vehicle while promoting configuration, shortens
Development cycle, feasibility are high, easy to implement.
A kind of display of new line is designed to achieve the above object monitors integrated system, including master controller 1, CMOS sense with face
Optical chip device 2, CAN transceiver 3 and energy supply control module device 4, the energy supply control module device 4 be separately connected master controller 1,
CMOS sensitive chip device 2, CAN transceiver 3, the energy supply control module device 4 are respectively master controller 1, CMOS sensitive chip device
2, CAN transceiver 3 is powered, and the port I/O one of the master controller 1 passes through connection ON/OFF key, the master controller 1
The port I/O two by connection mode selection button, the PWM interface one of the master controller 1 passes through connection brightness
Adjusting knob, for the PWM interface two of the master controller 1 by connection image height adjusting knob, the master controller 1 is logical
The frequency and pulse width variations for crossing input pulse indicate the adjustment variation of corresponding bright and height, the port I/O of the master controller 1
Three by connection energy supply control module device 4, and controls energy supply control module by three out-put supply switching signal of the port I/O
Device 4, the master controller 1 is come back by SPI interface and the connection of PWM interface and shows video playback unit device 6, and is shown to coming back
Brightness of image is adjusted, and the master controller 1 connects reflector alignment module device 5 by the port I/O four, and controls reflecting mirror
Corner is to adjust image height, and the CMOS sensitive chip device 2 is monitored for face, the output of the CMOS sensitive chip device 2
The picture element signal of conversion is inputted master controller 1 by end connection master controller 1, the CMOS sensitive chip device 2, and by master controller
1 completes the generation and identification of picture.
Further, for the master controller 1 by connection CAN transceiver 3, the CAN transceiver 3 is total by CAN
Line is connected with alarm, and the master controller 1 broadcasts the result of picture recognition by alarm in CAN bus, or by phase
The picture and Video Quality Metric answered are the output of RGB LVDS signal.
Further, the new line for coming back display video playback unit device 6 shows that image is shown and is inputted in fact by LVDS
It is existing, it is converted into rgb signal by LVDS transceiver, rgb signal is sent to new line display video playing again by the master controller 1
Unit device 6.
Further, the master controller 1 selects 32 bit processors, and the CMOS sensitive chip device 2 selects high sensitivity
CMOS image sensor.
Further, the CMOS sensitive chip device 2 is connected with vehicle mounted infrared emitter, the vehicle mounted infrared transmitting dress
The wavelength for the infrared light supply set is 940nm or 850nm, and the vehicle mounted infrared emitter is for realizing the face under the conditions of night vision
Identification.
The present invention compared with the existing technology, has the advantages that
(1) feature-rich: cover the basic function of come back display and recognition of face, and support Premium Features into one
Walk development and application；
(2) technology is novel: the common technology of come back display and recognition of face is utilized, and is integrated in a component；
(3) compatibility is strong: modularized design, unified interface, can be manually operated or by bus operation, while can
It is adapted to different video playback unit and camera；
(4) application prospect is extensive: come back display and recognition of face enhance the new hand of driving safety as driving experience is promoted
Section, has become the necessary functions of vehicle application, is widely used wealthy；
To sum up: connection and reasonable arrangement of the present invention, feasibility are high, easy to implement, while modular design save the cost, vehicle are matched
It sets customizable, life cycle length, comprehensive benefit to protrude, the development cycle can shorten 50%, it is excellent can to have technology in 5 years
Gesture passes through two components of integration, and vehicle can be made to promote configuration simultaneously, reduce by 20% to 50% cost, comprehensive benefit is bright
It is aobvious, it is worthy of popularization.
[Detailed description of the invention]
Fig. 1 is the principle of the present invention block diagram；
In figure: 1, master controller 2, CMOS sensitive chip 3, CAN transceiver 4, energy supply control module device 5, reflecting mirror
Adjust module device 6, come back display video playback unit device.
[specific embodiment]
The present invention is made with reference to the accompanying drawing further explained below:
As shown in the picture, the present invention includes: master controller 1, CMOS sensitive chip device 2, CAN transceiver 3 and power supply control
Module device 4, energy supply control module device 4 are separately connected master controller 1, CMOS sensitive chip device 2, CAN transceiver 3, power supply control
Module device 4 is respectively master controller 1, CMOS sensitive chip device 2, the power supply of CAN transceiver 3, and the port I/O one of master controller 1 is logical
Connection ON/OFF key is crossed, the port I/O two of master controller 1 passes through connection mode selection button, master controller 1
PWM interface one passes through connection image height tune by connection brightness regulation knob, the PWM interface two of master controller 1
Knob is saved, master controller 1 indicates the adjustment variation of corresponding bright and height, master control by the frequency and pulse width variations of input pulse
The port I/O three of device 1 processed passes through the three out-put supply switching signal control of the port I/O by connection energy supply control module device 4
Energy supply control module device 4 processed, master controller 1 are come back by SPI interface and the connection of PWM interface and show video playback unit device 6, and
To coming back, display brightness of image is adjusted, and master controller 1 connects reflector alignment module device 5 by the port I/O four, and controls
Mirror corners are to adjust image height, and CMOS sensitive chip device 2 is monitored for face, the output end of CMOS sensitive chip device 2
Master controller 1 is connected, the picture element signal of conversion is inputted master controller 1 by CMOS sensitive chip device 2, and is completed by master controller 1
The generation and identification of picture.
Wherein, master controller 1 is connected with alarm by CAN bus by connection CAN transceiver 3, CAN transceiver 3
Device, master controller 1 broadcasts the result of picture recognition by alarm in CAN bus, or corresponding picture and video are turned
It is changed to the output of RGB LVDS signal；It comes back and shows that the new line of video playback unit device 6 shows that image is shown and inputs by LVDS
It realizes, is converted into rgb signal by LVDS transceiver, rgb signal is sent to new line display video playing list again by master controller 1
First device 6；Master controller 1 selects 32 bit processors, and CMOS sensitive chip device 2 selects high sensitivity CMOS image sensor, CMOS
Sensitive chip device 2 is connected with vehicle mounted infrared emitter, the wavelength of the infrared light supply of vehicle mounted infrared emitter be 940nm or
850nm, vehicle mounted infrared emitter is for realizing the recognition of face under the conditions of night vision.
The present invention relates to the designs of double mode governor circuit comprising master controller, CMOS sensitive chip, CAN transmitting-receiving
Device and energy supply control module, master controller are connected with CMOS sensitive chip, CAN transceiver with energy supply control module respectively.Mainly
Thinking is to complete circuit design functionally to meet the requirement of come back display and recognition of face simultaneously.Come back the function master shown
It to be adjusted for the display unlatching/closing that comes back, picture altitude adjusting, brightness of image and image plays, and the main function of face monitoring
It can video acquisition and recognition of face.Therefore, in an integrated system unify complete unlatching/closing, come back display picture altitude adjust,
The display brightness of image that comes back is adjusted, the display image that comes back plays display function, camera image recording function and model selection function
Energy.
Wherein unlatching/closing, model selection, brightness regulation and image height adjust can by external hardwire switch or
CAN signal triggering, therefore the ON/OFF (switch on and off state) of key-press input, model selection (new line display are arranged in circuit
And recognition of face mode), the gear signal of Value knobs, image height relative position signal；Increase CAN transceiver simultaneously to connect
Receive switching signal, model selection, brightness adjusting signal and the image height adjustment signal of CAN bus.ON/OFF (the switch of key
On off operating mode) it is read by the I/O mouth of master controller, master controller controls 12V power supply by I/O mouthfuls of out-put supply switching signals
Switching function is realized in the power-on and power-off of control module；Model selection equally occupies one I/O mouthfuls of master controller；The shelves of Value knobs
The relative position signal of position signal and image height is inputted with pwm signal, is indicated by the frequency and pulse width variations of input pulse
The adjustment of corresponding bright and height changes.
In the present invention, master controller can be adjusted the display brightness of image that comes back by SPI and PWM interface；Pass through
Another I/O mouthfuls of control mirror corners achieve the purpose that adjust image height.The display image display function that comes back passes through LVDS
Input is realized, is converted into rgb signal by LVDS transceiver, rgb signal is sent to new line display video again and broadcast by master controller
Put unit.Face monitoring function inputs master controller by the picture element signal that CMOS sensitive chip is converted, and completes to scheme by master controller
The generation and identification of piece.The result of identification can be broadcasted in CAN bus in a manner of alarm signal, also can according to need by
Corresponding picture and Video Quality Metric are the output of RGB LVDS signal.
In the present invention, the STM32 series of 32 bit processors such as ST, the i.MX series of Freescale is can be selected in master controller.
Energy supply control module is the KL30 voltage 12V that input is vehicle, is converted to 5V for backlight adjusting and reflecting mirror tune by DCDC
Section is converted to 3.3V and uses for master controller and CMOS sensitive chip.TJA104X, TJA105X can be selected in CAN transceiver module.
CMOS sensitive chip can select high sensitivity CMOS image sensor, it is desirable that capture high score in 0.005lux low-light conditions
Resolution color image.In addition, cooperation vehicle mounted infrared emitter (infrared light supply as using wavelength being 940nm, 850nm) can be real
Recognition of face under the conditions of existing night vision.
The present invention is simultaneously not limited to the embodiments described above, other any without departing from spiritual essence and principle of the invention
Changes, modifications, substitutions, combinations, simplifications made by lower, should be equivalent substitute mode, are included in protection model of the invention
Within enclosing.
Claims (5)
1. a kind of new line display monitors integrated system with face, it is characterised in that: including master controller (1), CMOS sensitive chip
(2), CAN transceiver (3) and energy supply control module device (4), the energy supply control module device (4) be separately connected master controller (1),
CMOS sensitive chip (2), CAN transceiver (3), the energy supply control module device (4) are respectively master controller (1), CMOS photosensitive
Chip (2), CAN transceiver (3) power supply, the port I/O one of the master controller (1) pass through connection ON/OFF key, institute
The port I/O two of master controller (1) is stated by connection mode selection button, the PWM interface one of the master controller (1) is logical
Connection brightness regulation knob is crossed, the PWM interface two of the master controller (1) adjusts rotation by connection image height
Button, the master controller (1) indicate the adjustment variation of corresponding bright and height, institute by the frequency and pulse width variations of input pulse
The port I/O three of master controller (1) is stated by connection energy supply control module device (4), and passes through three out-put supply of the port I/O
Switching signal controls energy supply control module device (4), and the master controller (1) is come back and shown by SPI interface and the connection of PWM interface
Video playback unit device (6), and the display brightness of image that comes back is adjusted, the master controller (1) is connected by the port I/O four
Reflector alignment module device (5) is connect, and controls mirror corners to adjust image height, the CMOS sensitive chip (2) is used for
The output end of face monitoring, the CMOS sensitive chip (2) connects master controller (1), and the CMOS sensitive chip (2) will convert
Picture element signal input master controller (1), and by master controller (1) complete picture generation and identification.
2. the display as described in claim 1 that comes back monitors integrated system with face, it is characterised in that: the master controller (1)
By connection CAN transceiver (3), the CAN transceiver (3) is connected with alarm, the master controller by CAN bus
(1) result of picture recognition is broadcasted in CAN bus by alarm, or by corresponding picture and Video Quality Metric be RGB or
The output of person's LVDS signal.
3. the display as described in claim 1 that comes back monitors integrated system with face, it is characterised in that: the new line shows video
The new line of broadcast unit device (6) shows that image shows to input by LVDS and realizes, is converted into rgb signal by LVDS transceiver,
Rgb signal is sent to new line display video playback unit device (6) again by the master controller (1).
4. new line display as claimed in claim 1,2 or 3 monitors integrated system with face, it is characterised in that: the main control
Device (1) selects 32 bit processors, and the CMOS sensitive chip (2) selects high sensitivity CMOS image sensor.
5. the display as claimed in claim 4 that comes back monitors integrated system with face, it is characterised in that: the CMOS sensitive chip
(2) it is connected with vehicle mounted infrared emitter, the wavelength of the infrared light supply of the vehicle mounted infrared emitter is 940nm or 850nm,
The vehicle mounted infrared emitter is for realizing the recognition of face under the conditions of night vision.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910244800.0A CN109828375A (en) | 2019-03-28 | 2019-03-28 | A kind of display of new line monitors integrated system with face |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910244800.0A CN109828375A (en) | 2019-03-28 | 2019-03-28 | A kind of display of new line monitors integrated system with face |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109828375A true CN109828375A (en) | 2019-05-31 |
Family
ID=66873149
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910244800.0A Pending CN109828375A (en) | 2019-03-28 | 2019-03-28 | A kind of display of new line monitors integrated system with face |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109828375A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111267616A (en) * | 2020-02-28 | 2020-06-12 | 华域视觉科技(上海)有限公司 | Vehicle-mounted head-up display module and method and vehicle |
| CN114238193A (en) * | 2022-02-24 | 2022-03-25 | 浙江中控研究院有限公司 | Device for data interaction between PROFIBUS-DP bus and BLVDS bus |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203332005U (en) * | 2013-06-17 | 2013-12-11 | 郑州宇通客车股份有限公司 | Head up display system with automobile video function and passenger car using hold up display system |
| CN205720871U (en) * | 2016-01-08 | 2016-11-23 | 北京乐驾科技有限公司 | A kind of intelligence head-up-display system |
| CN107415691A (en) * | 2017-07-28 | 2017-12-01 | 上海仪电汽车电子***有限公司 | Centralized car-mounted display control system |
| CN107656374A (en) * | 2017-11-15 | 2018-02-02 | 长春理工大学 | A kind of head-up-display system based on catadioptric panorama camera |
| CN107672524A (en) * | 2017-10-24 | 2018-02-09 | 长春创盟欧科汽车安全***技术有限公司 | A kind of multifunctional vehicle mounted display and control system of coming back |
| CN109407320A (en) * | 2018-12-04 | 2019-03-01 | 中国科学院重庆绿色智能技术研究院 | Light path system and imaging optimization method are shown in conjunction with the new line of human eye tracing system |
| CN209928139U (en) * | 2019-03-28 | 2020-01-10 | 麦格纳斯太尔汽车技术（上海）有限公司 | Head-up display and face monitoring integrated system |
-
2019
- 2019-03-28 CN CN201910244800.0A patent/CN109828375A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203332005U (en) * | 2013-06-17 | 2013-12-11 | 郑州宇通客车股份有限公司 | Head up display system with automobile video function and passenger car using hold up display system |
| CN205720871U (en) * | 2016-01-08 | 2016-11-23 | 北京乐驾科技有限公司 | A kind of intelligence head-up-display system |
| CN107415691A (en) * | 2017-07-28 | 2017-12-01 | 上海仪电汽车电子***有限公司 | Centralized car-mounted display control system |
| CN107672524A (en) * | 2017-10-24 | 2018-02-09 | 长春创盟欧科汽车安全***技术有限公司 | A kind of multifunctional vehicle mounted display and control system of coming back |
| CN107656374A (en) * | 2017-11-15 | 2018-02-02 | 长春理工大学 | A kind of head-up-display system based on catadioptric panorama camera |
| CN109407320A (en) * | 2018-12-04 | 2019-03-01 | 中国科学院重庆绿色智能技术研究院 | Light path system and imaging optimization method are shown in conjunction with the new line of human eye tracing system |
| CN209928139U (en) * | 2019-03-28 | 2020-01-10 | 麦格纳斯太尔汽车技术（上海）有限公司 | Head-up display and face monitoring integrated system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111267616A (en) * | 2020-02-28 | 2020-06-12 | 华域视觉科技(上海)有限公司 | Vehicle-mounted head-up display module and method and vehicle |
| CN114238193A (en) * | 2022-02-24 | 2022-03-25 | 浙江中控研究院有限公司 | Device for data interaction between PROFIBUS-DP bus and BLVDS bus |
| CN114238193B (en) * | 2022-02-24 | 2022-06-17 | 浙江中控研究院有限公司 | Device for data interaction between PROFIBUS-DP bus and BLVDS bus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10671162B1 (en) | Eyeball tracking module for video glasses | |
| US9652036B2 (en) | Device, head mounted display, control method of device and control method of head mounted display | |
| CN201927050U (en) | Face recognition device with infrared human body sensing function | |
| CN108205374B (en) | Eyeball tracking module and method of video glasses and video glasses | |
| CN101697034B (en) | Circuit for portable day and night dual-purpose night-vision device | |
| CN109828375A (en) | A kind of display of new line monitors integrated system with face | |
| CN101840068A (en) | Head-worn optoelectronic automatic focusing visual aid | |
| EP3729182B1 (en) | Eye tracking for head-worn display | |
| WO2016136334A1 (en) | Projection display system and method for controlling projection display device | |
| EP3514606A1 (en) | Eye tracking for head-worn display | |
| US11216066B2 (en) | Display device, learning device, and control method of display device | |
| CN209928139U (en) | Head-up display and face monitoring integrated system | |
| CN212364780U (en) | Intelligent greeting lamp and intelligent greeting lamp system | |
| US10930200B2 (en) | Connection device, display device, and control method for the display device | |
| US8080904B2 (en) | Power supply and night vision device using the power supply | |
| JP2000019637A (en) | Projection type display device | |
| US20170285765A1 (en) | Input apparatus, input method, and computer program | |
| CN211720664U (en) | Projection apparatus and projection system | |
| CN112540462A (en) | AR video method based on Micro LED display and glasses | |
| CN111572453A (en) | Vehicle-mounted head-up display | |
| CN207300050U (en) | A kind of low-light (level) electronic aiming mirror of day and night compatibility | |
| CN220752397U (en) | Reflective eyepiece and digital sighting telescope with same | |
| CN217133467U (en) | Monocular telescope with night vision function | |
| CN215953975U (en) | Flexible liquid crystal intelligence AR glasses that discolour | |
| CN217320206U (en) | Vehicle rearview mirror and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |