CN103259971A - Eye control device in vehicle and method for eye control - Google Patents
Eye control device in vehicle and method for eye control Download PDFInfo
- Publication number
- CN103259971A CN103259971A CN2012100352868A CN201210035286A CN103259971A CN 103259971 A CN103259971 A CN 103259971A CN 2012100352868 A CN2012100352868 A CN 2012100352868A CN 201210035286 A CN201210035286 A CN 201210035286A CN 103259971 A CN103259971 A CN 103259971A
- Authority
- CN
- China
- Prior art keywords
- eye
- control
- eye control
- order
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
An eye control device in a vehicle and a method for eye control are used for monitoring movement of eyes of a driver and controlling communication outside the vehicle and equipment inside the vehicle. The eye control device mainly comprises an image taking unit capturing an image of the driver, a processing unit carries out calculation processing on the obtained image, and an eye judging unit monitors the movement of the eyes and produces eye control operation commands, a system manipulating unit carries out a corresponding system executive program and provides varied information communication or control or other solutions according to the eye control operation commands.
Description
Technical field
The invention relates to a kind of electronic installation that is used on the vehicle, particularly a kind of automobile-used eye control devices and methods therefor of controlling according to eye motion.
Background technology
Road safety etc. subject under discussion about the driving driver comes into one's own in recent years gradually.The traffic safety accident that causes owing to driver's maloperation often takes place, and main cause is owing to driver's fatigue, driving overlong time that causes of not having enough sleep do not have the rest of appropriateness, or drives when intoxicated etc.Rhembasmus, absent minded etc., the not good and generation of the accident that results in an automobile accident of driver's mental status.In order to solve this type of problem, there is the multiple technologies scheme to be suggested.As No. the 200910310326.3rd, Chinese patent, " driving monitoring device and method ", it mainly is the acquisition that sees through image, detecting driver person's eye areas be placed on the hand of steering wheel, whether the hand of judging the driver is placed on the correct zone on the steering wheel and whether eyes open or close because of fatigue.And United States Patent (USP) the 8th, 045, No. 766, " Device, program; and method for determining sleepiness " provides another kind of solution, mainly be acquisition driver's image of face, see through specific algorithm face is calculated, when finding driver's ill health, utilize gas device and safety belt shaking device to wake the driver up, or even warned through the brake controller.
In addition, as United States Patent (USP) the 6th, 842, No. 670, " Eye-tracking driving system " provides a kind of eyes tracing system, include specially designed glasses, assembling video camera on glasses and obtain the image of eyes allows the elderly of action inconvenience utilize rotation and then the control wheelchair of eyes.
It more than is the action that utilizes eyes, use detecting driver's situation and waken up caution, or be used for controlling technology such as wheelchair, can both reasonable operation and certain effect is arranged, yet function is quite limited to, and the driver can't utilize the action of eyes to control other vehicular equipment further or externally send information.
Summary of the invention
In view of this, the present invention is eye control devices and methods therefor in this proposes a kind of car, utilizes the action of monitoring driver's eyes to change, and then controls various device such as broadcast receiver in the car or multiple car such as call and link up operation outward.
Another object of the present invention, be to provide eye control devices and methods therefor in a kind of car, can send distress signals, when being seized on both sides by the arms, the driver plunders or when needing based on other cause that request is assisted to external world, as long as the driver makes specific eyes action, the present invention's device just can send distress signals automatically, has to use rapid, static caution, simple operation and other advantages.
According to eye control device in the car provided by the present invention, consist predominantly of taking unit, in order to capture driver's head phantom.Processing unit includes the image processing arithmetic element, in order to head phantom is carried out image processing, and obtains the eye image.The eye identifying unit carries out calculation process to the eye image, obtains eye characteristic parameter, and compares according to eye characteristic parameter and system's controlled condition, and produces eye control job command.System controls the unit and carries out various system executives according to eye control job command.Communication processing unit is controlled the unit with system and is connected, and according to eye control job command or system executive, car is sent various information datas outward.The state feedback unit according to system executive, sends the information that runs succeeded or fail, and reminds the various operation executing states of driver's apparatus of the present invention.
About the present invention's purpose, technology contents and characteristics, below lift a preferred embodiment and cooperate graphic the explanation.
Description of drawings
Fig. 1 is device architecture schematic diagram of the present invention.
Fig. 2 is device assembling schematic diagram of the present invention.
Fig. 3 is method flow schematic diagram of the present invention.
Fig. 4 is connecting method schematic flow sheet of the present invention.
Fig. 5 is that eye image of the present invention is obtained schematic diagram.
Fig. 6 is first eyes action schematic diagram of the present invention.
Fig. 7 is second eyes action schematic diagram of the present invention.
Drawing reference numeral
10 processing units
11 image processing arithmetic elements
12 eye identifying units
13 systems control the unit
14 communication processing units
20 taking units
30 state feedback unit
50 head phantom
51 eye Search Areas
52 eye images
60 device bodies
S101 obtains driver's head phantom
The head phantom of S102 is carried out image processing
S103 sets up the eye Search Area within head phantom
S104 obtains the eye image in the eye Search Area
S105 is, and the eye image carries out calculation process, obtains eye characteristic parameter
S106 is according to eye characteristic parameter, compares with system controlled condition, and produces an eye control job command
S107 carries out communication and connects operation, produces the communication feedback information
S108 confirms communication state
S109 sends the Communications failure information
S110 is controlled job command according to eye, carries out system executive
S111 confirms the state that carries out of system executive
S112 sends the information that runs succeeded
S113 sends and carries out the failure information
Embodiment
Please refer to Fig. 1 and be the system architecture schematic diagram of eye control device in the present invention's the car.The present invention's device is mainly by processing unit 10, taking unit 20, formed with state feedback unit 30.Taking unit 20 is in order to capture user's head phantom, and as shown in Figure 2, device body 60 preferablies can be assemblied in the instrument board top, use and obtain driver's head phantom clearly.Processing unit 10 is controlled unit 13 by image processing arithmetic element 11, eye identifying unit 12, system, and communication processing unit 14 etc. assembly constitutes.Continuous please the cooperation with reference to figure 3 to Fig. 5, image processing arithmetic element 11 can be carried out image processing with head phantom 50, and within the image capturing range of head phantom 50, sets up eye Search Area 51.Then, within eye Search Area 51, definition cuts out eye image 52.Then eye image 52 is carried out calculation process, and obtain eye characteristic parameter.As Fig. 4 and shown in Figure 5, driver nictation, or see towards the right side towards a left side, or dextrorotation turns around, or inhour revolves the specific eye motion that turns around etc., all can correspond to different eye characteristic parameters.After eye characteristic parameter is identified, will compare with system's controlled condition, and produce eye control job command.System controls unit 13 will control job command according to eye, and carry out various system executives.For in-vehicle device, as playing music, adjust volume, controlling air-conditioning system temperature etc.Outer for car, as call, cut off incoming call, send distress signals etc.Communication processing unit 14 is responsible for the outer information communication operation of car according to the order that system controls unit 13.State feedback unit 30 can send multiple information, runs succeeded or fails as system job, or dial or the prompting of the system mode of incoming information.
About the method for eye control in the present invention's the car, continuous please the cooperation with reference to figure 6 and Fig. 7, the present invention's method operation workflow partly be described.
At first, obtain driver's head phantom (S101), head phantom is carried out image processing (S102).Then within head phantom, set up eye Search Area (S103), be within the eye Search Area, obtain eye image (S104).Then, when the eye image be defined cut out after, the eye image is carried out calculation process, obtain eye characteristic parameter (S105).In fact eye characteristic parameter is corresponding to the action of driver's eyes, as nictation, towards a left side towards the right side, or up down, or clockwise counter-clockwise pitch of the laps etc.After the subsequent steps S105, device can be according to eye characteristic parameter, compares with system controlled condition, and produces an eye control job command (S106).Wherein, system's controlled condition has comprised most eye movement control options, driver's eyes action as previously mentioned, the eye movement control option that correspondence is different: issue orders, get on, get off after in earlier left back right order, the order of an earlier right back left side, the elder generation order or pitch of the laps order etc.And control option according to the eye movement of system's controlled condition, eye control job command can have corresponding variation according to different functions, as opening the light order, close the light order, open music commands, close music commands, increase audio volume command, reduce audio volume command, open the air-conditioning order, closing air-conditioning order etc.More than be the various controls of in-vehicle device, in addition also have and car is outer links up and other part that an eye control job command also includes: call order, send the note order, cut off incoming call communication command etc.
After the subsequent steps S106, can carry out communication and connect operation and produce communication feedback information (S107), confirm communication state according to the communication feedback information.If can't with external communication, will send Communications failure information (S109), remind and to inform the driver.Otherwise, set up successful words with external communication, then carry out system executive (S110) according to eye control job command, supplementary notes, step S110 optionally carries out according to the different conditions of eye control job command, if the driver wants to control in-vehicle device, as volume, necessity of not checking communication state so, and step S110 just can omit.Then, according to aforesaid various eye control job commands, carry out various system executives, and the actual various device of controlling.As control wireless volume, switch air-conditioning equipment, call etc.At last, carry out state (S111) with what confirm system executive, if program is executed correctly, just sends the information (S112) that runs succeeded and inform the driver, otherwise, failure prompting (S113) information of carrying out just sent.
Though the present invention discloses preferred embodiment as above; so it is not in order to limit the present invention; have in the field of the present invention and know the knowledgeable usually; without departing from the spirit and scope of the invention; when can doing a little change and retouching, the present invention's protection range when with accompanying claim the person of being defined be as the criterion.
Claims (10)
1. the method for the interior eye control of car sees through a device that is installed in the vehicle and allows the driver control, and it is characterized in that, includes the following step:
Obtain one of driver eye image;
Described eye image is carried out calculation process, obtain an eye characteristic parameter;
According to described eye characteristic parameter, compare with system's controlled condition, control job command and produce a glance; And
According to described eye control job command, carry out a system executive.
2. the method for eye control in the car according to claim 1 is characterized in that, described eye characteristic parameter is corresponding to driver's eyes action.
3. the method for eye control in the car according to claim 1 is characterized in that, more includes the following step:
Obtain one of driver head phantom;
Described head phantom is carried out image processing;
Within described head phantom, set up an eye Search Area; And
In described eye Search Area, obtain described eye image.
4. the method for eye control in the car according to claim 1 is characterized in that, described system controlled condition is made up of a plurality of eye movement control options.
5. the method for eye control in the described car according to claim 4, it is characterized in that, described eye movement control option, be selected from an earlier left back right order, an earlier right back left side order, go up afterwards earlier and issue orders, one get on, get off combination that order, a pitch of the laps order constituted one of them.
6. the method for eye control in the car according to claim 1 is characterized in that, described eye control job command, be selected from one call order, send message command, with one cut off the incoming call combination that communication command constituted one of them.
7. the method for eye control in the car according to claim 1, it is characterized in that, described eye control job command, be selected from one open light order, close light order, open music commands, close music commands, increase audio volume command, reduce audio volume command, open the air-conditioning order, with one close combination that the air-conditioning order constituted one of them.
8. the method for eye control in the car according to claim 1 is characterized in that, more includes the following step:
Confirm the state that carries out of system executive; And
Send the information that runs succeeded.
9. the method for eye control in the car according to claim 1 is characterized in that, more includes the following step:
Confirm the state that carries out of system executive; And
Send one and carry out the failure information.
10. the method for eye control in the car according to claim 1 is characterized in that, more comprises:
Carry out a communication and connect operation, and produce a communication feedback information; And
According to described communication feedback information, confirm communication state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100352868A CN103259971A (en) | 2012-02-16 | 2012-02-16 | Eye control device in vehicle and method for eye control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100352868A CN103259971A (en) | 2012-02-16 | 2012-02-16 | Eye control device in vehicle and method for eye control |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103259971A true CN103259971A (en) | 2013-08-21 |
Family
ID=48963645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012100352868A Pending CN103259971A (en) | 2012-02-16 | 2012-02-16 | Eye control device in vehicle and method for eye control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103259971A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105182778A (en) * | 2015-09-21 | 2015-12-23 | 王好雨 | Eye-controlled furniture system |
| CN108491068A (en) * | 2018-02-08 | 2018-09-04 | 东南大学 | A kind of exchange method of eye movement signal control |
| CN112114671A (en) * | 2020-09-22 | 2020-12-22 | 上海汽车集团股份有限公司 | Human-vehicle interaction method and device based on human eye sight and storage medium |
| CN113282161A (en) * | 2020-02-19 | 2021-08-20 | 北京七鑫易维信息技术有限公司 | Computer interface control method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5008946A (en) * | 1987-09-09 | 1991-04-16 | Aisin Seiki K.K. | System for recognizing image |
| CN101551934A (en) * | 2009-05-15 | 2009-10-07 | 东北大学 | Device and method for monitoring fatigue driving of driver |
| CN101599207A (en) * | 2009-05-06 | 2009-12-09 | 深圳市汉华安道科技有限责任公司 | A kind of fatigue driving detection device and automobile |
| CN202121681U (en) * | 2011-05-31 | 2012-01-18 | 德尔福电子(苏州)有限公司 | Vehicle-mounted eye movement control device |
-
2012
- 2012-02-16 CN CN2012100352868A patent/CN103259971A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5008946A (en) * | 1987-09-09 | 1991-04-16 | Aisin Seiki K.K. | System for recognizing image |
| CN101599207A (en) * | 2009-05-06 | 2009-12-09 | 深圳市汉华安道科技有限责任公司 | A kind of fatigue driving detection device and automobile |
| CN101551934A (en) * | 2009-05-15 | 2009-10-07 | 东北大学 | Device and method for monitoring fatigue driving of driver |
| CN202121681U (en) * | 2011-05-31 | 2012-01-18 | 德尔福电子(苏州)有限公司 | Vehicle-mounted eye movement control device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105182778A (en) * | 2015-09-21 | 2015-12-23 | 王好雨 | Eye-controlled furniture system |
| CN108491068A (en) * | 2018-02-08 | 2018-09-04 | 东南大学 | A kind of exchange method of eye movement signal control |
| CN108491068B (en) * | 2018-02-08 | 2020-11-17 | 东南大学 | Interaction method for eye movement signal control |
| CN113282161A (en) * | 2020-02-19 | 2021-08-20 | 北京七鑫易维信息技术有限公司 | Computer interface control method, device, equipment and storage medium |
| CN112114671A (en) * | 2020-09-22 | 2020-12-22 | 上海汽车集团股份有限公司 | Human-vehicle interaction method and device based on human eye sight and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11526165B1 (en) | Systems and methods for remotely controlling operation of a vehicle | |
| TWI582707B (en) | In-vehicle eye control method | |
| JP6520737B2 (en) | Biological information measuring device, vehicle-mounted device, and biological information measuring system | |
| US9771085B2 (en) | Robotic vehicle control | |
| JP6331975B2 (en) | Vehicle control device when stopped | |
| US8862317B2 (en) | Emotion-based vehicle service system, emotion cognition processing apparatus, safe driving apparatus, and emotion-based safe driving service method | |
| CN205405811U (en) | Vehicle status monitored control system | |
| WO2013008300A1 (en) | Vehicle emergency escape device | |
| WO2017089531A1 (en) | Vehicle with interactions with wearable device to provide health or physical monitoring | |
| WO2017089530A1 (en) | Autonomous vehicle with interactions with wearable devices | |
| CN105799697A (en) | Vehicle-mounted health monitoring system and method based on internet of vehicles | |
| US20180244288A1 (en) | Methods and systems for providing automated assists of driving task demands for reducing driver drowsiness | |
| WO2017138935A1 (en) | Systems and methods for vehicle assistance | |
| TW201713526A (en) | Fatigue driving control system and method | |
| CN103978977A (en) | System and method for monitoring automobile based on body communication | |
| CN105678961A (en) | Anti-fatigue driving automobile safety warning system and warning method | |
| KR20180059052A (en) | System monitoring rear seats in a car | |
| CN103259971A (en) | Eye control device in vehicle and method for eye control | |
| JP2018131202A (en) | Halt-time vehicle control unit | |
| CN103253275A (en) | Driving attention detection device and method for interactive voice question | |
| CN106740573A (en) | Vehicle early warning method and Intelligent worn device based on Intelligent worn device | |
| CN107953886B (en) | The safety traffic method of vehicle and vehicle | |
| JP2015115045A (en) | Doze preventing device for on-vehicle use, and doze preventing system for on-vehicle use | |
| CN111252087A (en) | Driver platform control system | |
| CN209921399U (en) | Vehicle steering wheel with driving auxiliary device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130821 |