CN105034804A - Vehicle active safety control method and vehicle active safety control system - Google Patents

Vehicle active safety control method and vehicle active safety control system Download PDF

Info

Publication number
CN105034804A
CN105034804A CN201510237642.8A CN201510237642A CN105034804A CN 105034804 A CN105034804 A CN 105034804A CN 201510237642 A CN201510237642 A CN 201510237642A CN 105034804 A CN105034804 A CN 105034804A
Authority
CN
China
Prior art keywords
vehicle
mobile phone
smart mobile
ecu
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510237642.8A
Other languages
Chinese (zh)
Inventor
殷德军
肖冰
刘梁
李伦波
张冰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Science and Technology
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN201510237642.8A priority Critical patent/CN105034804A/en
Publication of CN105034804A publication Critical patent/CN105034804A/en
Pending legal-status Critical Current

Links

Landscapes

  • Telephone Function (AREA)

Abstract

The invention provides a vehicle active safety control method. A smart phone is placed in the vehicle and performs the functions of detecting a face image of a driver of the vehicle, identifying the image, and checking a risk that the driver is in a fatigue driving state. Based on the risk, a first signal is transmitted to a vehicle electronic control unit (ECU), and the vehicular ECU performs corresponding processing based on the first signal for restricting the driving speed of the vehicle. By means of the vehicle active safety control method, a fatigue driving risk of the driver of the vehicle can be detected through the smart phone; the signal is transmitted to the vehicular ECU for performing active control by the vehicular ECU when a possible danger occurs, thereby preventing traffic safety accidents or reducing harms of traffic safety accidents.

Description

Vehicle active safety control method and system
Technical field
Various aspects of the present invention relate to technical field of vehicle control, especially vehicle active safety control method and system.
Background technology
All the time, the research of people on vehicle active safety control is never halted.In prior art, vehicle active safety control technology includes ABS, EBD, ESP, ACC, BSD, EBA, LDWS, VSC, HMWS, FCWS, HUD, HDC, tire pressure monitoring, chip theftproof, reverse image, automatic induction headlight, automatic induction rain brush etc., these prior arts none do not realize based on in-vehicle electronic system, electronics and/or hydraulic control system design complexity on the one hand, on the other hand the design of these control system and signal line is all with vehicle main control system or assist the data bus conllinear controlled, take the more communication resource, simultaneously once line fault or damage, maintenance work is very loaded down with trivial details and complicated, and it is expensive.
Such as, No. 2012102162069 Chinese patent application proposes a kind of fatigue driving remote monitoring of analyzing based on physiologic information and warning and method, brain wave acquisition device input end is connected the cerebral cortex of chaufeur, brain wave acquisition device mouth transmission EEG signals are to upper computer, upper computer exports tired signal to lower computer, and lower computer output alarm signal is to mobile module.Utilize mobile module can make the state of driving of chaufeur monitor staff real-time query chaufeur, remind preventing driver tired driving in time; When chaufeur is in fatigue driving state, the present invention can by analyzing EEG signals and alarm, if chaufeur still adheres to driving, lower computer sends alarm message to monitor staff's mobile phone by controlling mobile module, thus improves the detection pre-alerting ability of driver tired driving.
Along with Handheld intelligent equipment, especially the development of smart phone (also claiming smart mobile phone, handheld-type intelligent terminal, mobile terminal, cellular based communication equipment/terminal etc.), having begun one's study in prior art, it is applied in automobile active safety control.Such as, No. 2014104953266 Chinese patent application discloses a kind of fatigue driving based on Android platform and monitors in real time and method for early warning, system is to carry the smart mobile phone of Android service platform for carrier, first after smart mobile phone being fixed on bearing circle central authorities, the GPS location utilizing smart mobile phone to carry and gyro sensor, acceleration/accel in 1s calculating also store car driving procedure and steering wheel angle data, then utilize wavelet transformation from db5 wavelet scale 1 normalized energy storing extracting data acceleration/accel every 10s, turning angle of steering wheel velocity standard is poor, wheel steering db5 wavelet scale 4 normalized energy is as degree of fatigue Judging index, next index is brought into counter model determination degree of fatigue, degree of fatigue is divided into by forewarn system: clear-headed, slight fatigue, moderate is tired, the tired level Four of the degree of depth.Last according to counter model result of determination, different Forewarning Measures is taked to different degree of fatigues.It is low that system realizes cost, and reliability is high, easily realizes marketing, and system realizes not relating to vehicle refitting, realizes the real-time monitoring of driving condition.
And for example, No. 2012105171905 Chinese patent discloses a kind of cell phone platform vehicle drive giving fatigue pre-warning method, can popularize vehicle drive giving fatigue pre-warning fast, greatly improve the safety factor of steering vehicle.This software realizes mainly through calling existing hardware device on present smart mobile phone: 1. combining image recognition technology and audio analysis techniques, monitors vehicle steering; 2., in conjunction with audio analysis techniques and acceleration monitor, analyze vehicle driving condition and complete collision accident identification; 3. all can send fatigue driving early warning by software simulating bearing circle long time no operations or long-duration driving, remind chaufeur to have a rest.Collision rift obtains location information and sends note emergency, automatic call emergency.Carry out incoming call at driving condition to monitor, automatic rejection can be set to or automatically answer with outdoor pattern.While the Stability and veracity ensureing giving fatigue pre-warning function, carry out the maximum functionality integrated accident that comprises and emergency function occurs, quickening accident rescues speed after occurring.
Although utilize smart mobile phone to carry out active safety control in these prior aries, such as vehicle safety defence is reported to the police, automobile failure diagnosis, lane detection, detecting test of vehicle, pedestrian detection, interpretation of result calculate and remind chaufeur, fatigue detecting the speed of rescuing after reminding chaufeur or quickening accident, its be prompting in advance and rescue afterwards for what solve, but in fact when the unforeseen circumstancess such as such as fatigue driving, the emergent obstacle in front occur, effectively can not prevent the generation of traffic accidents.
Summary of the invention
A first aspect of the present invention provides a kind of vehicle active safety control method based on smart mobile phone, and this smart mobile phone is placed in vehicle, and the method comprises:
The first camera of smart mobile phone is made to obtain the face-image of chaufeur in car;
According to the face-image of aforementioned acquisition, smart mobile phone checks that chaufeur is in the risk of fatigue driving state;
In response to there is aforementioned risk, then smart mobile phone sends the ECU of the first signal to vehicle; And
After the ECU of vehicle receives described first signal, control the gait of march restriction of vehicle.
In further example, in preceding method:
Control after the ECU of vehicle receives described first signal vehicle is slowed down.
In further example, in preceding method:
Control after the ECU of vehicle receives described first signal vehicle is downshifted.
In further example, in preceding method:
Maximum speed that vehicle advances and/or most high tap position is controlled after the ECU of vehicle receives described first signal.
In further example, preceding method comprises following steps more:
The second camera of smart mobile phone is made to obtain the image of the obstacle of outside vehicle;
Smart mobile phone carries out obstacle range finding according to aforementioned acquisition image;
Distance based on obstacle and vehicle is less than the first threshold of setting, makes smart mobile phone send secondary signal to the ECU of vehicle;
The ECU of vehicle controls the applying increasing car brakeing after receiving described secondary signal.
According to the disclosure, also propose a kind of vehicle active safety control system, comprise vehicle and be placed in the smart mobile phone in vehicle, wherein:
Described smart mobile phone comprises: the first camera; For the module making the first camera of smart mobile phone obtain the face-image of chaufeur in car; For checking that chaufeur is in the module of the risk of fatigue driving state according to the face-image of aforementioned acquisition; For in response to there is aforementioned risk, smart mobile phone sends the module of the first signal to the ECU of vehicle;
The gait of march restriction of vehicle is controlled after the ECU of described vehicle receives described first signal.
In further example, in described vehicle active safety control system, smart mobile phone also comprises: second camera; For the module making second camera obtain the image of the obstacle of outside vehicle; For carrying out the module of obstacle range finding according to aforementioned acquisition image; For being less than the first threshold of setting based on the distance of obstacle and vehicle, smart mobile phone is made to send the module of secondary signal to the ECU of vehicle;
The ECU of described vehicle controls the applying increasing car brakeing after receiving described secondary signal.
In further example, control after the ECU of described vehicle receives described first signal vehicle is downshifted.
In further example, after the ECU of described vehicle receives described secondary signal, control maximum speed that vehicle advances and/or most high tap position.
As long as should be appreciated that aforementioned concepts and all combinations of extra design described in further detail below can be regarded as a part for subject matter of the present disclosure when such design is not conflicting.In addition, all combinations of theme required for protection are all regarded as a part for subject matter of the present disclosure.
The foregoing and other aspect of the present invention's instruction, embodiment and feature can be understood by reference to the accompanying drawings from the following description more all sidedly.Feature and/or the beneficial effect of other additional aspect of the present invention such as illustrative embodiments will be obvious in the following description, or by learning in the practice of the detailed description of the invention according to the present invention's instruction.
Accompanying drawing explanation
Accompanying drawing is not intended to draw in proportion.In the accompanying drawings, each identical or approximately uniform component part illustrated in each figure can represent with identical label.For clarity, in each figure, not each component part is all labeled.Now, the embodiment of various aspects of the present invention also will be described with reference to accompanying drawing by example, wherein:
Fig. 1 is the schematic diagram of the vehicle active safety control system based on smart mobile phone illustrated according to certain embodiments of the invention.
Fig. 2 is the schematic diagram of the smart mobile phone illustrated according to certain embodiments of the invention.
Fig. 3 illustrates the binocular stereo imaging principle schematic according to certain embodiments of the invention.
Fig. 4 is the schematic flow sheet of the vehicle active safety control method based on smart mobile phone illustrated according to certain embodiments of the invention.
Detailed description of the invention
In order to more understand technology contents of the present invention, institute's accompanying drawings is coordinated to be described as follows especially exemplified by specific embodiment.
Each side with reference to the accompanying drawings to describe the present invention in the disclosure, shown in the drawings of the embodiment of many explanations.Embodiment of the present disclosure must not be intended to comprise all aspects of the present invention.Be to be understood that, multiple design presented hereinbefore and embodiment, and describe in more detail below those design and embodiment can in many ways in any one is implemented, this is because design disclosed in this invention and embodiment are not limited to any embodiment.In addition, aspects more disclosed by the invention can be used alone, or otherwisely anyly appropriately combinedly to use with disclosed by the invention.
Fig. 1 is the schematic diagram of the vehicle active safety control system based on smart mobile phone illustrated according to certain embodiments of the invention.Vehicle active safety control system comprises vehicle and is positioned at the smart mobile phone 100 of vehicle, smart mobile phone 100 is via wire transmission or the mode of transmission over radio and the ECU (electronic control unit of vehicle, also car running computer is claimed) 200 to communicate, realize the transmission of data and/or signal.Such as, by the wireless network of blueteeth network, WLAN and so on, or the wire transmission mode of USB data line, special purpose interface data line and so on, realize the communication between smart mobile phone 100 and the ECU200 of vehicle.
In this example, by what more described in detail below, the face-image of the chaufeur of smart mobile phone 100 detecting vehicle, and this image is identified, check that chaufeur is in the risk of fatigue driving state.Based on there is such risk, send the ECU200 of the first signal to vehicle, vehicle ECU200 performs corresponding process based on this first signal, controls the gait of march restriction of vehicle.The restriction of these speed based on the first signal will make a more detailed description below.
In further describing, the obstructions chart picture of smart mobile phone 100 also further detecting vehicle outside, and the distance obtained accordingly between obstacle and vehicle, and based on the comparative result of this distance with a first threshold set, send the ECU200 of secondary signal to vehicle, vehicle ECU200 performs corresponding process based on this secondary signal, controls the applying increasing car brakeing.
Fig. 2 is the schematic diagram of the smart mobile phone 100 illustrated according to certain embodiments of the invention.Smart mobile phone 100 comprises one or more processing unit (CPU) 101, Memory Controller 102, Peripheral Interface 103, radio communication device 104, outside port 105, post-positioned pick-up head 1061, front-facing camera 1062, voice frequency circuit 107, one or more microphone 1071, one or more loud speaker 1072, memory device 120, I/O subsystem 130, touch screen 132, other export or control convenience 134, one or more motion sensor 140 and one or more registration device 150.These assemblies are communicated by one or more data bus/signal wire (SW) 160.Smart mobile phone 100 represented by Fig. 1 is only an example, and the assembly of this smart mobile phone 100 can also have more or less assembly than diagram, or has different arrangement of components.Various assemblies shown in Fig. 1 can utilize the combination of hardware, software or software and hardware to realize, and comprise one or more signal transacting and/or integrated circuit.
Aforementioned one or more treater (CPU) 101 performs core component as the control of smart mobile phone 100, run and be variously stored in program in memory device 120 and/or instruction set, to realize the various functions of smart mobile phone 100 and to carry out relevant treatment to data.
Memory device 120, comprises high speed random-access memory and carries out data buffer storage, also comprise nonvolatile memory, such as one or more flash memory device (FLASH), or other non-volatile solid-state memory devices.In certain embodiments, memory device 120 can also comprise the memory device away from aforementioned one or more treater 101, such as via the network attached storage that radio communication device 104 or outside port 105 and communication network conduct interviews, communication network wherein can be internet, one or more internal network, local area network (LAN), storage area network (SAN), wide area network (WLAN) etc., or other suitable array configurations.
Memory Controller 102, controls the assembly of such as one or more treaters 101, Peripheral Interface 103 and so on of smart mobile phone 100 to the access of memory device 120.
Peripheral Interface 103, for being couple to treater 101 and memory device 120 by the input and output peripheral hardware of smart mobile phone 100.
Treater 101, Memory Controller 102 and Peripheral Interface 103 can realize on a single chip, the chip 110 such as, represented in Fig. 1.In other example, they also can realize on multiple discrete chip.
Radio communication device 104, communicates with communication network and other equipment for realizing smart mobile phone 100.Such as realized the exchange of data message by electromagnetic wave, radio communication device 104 performs electromagnetic reception and transmission, electromagnetic wave is become electric signal or converting electrical signal is become electromagnetic wave.Radio communication device 104 can comprise known circuit for performing these functions and/or module, such as antenna system, RF transceiver, subscriber identification card (SIM), CODEC chipset, digital signal processor etc., or their combination.These radio communication devices 104 are communicated with communication network and/or other equipment by radio communication, the wireless network, WLAN (LAN), Metropolitan Area Network (MAN) (MAN) etc. of these communication networks such as internet, in-house network, such as cellular phone network and so on.These radio communications can based at least one in various communications protocols, standard, include but not limited to global system for mobile communications (GSM), enhanced data gsm environment (EDGE), Wideband Code Division Multiple Access (WCDMA) (W-CDMA), code division multiple access (CDMA), bluetooth (Bluetooth), the Wi-Fi based on ieee standard, the voice transfer based on Internet Protocol (VoIP), instant message protocol (IM), short message service agreement (SMS), or the communication protocol of other any appropriate.
External interface 105, such as USB (USB), fire-wire interfaces 1394 (FireWire), HDMI (HDMI), USB interface etc., be suitable for directly or be indirectly couple to other equipment by network (as internet, wireless local area etc.).
Post-positioned pick-up head 1061 and front-facing camera 1062 provide video and/or the image input function of smart mobile phone 100.Post-positioned pick-up head 1061 and front-facing camera 1062 have optical lens and imageing sensor, and imageing sensor is for catching the image of the target subject formed by optical lens to obtain view data.Post-positioned pick-up head 1061 and front-facing camera 1062 controllably start and obtain view data and/or the video data in the direction that is taken.These view data and/or video data are transferred to Peripheral Interface 103 and/or memory device 120, so that subsequent treatment by by data bus or signal wire (SW) 160.
In this example, the post-positioned pick-up head 1061 of smart mobile phone is preferably binocular camera, even many orders camera.Front-facing camera 1062 is binocular or monocular cam.
Voice frequency circuit 107, microphone 1071 and loud speaker 1072 provide the COBBAIF between user and smart mobile phone 100.Voice frequency circuit 107 receives the voice data from Peripheral Interface 103 and converts electric signal to, and by these electric signal transmissions to loud speaker 1072, converting electrical signal is grown up the sound wave that ear can be heard by loud speaker 1072.Voice frequency circuit also receives the electric signal converted from sound wave by microphone, and by converting electrical signal audio data, then by audio data transmission to Peripheral Interface 103 and/or memory device 120 to carry out subsequent treatment.Voice data can be retrieved from memory device 120 and/or radio communication device 104 by Peripheral Interface 103, and/or is transferred to memory device 120 and/or radio communication device 104.In certain embodiments, voice frequency circuit 107 also comprises wear-type and send/headphone jack, is suitable for the insertion accepting I/O peripheral hardware.
I/O subsystem 130 provides the interface between the I/O peripheral hardware of smart mobile phone 100 and Peripheral Interface 103.I/O peripheral hardware comprises touch screen 132, other input/control devicess, or other similar equipment.The I/O subsystem 130 of this example comprises a touch screen controller 131 and other input control devices 133 one or more.These other input control devices 133 one or more receive/send from/go to the electric signal of other input/control devicess.Described input/control devices 134 comprises physical button (such as push type button, rocker button etc.), dial, slipping switch, joystick, rotary multiple choice apparatus etc.
Touch screen 132 provides the interface of the constrained input between smart mobile phone 100 and user simultaneously.Touch screen controller 131 receive/send from/go to the electric signal of touch screen.This touch screen 132 provides visual output to user, comprises text, figure, video and combination in any thereof.
Touch screen 132 is suitable for the input accepting user based on sense of touch and/or stereognosis.Touch screen 132 has the touch sensitive surface that receives user's input.Touch screen 132 and touch screen controller 131 (together with any module that is associated stored in memory device 120 and/or instruction set) detect contact on touch screen (and contact continuously and/or interrupts), and become the contact transformation detected and be presented at user interface mutual of such as one or more soft-key buttons on touch screen and so on.
In certain embodiments, the contact between touch screen 132 and user is based on one or more finger.In other examples, the contact between touch screen 132 and user based on external device, such as capacitance pen etc.
Touch screen 132 based on the touch-control device of LCD, LED technology, can adopt a kind of continuous and interruption detecting contact and contact in multiple Touch technologies, such as electric capacity, resistance, infrared and surface acoustic wave techniques, proximity sensor arrays etc.
One or more motion sensor 140, for obtain smart mobile phone 100 and/or smart mobile phone 100 attached/attached/the state of kinematic motion data of equipment, instrument, device etc. that are arranged on and/or spatial data, these data obtained transfer to Peripheral Interface 103, to process by data bus or signal wire (SW) 160.
Motion sensor 140 comprises the sensing device of such as electronic gyroscope, electronic compass, acceleration pick-up, obliquity sensor and so on, for obtain smart mobile phone 100 and/or smart mobile phone 100 attached/attached/equipment that is arranged on, instrument, device multi-motion status data, in some instances, motion sensor 140 in smart mobile phone 100 is combined by above at least two kinds of motion sensors that are cited or that do not list and forms, thus play the function of motion sensor, utilize the effect of information fusion to reach and utilize substantially.
One or more registration device 150, for obtain smart mobile phone 100 and/or smart mobile phone 100 attached/attached/equipment that is arranged on, device, instrument geographic position data.These data obtained transfer to Peripheral Interface 103, to process by data bus or signal wire (SW) 160.
Registration device 150, comprises such as global positioning system (GPS) satellite positioning receiver module, GLONASS (Glonass) satellite positioning receiver module, Galileo (Galileo) satellite positioning receiver module, big-dipper satellite position receiver module etc.In some instances, registration device 150 is made up of above at least two kinds of receiver modules.Registration device 150, is suitable for the positioning signal receiving (sampling) satellite, thus obtains the position data (position vector) of different epoch.Utilize these position datas can carry out the measuring and calculating of speed.
Smart mobile phone 100 also comprises power-supply system 180, for being each assembly power supply.Power-supply system 180 comprises power-supply management system, one or more power supply (battery or AC), charge system, power failure detection circuit, power-switching circuit/inverter, power supply status indicating circuit etc.
In certain embodiments, as Fig. 2, the component software of cellular based communication equipment 100 comprises operating system, communication module (or instruction set), contact and/or motion module (or instruction set), range finder module (or instruction set), distance checking module (instruction set) and one or more application (or instruction set).
Operating system, such as Linux, OS, WINDOWS, android system, or the embedded system of such as Vxworks and so on, has the various component software and/or actuator that communicate between all kinds of software and hardware assembly for control and management general system tasks (such as memory management, storage equipment control, power management etc.) and contributing to.
Communication module, contributes to through one or more outside port 105 and carries out communication with other equipment.And this communication module also comprises the various softwares of the data received for the treatment of outside port 105 and/or radio communication device 104.
Contact and/or motion module, come together to detect the contact with touch screen 132 with described touch screen controller 130.This module comprises the software for performing the various operations be associated with the contact detection of touch screen 132, and whether aforesaid operational example comes in contact as determined whether, contact continuously and follow the trail of movement on touch screen, whether determine contact continuously or interrupt.
Fatigue detecting module, contains instruction set or the component software for carrying out fatigue detecting according to fatigue detecting algorithm.These, based on the fatigue detecting algorithm of face-image, can utilize algorithm commonly known in the art to realize.One of them example will be described below.
Based on the fatigue detecting of face-image, the state of closing of opening according to human eye obtains the risk that chaufeur is in fatigue driving simultaneously in conjunction with frequency of wink calculates degree of fatigue.Particularly, such as, first collect the chaufeur face-image in driving compartment according to the front-facing camera 1062 of smart mobile phone 100, adopt such as AdaBoost method to carry out Face detection; Then theoretical according to people's face skin color model, by discoloring, binaryzation scheduling algorithm determination position of human eye; Finally close combinations of states frequency of wink calculate degree of fatigue according to opening of human eye.Based on this degree of fatigue, the risk that chaufeur is in fatigue driving can be obtained.Open in pertinent literatures such as " the driver tired driving method of inspection based on Eye Recognition are studied " that the people such as " driver fatigue based on facial characteristics detects ", supreme people's court's lamp that such algorithm, technology such as propose people such as Yuan Jian, Yao Ming seas proposes, do not repeat them here.
In other examples, the aforementioned fatigue detecting based on face-image, method involved in " the driver fatigue detect delay based on human eye detection " such as proposed to people such as undergraduate courses can also be adopted, the method comprises: first detect based on the human eye of image recognition to chaufeur, the human eye area successfully detected carry out the identification of eyes folding condition and calculates PERCLOS value, finally carrying out the analysis judgement of fatigue driving risk based on the PERCLOS value calculated.
Range finder module, comprises the component software being such as suitable for carrying out binocular range finding.Compare the range finding of monocular cam, utilize binocular camera can realize the accurate measure of distance.Such as, by the view data gathered from the rearmounted binocular camera 1061 of smart mobile phone, found range by binocular location algorithm, obtain the distance between the obstacle of the vehicle front captured by post-positioned pick-up head 1061 and vehicle.This class binocular location algorithm, can utilize algorithm commonly known in the art to realize.One of them example will be described below.
Fig. 3 illustrates the binocular stereo imaging principle schematic according to certain embodiments of the invention.As shown in the figure, O l, O rrepresent the photocentre of left and right pick up camera (binocular camera) respectively.The distance of the projected centre lines of two pick up cameras, namely baseline distance is expressed as B.F crepresent the effective focal length of pick up camera, the focal length of two pick up cameras is identical.The picture plane of two pick up cameras is in the same plane, and optical axis is parallel.Two pick up cameras are at the same unique point P of synchronization viewing space object, and on " left eye " and " right eye ", obtain the image of a P respectively, their image coordinate is respectively p l=(X l, Y l), p r=(X r, Y r).Assuming that the image of two pick up cameras is in same plane, then unique point P (x c, y c, z c) image coordinate Y identical, i.e. Y r=Y l=Y, then obtained by triangle geometric relationship:
X l = f c x c z c X r = f c x c - B z c Y = f c y c z c - - - ( 1 )
If parallax is D=X l-X r.Can calculate the three-dimensional coordinate of unique point P under camera coordinate system is thus:
x c = BX l / D y c = BY l / D z c = Bf c / D - - - ( 2 )
Easily can obtain the distance of unique point to coordinate origin simultaneously:
s = x c 2 + y c 2 + z c 2 - - - ( 3 )
Therefore, as long as any point in left pick up camera image planes can find corresponding matching point (the two is the point of space same point in left and right pick up camera image planes) in right pick up camera image planes, the three-dimensional coordinate of this point can just be determined.
In order to utilize binocular camera to find range, first can demarcate binocular camera, and adopt such as Bouguet three-dimensional correction algorithm to carry out three-dimensional correction to binocular camera; Then such as angle point method is adopted to carry out sub-pixel angle point grid to the same unique point on measured target in the left and right cameras image after three-dimensional correction; Finally realize range observation according to the matching angle point coordinate extracted in conjunction with binocular distance measurement formula.
Obviously, component software described above is only an example, the component software of range finder module in smart mobile phone 100 of the present disclosure, can also be that other modes that to utilize in known technology other, that do not list in the disclosure realize, comprise current program/component software that is that not yet develop or that write.
Distance checking module, comprises the component software of the comparative result of the first threshold for the distance and setting checking obstacle and vehicle.Pre-determined first threshold can be arranged in advance by the people of the producing and selling of user, driver, smart mobile phone or operator etc. and so on.This first threshold also corresponds to different drivers and driving model in varied situations, such as under new driver or scorch pattern (more than 60KM/H), aforesaid first threshold has a higher numerical value usually, such as 100m or larger value, and under experienced driver or pattern of driving at low speed (lower than 20KM/H), aforesaid first threshold has a lower numerical value usually, such as 50m or less value.Certainly, these casehistorys do not make restriction to the present invention, are only exemplary explanations.
Described one or more application comprises the voice call application of such as cellular network, short message application, instant messaging application, map application, Online Music plays application, Online Video plays application, online reading application etc.Cellular based communication equipment 100 newly arrives incoming call receiving, or newly arrived short message, or newly arrived IM message, or the message that new map application pushes, or Online Music plays the online broadcasting recommendation that application/Online Video plays application/online reading application promotion, and/or the renewal prompting of these application, etc., new arrival message like this, reminder message will be produced on cellular based communication equipment 100, such as with word (screen is lighted and shown), play sound (prompt tone), physical vibration, at least one mode in indicator lamp feedback is fed back, be beneficial to and user is recognized in time.
Fig. 4 is the schematic flow sheet of the vehicle active safety control method 300 based on smart mobile phone illustrated according to certain embodiments of the invention.
Shown in composition graphs 1, based on the vehicle active safety control method of smart mobile phone, on the whole, by the face-image of the chaufeur of smart mobile phone 100 detecting vehicle, and this image is identified, check that chaufeur is in the risk of fatigue driving state.Based on there is such risk, send the ECU200 of the first signal to vehicle, vehicle ECU200 performs corresponding process based on this first signal, controls the gait of march restriction of vehicle.The restriction of these speed based on the first signal will make a more detailed description below.
In further scheme, the obstructions chart picture of smart mobile phone 100 also further detecting vehicle outside, and the distance obtained accordingly between obstacle and vehicle, and based on the comparative result of this distance with a first threshold set, send the ECU200 of secondary signal to vehicle, vehicle ECU200 performs corresponding process based on this secondary signal, controls the applying increasing car brakeing.
Specifically, Fig. 4 described in more detail the realization of said process.
The first camera of smart mobile phone is made to obtain the face-image (301) of chaufeur in car.
As above disclosed content, preferably, be utilize front-facing camera to obtain the face-image of chaufeur in car here.Driven or/and trigger and start, the face-image of the chaufeur of shooting vehicle interior.These images are transferred to Peripheral Interface 103 by such as data bus or signal wire (SW) and are beneficial to subsequent treatment and application.
According to the face-image of aforementioned acquisition, smart mobile phone checks that chaufeur is in the risk (302) of fatigue driving state.
Smart mobile phone 100, the one or more fatigue detecting modules stored in execute store are called by its treater, thus identify based on accessed face-image, the driving condition of chaufeur is judged, determine whether it is in fatigue driving state, if so, then there is the risk being in fatigue driving state.
In response to there is aforementioned risk, smart mobile phone sends the ECU (303) of the first signal to vehicle.
In this example, smart mobile phone 100 utilizes the running inspection of its component software to there is the risk of fatigue driving to chaufeur, sends the ECU of the first signal to vehicle based on this risk judgment result.This first signal is intended to show that chaufeur has the risk being in fatigue driving state to the ECU of vehicle, wishes that ECU can make response in time and make corresponding control, with the generation of harm reduction or disaster.
After the ECU of vehicle receives described first signal, control gait of march restriction (304) of vehicle.
The ECU of vehicle, as vehicular drive, braking and other management and the nucleus module controlled, is responsible for the active and passive control to this vehicle.
Composition graphs 1, controls the gait of march restriction of vehicle after the ECU200 of vehicle receives described first signal.The gait of march restriction of control vehicle mentioned here, particularly, in some optional examples, comprises: at least one in deceleration, downshift, speed limit, limit shelves.
ECU200, according to the first signal, controls to make vehicle perform at least one in deceleration, downshift, speed limit, limit shelves.Here restriction, automatic transmission vehicle, new energy vehicle (as motor vehicle driven by mixed power, pure electric vehicle, fuel-cell vehicle) and have auxiliary drive and/or Function for Automatic Pilot vehicle on be easily realize.Such as, send control signal by ECU200 to the brake system of vehicle, motor vehicle braking system is had an effect, thus makes car retardation; Or send control signal by ECU200 to the change-speed box of vehicle, reduce or reduce step by step (such as while deceleration) gear.
The ECU200 of vehicle as the core component of wagon control, in vehicle, be responsible for driving, braking, car light driving, indicator lamp driving, fault detection to vehicle, automobile window open, skylight controls, Car's door controlling, Navigation Control, rain brush control etc.In certain embodiments, the ECU200 of vehicle also comprises the auxiliary ECU of the different additional function of multiple control and controls vehicle and to advance drivings, the master control ECU of key function to brake and so on, a part in the controlling functions that aforementioned list goes out normally is performed by master control ECU in some instances, such as vehicle is advanced driving, braking etc., and other controlling functions, then completed by auxiliary ECU, such as car light driving, indicator lamp driving, fault detection, automobile window opens, skylight controls, Car's door controlling, Navigation Control, rain brush control etc.Data bus between each ECU and usually via vehicle between ECU and Controlling vertex carries out communication, such as CAN, LIN bus etc.
In some preferred schemes, after the ECU of vehicle receives described first signal, control maximum speed that vehicle advances and/or most high tap position.Such as be limited in lower gear, thus reduce or eliminate the harm or risk that may cause because of fatigue driving.
In some instances, preceding method comprises more:
The post-positioned pick-up head of smart mobile phone 100 is made to obtain the image of the obstacle of outside vehicle;
Smart mobile phone 100 carries out obstacle range finding according to aforementioned acquisition image;
Distance based on obstacle and vehicle is less than the first threshold of setting, makes smart mobile phone 100 send secondary signal to the ECU of vehicle;
The ECU of vehicle controls the applying increasing car brakeing after receiving described secondary signal.
So, when detecting that chaufeur exists the risk of fatigue driving, the gait of march restriction of vehicle is controlled by the ECU200 of vehicle, simultaneously when detecting that the distance between the obstacle of outside vehicle and vehicle is less than first threshold, control by vehicle ECU200 the applying strengthening car brakeing further, reduce the risk of collision further or reduce to collide the harm brought.
In the example that some are concrete, such as, control motor vehicle braking system is braked with larger brake torque.
Be to be understood that, shown in Fig. 4 or hint one or more schematic diagrams, diagram of circuit basis on, for a those of ordinary skill in the art, do not need just directly to develop one or more software to perform the method shown in Fig. 4 or process through performing creative labour.
Although the present invention with preferred embodiment disclose as above, so itself and be not used to limit the present invention.Persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when being used for a variety of modifications and variations.Therefore, protection scope of the present invention is when being as the criterion depending on those as defined in claim.

Claims (9)

1., based on a vehicle active safety control method for smart mobile phone, this smart mobile phone is placed in vehicle, it is characterized in that, the method comprises:
The first camera of smart mobile phone is made to obtain the face-image of chaufeur in car;
According to the face-image of aforementioned acquisition, smart mobile phone checks that chaufeur is in the risk of fatigue driving state;
In response to there is aforementioned risk, then smart mobile phone sends the ECU of the first signal to vehicle; And
After the ECU of vehicle receives described first signal, control the gait of march restriction of vehicle.
2. the vehicle active safety control method based on smart mobile phone according to claim 1, is characterized in that, in preceding method:
Control after the ECU of vehicle receives described first signal vehicle is slowed down.
3. the vehicle active safety control method based on smart mobile phone according to claim 1 and 2, is characterized in that, in preceding method:
Control after the ECU of vehicle receives described first signal vehicle is downshifted.
4. the vehicle active safety control method based on smart mobile phone according to claim 1, is characterized in that, in preceding method:
Maximum speed that vehicle advances and/or most high tap position is controlled after the ECU of vehicle receives described first signal.
5., according to the vehicle active safety control method based on smart mobile phone in claim 1-4 described in any one, it is characterized in that, preceding method comprises following steps more:
The second camera of smart mobile phone is made to obtain the image of the obstacle of outside vehicle;
Smart mobile phone carries out obstacle range finding according to aforementioned acquisition image;
Distance based on obstacle and vehicle is less than the first threshold of setting, makes smart mobile phone send secondary signal to the ECU of vehicle;
The ECU of vehicle controls the applying increasing car brakeing after receiving described secondary signal.
6. a vehicle active safety control system, is characterized in that, this system comprises vehicle and is placed in the smart mobile phone in vehicle, wherein:
Described smart mobile phone comprises: the first camera; For the module making the first camera of smart mobile phone obtain the face-image of chaufeur in car; For checking that chaufeur is in the module of the risk of fatigue driving state according to the face-image of aforementioned acquisition; For in response to there is aforementioned risk, smart mobile phone sends the module of the first signal to the ECU of vehicle;
The gait of march restriction of vehicle is controlled after the ECU of described vehicle receives described first signal.
7. vehicle active safety control system according to claim 6, is characterized in that, in described vehicle active safety control system, smart mobile phone also comprises: second camera; For the module making second camera obtain the image of the obstacle of outside vehicle; For carrying out the module of obstacle range finding according to aforementioned acquisition image; For being less than the first threshold of setting based on the distance of obstacle and vehicle, smart mobile phone is made to send the module of secondary signal to the ECU of vehicle;
The ECU of described vehicle controls the applying increasing car brakeing after receiving described secondary signal.
8. the vehicle active safety control system according to claim 6 or 7, is characterized in that, controls vehicle is downshifted after the ECU of described vehicle receives described first signal.
9. vehicle active safety control system according to claim 8, is characterized in that, controls maximum speed that vehicle advances and/or most high tap position after the ECU of described vehicle receives described secondary signal.
CN201510237642.8A 2015-05-11 2015-05-11 Vehicle active safety control method and vehicle active safety control system Pending CN105034804A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510237642.8A CN105034804A (en) 2015-05-11 2015-05-11 Vehicle active safety control method and vehicle active safety control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510237642.8A CN105034804A (en) 2015-05-11 2015-05-11 Vehicle active safety control method and vehicle active safety control system

Publications (1)

Publication Number Publication Date
CN105034804A true CN105034804A (en) 2015-11-11

Family

ID=54441998

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510237642.8A Pending CN105034804A (en) 2015-05-11 2015-05-11 Vehicle active safety control method and vehicle active safety control system

Country Status (1)

Country Link
CN (1) CN105034804A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105459891A (en) * 2015-12-21 2016-04-06 延锋伟世通电子科技(上海)有限公司 Intelligent automobile travelling brake control system
CN106205055A (en) * 2016-09-13 2016-12-07 珠海格力电器股份有限公司 Control method and device of intelligent terminal
WO2018023775A1 (en) * 2016-08-05 2018-02-08 王志强 Method for acquiring usage information of human face-based extreme speed regulation technology, and a speed limitation system
WO2018023776A1 (en) * 2016-08-05 2018-02-08 王志强 Human face-based extreme speed limitation method, and speed limitation system
WO2018058266A1 (en) * 2016-09-27 2018-04-05 深圳智乐信息科技有限公司 Mobile terminal-based notification method and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509418A (en) * 2011-10-11 2012-06-20 东华大学 Fatigue driving estimation and early-warning method and device of multi-sensor information fusion
CN102752458A (en) * 2012-07-19 2012-10-24 北京理工大学 Driver fatigue detection mobile phone and unit
CN103198618A (en) * 2013-04-13 2013-07-10 杭州立体世界科技有限公司 Mobile phone capable of preventing fatigue driving and warning method
CN103354012A (en) * 2013-06-28 2013-10-16 上海市航头学校 Alarm system for preventing fatigue driving
CN103956026A (en) * 2014-04-04 2014-07-30 驻马店市金格尔电气设备有限公司 Fatigue driving warning system based on mobile phone
CN104013414A (en) * 2014-04-30 2014-09-03 南京车锐信息科技有限公司 Driver fatigue detecting system based on smart mobile phone
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院(吴江) Machine vision-based fatigue driving pre-warning system suitable for smart phone

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509418A (en) * 2011-10-11 2012-06-20 东华大学 Fatigue driving estimation and early-warning method and device of multi-sensor information fusion
CN102752458A (en) * 2012-07-19 2012-10-24 北京理工大学 Driver fatigue detection mobile phone and unit
CN103198618A (en) * 2013-04-13 2013-07-10 杭州立体世界科技有限公司 Mobile phone capable of preventing fatigue driving and warning method
CN103354012A (en) * 2013-06-28 2013-10-16 上海市航头学校 Alarm system for preventing fatigue driving
CN103956026A (en) * 2014-04-04 2014-07-30 驻马店市金格尔电气设备有限公司 Fatigue driving warning system based on mobile phone
CN104013414A (en) * 2014-04-30 2014-09-03 南京车锐信息科技有限公司 Driver fatigue detecting system based on smart mobile phone
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院(吴江) Machine vision-based fatigue driving pre-warning system suitable for smart phone

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105459891A (en) * 2015-12-21 2016-04-06 延锋伟世通电子科技(上海)有限公司 Intelligent automobile travelling brake control system
WO2018023775A1 (en) * 2016-08-05 2018-02-08 王志强 Method for acquiring usage information of human face-based extreme speed regulation technology, and a speed limitation system
WO2018023776A1 (en) * 2016-08-05 2018-02-08 王志强 Human face-based extreme speed limitation method, and speed limitation system
CN106205055A (en) * 2016-09-13 2016-12-07 珠海格力电器股份有限公司 Control method and device of intelligent terminal
WO2018058266A1 (en) * 2016-09-27 2018-04-05 深圳智乐信息科技有限公司 Mobile terminal-based notification method and system

Similar Documents

Publication Publication Date Title
CN105035074A (en) Vehicle active safety control method based on portable intelligent equipment
CN105023394A (en) Dangerous driving reminding and controlling method based on portable intelligent device
CN105139583A (en) Vehicle danger prompting method based on portable intelligent equipment
CN105034979A (en) Vehicle active safety control method and vehicle active safety control system
US10812952B2 (en) Systems and methods for detecting driver phone operation using vehicle dynamics data
US10972975B2 (en) Electronic device for transmitting communication signal related to pedestrian safety and method of operating same
Engelbrecht et al. Survey of smartphone‐based sensing in vehicles for intelligent transportation system applications
US9921580B2 (en) Apparatus for switching driving modes of vehicle and method of switching between modes of vehicle
KR102552285B1 (en) Portable electronic device and method thereof
US20180141568A1 (en) Vehicle autonomy level selection based on user context
US10818110B2 (en) Methods and systems for providing a mixed autonomy vehicle trip summary
CN105788321B (en) Vehicle communication method, device and system
US11223381B2 (en) Phone docking station mounted on a vehicle for enhanced driving safety
CN109064763A (en) Test method, device, test equipment and the storage medium of automatic driving vehicle
CN105034804A (en) Vehicle active safety control method and vehicle active safety control system
WO2018046015A1 (en) Alarm method, device and terminal for vehicle
CN109895767B (en) Automobile control method and device and storage medium
WO2018094384A1 (en) Optimal route selection for autonomous vehicles
US10095937B2 (en) Apparatus and method for predicting targets of visual attention
US10560253B2 (en) Systems and methods of controlling synchronicity of communication within a network of devices
CN107800747A (en) A kind of passenger's locating and displaying processing method and processing device
CN112534487A (en) Information processing apparatus, moving object, information processing method, and program
WO2021217575A1 (en) Identification method and identification device for object of interest of user
CN107117099A (en) A kind of vehicle collision reminding method and vehicle
CN105035005A (en) Road danger prompting and controlling method based on portable intelligent equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20151111

RJ01 Rejection of invention patent application after publication