US20100171829A1 - Drive recorder - Google Patents
Drive recorder Download PDFInfo
- Publication number
- US20100171829A1 US20100171829A1 US12/669,299 US66929908A US2010171829A1 US 20100171829 A1 US20100171829 A1 US 20100171829A1 US 66929908 A US66929908 A US 66929908A US 2010171829 A1 US2010171829 A1 US 2010171829A1
- Authority
- US
- United States
- Prior art keywords
- video information
- recording
- time
- vehicle
- drive recorder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/0875—Registering performance data using magnetic data carriers
- G07C5/0891—Video recorder in combination with video camera
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0858—Registering performance data using electronic data carriers wherein the data carrier is removable
Definitions
- the present invention relates to a drive recorder, and more particularly to a drive recorder that records video information by detecting acceleration using an acceleration sensor.
- a vehicle-mounted video recording apparatus that captures the view outside of a vehicle by a camera mounted on the vehicle and records the captured view along with vehicle speed upon detecting an impact to the vehicle, such as a collision, hard braking, etc.
- a drive recorder When such a drive recorder is mounted in a vehicle, it is possible, in the event of a vehicle accident, to investigate the cause of the accident by analyzing the recorded information.
- the drive recorder serve to enhance the driver's awareness of safe driving, but also records the driver's usual driving habits, for example, for safe driving guidance.
- Patent documents 1 and 2 each disclose a drive recorder in which the video being captured by an onboard camera is recorded in a continuously looping fashion, and in the event of an accident, the recorded video is saved on another recording medium.
- patent documents 3 and 4 each disclose a drive recorder in which vehicle driving data, such as vehicle speed and transmission gear position, is recorded in a continuously looping fashion, and in the event of an accident, the recorded driving data is saved on another recording medium.
- Patent document 1 Japanese Unexamined Patent Publication No. S63-16785
- Patent document 2 Japanese Unexamined Patent Publication No. H06-237463
- Patent document 3 Japanese Unexamined Patent Publication No. H06-331391
- Patent document 4 Japanese Unexamined Patent Publication No. H06-186061
- the acceleration sensor can detect high acceleration values repetitively, such as when the driver applies hard braking repetitively or when the vehicle has collided with an obstacle immediately after hard braking.
- the acceleration information from the acceleration sensor equals or exceeds a threshold, it is determined that the recording condition holds, and video information captured for a predetermined period of time before and after the occurrence of the recording condition is recorded on a recording medium; in this case, if the acceleration information from the acceleration sensor exceeds the threshold repetitively, video information captured for the predetermined period of time before and after the occurrence of the recording condition will be recorded on the recording medium each time the recording condition holds.
- acceleration information equal to or greater than the threshold is detected repetitively within a short period of time, there is the possibility that the same video information may be recorded in an overlapping fashion repetitively on the recording medium having a limited capacity.
- the acceleration sensor when detecting acceleration by using an acceleration sensor, if the acceleration sensor malfunctions, the acceleration sensor can continue to output acceleration information equal to or greater than the predetermined value. Further, in such cases as when the vehicle has rolled over due to hard braking, the acceleration sensor can also continue to output acceleration information equal to or greater than the predetermined value.
- the drive recorder if provisions are made to record the video information by determining that the recording condition holds whenever the acceleration information from the acceleration sensor becomes equal to or exceeds the predetermined value, then if, in such cases, the acceleration sensor continues to output acceleration information equal to or greater than the predetermined value, video information that need not necessarily be recorded will continue to be recorded on the recording medium.
- a drive recorder for recording video information received from an image capturing unit onto a recording medium, includes an acceleration sensor which outputs acceleration information representing an acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records video information captured for a first predetermined period of time before the occurrence of the recording condition and video information captured for a second predetermined period of time after the occurrence of the recording condition on the recording medium when the acceleration information equals or exceeds a threshold, wherein after the recording condition once holds, the control unit does not records newly captured video information on the recording medium when the acceleration information again becomes equal to or exceeds the threshold in less than a third predetermined period of time which is shorter than the second predetermined period of time.
- a drive recorder for recording video information received from an image capturing unit onto a recording medium, includes an acceleration sensor which outputs acceleration information representing an acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records video information captured for a first predetermined period of time before the occurrence of the recording condition and video information captured for a second predetermined period of time after the occurrence of the recording condition on the recording medium when the acceleration information equals or exceeds a threshold, wherein after the recording condition holds, the control unit does not record newly captured video information on the recording medium when the acceleration information again becomes equal to or exceeds the threshold within the second predetermined period of time, and records newly captured video information on the recording medium when the recording condition again holds after the second predetermined period of time has elapsed.
- a drive recorder for recording video information received from an image capturing unit onto a recording medium, includes an acceleration sensor which outputs acceleration information representing an acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records video information captured for a first predetermined period of time before the occurrence of the recording condition and video information captured for a second predetermined period of time after the occurrence of the recording condition on the recording medium when the acceleration information equals or exceeds a threshold, wherein after the recording condition holds, the control unit continues the recording of the video information on the recording medium even after the second predetermined period of time has elapsed when the acceleration information again becomes equal to or exceeds the threshold within the second predetermined period of time.
- the acceleration information again becomes equal to or exceeds the threshold within a relatively short period of time, newly captured video information is not transferred for recording on the recording medium, thus preventing the same video information from being recorded on the recording medium in an overlapping fashion; this makes efficient use of the recording medium having a limited capacity.
- a drive recorder including an acceleration sensor which outputs acceleration information representing acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records the video information on a recording medium when the acceleration information, after dropping to or below a first threshold, exceeds a second threshold which is greater than the first threshold.
- the drive recorder of the present invention since it is determined that the recording condition holds only when acceleration information equal to or greater than the second threshold large enough to indicate the occurrence of an accident or the like is detected after the acceleration information has dropped to or below the relatively low second threshold, video information that need not necessarily be recorded can be prevented from continuing to be recorded on the recording medium.
- FIG. 1 is a diagram showing an example in which a drive recorder is mounted in a vehicle.
- FIG. 2 is a diagram showing an example of how the drive recorder, etc., are arranged in the vehicle.
- FIG. 3 is a perspective view of the main unit of the drive recorder.
- FIG. 4 is a diagram showing an example of an external view of a playback apparatus.
- FIG. 5 is a block diagram showing the electrical configuration of the drive recorder.
- FIG. 6 is a block diagram showing the electrical configuration of a power control circuit.
- FIG. 8 is a diagram showing an example of a process flow of the drive recorder.
- FIG. 9 is a diagram showing a self-diagnosis process flow of the drive recorder.
- FIG. 10( a ) is a diagram showing an arrangement in which the drive recorder 2 is installed in an upright position in the vehicle 1
- FIG. 10( b ) is a diagram showing an arrangement in which the drive recorder 2 is installed in a horizontal position in the vehicle 1
- FIG. 10( c ) is a diagram showing an arrangement in which the drive recorder 2 is tilted by an angle ⁇ relative to the position shown in FIG. 10( b ).
- FIG. 11 is a diagram showing a G-value detection process flow.
- FIG. 12 is a diagram showing a process flow for verifying the outputs of an acceleration sensor 5 .
- FIG. 13 is a process flow for G detection.
- FIG. 14( a ) is a diagram showing an example (1) of a graph of the G value 50 obtained in the process flow of FIG. 11
- FIG. 14( b ) is a diagram showing video information being stored in a second RAM 15 in a continuously looping fashion and video information transferred for recording on a memory card 6 .
- FIG. 15( a ) is a diagram showing an example (2) of a graph of the G value 60 obtained in the process flow of FIG. 11
- FIG. 15( b ) is a diagram showing video information being stored in the second RAM 15 in a continuously looping fashion and video information transferred for recording on the memory card 6 .
- FIG. 16( a ) is a diagram showing an example (3) of a graph of the G value 70 obtained in the process flow of FIG. 11
- FIG. 16( b ) is a diagram showing video information being stored in the second RAM 15 in a continuously looping fashion and video information transferred for recording on the memory card 6 .
- FIG. 17( a ) is a diagram showing an example (4) of a graph of the G value 80 obtained in the process flow of FIG. 11
- FIG. 17( b ) is a diagram showing video information being stored in the second RAM 15 in a continuously looping fashion and video information transferred for recording on the memory card 6 .
- FIG. 18 is a diagram showing a voltage drop process flow ( 1 ).
- FIG. 19 is a diagram showing a voltage drop process flow ( 2 ).
- FIG. 20 is a diagram showing voltage drops.
- FIG. 21 is a diagram showing a mode switching flow.
- FIG. 22 is a diagram showing a playback sequence.
- FIG. 23 is a diagram showing an example of the operation flow of the memory card 6 .
- FIG. 24 is a diagram showing a mapping table for field of vision ranges.
- FIG. 25 is a diagram showing an example of a screen for displaying video information.
- FIG. 26 is a diagram showing a process flow for identifying a driving situation.
- FIG. 27 is a diagram showing a sample sequence, etc.
- FIG. 28 is a diagram showing one example of a peak master file.
- FIG. 30( a ) is a diagram showing a G2-value sample sequence 300
- FIG. 30( b ) is a diagram showing a G1-value sample sequence 301
- FIG. 30( c ) is a diagram showing a vehicle-speed sample sequence 302 .
- FIG. 31( a ) is a diagram showing a G2-value sample sequence 310
- FIG. 31( b ) is a diagram showing a G1-value sample sequence 311
- FIG. 31( c ) is a diagram showing a vehicle-speed sample sequence 312 .
- FIG. 32( a ) is a diagram showing a G2-value sample sequence 320
- FIG. 32( b ) is a diagram showing a G1-value sample sequence 321
- FIG. 32( c ) is a diagram showing a vehicle-speed sample sequence 322 .
- FIG. 33( a ) is a diagram showing a G2-value sample sequence 330
- FIG. 33( b ) is a diagram showing a G1-value sample sequence 331
- FIG. 33( c ) is a diagram showing a vehicle-speed sample sequence 332 .
- FIG. 34( a ) is a diagram showing a G2-value sample sequence 340
- FIG. 34( b ) is a diagram showing a G1-value sample sequence 341
- FIG. 34( c ) is a diagram showing a vehicle-speed sample sequence 342 .
- FIG. 1 is a diagram showing an example in which the drive recorder 2 is mounted in a vehicle 1 .
- the drive recorder 2 mounted in the vehicle 1 is connected to a first camera 3 for capturing a view ahead of the vehicle 1 and a second camera 4 for capturing a view behind the vehicle 1 .
- Video information from the first camera 3 , etc. is stored in a semiconductor storage unit 15 in a continuously looping fashion. If a predetermined recording condition holds, the video information stored in the semiconductor storage unit 15 is transferred for recording on a memory card 6 .
- the predetermined recording condition refers to an event that occurs, for example, when the vehicle 1 is subjected to an impact due to an accident or the like, and the details will be described later.
- the drive recorder 2 acquires vehicle operational information including vehicle speed information, and stores the information in a continuously looping fashion in the semiconductor storage unit 15 contained in the drive recorder 2 . Each time the recording condition holds, the vehicle operational information is recorded on the memory card 6 together with the video information by being associated with the video information. The details of the vehicle operational information will be described later.
- FIG. 2 is a diagram showing an example of how the drive recorder 2 is arranged in the vehicle 1 .
- the drive recorder 2 is fixed, for example, to one side of the center panel at a position to the lower left of the steering wheel, and is electrically connected to the first camera 3 (and the second camera 4 not shown in FIG. 2 ) and also to a GPS sensor 9 , a vehicle speed sensor 10 not shown, a battery 21 not shown, a vehicle-mounted display unit 30 , etc.
- the first camera 3 which is attached to the inside of the windshield behind the rearview mirror in the passenger compartment, captures the view ahead of the vehicle and transmits video information to the drive recorder 2 .
- FIG. 3 is a perspective view of the main unit of the drive recorder 2 .
- the drive recorder 2 includes a microphone 7 , an image capture switch 8 , a power switch 20 , an LED 25 , a buzzer 26 , an open/close sensor 27 not shown, and an open/close knob 31 .
- the microphone 7 picks up sound inside the vehicle 1 .
- the image capture switch 8 is used to enter various inputs to the drive recorder 2 , such as the timing for starting to record video information in the drive recorder 2 and the initialization of the drive recorder 2 .
- the LED 25 and buzzer 26 each have the function of alerting the user to the condition of the drive recorder 2 by generating a visual or audible warning, etc.
- the open/close knob 31 is moved slidingly into position to provide a protective covering for the memory card 6 (this condition is shown in FIG. 3 ).
- the open/close knob 31 is slid in the direction of arrow A.
- the open/close sensor 27 in the drive recorder 2 operates in conjunction with the open/close knob 31 , and outputs an OFF signal indicating “closed” when the open/close knob 31 is closed to cover the memory card 6 (the condition shown in FIG. 3 ) and an ON signal indicating “open” when the open/close knob 31 is opened to allow the memory card 6 to be removed.
- FIG. 4 is a diagram showing an example of an external view of a playback apparatus.
- the video information, vehicle operational information, etc., recorded on the memory card 6 are played back on the playback apparatus 400 which includes a personal computer, etc.
- the memory card 6 is inserted into the I/F connected to the personal computer, and the video information, vehicle operational information, etc. are loaded into the personal computer.
- the user can, for example, investigate the vehicle driving conditions or the cause of a vehicle accident by playing back the video information, vehicle operational information, etc.
- FIG. 5 is a block diagram showing the electrical configuration of the drive recorder 2 .
- the first camera 3 is constructed, for example, from a two-dimensional image sensor, such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and is controlled so as to capture the view ahead of the vehicle 1 and to output an analog video signal as first video information 500 .
- a CCD Charge Coupled Device
- CMOS Complementary Metal Oxide Semiconductor
- the second camera 4 is installed as an additional camera in the vehicle 1 , and is controlled so as to capture the view behind the vehicle or view in a direction different than the first camera 3 , for example, in the direction of the passenger compartment, and to output an analog video signal as second video information 501 . If only one camera suffices, there is no need to connect the second camera 4 to the drive recorder 2 .
- An acceleration sensor 5 is constructed from a so-called G sensor (Gravity Accelerative Sensor) that detects the magnitude of an impact applied to the vehicle 1 as the magnitude of gravitational acceleration.
- G sensor Gram Accelerative Sensor
- This sensor is constructed from a semiconductor that, when subjected to an impact, produces a current proportional to the gravitational acceleration, and detects the magnitude of the gravitational acceleration in the longitudinal, as well as the transverse direction of the vehicle and then supplies gravitational acceleration information 502 to a CPU 24 .
- the memory card 6 is a storage medium removable from the drive recorder 2 , and is constructed from an SD card (Secure Digital Memory Card) which is a programmable nonvolatile semiconductor memory card.
- SD card Secure Digital Memory Card
- the memory card 6 is used to store video information and vehicle operational information.
- the memory card 6 is also used to separately store the recording condition to be described later and various other pieces of information such as the ID unique to the memory card 6 and data such as the ID or name of the user (for example, a taxi driver) that uses the memory card 6 .
- the memory card 6 is provided with a dip switch which can be used to write-protect the memory card 6 .
- an SD card is used as the removable storage medium, but alternatively, use may be made of other types of removable memory cards (for example, CF (Compact Flash) card or memory stick), hard disk, or the like.
- CF Compact Flash
- a hard disk may be built into the drive recorder 2 and used in place of the memory card 6 ; in that case, a transmitter circuit should be provided in the drive recorder 2 so that the video information and vehicle operational information recorded on the hard disk can be transmitted to the playback apparatus 400 by means of wireless communications.
- the microphone 7 is electrically connected to the CPU 24 , and is configured to pick up sound inside or outside the vehicle 1 and to transmit the sound as sound information 503 to the CPU 24 .
- the sound information 503 is converted into a digital signal by an analog/digital converter contained in the CPU 24 . It is preferable to use a unidirectional microphone whose sensitivity is the highest in the forward direction of the microphone so as not to unnecessarily pick up noise from the road.
- the image capture switch (capture SW) 8 when operated by the user, transmits a signal to the CPU 24 electrically connected to it. In response, the CPU 24 performs control so that the video information and vehicle operational information stored in a second RAM 15 are transferred for recording on the memory card 6 . That is, the operation of the capture SW 8 serves as an event that triggers the recording condition. Provisions may be made to record on the memory card 6 only the video information captured at the moment the capture SW 8 is operated. As will be described later, the capture SW 8 is also used as an operating means for using other functions of the drive recorder 2 .
- the GPS (Global Positioning System) receiver 9 receives from a plurality of GPS satellites radio signals carrying information such as the orbits of the satellites and time data generated by the atomic clocks mounted in the satellites, and acquires current position information by computing the relative differences in distance to the respective satellites from the time differences between the received radiowaves. Any position on the Earth can be identified by capturing radiowaves from at least three satellites.
- the GPS receiver 9 that detected the current position information transmits the position information and time information as GPS information 504 to the CPU 24 .
- the vehicle speed sensor 10 is constructed from a magnetic sensor or optical sensor which converts the rotation of the rotor mounted on the driveshaft of the vehicle 1 into a pulse signal 505 for output.
- the CPU 24 computes the speed of the vehicle 1 by calculating the number of revolutions of the driveshaft per unit time from the pulse signal received from the vehicle speed sensor 10 .
- the interface (I/F) 11 also serves as a slot provided in the drive recorder 2 for insertion of the memory card 6 .
- the I/F 11 transfers recorded information 506 , including the video information and vehicle operational information, from the drive recorder 2 to the inserted memory card 6 , and transfers various pieces of information 507 prestored in the drive recorder 2 to the CPU 24 .
- a video switch (hereinafter “video SW”) 12 is a switch for selecting the camera to be used for image capturing when a plurality of cameras are installed.
- the first and second cameras 3 and 4 are connected, and one or the other of the cameras is selected by a select signal 508 from the CPU 24 .
- the video information from the selected camera is output as selected video information 509 to an image processing circuit 13 .
- the video SW 12 may be provided with a timekeeping function so as to switch from one camera to the other at predetermined intervals of time.
- the selected video information 509 supplied from the first or second camera 3 or 4 via the video SW 12 is converted into a digital signal by the image processing circuit 13 which thus creates and outputs image data 510 .
- the image processing circuit 13 is constructed from a JPEG-IC (Joint Photographic coding Experts Group—Integrated Circuit), and generates data in JPEG format.
- the JPEG-IC writes 30 files per second to a first RAM (Random Access Memory) 14 by overwriting on a file-by-file basis, because the JPEG-IC does not have the function of outputting the data by specifying the address.
- the first RAM 14 temporarily stores the image data 510 converted by the image processing circuit 13 .
- the first RAM 14 is connected to a DMA (Direct Memory Access) circuit contained in the CPU 24 , and one in every three input video frames, which means 10 files per second, is transferred by the DMA function to the second RAM 15 where the data is stored in a continuously looping fashion.
- DMA Direct Memory Access
- the video information converted by the image processing circuit 13 into the image data is stored in the second RAM (semiconductor storage unit) 15 in a continuously looping fashion together with the vehicle operational information.
- the first and second RAMs 14 and 15 are each constructed from SDRAM (Synchronous Dynamic Random Access Memory). SDRAM is designed to operate synchronously with the CPU clock; therefore, SDRAM has short input/output latency, achieves higher access speeds than conventional DRAM (Dynamic Random Access Memory), and is thus suited to high-speed control operation when processing a large amount of video data at high speed.
- SDRAM Serial Dynamic Random Access Memory
- a nonvolatile ROM 16 stores programs such as a control program 17 for centrally controlling the hardware resources constituting the drive recorder 2 .
- a mask ROM may be used for the nonvolatile ROM 16 , but if a programmable nonvolatile semiconductor memory, such as a flash memory, EEPROM (Erasable Programmable Read Only Memory), or ferroelectric memory, is used, it becomes possible to erase and rewrite programs.
- the control program 17 is stored in the nonvolatile ROM 16 , is loaded into the CPU 24 during power on of the drive recorder 2 , and functions as a program for controlling various components and data processing operations.
- An accessory switch (ACC switch) 19 is provided in an electrically integral fashion with the engine starting key cylinder of the vehicle 1 .
- an accessory ON signal 511 is transmitted to the CPU 24 and the power control circuit 22 in the drive recorder 2 .
- the power control circuit 22 supplies power to the drive recorder 2 which thus initiates control.
- an ignition key output signal (IG ON signal) may be used.
- the power switch (power SW) 20 transmits a power ON signal to the CPU 24 and the power control circuit 22 in the drive recorder 2 when the power SW 20 is turned on by the user. This switch can be used when it is desired to operate the drive recorder 2 without turning on the ACC switch 17 .
- the battery 21 is mounted in the vehicle 1 , and supplies power to the main unit of the drive recorder 2 .
- the battery also supplies power to the power control circuit 22 . Any battery can be used as long as it can be mounted in the vehicle 1 and can produce an electromotive force of 12 V.
- the power control circuit 22 supplies the power from the battery 21 to the CPU 24 and other components of the drive recorder 2 .
- the details of the power control circuit 22 will be described later.
- the CPU (Central Processing Unit) 24 operates as a control unit for the drive recorder 2 , and is constructed from a microcomputer or the like.
- the CPU 24 performs control of the various components of the drive recorder 2 , data processing operations, etc., in accordance with the control program 17 .
- the LED 25 lights up during power on of the drive recorder 2 under control of the CPU 24 , thus indicating to the user that the system is being powered on. Further, if a fault occurs in the drive recorder 2 , for example, the CPU 24 causes the LED 25 to flash on and off in a predetermined manner to indicate the occurrence of the fault to the user.
- the CPU 24 In the event of a fault in the drive recorder 2 , the CPU 24 also causes the buzzer 26 to sound an alarm in a predetermined manner to indicate the occurrence of the fault to the user.
- the open/close sensor 27 outputs an open signal or closed signal as the open/close knob 31 is moved to the open position or closed position for insertion/removal of the memory card 6 .
- An RTC (Real Time Clock) 28 generates a signal corresponding to the current date and time and transmits the signal to the CPU 24 .
- the display unit 30 is constructed from a liquid crystal display or the like, and is used when playing back the video information recorded on the memory card 6 in a specific situation as will be described later.
- FIG. 2 has shown the configuration in which the display of a navigation system mounted in the vehicle is used as the display unit 30 , but a separate display may be used the display unit 30 .
- the drive recorder 2 is preferably provided with an output port for outputting video information.
- the drive recorder 2 may be constructed as an apparatus dedicated to video recording and may be combined with the first camera 3 , the second camera 4 , the GPS receiver 9 , and/or the display unit 30 , etc., into a single unit by housing them in the same cabinet.
- the drive recorder 2 may be incorporated into an automotive navigation system.
- FIG. 6 is a block diagram showing the electrical configuration of the power control circuit 22 .
- the power control circuit 22 comprises a first power supply circuit 40 , a second power supply circuit 41 , a third power supply circuit 42 , a first detector 43 , a second detector 44 , a third detector 45 , and a backup battery 46 .
- the first power supply circuit 40 starts to operate when the ACC switch 19 or the power switch 20 is turned on, and functions as a constant voltage power supply that produces an output of 6.0 V by receiving power from the battery 21 rated at 12.0 V.
- the output of the first power supply circuit 40 is supplied to the first and second cameras 3 and 4 , etc.
- the second power supply circuit 41 functions as a constant voltage power supply that produces an output of 3.3 V by receiving power from the first power supply circuit 40 rated at 6.0 V.
- the output of the second power supply circuit 41 is supplied to the JPEG circuit constituting the image processing circuit 13 , as well as to the GPS receiver 9 , CPU 24 , etc.
- the third power supply circuit 42 functions as a constant voltage power supply that produces an output of 1.8 V by receiving power from the second power supply circuit 41 rated at 3.3 V.
- the output of the third power supply circuit 42 is supplied to the CPU 24 , etc.
- the first detector 43 detects the output voltage of the battery 21 and, if the output voltage of the battery 21 drops to 8.0 V or lower, supplies a first voltage drop signal S 1 to the CPU 24 .
- the second detector 44 detects the output voltage of the first power supply circuit 40 and, if the output voltage of the first power supply circuit 40 drops to 3.7 V or lower, supplies a second voltage drop signal S 2 to the CPU 24 .
- the third detector 45 detects the output voltage of the second power supply circuit 41 and, if the output voltage of the second power supply circuit 41 drops to 3.0 V or lower, supplies a reset signal S 3 to the JPEG circuit constituting the image processing circuit 13 as well as to the GPS receiver 9 and the CPU 24 and thereby resets the components in order to prevent them from malfunctioning due to the low voltage.
- the backup battery 46 comprises two capacitors, and is constructed to be able to supply power so that, even when the output voltage of the battery 21 has dropped, at least the JPEG circuit constituting the image processing circuit 13 , the GPS receiver 9 , and the CPU 24 can operate for a predetermined period of time.
- the backup battery 46 supplies the stored power to the CPU 24 , etc., so that the video information, etc., currently being processed can be saved as much as possible. The processing performed at the time of a voltage drop will be described later.
- FIG. 7 is a block diagram showing the electrical configuration of the playback apparatus 400 .
- An interface (I/F) 411 serves as a slot provided in the playback apparatus 400 for insertion of the memory card 6 .
- the I/F 411 transfers the video information, vehicle operational information, etc., recorded on the memory card 6 to the playback apparatus 400 .
- a RAM 414 is used to temporarily store data when a CPU 424 processes the video information, vehicle operational information, etc., transferred from the memory card 6 .
- the RAM 414 is constructed, for example, from SDRAM.
- a nonvolatile ROM 416 stores programs such as a control program 417 for centrally controlling the hardware resources constituting the playback apparatus 400 .
- the nonvolatile ROM 416 is constructed, for example, from EEPROM, ferroelectric memory, or the like.
- the control program 417 is stored in the nonvolatile ROM 416 , is loaded into the CPU 424 during power on of the playback apparatus 400 , and functions as a program for controlling various components and data processing operations.
- the CPU 424 operates as a control unit for the playback apparatus 400 , and is constructed from a microcomputer or the like.
- the CPU 424 performs control of the various components of the playback apparatus 400 , data processing operations, etc., in accordance with the control program 417 .
- An operation unit 430 comprises a keyboard, mouse, etc., and is used as a means for entering operation inputs to the CPU 424 when the user operates the playback apparatus 400 .
- a display unit 440 is constructed from a liquid crystal display or the like, and is used to suitably display the video information, vehicle operational information, etc., recorded on the memory card 6 .
- a map information recording unit 450 is constructed from a recording medium such as a hard disk or DVD, and stores map information including road information and speed limit information.
- a card information recording unit 460 is constructed from a recording medium such as a hard disk, and is used to record the video information, vehicle operational information, etc., transferred from the memory card 6 .
- FIG. 8 is a diagram showing the overall process flow of the drive recorder 2 .
- the process flow shown in FIG. 8 is performed primarily by the CPU 24 in the drive recorder 2 in cooperation with the various component elements of the drive recorder 2 in accordance with the control program 17 .
- the CPU 24 When power is turned on to the drive recorder 2 by turning on the ACC switch 19 or power switch 20 , the CPU 24 performs power-up processing (S 1 ).
- the power-up processing includes initialization by a boot program and self-diagnosis of the various elements related to the drive recorder 2 . The self-diagnosis will be described later.
- the CPU 24 starts to store video information in the second RAM 15 in a continuously looping fashion (S 2 ). More specifically, the CPU 24 acquires still image data (640 ⁇ 480 pixels) from the first camera 3 and the second camera 4 , alternately, at a rate of 10 frames per second (i.e., still images from the camera 3 and still images from the camera 4 are respectively acquired at intervals of 0.2 second in an alternating fashion), and stores the thus acquired data in a continuously looping fashion in the second RAM 15 by way of the first RAM 14 .
- still image data 640 ⁇ 480 pixels
- the CPU 24 acquires still image data (640 ⁇ 480 pixels) from the first camera 3 and the second camera 4 , alternately, at a rate of 10 frames per second (i.e., still images from the camera 3 and still images from the camera 4 are respectively acquired at intervals of 0.2 second in an alternating fashion), and stores the thus acquired data in a continuously looping fashion in the second RAM 15 by way of the first RAM 14 .
- the CPU 24 acquires vehicle operational information and stores the vehicle operational information in a continuously looping fashion in the second RAM 15 by associating the information with the still image data.
- the intervals of time at which the CPU 24 acquires the still image data and the number of still image frames to be acquired, described above, are only illustrative and not restrictive.
- the CPU 24 determines whether the recording condition hereinafter described holds or not (S 3 ). If any of the following three events occurs, it is determined that the recording condition holds. One or two of the following events may be used, or some other event than the following three may be defined.
- G detection The acceleration sensor 5 has detected a gravitational acceleration of 0.40 G or greater. In this case, it is determined that the recording condition holds, because when such a gravitational acceleration is applied to the vehicle 1 , the situation can be determined as being the occurrence of an accident or the imminence of an accident.
- the above set value (0.40 G) is only one example, and some other suitable value may be employed. The details will be described later.
- Speed trigger The rate of change of the speed of the vehicle 1 detected by the vehicle speed sensor 10 over a predetermined period of time has become equal to or exceeded a threshold value. For example, when the vehicle is traveling at a speed of 60 km/h or higher, if the rate of deceleration of the vehicle in one second has become equal to or exceeded 14 km/h, then it is determined that the recording condition holds. The reason is that when the vehicle 1 has decelerated at such a rate, the situation can be determined as being the occurrence of an accident or the imminence of an accident.
- the above criterion (when the vehicle is traveling at a speed of 60 km/h or higher, the rate of deceleration in one second becomes equal to or exceeds 14 km/h) is only one example, and some other suitable criterion may be employed.
- Image capture SW The image capture SW 8 is operated.
- the CPU 24 performs control so that a total of 20 seconds of video information, i.e., 12 seconds before and 8 seconds after the occurrence of the recording condition (a total of 200 still images for each occurrence of the recording condition), is transferred together with its associated vehicle operational information from the second RAM 15 to the memory card 6 for recording thereon (S 4 ). Further, when the recording condition holds, event data indicating the event that triggered the recording condition (i.e., data indicating one of the three above events) is also recorded on the memory card 6 .
- the memory card 6 has a capacity that can store video information, etc., for at least 15 events.
- Provisions may be made so that, when the recording condition holds, the sound information acquired from the microphone 7 for a total of 20 seconds, i.e., 12 seconds before and 8 seconds after the occurrence of the recording condition, is also recorded on the memory card 6 together with the video information, etc. Since the video information, vehicle operational information, etc., recorded on the memory card 6 can be displayed on the playback apparatus 400 , the user of the drive recorder 2 can investigate the driving conditions of the vehicle 1 and the situation that led up to an accident.
- the length of time that the CPU 24 records the information on the memory card 6 when the recording condition holds i.e., 12 seconds before and 8 seconds after the occurrence of the recording condition), described above, is only illustrative and not restrictive.
- the vehicle operational information includes the following information.
- the contents of the vehicle operational information are not necessarily limited to the above information, but may also include information concerning the operation and driving of the vehicle 1 , such as the steering angle and the ON/OFF states of various lights including turn signal lights.
- the CPU 24 determines whether a termination signal effected by the OFF signal of the ACC switch 19 or power switch 20 is received or not (S 5 ); if the termination signal is received, termination processing is performed (S 6 ) to terminate the sequence of operations. If the termination signal is not yet received, the process from S 2 to S 4 is repeated.
- the self-diagnosis of the drive recorder 2 is performed in the power-up process (S 1 ) in the process flow shown in FIG. 8 , and the acceleration sensor 5 , the JPEG-IC constituting the image processing circuit 13 , the RTC 28 , and the connection state of the first and second cameras 3 and 4 are self-diagnosed.
- the reason that the self-diagnosis of the drive recorder 2 is performed is that the data recorded by the drive recorder 2 may be used as evidentiary data when investigating the cause of an accident, etc. It is therefore necessary to check in advance whether the drive recorder 2 can record data properly and whether there is any problem with the recorded data.
- FIG. 9 is a diagram showing a process flow for the self-diagnosis of the drive recorder 2 .
- the CPU 24 acquires the output G1 of a first predefined axis which is parallel to the longitudinal direction of the vehicle 1 and the output G2 of a second predefined axis which is parallel to the transverse direction of the vehicle 1 (S 11 ).
- FIG. 10 is a diagram showing the positional relationship between the drive recorder 2 and the acceleration sensor 5 .
- FIG. 10( a ) shows an arrangement in which the drive recorder 2 is installed in an upright position in the vehicle 1 (see FIG. 2)
- FIG. 10( b ) shows an arrangement in which the drive recorder 2 is installed in a horizontal position in the vehicle 1
- FIG. 10( c ) shows an arrangement in which the drive recorder 2 is tilted by an angle ⁇ relative to the position shown in FIG. 10( b ).
- the direction of arrow B indicates the traveling direction of the vehicle.
- the acceleration sensor 5 has three axes, but when the drive recorder 2 is arranged as shown in FIG. 10( a ), the output of the x axis is defined as the output G1 of the first axis and the output of the y axis as the output G2 of the second axis, and the output of the z axis is not used. On the other hand, when the drive recorder 2 is arranged as shown in FIG. 10( b ), the output of the z axis is defined as the output G1 of the first axis and the output of the x axis as the output G2 of the second axis, and the output of the y axis is not used.
- the drive recorder 2 uses the acceleration sensor 5 having three output axes, as described above, the drive recorder 2 can be arranged in any desired orientation. However, in this case, it is required to determine in advance which axes are used as the first and second axes. Therefore, when installing the drive recorder 2 in the vehicle, the two axes to be used are selected in advance from among the x, y, and z axes.
- the CPU 24 determines whether any one of the outputs G1 and G2 of the first and second axes acquired in S 11 has been producing a value of 1 G or greater for five seconds or longer (S 12 ). In the normal condition, both axes should output 0 G; therefore, if an acceleration of 1 G or greater has been detected for five seconds or longer, it can be determined that some kind of fault has occurred in the acceleration sensor element.
- the CPU 24 switches a test mode pin (ST pin) on the acceleration sensor 5 (S 13 ) to create a situation where vibration is generated electrically, and detects its output to determine whether any change has occurred in the output (S 14 ). If the output of the acceleration sensor 5 does not change despite the switching of the ST pin, it can be determined that it is highly likely that the acceleration sensor 5 is not operating properly.
- ST pin test mode pin
- the CPU 24 proceeds to determine whether any one of the outputs G1 and G2 of the first and second axes acquired in S 11 has been producing a value of 0.7 G or greater for five seconds or longer (S 15 ). In such cases, it can be determined that while the acceleration sensor 5 itself may operate properly, it is highly likely that the axes predefined as the first and second axes do not match the initial setting, i.e., the drive recorder 2 originally arranged as shown in FIG. 10( a ) has been reoriented, for example, as shown in FIG. 10( b ), but the setting of the output axes has not been changed. For example, when the position is changed from that shown in FIG. 10( a ) to that shown in FIG. 10( b ), the y axis originally set as the second axis is now pointing in the vertical direction, producing an output of 0.7 G or greater in terms of gravity.
- the CPU 24 determines that the acceleration sensor 5 is operating properly, and performs processing to compensate for the offsets of the outputs G1 and G2 of the first and second axes, i.e., to correct the values acquired in S 11 to 0 (S 16 ), after which the sequence of operations is terminated.
- a possible cause for the offsets is that the drive recorder 2 is not mounted completely parallel relative to the vehicle 1 .
- the drive recorder 2 that should have been installed as shown in FIG. 10( b ) may be installed in a tilted position as shown in FIG. 10( c ).
- the drive recorder 2 is constructed so that, by compensating for the offsets, it can operate properly unless the tilt angle ⁇ shown in FIG. 10( c ) is larger than about 30 degrees.
- the CPU 24 determines that the acceleration sensor 5 is faulty, and notifies the user of the occurrence of the fault by turning on the LED 25 and issuing an alarm sound from the buzzer 26 ; at the same time, the CPU 24 deactivates other components than the LED 25 and the buzzer 26 , and continues the above alarm action until the ACC switch 19 or the power switch 20 is turned off (S 18 ).
- the CPU 24 determines that the setting of the output axes has not been changed after changing the orientation of the drive recorder 2 , and notifies the user of the occurrence of the fault by turning on the LED 25 and issuing an alarm sound from the buzzer 26 ; this alarm action is continued until the ACC switch 19 or the power switch 20 is turned off (S 17 ). However, the drive recorder 2 is allowed to continue operation, since the acceleration sensor 5 itself operates properly.
- the CPU 24 is constantly monitored for an interrupt signal to be input thereto at intervals of 16.7 ms, and if no interrupt occurs for a period of 500 ms, the CPU 24 determines that a fault has occurred in the JPEG-IC constituting the image processing circuit 13 . If it is determined that a fault has occurred, the CPU 24 notifies the user of the occurrence of the fault by turning on the LED 25 and issuing an alarm sound from the buzzer 26 ; at the same time, the CPU 24 deactivates other components than the LED 25 and the buzzer 26 , and continues the above alarm action until the ACC switch 19 or the power switch 20 is turned off.
- the interrupt monitoring intervals of 16.7 ms and the monitoring period of 500 ms are only illustrative and not restrictive.
- the CPU 24 monitors the status bits indicating the year, month, date and time, second, etc., being received from the RTC 28 , and if data that does not fall within a predefined range is received, it is determined that a fault has occurred. If it is determined that a fault has occurred, the CPU 24 notifies the user of the occurrence of the fault by turning on the LED 25 and issuing an alarm sound from the buzzer 26 , and resets the internal RTC of the CPU 24 to a predetermined value (for example, 0 hours, 0 minutes, 0 seconds, Jan. 1, 2001). Other normal operation of the drive recorder 2 is allowed to continue.
- a predetermined value for example, 0 hours, 0 minutes, 0 seconds, Jan. 1, 2001. Other normal operation of the drive recorder 2 is allowed to continue.
- the CPU 24 determines that a fault has occurred (the connection between the drive recorder 2 and the first and second cameras 3 and 4 is broken), if the data size of each image frame transferred from the first RAM 14 to the second RAM 15 has continued to be 6592 bytes for 10 seconds or longer.
- the size of 6592 bytes corresponds to the image data size when the image created by the JPEG-IC used in the drive recorder is an all black image.
- the JPEG-IC is preset to output a black image when there is no video input from the cameras 3 and 4 .
- the JPEG-IC has been outputting all black images continuously for a predetermined period (for example, 10 seconds), it can be determined that the connection between the drive recorder 2 and the first and second cameras 3 and 4 is broken.
- the CPU 24 notifies the user of the occurrence of the fault by turning on the LED 25 and issuing an alarm sound from the buzzer 26 ; at the same time, the CPU 24 deactivates other components than the LED 25 and the buzzer 26 , and continues the above alarm action until the ACC switch 19 or the power switch 20 is turned off.
- the image data size of 6592 bytes to be detected and the monitoring period of 10 seconds are only illustrative and not restrictive.
- the JPEG-IC is preset to output some other color image than black (for example, a blue color image) when there is no video input to the JPEG-IC, provisions should be made to detect a fault based on the data size of that color image.
- the self-diagnosis to check the connection state of the first and second cameras 3 and 4 may be performed not only during power-up of the drive recorder 2 but also constantly during the operation of the drive recorder 2 .
- the drive recorder 2 Since the drive recorder 2 according to the present invention performs self-diagnostic tests to verify proper operation of the components during power-up, etc., the validity of the video information and vehicle operational information can be ensured.
- FIG. 11 is a diagram showing a G-value detection process flow.
- the CPU 24 determines the G value based on the outputs of the acceleration sensor 5 in accordance with the process flow shown in FIG. 11 . Then, based on the G value detected in accordance with the process flow of FIG. 11 , the CPU 24 determines whether the recording condition related to the earlier described G detection holds or not, as will be described later.
- the CPU 24 acquires the output G1 of the first predefined axis and the output G2 of the second predefined axis (S 20 and S 21 ).
- the CPU 24 detects the current speed of the vehicle 1 based on the vehicle speed pulse signal received from the vehicle speed sensor 10 (S 22 ).
- the CPU 24 determines whether the road section on which the vehicle 1 is currently traveling corresponds to a sharp curve or not, based on the current position information of the vehicle 1 received from the GPS receiver 9 (S 23 ).
- the CPU 24 may obtain the “sharp curve or not” information from the navigation system (now shown) connected to the drive recorder 2 , or the drive recorder 2 itself may include a storage unit (not shown) that stores map information, and the “sharp curve or not” information may be obtained by comparing the current position information with the map information.
- the total value of the absolute values of the first and second axis outputs G1 and G2 acquired in S 20 and S 21 i.e., (G1 2 +G2 2 ) 0.5 , is taken as the G value (S 24 ).
- a correction value a determined in accordance with the vehicle speed detected in S 22 is obtained, and a value (G1 2 +(
- the correction value a can be set empirically, for example, to 0.1 when the vehicle speed is slower than 60 km/h and to 0.2 when the vehicle speed is 60 km/h or higher.
- the reason that the correction value a is subtracted from the absolute value of G2 representing the output in the transverse direction of the vehicle 1 in the case of a sharp curve is that, when traveling along a sharp curve, the vehicle 1 tends to be subjected to an acceleration in the transverse direction, and the recording condition may erroneously hold when the situation is not a vehicle accident or the like.
- the output G2 is taken to be positive when the acceleration is in the rightward direction and negative when the acceleration is in the leftward direction.
- the determination as to whether the road section on which the vehicle 1 is currently traveling is a sharp curve or not may not be determined based on the current position information received from the GPS receiver 9 , and the G value may be determined based on (G1 2 +(
- FIG. 12 is a diagram showing a process flow for verifying the outputs of the acceleration sensor 5 .
- FIG. 12 show a process flow for this purpose.
- the CPU 24 determines whether the vehicle 1 has stopped (S 30 ). It can be determined that the vehicle has stopped, for example, when the G value obtained in the process flow of FIG. 11 has remained at 0.1 G or less for three seconds or longer. Alternatively, it may be determined that the vehicle has stopped when the vehicle speed detected by the vehicle speed sensor is slower than a predetermined speed (for example, 2 km/h).
- a predetermined speed for example, 2 km/h.
- the CPU 24 acquires the output G1 of the first predefined axis and the output G2 of the second predefined axis (S 31 ); then, of these two axes, the axis whose output increased to 0.2 G or greater when the vehicle 1 began to move after stopping is identified as the axis oriented parallel to the traveling direction (or the longitudinal direction) of the vehicle 1 (S 32 ).
- the CPU 24 After identifying the axis oriented parallel to the traveling direction of the vehicle 1 in the above step, the CPU 24 stores information concerning the thus identified axis as history information in the second RAM 15 (S 33 ).
- the CPU 24 identifies the output of the other axis than the one identified in S 32 , as the output of the second axis oriented in the transverse direction of the vehicle 1 (S 34 ), and the sequence of operations is terminated.
- the process shown in FIG. 12 is repeated each time it is determined that the vehicle 1 has stopped.
- the history information is collected by repeating the process flow of FIG. 12 a predetermined number of times; therefore, the axes may be identified based on the history information.
- the axis output can be corrected by subtracting the correction value ⁇ from the absolute value of the output G2 of the second axis (in the transverse direction of the vehicle) of the acceleration sensor 5 as earlier shown in FIG. 11 .
- the redefining of the axes may be performed not when the vehicle has stopped, but when the vehicle has begun to move. In that case, it is determined in S 30 that the vehicle has begun to move, by detecting the vehicle speed, for example, by detecting that the vehicle speed has increased to 5 km/h or higher. Then, in S 32 , the axis whose output increased to 0.2 G or greater immediately after the vehicle began to move is identified as the axis oriented parallel to the traveling direction of the vehicle 1 . Further, provisions may be made to reset the history information when power is turned on to the drive recorder 2 and to collect the information repeatedly after each power on.
- FIG. 13 is a process flow for the G detection that provides a criterion upon which to determine whether the recording condition holds or not.
- the CPU 24 determines whether or not the G value detected in the process flow of FIG. 11 has once dropped to a value equal to or smaller than a first threshold (0.1 G) and then increased to a value equal to or larger than a second threshold (0.4 G) (S 40 ) and, if the determination is affirmative, then it is determined that the recording condition related to the G detection holds (S 41 ).
- the first threshold (0.1 G) and the second threshold (0.4 G) are values predetermined for the G detection.
- the reason that it is determined that the recording condition holds only when the G value has reached or exceeded the second threshold after once dropping to or below the first threshold is that, if values equal to or larger than the second threshold are detected repetitively, the situation could well be due, for example, to a failure of the acceleration sensor 5 or a rolling over of the vehicle 1 , and in such cases, it would not be necessary to record the video information, etc., by determining that a new recording condition occurred.
- the CPU 24 determines whether or not the usual video information recording time (12 seconds before and 8 seconds after the occurrence of the recording condition) has been extended as will be described later (S 42 ).
- the recording time is extended by a predetermined length of time (for example, 4 seconds) (S 45 ). That is, if the recording condition holds a second time during the recording of the video information, more specifically, in the second half of the 8-second period after the occurrence of the previous recording condition, the recording time of the video information, etc., is extended, because if not extended, the amount of time to record the video information after the occurrence of the current recording condition would become too short. As a result, in the case of S 45 , the video information, etc., are recorded for a total of 24 seconds, i.e., 12 seconds before and 12 seconds after the occurrence of the recording condition.
- the time elapsed from the occurrence of the previous recording condition is not shorter than T2 seconds (for example, 8 seconds)
- T2 seconds for example, 8 seconds
- the video information, etc. are recorded for 12 seconds before and 8 seconds after the occurrence of that recording condition.
- the process proceeds to S 46 , and the video information, etc., are recorded for 12 seconds before and 8 seconds after the occurrence of that recording condition.
- the recording time is not re-extended (S 48 ). That is, the detection of the current recording condition is ignored. The reason is that if the recording time were extended again, the video information, etc., for the same event would be recorded for too long a time.
- FIG. 14 is a diagram showing an example (1) of the video information recording based on the G detection.
- FIG. 14( a ) shows a graph of the G value 50 obtained in the process flow of FIG. 11
- FIG. 14( b ) is a diagram showing the video information being stored in the second RAM 15 in a continuously looping fashion and the video information transferred for recording on the memory card 6 .
- the G value after first dropping to or below the first threshold, increases to or above the second threshold at t0 and, thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1.
- the period from t0 to t1 is longer than T2 seconds.
- FIG. 15 is a diagram showing an example (2) of the video information recording based on the G detection.
- FIG. 15( a ) is a diagram showing an example (2) of a graph of the G value 60 obtained in the process flow of FIG. 11
- FIG. 15( b ) is a diagram showing the video information being stored in the second RAM 15 in a continuously looping fashion and the video information transferred for recording on the memory card 6 .
- the G value after first dropping to or below the first threshold, increases to or above the second threshold at t0 and, thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1, after which the G value once again drops to or below the first threshold and then increases once again to or above the second threshold at t2.
- the period from t0 to t1 is shorter than T2 seconds, and the period from t0 to t2 is longer than T3 seconds.
- FIG. 16 is a diagram showing an example (3) of the video information recording based on the G detection.
- FIG. 16( a ) is a diagram showing an example (3) of a graph of the G value 70 obtained in the process flow of FIG. 11
- FIG. 16( b ) is a diagram showing the video information being stored in the second RAM 15 in a continuously looping fashion and the video information transferred for recording on the memory card 6 .
- the G value after first dropping to or below the first threshold, increases to or above the second threshold at t0 and, thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1, then dropping and increasing in a similar manner at t2, t3, and t4, respectively.
- the period from t0 to t1 is shorter than T1 seconds
- the period from t0 to t2 is shorter than T2 seconds
- the period from t0 to t3 is shorter than T3 seconds
- the period from t0 to t4 is longer than T3 seconds.
- the recording condition at t3 is ignored in accordance with S 48 of FIG. 13 .
- the recording condition holds at t4, and video information 76 for 12 seconds before and 8 seconds after t4 is recorded as another event 77 on the memory card 6 in accordance with S 49 of FIG. 13 .
- the video information recorded as the event 74 and the video information recorded as the event 77 partially overlap, as shown in FIG. 16( b ).
- FIG. 17 is a diagram showing an example (4) of the video information recording based on the G detection.
- FIG. 17( a ) is a diagram showing an example (4) of a graph of the G value 80 obtained in the process flow of FIG. 11
- FIG. 17( b ) is a diagram showing the video information being stored in the second RAM 15 in a continuously looping fashion and the video information transferred for recording on the memory card 6 .
- the G value after first dropping to or below the first threshold, increases to or above the second threshold at t0, and thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1, the G value then continuing to remain above the second threshold.
- the recording condition holds at t0, video information 81 , etc., for 12 seconds before and 8 seconds after t0 are recorded as one event 82 on the memory card 6 in accordance with S 46 of FIG. 13 . Since t1 is shorter than T1 seconds, the recording condition at t1 is ignored in accordance with S 44 of FIG. 13 . Further, since thereafter the G value does not drop to or below the first threshold, if a G value equal to or greater than the second threshold is detected, it is determined in S 40 of FIG. 13 that the recording condition does not hold.
- the example of FIG. 17 corresponds, for example, to a situation where the driver applied hard braking at t0 but was unable to avoid a collision, and the vehicle 1 rolled over at t1, the acceleration sensor 5 thereafter continuing to output high G values due to the rolling over of the vehicle.
- the voltage drop processing refers to the processing performed to properly protect video information being recorded, etc., in such cases as when the output voltage of the battery 21 has dropped due to, for example, the damage caused by an accident of the vehicle 1 , or the like.
- FIG. 18 is a diagram showing a voltage drop process flow ( 1 ).
- the CPU 24 constantly monitors the output of the first detector 43 (see FIG. 6 ) to detect a H to L transition of the first voltage drop signal S 1 (S 50 ). As earlier described with reference to FIG. 6 , if the output voltage of the battery 21 drops to 8.0 V or below, the first detector 43 sets the first voltage drop signal S 1 from H to L.
- the CPU 24 determines whether the recording condition currently holds and video information, etc., are in the process of being written to the memory card 6 (S 52 ), and also determines whether a predetermined time (for example, 8 seconds) had elapsed from the occurrence of the recording condition when the first voltage drop signal S 1 was detected in S 50 (S 53 ).
- a predetermined time for example, 8 seconds
- the writing to the memory card is suspended, and the video information acquired for the 10 seconds preceding the occurrence of the trigger is recorded. In this case, the number of frames to be recorded is reduced. That is, the video information acquired for the 10 seconds preceding the detection of the first voltage drop signal is written to the memory card 6 at a rate of 5 frames per second (compared with the usual rate of 10 frames per second) by creating a special backup folder (S 54 ).
- the first voltage drop signal is detected, since it is highly likely that the drive recorder is unable to acquire new video information thereafter, control is performed to minimize the loss of information by saving the video information acquired up to that moment in the special backup folder. It is preferable to also save the vehicle operational information in the special backup folder together with the video information.
- processing is performed to reduce power consumption by cutting off power to the first camera 3 , the second camera 4 , the JPEG-IC constituting the image processing circuit 13 , and the GPS receiver 9 , thereby reserving power for writing the video information 6 to the memory card 6 (S 55 ).
- Power for the backup processing in S 54 is supplied from the backup battery 46 .
- the CPU 24 After completing the backup processing, the CPU 24 stops watchdog timer, and reboots itself (S 56 ) to terminate the sequence of operations.
- FIG. 19 is a diagram showing a voltage drop process flow ( 2 ).
- the CPU 24 constantly monitors the output of the second detector 44 (see FIG. 6 ) to detect a H to L transition of the second voltage drop signal S 2 (S 60 ). As earlier described with reference to FIG. 6 , if the output voltage of the first power supply circuit 40 (or the output voltage of the backup battery 46 ) drops to 3.7 V or below, the second detector 44 sets the second voltage drop signal S 2 from H to L.
- the CPU 24 determines the start time of a closing operation (S 61 ).
- FIG. 20 is a diagram showing voltage drops.
- Curve 90 in FIG. 20 shows the case where it took T4 seconds for the voltage to drop from 8.0 V to 3.7 V (the time from the detection of the first voltage drop to the detection of the second voltage drop) and T5 seconds for the voltage to drop from 3.7 V to 3.0 V (the time from the detection of the second voltage drop to the output of the reset signal), and curve 91 in FIG. 20 shows the case where it took T6 seconds for the voltage to drop from 8.0 V to 3.7 V and T7 seconds for the voltage to drop from 3.7 V to 3.0 V.
- the reset signal for preventing the erroneous operation of the CPU 24 , etc. is output from the third detector 45 when the voltage drops to 3.0 V, it is important to estimate the time left after the detection of the second voltage drop until the reset voltage is output. As shown in FIG. 20 , the time left after the detection of the second voltage drop until the reset voltage is output can be roughly estimated based on the time taken from the detection of the first voltage drop to the detection of the second voltage drop. It should be noted here that the closing operation takes about 500 ms to complete.
- the closing operation is started one second after the detection of the second voltage drop; on the other hand, if the time taken for the voltage to drop from 8.0 V to 3.7 V is less than one second, since the reset signal is highly likely to occur early, the closing operation is started immediately after the detection of the second voltage drop.
- the above time setting is only illustrative and not restrictive.
- the closing operation refers to the operation performed to close all of the currently opened files, thereby completing the writing of the video information to the memory card 6 . After the closing operation, writing to the memory card is prohibited. If the closing operation is not carried out properly, the video information recorded in the files may become unable to be used properly at a later time; therefore, even when the backup processing shown in FIG. 18 is in progress, the closing operation is performed by interrupting the backup processing.
- the CPU 24 After completing the closing operation, the CPU 24 stops watchdog timer, and reboots itself (S 63 ) to terminate the sequence of operations.
- FIG. 21 is a diagram showing a mode switching flow.
- the drive recorder 2 has an output port for connecting to the display unit 30 , and is constructed so that in the event of an accident or the like, the contents recorded on the memory card can be examined on the spot. That is, the drive recorder 2 of the present invention has a recording mode for recording the video information, etc., on the memory card 6 and a playback mode for playing back the video information recorded on the memory card 6 .
- the recording mode/playback mode switching flow will be described with reference to FIG. 21 .
- the CPU 24 starts up a boot program for initializing the drive recorder 2 (S 71 ).
- the CPU 24 loads a playback mode program from the nonvolatile ROM, and executes the program to operate the drive recorder 2 in the playback mode (S 73 ).
- the port associated with one of the connecting terminals of the memory card 6 produces a specific output; therefore, the CPU 24 can check, via the I/F 11 , whether the memory card 6 is write-protected or not.
- the CPU 24 activates the LED 25 and/or buzzer 26 to indicate that the drive recorder 2 is operating in the playback mode (S 74 ), and the sequence of operations is terminated.
- the CPU 24 loads a recording mode program from the nonvolatile ROM, and executes the program to operate the drive recorder 2 in the recording mode (S 75 ).
- the memory card 6 set to a write-unprotected state is inserted in the drive recorder 2 , and the mode is set to the recording mode; in this condition, video information, etc., are recorded each time the recording condition holds as earlier described.
- the user if the user desires to check the recorded contents on the spot, the user removes the memory card 6 and sets its switch to the write-protection position; then, the memory card 6 is inserted in the drive recorder 2 , whereupon the mode is changed to the playback mode so that the video information recorded on the memory card 6 can be played back.
- the playback mode setting method is not limited to the above one. Various other methods are possible, one possible method being such that if the image capture switch 8 is operated in a predetermined manner within a predetermined time after power on, the mode is set to the playback mode, but if it is not operated in the predetermined manner, the mode is set to the recording mode.
- the above has described one method devised to make effective use of the image capture switch 8 which is the only one operating means provided on the drive recorder 2 , but it will be appreciated that an additional operating means may be provided on the drive recorder 2 .
- the CPU 24 If the image capture switch is not operated within a predetermined time (for example, at least 30 seconds) after the playback mode is entered, it is preferable for the CPU 24 to reboot itself (see S 71 ) and start up the process once again. In this case, by sounding the playback mode buzzer after restarting, an audible warning can be issued prompting the user to release the playback mode.
- a predetermined time for example, at least 30 seconds
- FIG. 22 is a diagram showing a playback sequence. As shown in FIG. 22 , by pressing and holding down the image capture switch 8 , control can be performed to play back the recorded events one after another, starting from the most recently recorded 15th event (S 80 ) and progressing toward the first recorded event (S 85 ). If the image capture switch 8 is pressed and held down during the playback of the first event, the playback of the 15th event starts.
- FIG. 23 is a diagram showing an example of the operation flow of the memory card 6 .
- the user sets the memory card 6 to a write-unprotected state, and inserts it into the I/F 411 of the playback apparatus 400 to initialize the card (S 90 ).
- the CPU 424 erases the data, etc., recorded on the memory card 6 and writes the ID of the user (for example, a taxi driver) of the memory card 6 to a predetermined address in the memory card 6 .
- the user when the user starts the operation of the vehicle 1 (for example, when the taxi driver as the user starts his duty for the day (07:45 to 17:15)), the user inserts the initialized and write-protected memory card 6 into the I/F 11 of the drive recorder 2 installed in the vehicle 1 , and sets the drive recorder 2 to the recording mode to start data recording (S 91 ).
- the CPU 24 records on the memory card 6 the video information and vehicle operational information captured for a predetermined period of time (for example, 20 seconds).
- the user removes the memory card 6 , on which data has been recorded, from the I/F 11 of the drive recorder 2 . Then, the user inserts the memory card 6 into the I/F 411 of the playback apparatus 400 , and loads the video information, vehicle operational information, memory card ID, user ID, etc., recorded on the memory card 6 into the playback apparatus 400 (S 92 ).
- the video information, vehicle operational information, memory card ID, and user ID recorded on the memory card 6 are loaded into the playback apparatus 400 on a per-duty and per-vehicle basis under the control of the CPU 424 .
- the playback apparatus 400 not only can the data recorded on each memory card be analyzed on an individual basis, but after loading data from different memory cards 6 used to record the operations of different vehicles, the data can be analyzed in a collective manner. Further, the same memory card 6 may be used for different vehicles or for recording the operations of the same vehicle over more than one duty.
- the drive recorder 2 acquires video information using the first and second cameras 3 and 4 , but the field of vision with which the driver actually sees the surroundings is different from the field of vision that each camera has.
- the field of vision of a human is the range in which a human can see without moving his eyes, and generally, when the vehicle 1 is stationary, the field of human vision with two eyes is about 200 degrees horizontally and about 112 degrees vertically. As the speed of the vehicle 1 increases, the driver's eyes tend to focus on objects farther ahead, causing near objects to appear blurred, and the field of vision of the driver thus decreases. Further, since the field of vision tends to decrease with age, the field of vision of an elderly driver is not the same as that of a younger driver. Generally, the field of vision of elderly people (for example, 60 years or older) is narrower than that of younger people (for example, younger than 60 years). As an example, it can be considered that the field of vision is narrower by 20%. FIG.
- FIG. 24 is a diagram showing a mapping table that provides a mapping between the speed of the vehicle 1 and the horizontal and vertical fields of vision as used in the playback apparatus 400 .
- the area defined by the horizontal and vertical fields of vision i.e., the range that the driver can see without moving his eyes, will be referred to as the field of vision area.
- the playback apparatus 400 when playing back the video information acquired by the drive recorder, the field of vision range in which the driver actually sees the surroundings is identified to help to investigate how an accident or the like can occur. By thus identifying the field of vision range, it also becomes possible to use the video for safe driving education of drivers.
- the playback apparatus 400 is constructed so that when displaying the video information concerning any particular event on the display unit 440 , the playback apparatus 400 can detect the vehicle speed from the vehicle speed data in the vehicle operational information, obtain the corresponding field of vision angles from the mapping table shown in FIG. 24 (the mapping table is stored in the playback apparatus 400 ), and display the field of vision range on the screen under the control of the CPU 424 in accordance with the control program 417 .
- the playback apparatus 400 provides the following five field-of-vision-range playback modes so that by operating the operation unit 430 , the user can select one of the modes to playback the video information.
- Fixed angle mode Displays only the field of vision range that corresponds to the horizontal and vertical field of vision angles specified by the operation unit 430 .
- Instantaneous vehicle speed mode Displays only the field of vision range that corresponds to the horizontal and vertical field of vision angles corresponding to the vehicle speed detected at the instant that the recording condition occurred.
- Playback image-based vehicle speed mode Sequentially displays the field of vision ranges that correspond to the horizontal and vertical field of vision angles corresponding to the vehicle speeds applicable to sequentially presented still images.
- Fixed vehicle speed mode Displays only the field of vision range that corresponds to the horizontal and vertical field of vision angles corresponding to the vehicle speed specified by the operation unit 430 .
- the field of vision angles can be corrected for the elderly.
- FIG. 25 is a diagram showing an example of a screen for displaying the video information recorded on the memory card 6 .
- the screen of FIG. 25 and any operation that the user performs on the screen are displayed on the display unit 440 under the control of the CPU 424 in accordance with the control program 417 and based on the data stored on the card information recording unit 460 .
- the screen 140 presented on the display unit 440 displays ID number data 141 of the memory card 6 , time information 142 contained in the vehicle operational information, kind information 143 indicating the kind of the recording condition that occurred, latitude information 144 contained in the position information, longitude information 145 contained in the position information, G value 146 obtained in accordance with the flow of FIG.
- driving situation information 147 to be described later that indicates the driving situation when the presented still image was captured, an area 148 - 1 in which still images captured by the first camera 3 are sequentially displayed, an area 148 - 2 in which still images captured by the second camera 4 are sequentially displayed, operation buttons 149 (rewind, playback, stop, fast forward) for controlling the display of the still images captured by the first camera 3 and second camera 4 , vehicle speed information 150 indicating the vehicle speed detected when the presented still image was captured, an area 151 for displaying the selected field-of-vision-range playback mode, and an area 152 for displaying whether correction for the elderly is applied or not.
- the area 148 - 1 displays a first frame 153 - 1 defining the field of vision range and a second frame 153 - 2 defining the field of vision range corrected for the elderly.
- the area 148 - 2 displays a first frame 154 - 1 defining the field of vision range and a second frame 154 - 2 defining the field of vision range corrected for the elderly.
- the area 152 indicates that correction for the elderly is applied, but when correction for the elderly is not applied, the second frames 153 - 2 and 154 - 2 are not displayed.
- the field of vision ranges can be displayed clearly by displaying the areas outside the first and second frames differently than the areas inside the respective frames.
- the field of vision area defined by the horizontal field of vision angle (140 degrees) and vertical field of vision angle (78 degrees) corresponding to the vehicle speed (for example, 40 km/h) detected at the instant that the recording condition occurred (see FIG. 24 ) is shown by the first frame 153 - 1 within the area 148 - 1 .
- the field of vision area defined by the horizontal field of vision angle (112 degrees) and vertical field of vision angle (63 degrees), corrected for the elderly, corresponding to the vehicle speed (for example, 40 km/h) detected at the instant that the recording condition occurred (see FIG. 24 ) is shown by the second frame 153 - 2 within the area 148 - 1 .
- the field of vision areas are likewise shown within the area 148 - 2 .
- 100 still images captured for 10 seconds by the first camera 3 and 100 still images captured for 10 seconds by the second camera 4 are sequentially displayed on the respective display areas 148 - 1 and 148 - 2 under the control of the operation buttons 149 operated by the user.
- the various pieces of information associated with the displayed still images are displayed in the display/input areas 141 to 147 and 150 .
- the screen 140 shown in FIG. 25 is only one example, and any other suitable screen design may be employed.
- the video information acquired by the drive recorder can be checked by discriminating between the area that actually corresponds to the driver's field of vision range and the area that corresponds to the camera's field of vision range. Further, by correcting the field of vision range according to age, the driver's field of vision range can be brought further closer to that in the actual situation.
- the recording condition and the video information are displayed on the same screen, but they need not necessarily be displayed on the same screen; for example, an operation button for displaying the recording condition may be displayed on the same screen as the image, with provisions made to display the recording condition in a separate window by operating the operation button.
- FIG. 26 is a diagram showing a process flow for identifying the driving situation.
- the video information, etc. concerning each event that triggered the recording condition are recorded on the memory card 6 .
- the playback apparatus 400 has the function of automatically identifying each event in accordance with the process flow of FIG. 26 by using the recorded video information and vehicle operational information.
- the driving situations to be identified here are classified into the following five categories: “abrupt starting,” “hard braking,” “normal braking,” “abrupt left turn steering,” and “abrupt right turn steering.”
- the CPU 424 selects a particular event, and acquires as sample data the G1 value (the output of the axis of the acceleration sensor 5 in the direction parallel to the longitudinal direction of the vehicle 1 ), G2 value (the output of the axis of the acceleration sensor 5 in the direction parallel to the transverse direction of the vehicle 1 ), and vehicle speed data for each of the 30 still images captured before and after the occurrence of the recording condition (S 100 ).
- the CPU 424 calculates the slope of change in the sample by applying the method of least squares to the values at 10 points before and after that sample (S 101 ). Then, for each sample sequence, the CPU 424 identifies the peaks of the slope waveform before and after the occurrence of the recording condition (S 102 ).
- the CPU 424 identifies the driving situation for the particular event (S 103 ), after which the sequence of operations is terminated.
- the driving situation identified for each particular event is displayed (in the area 147 of FIG. 25 ) on the display unit 440 when displaying the video information related to that event. Further, an icon representing the identified driving situation is displayed in a superimposing fashion on the image, for example, in the upper right corner of the image. This enables the user to properly recognize the driving situation for the event being played back. Further, since the events can be searched based on the category of the driving situation, the search range can be narrowed. In this way, only the driving situation that the user desires to check can be extracted and the associated images played back.
- FIG. 27 is a diagram showing a sample sequence, etc.
- FIG. 27 shows the sample sequence 200 representing the samples of the G1 value acquired for a particular event in accordance with S 100 in FIG. 26 .
- Waveform 210 is the slope waveform constructed by joining the slopes of the samples in the sample sequence 200 , obtained in accordance with S 101 in FIG. 26 . Further, point 220 indicates the peak of the waveform 210 before the occurrence of the recording condition, and point 230 indicates the peak of the waveform 210 after the occurrence of the recording condition.
- FIG. 28 is a diagram showing one example of the peak master file.
- the ranges of values i.e., the upper and lower limit values, that the peak values (see S 102 in FIG. 26 ) of the G1 value, G2 value, and vehicle speed, respectively, can take before and after the occurrence of the recording condition, are defined for each of the five driving situations, and the driving situation is identified (S 103 in FIG. 26 ) by determining within which of the upper/lower limit value ranges shown in FIG. 28 each peak value identified in S 102 of FIG. 26 falls.
- hatched areas are the areas where the peaks are defined, and peak values are not defined in other areas.
- the values defined in the peak master file of FIG. 28 can be corrected using the edit screen 160 displayed on the display unit 440 as shown in FIG. 29 .
- the edit screen 160 shown in FIG. 29 is one for correcting the conditions concerning abrupt starting.
- the values defined in the peak master file of FIG. 28 are only examples, and other suitable values can be employed; further, vehicle speed can be added as a condition.
- FIG. 30 is a diagram showing a typical pattern representing an abrupt starting situation.
- FIG. 30( a ) shows a G2-value sample sequence 300
- FIG. 30( b ) shows a G1-value sample sequence 301
- FIG. 30( c ) shows a vehicle-speed sample sequence 302 .
- the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition.
- the slope waveform 303 of each sample is obtained from the G1-value sample sequence 301 , and since the peak value 304 before the occurrence of the recording condition falls within the range of ⁇ 0.2 to ⁇ 2.0, it is determined that the driving situation corresponds to abrupt starting.
- FIG. 31 is a diagram showing a typical pattern representing a hard braking situation.
- FIG. 31( a ) shows a G2-value sample sequence 310
- FIG. 31( b ) shows a G1-value sample sequence 311
- FIG. 31( c ) shows a vehicle-speed sample sequence 312 .
- the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition.
- the slope waveform 313 of each sample is obtained from the G1-value sample sequence 311 , and since the peak value 314 before the occurrence of the recording condition falls within the range of 3.0 to 0.5, and the peak value 315 after the occurrence of the recording condition falls within the range of ⁇ 0.4 to ⁇ 3.0, it is determined that the driving situation corresponds to hard braking.
- FIG. 32 is a diagram showing a typical pattern representing a normal braking situation.
- FIG. 32( a ) shows a G2-value sample sequence 320
- FIG. 32( b ) shows a G1-value sample sequence 321
- FIG. 32( c ) shows a vehicle-speed sample sequence 322 .
- the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition.
- the slope waveform 323 of each sample is obtained from the G1-value sample sequence 321 , and since the peak value 324 before the occurrence of the recording condition falls within the range of 0.5 to 0.05, and the peak value 325 after the occurrence of the recording condition falls within the range of ⁇ 0.05 to ⁇ 0.5, it is determined that the driving situation corresponds to normal braking.
- FIG. 33 is a diagram showing a typical pattern representing an abrupt left turn steering situation.
- FIG. 33( a ) shows a G2-value sample sequence 330
- FIG. 33( b ) shows a G1-value sample sequence 331
- FIG. 33( c ) shows a vehicle-speed sample sequence 332 .
- the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition.
- the slope waveform 333 of each sample is obtained from the G2-value sample sequence 330 , and since the peak value 334 before the occurrence of the recording condition falls within the range of 2.0 to 0.1, it is determined that the driving situation corresponds to abrupt left turn steering.
- FIG. 34 is a diagram showing a typical pattern representing an abrupt right turn steering situation.
- FIG. 34( a ) shows a G2-value sample sequence 340
- FIG. 34( b ) shows a G1-value sample sequence 341
- FIG. 34( c ) shows a vehicle-speed sample sequence 342 .
- the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition.
- the slope waveform 343 of each sample is obtained from the G2-value sample sequence 340 , and since the peak value 344 before the occurrence of the recording condition falls within the range of ⁇ 0.1 to ⁇ 2.0, it is determined that the driving situation corresponds to abrupt right turn steering.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Time Recorders, Dirve Recorders, Access Control (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- The present invention relates to a drive recorder, and more particularly to a drive recorder that records video information by detecting acceleration using an acceleration sensor.
- In the prior art, a vehicle-mounted video recording apparatus has been proposed, generally known as a vehicle drive recorder, that captures the view outside of a vehicle by a camera mounted on the vehicle and records the captured view along with vehicle speed upon detecting an impact to the vehicle, such as a collision, hard braking, etc. When such a drive recorder is mounted in a vehicle, it is possible, in the event of a vehicle accident, to investigate the cause of the accident by analyzing the recorded information. Furthermore, not only does the drive recorder serve to enhance the driver's awareness of safe driving, but also records the driver's usual driving habits, for example, for safe driving guidance.
-
Patent documents patent documents - Patent document 1: Japanese Unexamined Patent Publication No. S63-16785
- Patent document 2: Japanese Unexamined Patent Publication No. H06-237463
- Patent document 3: Japanese Unexamined Patent Publication No. H06-331391
- Patent document 4: Japanese Unexamined Patent Publication No. H06-186061
- When detecting acceleration being applied to a vehicle by using an acceleration sensor incorporated in the drive recorder, the acceleration sensor can detect high acceleration values repetitively, such as when the driver applies hard braking repetitively or when the vehicle has collided with an obstacle immediately after hard braking.
- Generally, in the drive recorder, if the acceleration information from the acceleration sensor equals or exceeds a threshold, it is determined that the recording condition holds, and video information captured for a predetermined period of time before and after the occurrence of the recording condition is recorded on a recording medium; in this case, if the acceleration information from the acceleration sensor exceeds the threshold repetitively, video information captured for the predetermined period of time before and after the occurrence of the recording condition will be recorded on the recording medium each time the recording condition holds.
- That is, if acceleration information equal to or greater than the threshold is detected repetitively within a short period of time, there is the possibility that the same video information may be recorded in an overlapping fashion repetitively on the recording medium having a limited capacity.
- Accordingly, it is an object of the present invention to provide a drive recorder that can record all video information required and only what is required.
- Further, when detecting acceleration by using an acceleration sensor, if the acceleration sensor malfunctions, the acceleration sensor can continue to output acceleration information equal to or greater than the predetermined value. Further, in such cases as when the vehicle has rolled over due to hard braking, the acceleration sensor can also continue to output acceleration information equal to or greater than the predetermined value.
- In the drive recorder, if provisions are made to record the video information by determining that the recording condition holds whenever the acceleration information from the acceleration sensor becomes equal to or exceeds the predetermined value, then if, in such cases, the acceleration sensor continues to output acceleration information equal to or greater than the predetermined value, video information that need not necessarily be recorded will continue to be recorded on the recording medium.
- Accordingly, it is an object of the present invention to provide a drive recorder that can record all video information required and only what is required, by determining that the recording condition holds only when the acceleration applied to the vehicle is properly detected.
- There is provided a drive recorder for recording video information received from an image capturing unit onto a recording medium, includes an acceleration sensor which outputs acceleration information representing an acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records video information captured for a first predetermined period of time before the occurrence of the recording condition and video information captured for a second predetermined period of time after the occurrence of the recording condition on the recording medium when the acceleration information equals or exceeds a threshold, wherein after the recording condition once holds, the control unit does not records newly captured video information on the recording medium when the acceleration information again becomes equal to or exceeds the threshold in less than a third predetermined period of time which is shorter than the second predetermined period of time.
- There is also provided a drive recorder for recording video information received from an image capturing unit onto a recording medium, includes an acceleration sensor which outputs acceleration information representing an acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records video information captured for a first predetermined period of time before the occurrence of the recording condition and video information captured for a second predetermined period of time after the occurrence of the recording condition on the recording medium when the acceleration information equals or exceeds a threshold, wherein after the recording condition holds, the control unit does not record newly captured video information on the recording medium when the acceleration information again becomes equal to or exceeds the threshold within the second predetermined period of time, and records newly captured video information on the recording medium when the recording condition again holds after the second predetermined period of time has elapsed.
- There is also provided a drive recorder for recording video information received from an image capturing unit onto a recording medium, includes an acceleration sensor which outputs acceleration information representing an acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records video information captured for a first predetermined period of time before the occurrence of the recording condition and video information captured for a second predetermined period of time after the occurrence of the recording condition on the recording medium when the acceleration information equals or exceeds a threshold, wherein after the recording condition holds, the control unit continues the recording of the video information on the recording medium even after the second predetermined period of time has elapsed when the acceleration information again becomes equal to or exceeds the threshold within the second predetermined period of time.
- According to the drive recorder of the present invention, when the acceleration information again becomes equal to or exceeds the threshold within a relatively short period of time, newly captured video information is not transferred for recording on the recording medium, thus preventing the same video information from being recorded on the recording medium in an overlapping fashion; this makes efficient use of the recording medium having a limited capacity.
- There is also provided a drive recorder including an acceleration sensor which outputs acceleration information representing acceleration applied to a vehicle, and a control unit which determines that a recording condition holds and records the video information on a recording medium when the acceleration information, after dropping to or below a first threshold, exceeds a second threshold which is greater than the first threshold.
- According to the drive recorder of the present invention, since it is determined that the recording condition holds only when acceleration information equal to or greater than the second threshold large enough to indicate the occurrence of an accident or the like is detected after the acceleration information has dropped to or below the relatively low second threshold, video information that need not necessarily be recorded can be prevented from continuing to be recorded on the recording medium.
-
FIG. 1 is a diagram showing an example in which a drive recorder is mounted in a vehicle. -
FIG. 2 is a diagram showing an example of how the drive recorder, etc., are arranged in the vehicle. -
FIG. 3 is a perspective view of the main unit of the drive recorder. -
FIG. 4 is a diagram showing an example of an external view of a playback apparatus. -
FIG. 5 is a block diagram showing the electrical configuration of the drive recorder. -
FIG. 6 is a block diagram showing the electrical configuration of a power control circuit. -
FIG. 8 is a diagram showing an example of a process flow of the drive recorder. -
FIG. 9 is a diagram showing a self-diagnosis process flow of the drive recorder. -
FIG. 10( a) is a diagram showing an arrangement in which thedrive recorder 2 is installed in an upright position in thevehicle 1,FIG. 10( b) is a diagram showing an arrangement in which thedrive recorder 2 is installed in a horizontal position in thevehicle 1, andFIG. 10( c) is a diagram showing an arrangement in which thedrive recorder 2 is tilted by an angle θ relative to the position shown inFIG. 10( b). -
FIG. 11 is a diagram showing a G-value detection process flow. -
FIG. 12 is a diagram showing a process flow for verifying the outputs of anacceleration sensor 5. -
FIG. 13 is a process flow for G detection. -
FIG. 14( a) is a diagram showing an example (1) of a graph of theG value 50 obtained in the process flow ofFIG. 11 , andFIG. 14( b) is a diagram showing video information being stored in asecond RAM 15 in a continuously looping fashion and video information transferred for recording on amemory card 6. -
FIG. 15( a) is a diagram showing an example (2) of a graph of theG value 60 obtained in the process flow ofFIG. 11 , andFIG. 15( b) is a diagram showing video information being stored in thesecond RAM 15 in a continuously looping fashion and video information transferred for recording on thememory card 6. -
FIG. 16( a) is a diagram showing an example (3) of a graph of theG value 70 obtained in the process flow ofFIG. 11 , andFIG. 16( b) is a diagram showing video information being stored in thesecond RAM 15 in a continuously looping fashion and video information transferred for recording on thememory card 6. -
FIG. 17( a) is a diagram showing an example (4) of a graph of theG value 80 obtained in the process flow ofFIG. 11 , andFIG. 17( b) is a diagram showing video information being stored in thesecond RAM 15 in a continuously looping fashion and video information transferred for recording on thememory card 6. -
FIG. 18 is a diagram showing a voltage drop process flow (1). -
FIG. 19 is a diagram showing a voltage drop process flow (2). -
FIG. 20 is a diagram showing voltage drops. -
FIG. 21 is a diagram showing a mode switching flow. -
FIG. 22 is a diagram showing a playback sequence. -
FIG. 23 is a diagram showing an example of the operation flow of thememory card 6. -
FIG. 24 is a diagram showing a mapping table for field of vision ranges. -
FIG. 25 is a diagram showing an example of a screen for displaying video information. -
FIG. 26 is a diagram showing a process flow for identifying a driving situation. -
FIG. 27 is a diagram showing a sample sequence, etc. -
FIG. 28 is a diagram showing one example of a peak master file. -
FIG. 30( a) is a diagram showing a G2-value sample sequence 300,FIG. 30( b) is a diagram showing a G1-value sample sequence 301, andFIG. 30( c) is a diagram showing a vehicle-speed sample sequence 302. -
FIG. 31( a) is a diagram showing a G2-value sample sequence 310,FIG. 31( b) is a diagram showing a G1-value sample sequence 311, andFIG. 31( c) is a diagram showing a vehicle-speed sample sequence 312. -
FIG. 32( a) is a diagram showing a G2-value sample sequence 320,FIG. 32( b) is a diagram showing a G1-value sample sequence 321, andFIG. 32( c) is a diagram showing a vehicle-speed sample sequence 322. -
FIG. 33( a) is a diagram showing a G2-value sample sequence 330,FIG. 33( b) is a diagram showing a G1-value sample sequence 331, andFIG. 33( c) is a diagram showing a vehicle-speed sample sequence 332. -
FIG. 34( a) is a diagram showing a G2-value sample sequence 340,FIG. 34( b) is a diagram showing a G1-value sample sequence 341, andFIG. 34( c) is a diagram showing a vehicle-speed sample sequence 342. - Embodiments of the present invention will be described in detail below with reference to the drawings. It should be noted, however, that the technical scope of the present invention is not limited to the specific embodiments described herein, but extends to the inventions described in the appended claims and their equivalents. It should also be noted that the present invention can be carried out in other ways by making various changes without departing from the spirit and scope of the invention.
- First, information recording in a drive recorder will be described.
-
FIG. 1 is a diagram showing an example in which thedrive recorder 2 is mounted in avehicle 1. - The
drive recorder 2 mounted in thevehicle 1 is connected to afirst camera 3 for capturing a view ahead of thevehicle 1 and asecond camera 4 for capturing a view behind thevehicle 1. Video information from thefirst camera 3, etc., is stored in asemiconductor storage unit 15 in a continuously looping fashion. If a predetermined recording condition holds, the video information stored in thesemiconductor storage unit 15 is transferred for recording on amemory card 6. The predetermined recording condition refers to an event that occurs, for example, when thevehicle 1 is subjected to an impact due to an accident or the like, and the details will be described later. - In addition to the video information, the
drive recorder 2 acquires vehicle operational information including vehicle speed information, and stores the information in a continuously looping fashion in thesemiconductor storage unit 15 contained in thedrive recorder 2. Each time the recording condition holds, the vehicle operational information is recorded on thememory card 6 together with the video information by being associated with the video information. The details of the vehicle operational information will be described later. -
FIG. 2 is a diagram showing an example of how thedrive recorder 2 is arranged in thevehicle 1. - The
drive recorder 2 is fixed, for example, to one side of the center panel at a position to the lower left of the steering wheel, and is electrically connected to the first camera 3 (and thesecond camera 4 not shown inFIG. 2 ) and also to aGPS sensor 9, avehicle speed sensor 10 not shown, abattery 21 not shown, a vehicle-mounteddisplay unit 30, etc. Thefirst camera 3, which is attached to the inside of the windshield behind the rearview mirror in the passenger compartment, captures the view ahead of the vehicle and transmits video information to thedrive recorder 2. -
FIG. 3 is a perspective view of the main unit of thedrive recorder 2. - The
drive recorder 2 includes amicrophone 7, an image capture switch 8, apower switch 20, anLED 25, abuzzer 26, an open/close sensor 27 not shown, and an open/close knob 31. - The
microphone 7 picks up sound inside thevehicle 1. The image capture switch 8 is used to enter various inputs to thedrive recorder 2, such as the timing for starting to record video information in thedrive recorder 2 and the initialization of thedrive recorder 2. TheLED 25 andbuzzer 26 each have the function of alerting the user to the condition of thedrive recorder 2 by generating a visual or audible warning, etc. - After the
memory card 6 is inserted into a slot of an I/F 11 to be described later, the open/close knob 31 is moved slidingly into position to provide a protective covering for the memory card 6 (this condition is shown inFIG. 3 ). When removing thememory card 6, the open/close knob 31 is slid in the direction of arrow A. The open/close sensor 27 in thedrive recorder 2 operates in conjunction with the open/close knob 31, and outputs an OFF signal indicating “closed” when the open/close knob 31 is closed to cover the memory card 6 (the condition shown inFIG. 3 ) and an ON signal indicating “open” when the open/close knob 31 is opened to allow thememory card 6 to be removed. -
FIG. 4 is a diagram showing an example of an external view of a playback apparatus. - The video information, vehicle operational information, etc., recorded on the
memory card 6 are played back on theplayback apparatus 400 which includes a personal computer, etc. Thememory card 6 is inserted into the I/F connected to the personal computer, and the video information, vehicle operational information, etc. are loaded into the personal computer. The user can, for example, investigate the vehicle driving conditions or the cause of a vehicle accident by playing back the video information, vehicle operational information, etc. -
FIG. 5 is a block diagram showing the electrical configuration of thedrive recorder 2. - The
first camera 3 is constructed, for example, from a two-dimensional image sensor, such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and is controlled so as to capture the view ahead of thevehicle 1 and to output an analog video signal asfirst video information 500. - The
second camera 4 is installed as an additional camera in thevehicle 1, and is controlled so as to capture the view behind the vehicle or view in a direction different than thefirst camera 3, for example, in the direction of the passenger compartment, and to output an analog video signal assecond video information 501. If only one camera suffices, there is no need to connect thesecond camera 4 to thedrive recorder 2. - An
acceleration sensor 5 is constructed from a so-called G sensor (Gravity Accelerative Sensor) that detects the magnitude of an impact applied to thevehicle 1 as the magnitude of gravitational acceleration. This sensor is constructed from a semiconductor that, when subjected to an impact, produces a current proportional to the gravitational acceleration, and detects the magnitude of the gravitational acceleration in the longitudinal, as well as the transverse direction of the vehicle and then suppliesgravitational acceleration information 502 to aCPU 24. - The
memory card 6 is a storage medium removable from thedrive recorder 2, and is constructed from an SD card (Secure Digital Memory Card) which is a programmable nonvolatile semiconductor memory card. Thememory card 6 is used to store video information and vehicle operational information. Thememory card 6 is also used to separately store the recording condition to be described later and various other pieces of information such as the ID unique to thememory card 6 and data such as the ID or name of the user (for example, a taxi driver) that uses thememory card 6. Thememory card 6 is provided with a dip switch which can be used to write-protect thememory card 6. - In the present embodiment, an SD card is used as the removable storage medium, but alternatively, use may be made of other types of removable memory cards (for example, CF (Compact Flash) card or memory stick), hard disk, or the like. Further, a hard disk may be built into the
drive recorder 2 and used in place of thememory card 6; in that case, a transmitter circuit should be provided in thedrive recorder 2 so that the video information and vehicle operational information recorded on the hard disk can be transmitted to theplayback apparatus 400 by means of wireless communications. - The
microphone 7 is electrically connected to theCPU 24, and is configured to pick up sound inside or outside thevehicle 1 and to transmit the sound assound information 503 to theCPU 24. Thesound information 503 is converted into a digital signal by an analog/digital converter contained in theCPU 24. It is preferable to use a unidirectional microphone whose sensitivity is the highest in the forward direction of the microphone so as not to unnecessarily pick up noise from the road. - The image capture switch (capture SW) 8, when operated by the user, transmits a signal to the
CPU 24 electrically connected to it. In response, theCPU 24 performs control so that the video information and vehicle operational information stored in asecond RAM 15 are transferred for recording on thememory card 6. That is, the operation of the capture SW 8 serves as an event that triggers the recording condition. Provisions may be made to record on thememory card 6 only the video information captured at the moment the capture SW 8 is operated. As will be described later, the capture SW 8 is also used as an operating means for using other functions of thedrive recorder 2. - The GPS (Global Positioning System)
receiver 9 receives from a plurality of GPS satellites radio signals carrying information such as the orbits of the satellites and time data generated by the atomic clocks mounted in the satellites, and acquires current position information by computing the relative differences in distance to the respective satellites from the time differences between the received radiowaves. Any position on the Earth can be identified by capturing radiowaves from at least three satellites. TheGPS receiver 9 that detected the current position information transmits the position information and time information asGPS information 504 to theCPU 24. - The
vehicle speed sensor 10 is constructed from a magnetic sensor or optical sensor which converts the rotation of the rotor mounted on the driveshaft of thevehicle 1 into apulse signal 505 for output. TheCPU 24 computes the speed of thevehicle 1 by calculating the number of revolutions of the driveshaft per unit time from the pulse signal received from thevehicle speed sensor 10. - The interface (I/F) 11 also serves as a slot provided in the
drive recorder 2 for insertion of thememory card 6. The I/F 11 transfers recordedinformation 506, including the video information and vehicle operational information, from thedrive recorder 2 to the insertedmemory card 6, and transfers various pieces ofinformation 507 prestored in thedrive recorder 2 to theCPU 24. - A video switch (hereinafter “video SW”) 12 is a switch for selecting the camera to be used for image capturing when a plurality of cameras are installed. In the present embodiment, the first and
second cameras select signal 508 from theCPU 24. The video information from the selected camera is output as selected video information 509 to animage processing circuit 13. Thevideo SW 12 may be provided with a timekeeping function so as to switch from one camera to the other at predetermined intervals of time. - The selected video information 509 supplied from the first or
second camera video SW 12 is converted into a digital signal by theimage processing circuit 13 which thus creates andoutputs image data 510. Theimage processing circuit 13 is constructed from a JPEG-IC (Joint Photographic coding Experts Group—Integrated Circuit), and generates data in JPEG format. In this case, the JPEG-IC writes 30 files per second to a first RAM (Random Access Memory) 14 by overwriting on a file-by-file basis, because the JPEG-IC does not have the function of outputting the data by specifying the address. - The
first RAM 14 temporarily stores theimage data 510 converted by theimage processing circuit 13. Thefirst RAM 14 is connected to a DMA (Direct Memory Access) circuit contained in theCPU 24, and one in every three input video frames, which means 10 files per second, is transferred by the DMA function to thesecond RAM 15 where the data is stored in a continuously looping fashion. - Thus, the video information converted by the
image processing circuit 13 into the image data is stored in the second RAM (semiconductor storage unit) 15 in a continuously looping fashion together with the vehicle operational information. - The first and
second RAMs - A
nonvolatile ROM 16 stores programs such as acontrol program 17 for centrally controlling the hardware resources constituting thedrive recorder 2. A mask ROM may be used for thenonvolatile ROM 16, but if a programmable nonvolatile semiconductor memory, such as a flash memory, EEPROM (Erasable Programmable Read Only Memory), or ferroelectric memory, is used, it becomes possible to erase and rewrite programs. - The
control program 17 is stored in thenonvolatile ROM 16, is loaded into theCPU 24 during power on of thedrive recorder 2, and functions as a program for controlling various components and data processing operations. - An accessory switch (ACC switch) 19 is provided in an electrically integral fashion with the engine starting key cylinder of the
vehicle 1. When the switch is turned on by the user operating the key, an accessory ON signal 511 is transmitted to theCPU 24 and thepower control circuit 22 in thedrive recorder 2. In response to the accessory ON signal 511 from theACC switch 19, thepower control circuit 22 supplies power to thedrive recorder 2 which thus initiates control. Instead of the output signal of theACC switch 19, an ignition key output signal (IG ON signal) may be used. - The power switch (power SW) 20 transmits a power ON signal to the
CPU 24 and thepower control circuit 22 in thedrive recorder 2 when thepower SW 20 is turned on by the user. This switch can be used when it is desired to operate thedrive recorder 2 without turning on theACC switch 17. - The
battery 21 is mounted in thevehicle 1, and supplies power to the main unit of thedrive recorder 2. The battery also supplies power to thepower control circuit 22. Any battery can be used as long as it can be mounted in thevehicle 1 and can produce an electromotive force of 12 V. - The
power control circuit 22 supplies the power from thebattery 21 to theCPU 24 and other components of thedrive recorder 2. The details of thepower control circuit 22 will be described later. - The CPU (Central Processing Unit) 24 operates as a control unit for the
drive recorder 2, and is constructed from a microcomputer or the like. TheCPU 24 performs control of the various components of thedrive recorder 2, data processing operations, etc., in accordance with thecontrol program 17. - The
LED 25 lights up during power on of thedrive recorder 2 under control of theCPU 24, thus indicating to the user that the system is being powered on. Further, if a fault occurs in thedrive recorder 2, for example, theCPU 24 causes theLED 25 to flash on and off in a predetermined manner to indicate the occurrence of the fault to the user. - In the event of a fault in the
drive recorder 2, theCPU 24 also causes thebuzzer 26 to sound an alarm in a predetermined manner to indicate the occurrence of the fault to the user. - The open/
close sensor 27 outputs an open signal or closed signal as the open/close knob 31 is moved to the open position or closed position for insertion/removal of thememory card 6. - An RTC (Real Time Clock) 28 generates a signal corresponding to the current date and time and transmits the signal to the
CPU 24. - The
display unit 30 is constructed from a liquid crystal display or the like, and is used when playing back the video information recorded on thememory card 6 in a specific situation as will be described later.FIG. 2 has shown the configuration in which the display of a navigation system mounted in the vehicle is used as thedisplay unit 30, but a separate display may be used thedisplay unit 30. In the event of a vehicle accident, the cause of the accident can be investigated on the spot by using thedisplay unit 30. In any case, thedrive recorder 2 is preferably provided with an output port for outputting video information. - The
drive recorder 2 may be constructed as an apparatus dedicated to video recording and may be combined with thefirst camera 3, thesecond camera 4, theGPS receiver 9, and/or thedisplay unit 30, etc., into a single unit by housing them in the same cabinet. - Further, the
drive recorder 2 may be incorporated into an automotive navigation system. -
FIG. 6 is a block diagram showing the electrical configuration of thepower control circuit 22. - The
power control circuit 22 comprises a firstpower supply circuit 40, a secondpower supply circuit 41, a thirdpower supply circuit 42, afirst detector 43, asecond detector 44, athird detector 45, and abackup battery 46. - The first
power supply circuit 40 starts to operate when theACC switch 19 or thepower switch 20 is turned on, and functions as a constant voltage power supply that produces an output of 6.0 V by receiving power from thebattery 21 rated at 12.0 V. The output of the firstpower supply circuit 40 is supplied to the first andsecond cameras - The second
power supply circuit 41 functions as a constant voltage power supply that produces an output of 3.3 V by receiving power from the firstpower supply circuit 40 rated at 6.0 V. The output of the secondpower supply circuit 41 is supplied to the JPEG circuit constituting theimage processing circuit 13, as well as to theGPS receiver 9,CPU 24, etc. - The third
power supply circuit 42 functions as a constant voltage power supply that produces an output of 1.8 V by receiving power from the secondpower supply circuit 41 rated at 3.3 V. The output of the thirdpower supply circuit 42 is supplied to theCPU 24, etc. - The
first detector 43 detects the output voltage of thebattery 21 and, if the output voltage of thebattery 21 drops to 8.0 V or lower, supplies a first voltage drop signal S1 to theCPU 24. Thesecond detector 44 detects the output voltage of the firstpower supply circuit 40 and, if the output voltage of the firstpower supply circuit 40 drops to 3.7 V or lower, supplies a second voltage drop signal S2 to theCPU 24. Further, thethird detector 45 detects the output voltage of the secondpower supply circuit 41 and, if the output voltage of the secondpower supply circuit 41 drops to 3.0 V or lower, supplies a reset signal S3 to the JPEG circuit constituting theimage processing circuit 13 as well as to theGPS receiver 9 and theCPU 24 and thereby resets the components in order to prevent them from malfunctioning due to the low voltage. - The
backup battery 46 comprises two capacitors, and is constructed to be able to supply power so that, even when the output voltage of thebattery 21 has dropped, at least the JPEG circuit constituting theimage processing circuit 13, theGPS receiver 9, and theCPU 24 can operate for a predetermined period of time. When an impact is applied to the vehicle in the event of an accident, such as a collision, thebattery 21 may be damaged or the connecting line between thebattery 21 and the powersupply control circuit 22 may be broken; if this happens, thebackup battery 46 supplies the stored power to theCPU 24, etc., so that the video information, etc., currently being processed can be saved as much as possible. The processing performed at the time of a voltage drop will be described later. -
FIG. 7 is a block diagram showing the electrical configuration of theplayback apparatus 400. - An interface (I/F) 411 serves as a slot provided in the
playback apparatus 400 for insertion of thememory card 6. The I/F 411 transfers the video information, vehicle operational information, etc., recorded on thememory card 6 to theplayback apparatus 400. - A
RAM 414 is used to temporarily store data when aCPU 424 processes the video information, vehicle operational information, etc., transferred from thememory card 6. TheRAM 414 is constructed, for example, from SDRAM. - A
nonvolatile ROM 416 stores programs such as acontrol program 417 for centrally controlling the hardware resources constituting theplayback apparatus 400. Thenonvolatile ROM 416 is constructed, for example, from EEPROM, ferroelectric memory, or the like. - The
control program 417 is stored in thenonvolatile ROM 416, is loaded into theCPU 424 during power on of theplayback apparatus 400, and functions as a program for controlling various components and data processing operations. - The
CPU 424 operates as a control unit for theplayback apparatus 400, and is constructed from a microcomputer or the like. TheCPU 424 performs control of the various components of theplayback apparatus 400, data processing operations, etc., in accordance with thecontrol program 417. - An
operation unit 430 comprises a keyboard, mouse, etc., and is used as a means for entering operation inputs to theCPU 424 when the user operates theplayback apparatus 400. - A
display unit 440 is constructed from a liquid crystal display or the like, and is used to suitably display the video information, vehicle operational information, etc., recorded on thememory card 6. - A map
information recording unit 450 is constructed from a recording medium such as a hard disk or DVD, and stores map information including road information and speed limit information. - A card
information recording unit 460 is constructed from a recording medium such as a hard disk, and is used to record the video information, vehicle operational information, etc., transferred from thememory card 6. -
FIG. 8 is a diagram showing the overall process flow of thedrive recorder 2. - The process flow shown in
FIG. 8 is performed primarily by theCPU 24 in thedrive recorder 2 in cooperation with the various component elements of thedrive recorder 2 in accordance with thecontrol program 17. - When power is turned on to the
drive recorder 2 by turning on theACC switch 19 orpower switch 20, theCPU 24 performs power-up processing (S1). The power-up processing includes initialization by a boot program and self-diagnosis of the various elements related to thedrive recorder 2. The self-diagnosis will be described later. - When the power-up processing of the
drive recorder 2 is completed, theCPU 24 starts to store video information in thesecond RAM 15 in a continuously looping fashion (S2). More specifically, theCPU 24 acquires still image data (640×480 pixels) from thefirst camera 3 and thesecond camera 4, alternately, at a rate of 10 frames per second (i.e., still images from thecamera 3 and still images from thecamera 4 are respectively acquired at intervals of 0.2 second in an alternating fashion), and stores the thus acquired data in a continuously looping fashion in thesecond RAM 15 by way of thefirst RAM 14. Further, each time the still image data is acquired from thefirst camera 3 and thesecond camera 4, theCPU 24 acquires vehicle operational information and stores the vehicle operational information in a continuously looping fashion in thesecond RAM 15 by associating the information with the still image data. The intervals of time at which theCPU 24 acquires the still image data and the number of still image frames to be acquired, described above, are only illustrative and not restrictive. - Next, the
CPU 24 determines whether the recording condition hereinafter described holds or not (S3). If any of the following three events occurs, it is determined that the recording condition holds. One or two of the following events may be used, or some other event than the following three may be defined. - 1. G detection: The
acceleration sensor 5 has detected a gravitational acceleration of 0.40 G or greater. In this case, it is determined that the recording condition holds, because when such a gravitational acceleration is applied to thevehicle 1, the situation can be determined as being the occurrence of an accident or the imminence of an accident. The above set value (0.40 G) is only one example, and some other suitable value may be employed. The details will be described later. - 2. Speed trigger: The rate of change of the speed of the
vehicle 1 detected by thevehicle speed sensor 10 over a predetermined period of time has become equal to or exceeded a threshold value. For example, when the vehicle is traveling at a speed of 60 km/h or higher, if the rate of deceleration of the vehicle in one second has become equal to or exceeded 14 km/h, then it is determined that the recording condition holds. The reason is that when thevehicle 1 has decelerated at such a rate, the situation can be determined as being the occurrence of an accident or the imminence of an accident. The above criterion (when the vehicle is traveling at a speed of 60 km/h or higher, the rate of deceleration in one second becomes equal to or exceeds 14 km/h) is only one example, and some other suitable criterion may be employed. - 3. Image capture SW: The image capture SW 8 is operated.
- If the recording condition holds, the
CPU 24 performs control so that a total of 20 seconds of video information, i.e., 12 seconds before and 8 seconds after the occurrence of the recording condition (a total of 200 still images for each occurrence of the recording condition), is transferred together with its associated vehicle operational information from thesecond RAM 15 to thememory card 6 for recording thereon (S4). Further, when the recording condition holds, event data indicating the event that triggered the recording condition (i.e., data indicating one of the three above events) is also recorded on thememory card 6. Thememory card 6 has a capacity that can store video information, etc., for at least 15 events. - Provisions may be made so that, when the recording condition holds, the sound information acquired from the
microphone 7 for a total of 20 seconds, i.e., 12 seconds before and 8 seconds after the occurrence of the recording condition, is also recorded on thememory card 6 together with the video information, etc. Since the video information, vehicle operational information, etc., recorded on thememory card 6 can be displayed on theplayback apparatus 400, the user of thedrive recorder 2 can investigate the driving conditions of thevehicle 1 and the situation that led up to an accident. The length of time that theCPU 24 records the information on thememory card 6 when the recording condition holds (i.e., 12 seconds before and 8 seconds after the occurrence of the recording condition), described above, is only illustrative and not restrictive. - The vehicle operational information includes the following information.
- 1. Gravitational acceleration information (G1, G2) detected along the respective axes of the
acceleration sensor 5. - 2. Position information of the
vehicle 1 and time information detected by theGPS receiver 9. - 3. Speed information detected by the
vehicle speed sensor 10. - 4. ON/OFF information of the
ACC switch 19. - The contents of the vehicle operational information are not necessarily limited to the above information, but may also include information concerning the operation and driving of the
vehicle 1, such as the steering angle and the ON/OFF states of various lights including turn signal lights. - Next, the
CPU 24 determines whether a termination signal effected by the OFF signal of theACC switch 19 orpower switch 20 is received or not (S5); if the termination signal is received, termination processing is performed (S6) to terminate the sequence of operations. If the termination signal is not yet received, the process from S2 to S4 is repeated. - Self-diagnosis of the
drive recorder 2 will be described below. - The self-diagnosis of the
drive recorder 2 is performed in the power-up process (S1) in the process flow shown inFIG. 8 , and theacceleration sensor 5, the JPEG-IC constituting theimage processing circuit 13, theRTC 28, and the connection state of the first andsecond cameras drive recorder 2 is performed is that the data recorded by thedrive recorder 2 may be used as evidentiary data when investigating the cause of an accident, etc. It is therefore necessary to check in advance whether thedrive recorder 2 can record data properly and whether there is any problem with the recorded data. -
FIG. 9 is a diagram showing a process flow for the self-diagnosis of thedrive recorder 2. - First, of the three axes (x axis, y axis, and z axis) of the
acceleration sensor 5, theCPU 24 acquires the output G1 of a first predefined axis which is parallel to the longitudinal direction of thevehicle 1 and the output G2 of a second predefined axis which is parallel to the transverse direction of the vehicle 1 (S11). -
FIG. 10 is a diagram showing the positional relationship between thedrive recorder 2 and theacceleration sensor 5.FIG. 10( a) shows an arrangement in which thedrive recorder 2 is installed in an upright position in the vehicle 1 (seeFIG. 2) ,FIG. 10( b) shows an arrangement in which thedrive recorder 2 is installed in a horizontal position in thevehicle 1, andFIG. 10( c) shows an arrangement in which thedrive recorder 2 is tilted by an angle θ relative to the position shown inFIG. 10( b). InFIGS. 10( a) to 10(c), the direction of arrow B indicates the traveling direction of the vehicle. - The
acceleration sensor 5 has three axes, but when thedrive recorder 2 is arranged as shown inFIG. 10( a), the output of the x axis is defined as the output G1 of the first axis and the output of the y axis as the output G2 of the second axis, and the output of the z axis is not used. On the other hand, when thedrive recorder 2 is arranged as shown inFIG. 10( b), the output of the z axis is defined as the output G1 of the first axis and the output of the x axis as the output G2 of the second axis, and the output of the y axis is not used. Since thedrive recorder 2 uses theacceleration sensor 5 having three output axes, as described above, thedrive recorder 2 can be arranged in any desired orientation. However, in this case, it is required to determine in advance which axes are used as the first and second axes. Therefore, when installing thedrive recorder 2 in the vehicle, the two axes to be used are selected in advance from among the x, y, and z axes. - Next, the
CPU 24 determines whether any one of the outputs G1 and G2 of the first and second axes acquired in S11 has been producing a value of 1 G or greater for five seconds or longer (S12). In the normal condition, both axes should output 0 G; therefore, if an acceleration of 1 G or greater has been detected for five seconds or longer, it can be determined that some kind of fault has occurred in the acceleration sensor element. - If it is determined in S12 that neither axis has been outputting a value of 1 G or greater for five seconds or longer, the
CPU 24 switches a test mode pin (ST pin) on the acceleration sensor 5 (S13) to create a situation where vibration is generated electrically, and detects its output to determine whether any change has occurred in the output (S14). If the output of theacceleration sensor 5 does not change despite the switching of the ST pin, it can be determined that it is highly likely that theacceleration sensor 5 is not operating properly. - If a change in the output is detected in S14, the
CPU 24 proceeds to determine whether any one of the outputs G1 and G2 of the first and second axes acquired in S11 has been producing a value of 0.7 G or greater for five seconds or longer (S15). In such cases, it can be determined that while theacceleration sensor 5 itself may operate properly, it is highly likely that the axes predefined as the first and second axes do not match the initial setting, i.e., thedrive recorder 2 originally arranged as shown inFIG. 10( a) has been reoriented, for example, as shown inFIG. 10( b), but the setting of the output axes has not been changed. For example, when the position is changed from that shown inFIG. 10( a) to that shown inFIG. 10( b), the y axis originally set as the second axis is now pointing in the vertical direction, producing an output of 0.7 G or greater in terms of gravity. - If it is determined in S15 that neither axis has been outputting a value of 0.7 G or greater for five seconds or longer, the
CPU 24 determines that theacceleration sensor 5 is operating properly, and performs processing to compensate for the offsets of the outputs G1 and G2 of the first and second axes, i.e., to correct the values acquired in S11 to 0 (S16), after which the sequence of operations is terminated. A possible cause for the offsets is that thedrive recorder 2 is not mounted completely parallel relative to thevehicle 1. For example, thedrive recorder 2 that should have been installed as shown inFIG. 10( b) may be installed in a tilted position as shown inFIG. 10( c). Thedrive recorder 2 is constructed so that, by compensating for the offsets, it can operate properly unless the tilt angle φ shown inFIG. 10( c) is larger than about 30 degrees. - If it is determined in S12 that any one of the outputs G1 and G2 of the first and second axes acquired in S11 has been producing a value of 1 G or greater for five seconds or longer, or if no change is detected in the output in S14, the
CPU 24 determines that theacceleration sensor 5 is faulty, and notifies the user of the occurrence of the fault by turning on theLED 25 and issuing an alarm sound from thebuzzer 26; at the same time, theCPU 24 deactivates other components than theLED 25 and thebuzzer 26, and continues the above alarm action until theACC switch 19 or thepower switch 20 is turned off (S18). - If it is determined in S15 that any one of the outputs G1 and G2 of the first and second axes acquired in S11 has been producing a value of 0.7 G or greater for five seconds or longer, the
CPU 24 determines that the setting of the output axes has not been changed after changing the orientation of thedrive recorder 2, and notifies the user of the occurrence of the fault by turning on theLED 25 and issuing an alarm sound from thebuzzer 26; this alarm action is continued until theACC switch 19 or thepower switch 20 is turned off (S17). However, thedrive recorder 2 is allowed to continue operation, since theacceleration sensor 5 itself operates properly. - Next, the self-diagnoses of the JPEG-IC constituting the
image processing circuit 13, theRTC 28, and the connection state of the first andsecond cameras - For the JPEG-IC constituting the
image processing circuit 13, theCPU 24 is constantly monitored for an interrupt signal to be input thereto at intervals of 16.7 ms, and if no interrupt occurs for a period of 500 ms, theCPU 24 determines that a fault has occurred in the JPEG-IC constituting theimage processing circuit 13. If it is determined that a fault has occurred, theCPU 24 notifies the user of the occurrence of the fault by turning on theLED 25 and issuing an alarm sound from thebuzzer 26; at the same time, theCPU 24 deactivates other components than theLED 25 and thebuzzer 26, and continues the above alarm action until theACC switch 19 or thepower switch 20 is turned off. The interrupt monitoring intervals of 16.7 ms and the monitoring period of 500 ms are only illustrative and not restrictive. - For the
RTC 28, theCPU 24 monitors the status bits indicating the year, month, date and time, second, etc., being received from theRTC 28, and if data that does not fall within a predefined range is received, it is determined that a fault has occurred. If it is determined that a fault has occurred, theCPU 24 notifies the user of the occurrence of the fault by turning on theLED 25 and issuing an alarm sound from thebuzzer 26, and resets the internal RTC of theCPU 24 to a predetermined value (for example, 0 hours, 0 minutes, 0 seconds, Jan. 1, 2001). Other normal operation of thedrive recorder 2 is allowed to continue. - For the connection state of the first and
second cameras CPU 24 determines that a fault has occurred (the connection between thedrive recorder 2 and the first andsecond cameras first RAM 14 to thesecond RAM 15 has continued to be 6592 bytes for 10 seconds or longer. The size of 6592 bytes corresponds to the image data size when the image created by the JPEG-IC used in the drive recorder is an all black image. The JPEG-IC is preset to output a black image when there is no video input from thecameras drive recorder 2 and the first andsecond cameras CPU 24 notifies the user of the occurrence of the fault by turning on theLED 25 and issuing an alarm sound from thebuzzer 26; at the same time, theCPU 24 deactivates other components than theLED 25 and thebuzzer 26, and continues the above alarm action until theACC switch 19 or thepower switch 20 is turned off. The image data size of 6592 bytes to be detected and the monitoring period of 10 seconds are only illustrative and not restrictive. Further, if the JPEG-IC is preset to output some other color image than black (for example, a blue color image) when there is no video input to the JPEG-IC, provisions should be made to detect a fault based on the data size of that color image. - The self-diagnosis to check the connection state of the first and
second cameras drive recorder 2 but also constantly during the operation of thedrive recorder 2. - Since the
drive recorder 2 according to the present invention performs self-diagnostic tests to verify proper operation of the components during power-up, etc., the validity of the video information and vehicle operational information can be ensured. -
FIG. 11 is a diagram showing a G-value detection process flow. - The
CPU 24 determines the G value based on the outputs of theacceleration sensor 5 in accordance with the process flow shown inFIG. 11 . Then, based on the G value detected in accordance with the process flow ofFIG. 11 , theCPU 24 determines whether the recording condition related to the earlier described G detection holds or not, as will be described later. - First, the
CPU 24 acquires the output G1 of the first predefined axis and the output G2 of the second predefined axis (S20 and S21). - Next, the
CPU 24 detects the current speed of thevehicle 1 based on the vehicle speed pulse signal received from the vehicle speed sensor 10 (S22). - Then, the
CPU 24 determines whether the road section on which thevehicle 1 is currently traveling corresponds to a sharp curve or not, based on the current position information of thevehicle 1 received from the GPS receiver 9 (S23). TheCPU 24 may obtain the “sharp curve or not” information from the navigation system (now shown) connected to thedrive recorder 2, or thedrive recorder 2 itself may include a storage unit (not shown) that stores map information, and the “sharp curve or not” information may be obtained by comparing the current position information with the map information. - If it is determined in S23 that the road section is not a sharp curve, the total value of the absolute values of the first and second axis outputs G1 and G2 acquired in S20 and S21, i.e., (G12+G22)0.5, is taken as the G value (S24).
- On the other hand, if it is determined in S23 that the road section is a sharp curve, a correction value a determined in accordance with the vehicle speed detected in S22 is obtained, and a value (G12+(|G2|−α)2)0.5, calculated from the correction value a and the first and second axis outputs G1 and G2 acquired in S20 and S21, is taken as the G value (S26). The correction value a can be set empirically, for example, to 0.1 when the vehicle speed is slower than 60 km/h and to 0.2 when the vehicle speed is 60 km/h or higher.
- The reason that the correction value a is subtracted from the absolute value of G2 representing the output in the transverse direction of the
vehicle 1 in the case of a sharp curve is that, when traveling along a sharp curve, thevehicle 1 tends to be subjected to an acceleration in the transverse direction, and the recording condition may erroneously hold when the situation is not a vehicle accident or the like. The output G2 is taken to be positive when the acceleration is in the rightward direction and negative when the acceleration is in the leftward direction. - In the above process, the determination as to whether the road section on which the
vehicle 1 is currently traveling is a sharp curve or not may not be determined based on the current position information received from theGPS receiver 9, and the G value may be determined based on (G12+(|G2|−α)2)0.5. Further, the correction value α may be set independently of the vehicle speed. Furthermore, the “sharp curve or not” determination may be made using other means, such as a steering angle sensor. - By determining the G value in accordance with the above G-value detection process flow, it is possible to prevent false recording conditions from occurring too often when the vehicle is traveling along a curve, and unnecessary video information, etc., can thus be prevented from being recorded on the
memory card 6. -
FIG. 12 is a diagram showing a process flow for verifying the outputs of theacceleration sensor 5. - In the foregoing example, the first and second axes of the
acceleration sensor 5 have been described as being predefined, but provisions may be made so that theCPU 24 can by itself redefine the two predefined axes.FIG. 12 show a process flow for this purpose. - First, the
CPU 24 determines whether thevehicle 1 has stopped (S30). It can be determined that the vehicle has stopped, for example, when the G value obtained in the process flow ofFIG. 11 has remained at 0.1 G or less for three seconds or longer. Alternatively, it may be determined that the vehicle has stopped when the vehicle speed detected by the vehicle speed sensor is slower than a predetermined speed (for example, 2 km/h). - Next, among the outputs produced by the
acceleration sensor 5 immediately after the stopping of the vehicle, theCPU 24 acquires the output G1 of the first predefined axis and the output G2 of the second predefined axis (S31); then, of these two axes, the axis whose output increased to 0.2 G or greater when thevehicle 1 began to move after stopping is identified as the axis oriented parallel to the traveling direction (or the longitudinal direction) of the vehicle 1 (S32). - After identifying the axis oriented parallel to the traveling direction of the
vehicle 1 in the above step, theCPU 24 stores information concerning the thus identified axis as history information in the second RAM 15 (S33). - Next, the
CPU 24 identifies the output of the other axis than the one identified in S32, as the output of the second axis oriented in the transverse direction of the vehicle 1 (S34), and the sequence of operations is terminated. - The process shown in
FIG. 12 is repeated each time it is determined that thevehicle 1 has stopped. The history information is collected by repeating the process flow ofFIG. 12 a predetermined number of times; therefore, the axes may be identified based on the history information. Further, after identifying the axis output in the transverse direction of thevehicle 1 in a distinct manner by redefining the orientation of the axis as shown inFIG. 12 , the axis output can be corrected by subtracting the correction value α from the absolute value of the output G2 of the second axis (in the transverse direction of the vehicle) of theacceleration sensor 5 as earlier shown inFIG. 11 . By combining the processes in this way, erroneous detection during traveling around a curve can be prevented in a more reliable manner. The redefining of the axes may be performed not when the vehicle has stopped, but when the vehicle has begun to move. In that case, it is determined in S30 that the vehicle has begun to move, by detecting the vehicle speed, for example, by detecting that the vehicle speed has increased to 5 km/h or higher. Then, in S32, the axis whose output increased to 0.2 G or greater immediately after the vehicle began to move is identified as the axis oriented parallel to the traveling direction of thevehicle 1. Further, provisions may be made to reset the history information when power is turned on to thedrive recorder 2 and to collect the information repeatedly after each power on. -
FIG. 13 is a process flow for the G detection that provides a criterion upon which to determine whether the recording condition holds or not. - First, the
CPU 24 determines whether or not the G value detected in the process flow ofFIG. 11 has once dropped to a value equal to or smaller than a first threshold (0.1 G) and then increased to a value equal to or larger than a second threshold (0.4 G) (S40) and, if the determination is affirmative, then it is determined that the recording condition related to the G detection holds (S41). The first threshold (0.1 G) and the second threshold (0.4 G) are values predetermined for the G detection. The reason that it is determined that the recording condition holds only when the G value has reached or exceeded the second threshold after once dropping to or below the first threshold is that, if values equal to or larger than the second threshold are detected repetitively, the situation could well be due, for example, to a failure of theacceleration sensor 5 or a rolling over of thevehicle 1, and in such cases, it would not be necessary to record the video information, etc., by determining that a new recording condition occurred. - Next, the
CPU 24 determines whether or not the usual video information recording time (12 seconds before and 8 seconds after the occurrence of the recording condition) has been extended as will be described later (S42). - If, in S42, the recording time is not extended, the time elapsed from the occurrence of the previous recording condition is detected, and the process proceeds as follows according to the elapsed time (S43).
- If, in S43, the time elapsed from the occurrence of the previous recording condition is longer than 0 second but shorter than T1 seconds (for example, 4 seconds), no new recording is initiated due to the occurrence of the current recording condition, nor is the video information recording time extended (S44). That is, the detection of the current recording condition is ignored. The reason is that the situation can be considered to be a series of events leading up to, for example, a collision after hard braking, and when the recording condition holds repetitively in too short a period, if the video information, etc., are recorded each time the recording condition holds, the same video information, etc., will be recorded repetitively in an overlapping fashion, which is not desirable.
- If, in S43, the time elapsed from the occurrence of the previous recording condition is not shorter than T1 seconds (for example, 4 seconds) second but shorter than T2 seconds (for example, 8 seconds), the recording time is extended by a predetermined length of time (for example, 4 seconds) (S45). That is, if the recording condition holds a second time during the recording of the video information, more specifically, in the second half of the 8-second period after the occurrence of the previous recording condition, the recording time of the video information, etc., is extended, because if not extended, the amount of time to record the video information after the occurrence of the current recording condition would become too short. As a result, in the case of S45, the video information, etc., are recorded for a total of 24 seconds, i.e., 12 seconds before and 12 seconds after the occurrence of the recording condition.
- If, in S43, the time elapsed from the occurrence of the previous recording condition is not shorter than T2 seconds (for example, 8 seconds), it is determined that a new recording condition holds, and the video information, etc., are recorded for 12 seconds before and 8 seconds after the occurrence of that recording condition (S46). As an exception to the above rule, when the recording condition holds for the first time after the startup of the
drive recorder 2, the process proceeds to S46, and the video information, etc., are recorded for 12 seconds before and 8 seconds after the occurrence of that recording condition. - If it is determined in S42 that the recording time is already extended (S45), the process proceeds as follows by considering the time elapsed from the occurrence of the previous recording condition (S47).
- If, in S47, the time elapsed from the occurrence of the previous recording condition is not shorter than T2 seconds (for example, 8 seconds) second but shorter than T3 seconds (for example, 12 seconds), the recording time is not re-extended (S48). That is, the detection of the current recording condition is ignored. The reason is that if the recording time were extended again, the video information, etc., for the same event would be recorded for too long a time.
- If, in S47, the time elapsed from the occurrence of the previous recording condition is not shorter than T3 seconds (for example, 12 seconds), it is determined that a new recording condition holds, and the video information, etc., are recorded for 12 seconds before and 8 seconds after the occurrence of that recording condition (S49).
- Specific examples of how the video information, etc. are recorded in accordance with the process flow of
FIG. 13 will be described below with reference toFIGS. 14 to 17 . -
FIG. 14 is a diagram showing an example (1) of the video information recording based on the G detection.FIG. 14( a) shows a graph of theG value 50 obtained in the process flow ofFIG. 11 , andFIG. 14( b) is a diagram showing the video information being stored in thesecond RAM 15 in a continuously looping fashion and the video information transferred for recording on thememory card 6. - Suppose that the G value, after first dropping to or below the first threshold, increases to or above the second threshold at t0 and, thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1. The period from t0 to t1 is longer than T2 seconds.
- Since the recording condition holds at t0,
video information 52 for 12 seconds before and 8 seconds after t0 is recorded as oneevent 53 on thememory card 6 in accordance with S46 ofFIG. 13 . Next, since t1 occurs more than T2 seconds after t0, and since the recording time is not yet extended at the time of occurrence of t1, the recording condition holds at t1, andvideo information 54 for 12 seconds before and 8 seconds after t1 is recorded as anotherevent 55 on thememory card 6 in accordance with S46 ofFIG. 13 . The video information recorded as theevent 53 and the video information recorded as theevent 55 partially overlap, as shown inFIG. 14( b). -
FIG. 15 is a diagram showing an example (2) of the video information recording based on the G detection.FIG. 15( a) is a diagram showing an example (2) of a graph of theG value 60 obtained in the process flow ofFIG. 11 , andFIG. 15( b) is a diagram showing the video information being stored in thesecond RAM 15 in a continuously looping fashion and the video information transferred for recording on thememory card 6. - Suppose that the G value, after first dropping to or below the first threshold, increases to or above the second threshold at t0 and, thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1, after which the G value once again drops to or below the first threshold and then increases once again to or above the second threshold at t2. The period from t0 to t1 is shorter than T2 seconds, and the period from t0 to t2 is longer than T3 seconds.
- Since the recording condition holds at t0,
video information 62 for 12 seconds before and 8 seconds after t0 is recorded as oneevent 64 on thememory card 6 in accordance with S46 ofFIG. 13 . Next, since t1 occurs less than T2 seconds after t0, and since the recording time is not yet extended at the time of occurrence of t1, the recording condition holds at t1, andvideo information 63 for 4 seconds is recorded as anextension 65 on thememory card 6 in accordance with S45 ofFIG. 13 . Further, at t2, since the recording time is already extended, and since t2 occurs more than T3 seconds after t0, the recording condition holds at t2, andvideo information 66, etc., for 12 seconds before and 8 seconds after t2 are recorded as anotherevent 67 on thememory card 6 in accordance with S49 ofFIG. 13 . The video information recorded as theevent 64 and the video information recorded as theevent 67 partially overlap, as shown inFIG. 15( b). -
FIG. 16 is a diagram showing an example (3) of the video information recording based on the G detection.FIG. 16( a) is a diagram showing an example (3) of a graph of theG value 70 obtained in the process flow ofFIG. 11 , andFIG. 16( b) is a diagram showing the video information being stored in thesecond RAM 15 in a continuously looping fashion and the video information transferred for recording on thememory card 6. - Suppose that the G value, after first dropping to or below the first threshold, increases to or above the second threshold at t0 and, thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1, then dropping and increasing in a similar manner at t2, t3, and t4, respectively. The period from t0 to t1 is shorter than T1 seconds, the period from t0 to t2 is shorter than T2 seconds, the period from t0 to t3 is shorter than T3 seconds, and the period from t0 to t4 is longer than T3 seconds.
- Since the recording condition holds at t0,
video information 72 for 12 seconds before and 8 seconds after t0 is recorded as oneevent 74 on thememory card 6 in accordance with S46 ofFIG. 13 . Since t1 is shorter than T1 seconds, the recording condition at t1 is ignored in accordance with S44 ofFIG. 13 . Next, since t2 occurs less than T2 seconds after t0, and since the recording time is not yet extended at the time of occurrence of t2, the recording condition holds at t2, and video information 73 for 4 seconds is recorded as anextension 75 on thememory card 6 in accordance with S45 ofFIG. 13 . At t3, since the recording time is already extended, and since t3 occurs less than T3 seconds after t0, the recording condition at t3 is ignored in accordance with S48 ofFIG. 13 . Further, at t4, since the recording time is already extended, and since t4 occurs more than T3 seconds after t0, the recording condition holds at t4, andvideo information 76 for 12 seconds before and 8 seconds after t4 is recorded as anotherevent 77 on thememory card 6 in accordance with S49 ofFIG. 13 . The video information recorded as theevent 74 and the video information recorded as theevent 77 partially overlap, as shown inFIG. 16( b). -
FIG. 17 is a diagram showing an example (4) of the video information recording based on the G detection.FIG. 17( a) is a diagram showing an example (4) of a graph of theG value 80 obtained in the process flow ofFIG. 11 , andFIG. 17( b) is a diagram showing the video information being stored in thesecond RAM 15 in a continuously looping fashion and the video information transferred for recording on thememory card 6. - Suppose that the G value, after first dropping to or below the first threshold, increases to or above the second threshold at t0, and thereafter, the G value drops again to or below the first threshold and then increases again to or above the second threshold at t1, the G value then continuing to remain above the second threshold.
- Since the recording condition holds at t0,
video information 81, etc., for 12 seconds before and 8 seconds after t0 are recorded as oneevent 82 on thememory card 6 in accordance with S46 ofFIG. 13 . Since t1 is shorter than T1 seconds, the recording condition at t1 is ignored in accordance with S44 ofFIG. 13 . Further, since thereafter the G value does not drop to or below the first threshold, if a G value equal to or greater than the second threshold is detected, it is determined in S40 ofFIG. 13 that the recording condition does not hold. The example ofFIG. 17 corresponds, for example, to a situation where the driver applied hard braking at t0 but was unable to avoid a collision, and thevehicle 1 rolled over at t1, theacceleration sensor 5 thereafter continuing to output high G values due to the rolling over of the vehicle. - As described above with reference to
FIGS. 13 to 17 , when a G value equal to or greater than a predetermined threshold is detected, if the recording condition holds repetitively, or if such high G values are detected repetitively, control is performed so as not to record unnecessary video information; this serves to make efficient use of thememory card 6 having a limited capacity. - The voltage drop processing of the
drive recorder 2 will be described with reference toFIGS. 18 to 20 . - The voltage drop processing refers to the processing performed to properly protect video information being recorded, etc., in such cases as when the output voltage of the
battery 21 has dropped due to, for example, the damage caused by an accident of thevehicle 1, or the like. -
FIG. 18 is a diagram showing a voltage drop process flow (1). - The
CPU 24 constantly monitors the output of the first detector 43 (seeFIG. 6 ) to detect a H to L transition of the first voltage drop signal S1 (S50). As earlier described with reference toFIG. 6 , if the output voltage of thebattery 21 drops to 8.0 V or below, thefirst detector 43 sets the first voltage drop signal S1 from H to L. - If, in S50, the first voltage drop signal S1 changes from H to L, the
CPU 24 causes thebuzzer 26 to sound an alarm (S51). - Next, the
CPU 24 determines whether the recording condition currently holds and video information, etc., are in the process of being written to the memory card 6 (S52), and also determines whether a predetermined time (for example, 8 seconds) had elapsed from the occurrence of the recording condition when the first voltage drop signal S1 was detected in S50 (S53). - If the video information is currently being written, and if the predetermined time had not elapsed from the occurrence of the recording condition, the writing to the memory card is suspended, and the video information acquired for the 10 seconds preceding the occurrence of the trigger is recorded. In this case, the number of frames to be recorded is reduced. That is, the video information acquired for the 10 seconds preceding the detection of the first voltage drop signal is written to the
memory card 6 at a rate of 5 frames per second (compared with the usual rate of 10 frames per second) by creating a special backup folder (S54). When the first voltage drop signal is detected, since it is highly likely that the drive recorder is unable to acquire new video information thereafter, control is performed to minimize the loss of information by saving the video information acquired up to that moment in the special backup folder. It is preferable to also save the vehicle operational information in the special backup folder together with the video information. - If it is determined in S53 that the predetermined time had elapsed, no special backup processing is performed. The reason is that since, in this case, the video information for the usual recording time (12 seconds before and 8 seconds after the occurrence of the recording condition) is already acquired, it is considered that the video information can be recorded on the
memory card 6 in the usual way. - After that, processing is performed to reduce power consumption by cutting off power to the
first camera 3, thesecond camera 4, the JPEG-IC constituting theimage processing circuit 13, and theGPS receiver 9, thereby reserving power for writing thevideo information 6 to the memory card 6 (S55). Power for the backup processing in S54 is supplied from thebackup battery 46. - After completing the backup processing, the
CPU 24 stops watchdog timer, and reboots itself (S56) to terminate the sequence of operations. -
FIG. 19 is a diagram showing a voltage drop process flow (2). - The
CPU 24 constantly monitors the output of the second detector 44 (seeFIG. 6 ) to detect a H to L transition of the second voltage drop signal S2 (S60). As earlier described with reference toFIG. 6 , if the output voltage of the first power supply circuit 40 (or the output voltage of the backup battery 46) drops to 3.7 V or below, thesecond detector 44 sets the second voltage drop signal S2 from H to L. - If, in S60, the second voltage drop signal S2 changes from H to L, the
CPU 24 determines the start time of a closing operation (S61). -
FIG. 20 is a diagram showing voltage drops.Curve 90 inFIG. 20 shows the case where it took T4 seconds for the voltage to drop from 8.0 V to 3.7 V (the time from the detection of the first voltage drop to the detection of the second voltage drop) and T5 seconds for the voltage to drop from 3.7 V to 3.0 V (the time from the detection of the second voltage drop to the output of the reset signal), and curve 91 inFIG. 20 shows the case where it took T6 seconds for the voltage to drop from 8.0 V to 3.7 V and T7 seconds for the voltage to drop from 3.7 V to 3.0 V. Since the reset signal for preventing the erroneous operation of theCPU 24, etc., is output from thethird detector 45 when the voltage drops to 3.0 V, it is important to estimate the time left after the detection of the second voltage drop until the reset voltage is output. As shown inFIG. 20 , the time left after the detection of the second voltage drop until the reset voltage is output can be roughly estimated based on the time taken from the detection of the first voltage drop to the detection of the second voltage drop. It should be noted here that the closing operation takes about 500 ms to complete. - In view of the above, if the time taken for the voltage to drop from 8.0 V to 3.7 V is one second or longer, since some time is left until the reset signal occurs, the closing operation is started one second after the detection of the second voltage drop; on the other hand, if the time taken for the voltage to drop from 8.0 V to 3.7 V is less than one second, since the reset signal is highly likely to occur early, the closing operation is started immediately after the detection of the second voltage drop. The above time setting is only illustrative and not restrictive.
- Next, the
CPU 24 starts the closing operation (S62) at the start time determined in S61. The closing operation refers to the operation performed to close all of the currently opened files, thereby completing the writing of the video information to thememory card 6. After the closing operation, writing to the memory card is prohibited. If the closing operation is not carried out properly, the video information recorded in the files may become unable to be used properly at a later time; therefore, even when the backup processing shown inFIG. 18 is in progress, the closing operation is performed by interrupting the backup processing. - After completing the closing operation, the
CPU 24 stops watchdog timer, and reboots itself (S63) to terminate the sequence of operations. - By properly performing the voltage drop processing shown in
FIGS. 18 to 20 , as much of the video information, etc., as possible can be recorded on thememory card 6 even when thebattery 21 is damaged or the connection between thedrive recorder 2 and thebattery 21 is broken due to a vehicle accident or the like. -
FIG. 21 is a diagram showing a mode switching flow. - The
drive recorder 2 has an output port for connecting to thedisplay unit 30, and is constructed so that in the event of an accident or the like, the contents recorded on the memory card can be examined on the spot. That is, thedrive recorder 2 of the present invention has a recording mode for recording the video information, etc., on thememory card 6 and a playback mode for playing back the video information recorded on thememory card 6. The recording mode/playback mode switching flow will be described with reference toFIG. 21 . - First, when the open/
close sensor 27 detects that the open/close knob 31 on thedrive recorder 2 is set to the open position (S70), theCPU 24 starts up a boot program for initializing the drive recorder 2 (S71). - Next, after checking that the
memory card 6 is inserted in the I/F 11 and that thememory card 6 is write-protected (S72), theCPU 24 loads a playback mode program from the nonvolatile ROM, and executes the program to operate thedrive recorder 2 in the playback mode (S73). When thememory card 6 is write-protected, the port associated with one of the connecting terminals of thememory card 6 produces a specific output; therefore, theCPU 24 can check, via the I/F 11, whether thememory card 6 is write-protected or not. - Next, the
CPU 24 activates theLED 25 and/orbuzzer 26 to indicate that thedrive recorder 2 is operating in the playback mode (S74), and the sequence of operations is terminated. - On the other hand, if, in S72, the
memory card 6 is inserted in the I/F 11, but thememory card 6 is not write-protected, theCPU 24 loads a recording mode program from the nonvolatile ROM, and executes the program to operate thedrive recorder 2 in the recording mode (S75). - That is, usually, the
memory card 6 set to a write-unprotected state is inserted in thedrive recorder 2, and the mode is set to the recording mode; in this condition, video information, etc., are recorded each time the recording condition holds as earlier described. In the event of an accident or the like, if the user desires to check the recorded contents on the spot, the user removes thememory card 6 and sets its switch to the write-protection position; then, thememory card 6 is inserted in thedrive recorder 2, whereupon the mode is changed to the playback mode so that the video information recorded on thememory card 6 can be played back. If thedrive recorder 2 is not connected to thedisplay unit 30, or if thedisplay unit 30 is damaged, for example, a portable display device may be connected to the output slot of thedrive recorder 2. The playback mode setting method is not limited to the above one. Various other methods are possible, one possible method being such that if the image capture switch 8 is operated in a predetermined manner within a predetermined time after power on, the mode is set to the playback mode, but if it is not operated in the predetermined manner, the mode is set to the recording mode. - Next, a description will be given of how the video information is played back in the playback mode.
- After the
LED 25 andbuzzer 26 are activated in S74 ofFIG. 21 to indicate that thedrive recorder 2 is operating in the playback mode, if the user presses the image capture switch 8, thebuzzer 26 stops and the playback of the most recently recorded event starts. Suppose that 15 events are recorded on thememory card 6; then, the playback of the most recent 15th event starts, and usually (if the recording time is not extended) 20 seconds of recorded video information will be displayed on thedisplay unit 30. It is preferable that at least the event number indicating which event the video information concerns and the time at which the recording condition occurred are displayed on thedisplay unit 30 along with the video information. - When the image capture switch 8 is pressed again during the playback of the video information concerning the event, the playback stops. With the playback thus stopped, if the image capture switch 8 is pressed once again, the playback resumes from the point one second before the point at which the playback was stopped. After the playback of the video information concerning one event is completed, the same playback mode is maintained, and when the image capture switch 8 is pressed again, the video information concerning the same event is played back over again. If the image capture switch 8 is pressed and held down, the playback of the video information concerning the next event, i.e., the event recorded before the current event, starts. By pressing and holding down the image capture switch 8, all the video information recorded on the
memory card 6 can be played back, one event after another. The above has described one method devised to make effective use of the image capture switch 8 which is the only one operating means provided on thedrive recorder 2, but it will be appreciated that an additional operating means may be provided on thedrive recorder 2. - If the image capture switch is not operated within a predetermined time (for example, at least 30 seconds) after the playback mode is entered, it is preferable for the
CPU 24 to reboot itself (see S71) and start up the process once again. In this case, by sounding the playback mode buzzer after restarting, an audible warning can be issued prompting the user to release the playback mode. -
FIG. 22 is a diagram showing a playback sequence. As shown inFIG. 22 , by pressing and holding down the image capture switch 8, control can be performed to play back the recorded events one after another, starting from the most recently recorded 15th event (S80) and progressing toward the first recorded event (S85). If the image capture switch 8 is pressed and held down during the playback of the first event, the playback of the 15th event starts. - Next, a description will be given of how the
memory card 6 is used with theplayback apparatus 400. -
FIG. 23 is a diagram showing an example of the operation flow of thememory card 6. - First, the user sets the
memory card 6 to a write-unprotected state, and inserts it into the I/F 411 of theplayback apparatus 400 to initialize the card (S90). In the initialization of the card, theCPU 424 erases the data, etc., recorded on thememory card 6 and writes the ID of the user (for example, a taxi driver) of thememory card 6 to a predetermined address in thememory card 6. - Next, when the user starts the operation of the vehicle 1 (for example, when the taxi driver as the user starts his duty for the day (07:45 to 17:15)), the user inserts the initialized and write-protected
memory card 6 into the I/F 11 of thedrive recorder 2 installed in thevehicle 1, and sets thedrive recorder 2 to the recording mode to start data recording (S91). As previously described, each time the recording condition holds, theCPU 24 records on thememory card 6 the video information and vehicle operational information captured for a predetermined period of time (for example, 20 seconds). - Next, at the end of the operation of the vehicle 1 (for example, when the taxi driver ends his duty for the day), the user removes the
memory card 6, on which data has been recorded, from the I/F 11 of thedrive recorder 2. Then, the user inserts thememory card 6 into the I/F 411 of theplayback apparatus 400, and loads the video information, vehicle operational information, memory card ID, user ID, etc., recorded on thememory card 6 into the playback apparatus 400 (S92). - The video information, vehicle operational information, memory card ID, and user ID recorded on the
memory card 6 are loaded into theplayback apparatus 400 on a per-duty and per-vehicle basis under the control of theCPU 424. In theplayback apparatus 400, not only can the data recorded on each memory card be analyzed on an individual basis, but after loading data fromdifferent memory cards 6 used to record the operations of different vehicles, the data can be analyzed in a collective manner. Further, thesame memory card 6 may be used for different vehicles or for recording the operations of the same vehicle over more than one duty. - Next, a description will be given of the field of vision area to be displayed on the
playback apparatus 400. - The
drive recorder 2 acquires video information using the first andsecond cameras - The field of vision of a human is the range in which a human can see without moving his eyes, and generally, when the
vehicle 1 is stationary, the field of human vision with two eyes is about 200 degrees horizontally and about 112 degrees vertically. As the speed of thevehicle 1 increases, the driver's eyes tend to focus on objects farther ahead, causing near objects to appear blurred, and the field of vision of the driver thus decreases. Further, since the field of vision tends to decrease with age, the field of vision of an elderly driver is not the same as that of a younger driver. Generally, the field of vision of elderly people (for example, 60 years or older) is narrower than that of younger people (for example, younger than 60 years). As an example, it can be considered that the field of vision is narrower by 20%.FIG. 24 is a diagram showing a mapping table that provides a mapping between the speed of thevehicle 1 and the horizontal and vertical fields of vision as used in theplayback apparatus 400. The area defined by the horizontal and vertical fields of vision, i.e., the range that the driver can see without moving his eyes, will be referred to as the field of vision area. - In the
playback apparatus 400, when playing back the video information acquired by the drive recorder, the field of vision range in which the driver actually sees the surroundings is identified to help to investigate how an accident or the like can occur. By thus identifying the field of vision range, it also becomes possible to use the video for safe driving education of drivers. - The
playback apparatus 400 is constructed so that when displaying the video information concerning any particular event on thedisplay unit 440, theplayback apparatus 400 can detect the vehicle speed from the vehicle speed data in the vehicle operational information, obtain the corresponding field of vision angles from the mapping table shown inFIG. 24 (the mapping table is stored in the playback apparatus 400), and display the field of vision range on the screen under the control of theCPU 424 in accordance with thecontrol program 417. - The
playback apparatus 400 provides the following five field-of-vision-range playback modes so that by operating theoperation unit 430, the user can select one of the modes to playback the video information. - 1. Fixed angle mode: Displays only the field of vision range that corresponds to the horizontal and vertical field of vision angles specified by the
operation unit 430. - 2. Instantaneous vehicle speed mode: Displays only the field of vision range that corresponds to the horizontal and vertical field of vision angles corresponding to the vehicle speed detected at the instant that the recording condition occurred.
- 3. Playback image-based vehicle speed mode: Sequentially displays the field of vision ranges that correspond to the horizontal and vertical field of vision angles corresponding to the vehicle speeds applicable to sequentially presented still images.
- 4. Fixed vehicle speed mode: Displays only the field of vision range that corresponds to the horizontal and vertical field of vision angles corresponding to the vehicle speed specified by the
operation unit 430. - 5. Normal mode: Does not display the field of vision range.
- In the instantaneous vehicle speed mode (2), playback image-based vehicle speed mode (3), and fixed vehicle speed mode (4), the field of vision angles can be corrected for the elderly.
-
FIG. 25 is a diagram showing an example of a screen for displaying the video information recorded on thememory card 6. The screen ofFIG. 25 and any operation that the user performs on the screen are displayed on thedisplay unit 440 under the control of theCPU 424 in accordance with thecontrol program 417 and based on the data stored on the cardinformation recording unit 460. - As shown in
FIG. 25 , thescreen 140 presented on thedisplay unit 440 displaysID number data 141 of thememory card 6,time information 142 contained in the vehicle operational information,kind information 143 indicating the kind of the recording condition that occurred,latitude information 144 contained in the position information,longitude information 145 contained in the position information,G value 146 obtained in accordance with the flow ofFIG. 11 , drivingsituation information 147 to be described later that indicates the driving situation when the presented still image was captured, an area 148-1 in which still images captured by thefirst camera 3 are sequentially displayed, an area 148-2 in which still images captured by thesecond camera 4 are sequentially displayed, operation buttons 149 (rewind, playback, stop, fast forward) for controlling the display of the still images captured by thefirst camera 3 andsecond camera 4,vehicle speed information 150 indicating the vehicle speed detected when the presented still image was captured, anarea 151 for displaying the selected field-of-vision-range playback mode, and anarea 152 for displaying whether correction for the elderly is applied or not. - The area 148-1 displays a first frame 153-1 defining the field of vision range and a second frame 153-2 defining the field of vision range corrected for the elderly. Likewise, the area 148-2 displays a first frame 154-1 defining the field of vision range and a second frame 154-2 defining the field of vision range corrected for the elderly. In the example of
FIG. 25 , thearea 152 indicates that correction for the elderly is applied, but when correction for the elderly is not applied, the second frames 153-2 and 154-2 are not displayed. The field of vision ranges can be displayed clearly by displaying the areas outside the first and second frames differently than the areas inside the respective frames. - In the example of
FIG. 25 , since the instantaneous vehicle speed mode is selected as indicated in thearea 151, the field of vision area defined by the horizontal field of vision angle (140 degrees) and vertical field of vision angle (78 degrees) corresponding to the vehicle speed (for example, 40 km/h) detected at the instant that the recording condition occurred (seeFIG. 24 ) is shown by the first frame 153-1 within the area 148-1. Further, the field of vision area defined by the horizontal field of vision angle (112 degrees) and vertical field of vision angle (63 degrees), corrected for the elderly, corresponding to the vehicle speed (for example, 40 km/h) detected at the instant that the recording condition occurred (seeFIG. 24 ) is shown by the second frame 153-2 within the area 148-1. The field of vision areas are likewise shown within the area 148-2. - On the
screen 140 shown inFIG. 25 , 100 still images captured for 10 seconds by thefirst camera second camera 4 are sequentially displayed on the respective display areas 148-1 and 148-2 under the control of theoperation buttons 149 operated by the user. At the same time, the various pieces of information associated with the displayed still images are displayed in the display/input areas 141 to 147 and 150. Thescreen 140 shown inFIG. 25 is only one example, and any other suitable screen design may be employed. - In the present embodiment, since the field of vision area is displayed in a superimposing fashion on the video information recorded on the
memory card 6, the video information acquired by the drive recorder can be checked by discriminating between the area that actually corresponds to the driver's field of vision range and the area that corresponds to the camera's field of vision range. Further, by correcting the field of vision range according to age, the driver's field of vision range can be brought further closer to that in the actual situation. - In
FIG. 25 , the recording condition and the video information are displayed on the same screen, but they need not necessarily be displayed on the same screen; for example, an operation button for displaying the recording condition may be displayed on the same screen as the image, with provisions made to display the recording condition in a separate window by operating the operation button. -
FIG. 26 is a diagram showing a process flow for identifying the driving situation. - As described earlier, the video information, etc. concerning each event that triggered the recording condition are recorded on the
memory card 6. However, when checking the recorded video information, etc., by displaying them on theplayback apparatus 400, it is important to identify the driving situation that triggered the recording condition. In view of this, theplayback apparatus 400 has the function of automatically identifying each event in accordance with the process flow ofFIG. 26 by using the recorded video information and vehicle operational information. - The driving situations to be identified here are classified into the following five categories: “abrupt starting,” “hard braking,” “normal braking,” “abrupt left turn steering,” and “abrupt right turn steering.”
- First, the
CPU 424 selects a particular event, and acquires as sample data the G1 value (the output of the axis of theacceleration sensor 5 in the direction parallel to the longitudinal direction of the vehicle 1), G2 value (the output of the axis of theacceleration sensor 5 in the direction parallel to the transverse direction of the vehicle 1), and vehicle speed data for each of the 30 still images captured before and after the occurrence of the recording condition (S100). - Next, for each sample, the
CPU 424 calculates the slope of change in the sample by applying the method of least squares to the values at 10 points before and after that sample (S101). Then, for each sample sequence, theCPU 424 identifies the peaks of the slope waveform before and after the occurrence of the recording condition (S102). - Next, by matching the peaks obtained in S102 against a peak master file for identifying each predetermined driving situation to be described later, the
CPU 424 identifies the driving situation for the particular event (S103), after which the sequence of operations is terminated. The driving situation identified for each particular event is displayed (in thearea 147 ofFIG. 25 ) on thedisplay unit 440 when displaying the video information related to that event. Further, an icon representing the identified driving situation is displayed in a superimposing fashion on the image, for example, in the upper right corner of the image. This enables the user to properly recognize the driving situation for the event being played back. Further, since the events can be searched based on the category of the driving situation, the search range can be narrowed. In this way, only the driving situation that the user desires to check can be extracted and the associated images played back. -
FIG. 27 is a diagram showing a sample sequence, etc. The ordinate represents the G1 value and the abscissa the time, and t=0 corresponds to the time at which the recording condition occurred. -
FIG. 27 shows thesample sequence 200 representing the samples of the G1 value acquired for a particular event in accordance with S100 inFIG. 26 .Waveform 210 is the slope waveform constructed by joining the slopes of the samples in thesample sequence 200, obtained in accordance with S101 inFIG. 26 . Further,point 220 indicates the peak of thewaveform 210 before the occurrence of the recording condition, andpoint 230 indicates the peak of thewaveform 210 after the occurrence of the recording condition. -
FIG. 28 is a diagram showing one example of the peak master file. - As shown in
FIG. 28 , the ranges of values, i.e., the upper and lower limit values, that the peak values (see S102 inFIG. 26 ) of the G1 value, G2 value, and vehicle speed, respectively, can take before and after the occurrence of the recording condition, are defined for each of the five driving situations, and the driving situation is identified (S103 inFIG. 26 ) by determining within which of the upper/lower limit value ranges shown inFIG. 28 each peak value identified in S102 ofFIG. 26 falls. InFIG. 28 , hatched areas are the areas where the peaks are defined, and peak values are not defined in other areas. - In
FIG. 27 , suppose, for example, that the value atpoint 220 of the G1-value waveform 210 is 1.5 and the value atpoint 230 is −1.5; then, from the peak master file ofFIG. 28 , it can be determined that the driving situation corresponds to “hard braking.” - Here, it is preferable to make provisions so that the values defined in the peak master file of
FIG. 28 can be corrected using theedit screen 160 displayed on thedisplay unit 440 as shown inFIG. 29 . Theedit screen 160 shown inFIG. 29 is one for correcting the conditions concerning abrupt starting. The values defined in the peak master file ofFIG. 28 are only examples, and other suitable values can be employed; further, vehicle speed can be added as a condition. -
FIG. 30 is a diagram showing a typical pattern representing an abrupt starting situation. -
FIG. 30( a) shows a G2-value sample sequence 300,FIG. 30( b) shows a G1-value sample sequence 301, andFIG. 30( c) shows a vehicle-speed sample sequence 302. In each diagram, T=0 represents the time at which the recording condition occurred. - From the G1-value, G2-value, and vehicle-speed sample sequences, the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition. In the case of
FIG. 30 , theslope waveform 303 of each sample is obtained from the G1-value sample sequence 301, and since thepeak value 304 before the occurrence of the recording condition falls within the range of −0.2 to −2.0, it is determined that the driving situation corresponds to abrupt starting. -
FIG. 31 is a diagram showing a typical pattern representing a hard braking situation. -
FIG. 31( a) shows a G2-value sample sequence 310,FIG. 31( b) shows a G1-value sample sequence 311, andFIG. 31( c) shows a vehicle-speed sample sequence 312. In each diagram, T=0 represents the time at which the recording condition occurred. - From the G1-value, G2-value, and vehicle-speed sample sequences, the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition. In the case of
FIG. 31 , theslope waveform 313 of each sample is obtained from the G1-value sample sequence 311, and since the peak value 314 before the occurrence of the recording condition falls within the range of 3.0 to 0.5, and thepeak value 315 after the occurrence of the recording condition falls within the range of −0.4 to −3.0, it is determined that the driving situation corresponds to hard braking. -
FIG. 32 is a diagram showing a typical pattern representing a normal braking situation. -
FIG. 32( a) shows a G2-value sample sequence 320,FIG. 32( b) shows a G1-value sample sequence 321, andFIG. 32( c) shows a vehicle-speed sample sequence 322. In each diagram, T=0 represents the time at which the recording condition occurred. - From the G1-value, G2-value, and vehicle-speed sample sequences, the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition. In the case of
FIG. 32 , theslope waveform 323 of each sample is obtained from the G1-value sample sequence 321, and since thepeak value 324 before the occurrence of the recording condition falls within the range of 0.5 to 0.05, and thepeak value 325 after the occurrence of the recording condition falls within the range of −0.05 to −0.5, it is determined that the driving situation corresponds to normal braking. -
FIG. 33 is a diagram showing a typical pattern representing an abrupt left turn steering situation. -
FIG. 33( a) shows a G2-value sample sequence 330,FIG. 33( b) shows a G1-value sample sequence 331, andFIG. 33( c) shows a vehicle-speed sample sequence 332. In each diagram, T=0 represents the time at which the recording condition occurred. - From the G1-value, G2-value, and vehicle-speed sample sequences, the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition. In the case of
FIG. 33 , theslope waveform 333 of each sample is obtained from the G2-value sample sequence 330, and since thepeak value 334 before the occurrence of the recording condition falls within the range of 2.0 to 0.1, it is determined that the driving situation corresponds to abrupt left turn steering. -
FIG. 34 is a diagram showing a typical pattern representing an abrupt right turn steering situation. -
FIG. 34( a) shows a G2-value sample sequence 340,FIG. 34( b) shows a G1-value sample sequence 341, andFIG. 34( c) shows a vehicle-speed sample sequence 342. In each diagram, T=0 represents the time at which the recording condition occurred. - From the G1-value, G2-value, and vehicle-speed sample sequences, the slope waveform of each sample is obtained, and the driving situation is identified based on the peak values before and after the occurrence of the recording condition. In the case of
FIG. 34 , theslope waveform 343 of each sample is obtained from the G2-value sample sequence 340, and since thepeak value 344 before the occurrence of the recording condition falls within the range of −0.1 to −2.0, it is determined that the driving situation corresponds to abrupt right turn steering. - Since the driving situation that triggered the recording of the video information, etc., can be identified for each event as described above, it is possible to analyze the data in a more quantitative manner on the
playback apparatus 400.
Claims (7)
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007-255767 | 2007-09-28 | ||
JP2007255767A JP4439549B2 (en) | 2007-09-28 | 2007-09-28 | Drive recorder |
JP2007-255721 | 2007-09-28 | ||
JP2007255721A JP4439548B2 (en) | 2007-09-28 | 2007-09-28 | Drive recorder |
PCT/JP2008/067974 WO2009041718A1 (en) | 2007-09-28 | 2008-09-26 | Drive recorder |
Publications (2)
Publication Number | Publication Date |
---|---|
US20100171829A1 true US20100171829A1 (en) | 2010-07-08 |
US8421862B2 US8421862B2 (en) | 2013-04-16 |
Family
ID=40511590
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/669,299 Expired - Fee Related US8421862B2 (en) | 2007-09-28 | 2008-09-26 | Drive recorder |
Country Status (3)
Country | Link |
---|---|
US (1) | US8421862B2 (en) |
CN (1) | CN101809630B (en) |
WO (1) | WO2009041718A1 (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012146273A1 (en) * | 2011-04-26 | 2012-11-01 | Better4Drive Ug (Haftungsbeschränkt) | Method and system for video marker insertion |
US20130027537A1 (en) * | 2011-03-11 | 2013-01-31 | Steelmate Co., Ltd. | Car video recorder |
US20130163946A1 (en) * | 2011-12-26 | 2013-06-27 | JVC Kenwood Corporation | Reproduction apparatus, mode setting apparatus and reproduction method |
US20140028848A1 (en) * | 2012-07-26 | 2014-01-30 | Denso Corporation | Drive video recording device and method, drive video recording system, and summarized moving image creating device |
CN104125423A (en) * | 2013-04-29 | 2014-10-29 | 星克跃尔株式会社 | Vehicular image processing apparatus and method of processing event using same |
JP2016045790A (en) * | 2014-08-25 | 2016-04-04 | 株式会社デンソー | Information recording device for vehicle |
CN106575119A (en) * | 2014-08-22 | 2017-04-19 | 捷太格特欧洲公司 | Computer for a vehicle, such as a power steering computer, provided with an integrated event recorder |
US9994174B2 (en) * | 2016-09-27 | 2018-06-12 | Auto-Linked Shanghai Info Technology Co., Ltd. | Smart power supply interface, vehicle-mounted electronic component with the same and method of controlling the same |
US10590628B2 (en) * | 2016-09-28 | 2020-03-17 | Hitachi Construction Machinery Co., Ltd. | Work machine |
US10958866B2 (en) | 2018-05-10 | 2021-03-23 | Jvckenwood Corporation | Recording apparatus, recording method, and a non-transitory computer readable medium |
US11115587B2 (en) | 2018-06-06 | 2021-09-07 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and program |
US11343462B2 (en) * | 2018-09-10 | 2022-05-24 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and non-transitory computer readable medium |
US11425329B2 (en) * | 2019-02-27 | 2022-08-23 | Jvckenwood Corporation | Recording/reproducing device, recording/reproducing method, and program for movable object and recording and reproducing captured by camera |
WO2022220890A1 (en) * | 2021-04-16 | 2022-10-20 | Darmodihardjo Denny P | Snipitz video cdi (content delivery interface) |
US11908254B2 (en) | 2020-01-31 | 2024-02-20 | Jvckenwood Corporation | Recording control apparatus, recording apparatus, recording control method, and program |
US11917285B2 (en) | 2019-06-27 | 2024-02-27 | Jvckenwood Corporation | Recording control apparatus, recording apparatus, recording control method, and recording control program |
US11978255B2 (en) | 2019-06-27 | 2024-05-07 | Jvckenwood Corporation | Recording control apparatus, recording apparatus, recording control method, and recording control program |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5238595B2 (en) * | 2009-04-22 | 2013-07-17 | 矢崎エナジーシステム株式会社 | In-car video recording device |
JP5573220B2 (en) * | 2010-02-18 | 2014-08-20 | 株式会社リコー | Drive recorder apparatus, recording method, program, and recording medium |
CN102402802A (en) * | 2010-09-16 | 2012-04-04 | 萱场工业株式会社 | Driving recorder |
CN102402804B (en) * | 2010-09-16 | 2015-12-09 | 萱场工业株式会社 | Drive recorder |
CN102402806A (en) * | 2010-09-16 | 2012-04-04 | 萱场工业株式会社 | Driving recorder |
CN102402805B (en) * | 2010-09-16 | 2015-08-26 | 萱场工业株式会社 | Drive recorder |
CN103632411B (en) * | 2012-08-23 | 2017-08-29 | 中国电信股份有限公司 | The storage method and equipment of vehicle-mounted data |
US20150002674A1 (en) * | 2013-06-26 | 2015-01-01 | Ford Global Technologies, Llc | Integrated vehicle traffic camera |
CN106033624A (en) * | 2015-03-16 | 2016-10-19 | 联想(北京)有限公司 | Electronic device and control method thereof |
WO2018131801A1 (en) * | 2017-01-10 | 2018-07-19 | 콘텔라 주식회사 | Service terminal for providing various services using low-power broadband communication network and connectable to black box pre-installed in vehicle, and connection method of black box |
JP6912324B2 (en) * | 2017-08-30 | 2021-08-04 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | Information processing method, information processing device and information processing program |
WO2021131129A1 (en) * | 2019-12-23 | 2021-07-01 | 株式会社Jvcケンウッド | Recording device, recording method, and program |
CN115223275A (en) * | 2021-09-08 | 2022-10-21 | 广州汽车集团股份有限公司 | Driving data processing method and system, vehicle-mounted assistant device, vehicle and medium |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6389340B1 (en) * | 1998-02-09 | 2002-05-14 | Gary A. Rayner | Vehicle data recorder |
US20030168839A1 (en) * | 2002-03-11 | 2003-09-11 | Mitsubishi Denki Kabushiki Kaisha | Airbag system collision history recording method |
US20060192658A1 (en) * | 2005-01-21 | 2006-08-31 | Sanyo Electric Co., Ltd. | Drive recorder and control method therefor |
US20070040365A1 (en) * | 2005-08-22 | 2007-02-22 | Calsonic Kansei Corporation | Vehicle data recorder |
US20070109106A1 (en) * | 2005-11-14 | 2007-05-17 | Munenori Maeda | Driving information recording apparatus |
US7266433B2 (en) * | 2005-08-23 | 2007-09-04 | Calsonic Kansei Corporation | Data recording apparatus for vehicle |
US20070285512A1 (en) * | 2006-06-07 | 2007-12-13 | Mitsuhiro Kitani | Communication system, communication terminal and information processing device |
US20080059054A1 (en) * | 2006-09-06 | 2008-03-06 | Denso Corporation | Drive recorder for vehicle |
US20100100276A1 (en) * | 2005-05-09 | 2010-04-22 | Nikon Corporation | Imaging apparatus and drive recorder system |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6316785A (en) | 1986-07-09 | 1988-01-23 | Matsushita Electric Ind Co Ltd | On-vehicle supervisory equipment |
JPH06186061A (en) | 1992-12-22 | 1994-07-08 | Yazaki Corp | Digital vehicle operation data storage device |
JPH06237463A (en) | 1993-02-12 | 1994-08-23 | Matsushita Electron Corp | Picture storage system |
JP2813615B2 (en) | 1993-05-25 | 1998-10-22 | 矢崎総業株式会社 | How to display vehicle operation information |
JP3180549B2 (en) | 1994-03-09 | 2001-06-25 | トヨタ自動車株式会社 | Vehicle data storage method and vehicle data recording device |
JPH0950547A (en) * | 1995-08-10 | 1997-02-18 | Fujitsu Ten Ltd | Operation recording device |
JPH1029567A (en) | 1996-07-15 | 1998-02-03 | Nippon Soken Inc | Vehicular accident-state recorder |
JP2006235732A (en) | 2005-02-22 | 2006-09-07 | Sanyo Electric Co Ltd | Drive recorder |
JP4799565B2 (en) | 2005-12-08 | 2011-10-26 | パイオニア株式会社 | Information recording apparatus, information recording method, information recording program, and computer-readable recording medium |
JP4439549B2 (en) | 2007-09-28 | 2010-03-24 | 富士通テン株式会社 | Drive recorder |
-
2008
- 2008-09-26 CN CN2008801083004A patent/CN101809630B/en not_active Expired - Fee Related
- 2008-09-26 US US12/669,299 patent/US8421862B2/en not_active Expired - Fee Related
- 2008-09-26 WO PCT/JP2008/067974 patent/WO2009041718A1/en active Application Filing
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6389340B1 (en) * | 1998-02-09 | 2002-05-14 | Gary A. Rayner | Vehicle data recorder |
US20030168839A1 (en) * | 2002-03-11 | 2003-09-11 | Mitsubishi Denki Kabushiki Kaisha | Airbag system collision history recording method |
US20060192658A1 (en) * | 2005-01-21 | 2006-08-31 | Sanyo Electric Co., Ltd. | Drive recorder and control method therefor |
US20100100276A1 (en) * | 2005-05-09 | 2010-04-22 | Nikon Corporation | Imaging apparatus and drive recorder system |
US20070040365A1 (en) * | 2005-08-22 | 2007-02-22 | Calsonic Kansei Corporation | Vehicle data recorder |
US7266433B2 (en) * | 2005-08-23 | 2007-09-04 | Calsonic Kansei Corporation | Data recording apparatus for vehicle |
US20070109106A1 (en) * | 2005-11-14 | 2007-05-17 | Munenori Maeda | Driving information recording apparatus |
US20070285512A1 (en) * | 2006-06-07 | 2007-12-13 | Mitsuhiro Kitani | Communication system, communication terminal and information processing device |
US20080059054A1 (en) * | 2006-09-06 | 2008-03-06 | Denso Corporation | Drive recorder for vehicle |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130027537A1 (en) * | 2011-03-11 | 2013-01-31 | Steelmate Co., Ltd. | Car video recorder |
WO2012146273A1 (en) * | 2011-04-26 | 2012-11-01 | Better4Drive Ug (Haftungsbeschränkt) | Method and system for video marker insertion |
US20130163946A1 (en) * | 2011-12-26 | 2013-06-27 | JVC Kenwood Corporation | Reproduction apparatus, mode setting apparatus and reproduction method |
US8761571B2 (en) * | 2011-12-26 | 2014-06-24 | JVC Kenwood Corporation | Reproduction apparatus, mode setting apparatus and reproduction method |
US9350952B2 (en) * | 2012-07-26 | 2016-05-24 | Denso Corporation | Drive video recording device and method, drive video recording system, and summarized moving image creating device |
US20140028848A1 (en) * | 2012-07-26 | 2014-01-30 | Denso Corporation | Drive video recording device and method, drive video recording system, and summarized moving image creating device |
CN104125423A (en) * | 2013-04-29 | 2014-10-29 | 星克跃尔株式会社 | Vehicular image processing apparatus and method of processing event using same |
US10282926B2 (en) * | 2014-08-22 | 2019-05-07 | Jtekt Europe | Calculator for a vehicle, such as a power steering calculator, provided with an integrated event recorder |
CN106575119A (en) * | 2014-08-22 | 2017-04-19 | 捷太格特欧洲公司 | Computer for a vehicle, such as a power steering computer, provided with an integrated event recorder |
JP2016045790A (en) * | 2014-08-25 | 2016-04-04 | 株式会社デンソー | Information recording device for vehicle |
US9994174B2 (en) * | 2016-09-27 | 2018-06-12 | Auto-Linked Shanghai Info Technology Co., Ltd. | Smart power supply interface, vehicle-mounted electronic component with the same and method of controlling the same |
US10590628B2 (en) * | 2016-09-28 | 2020-03-17 | Hitachi Construction Machinery Co., Ltd. | Work machine |
US10958866B2 (en) | 2018-05-10 | 2021-03-23 | Jvckenwood Corporation | Recording apparatus, recording method, and a non-transitory computer readable medium |
US11616905B2 (en) | 2018-06-06 | 2023-03-28 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and program |
US11115587B2 (en) | 2018-06-06 | 2021-09-07 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and program |
US11343462B2 (en) * | 2018-09-10 | 2022-05-24 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and non-transitory computer readable medium |
US20220256110A1 (en) * | 2018-09-10 | 2022-08-11 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and non-transitory computer readable medium |
US11917326B2 (en) * | 2018-09-10 | 2024-02-27 | Jvckenwood Corporation | Recording reproduction apparatus, recording reproduction method, and non-transitory computer readable medium |
US11425329B2 (en) * | 2019-02-27 | 2022-08-23 | Jvckenwood Corporation | Recording/reproducing device, recording/reproducing method, and program for movable object and recording and reproducing captured by camera |
US11917285B2 (en) | 2019-06-27 | 2024-02-27 | Jvckenwood Corporation | Recording control apparatus, recording apparatus, recording control method, and recording control program |
US11978255B2 (en) | 2019-06-27 | 2024-05-07 | Jvckenwood Corporation | Recording control apparatus, recording apparatus, recording control method, and recording control program |
US11908254B2 (en) | 2020-01-31 | 2024-02-20 | Jvckenwood Corporation | Recording control apparatus, recording apparatus, recording control method, and program |
WO2022220890A1 (en) * | 2021-04-16 | 2022-10-20 | Darmodihardjo Denny P | Snipitz video cdi (content delivery interface) |
Also Published As
Publication number | Publication date |
---|---|
CN101809630A (en) | 2010-08-18 |
WO2009041718A1 (en) | 2009-04-02 |
US8421862B2 (en) | 2013-04-16 |
CN101809630B (en) | 2012-07-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8421862B2 (en) | Drive recorder | |
US8396623B2 (en) | Driver recorder and method for setting up the driver recorder | |
US20100194549A1 (en) | Drive Recorder | |
US20100256858A1 (en) | Drive recorder | |
US20100194887A1 (en) | Method for displaying vehicle driving conditions | |
JP4439548B2 (en) | Drive recorder | |
JP4531077B2 (en) | Vehicle running state display device | |
US20100134623A1 (en) | Method of processing continuously recorded image, computer-readable medium for processing continuously recorded image, drive recorder and reproduction device | |
US20100129064A1 (en) | Drive recorder | |
JP4859756B2 (en) | Image recording condition setting method in drive recorder | |
JP4439551B2 (en) | Vehicle running status display method | |
JP5036787B2 (en) | Drive recorder | |
JP5220788B2 (en) | Vehicle running status display method | |
JP4679558B2 (en) | Drive recorder | |
JP4439549B2 (en) | Drive recorder | |
JP2022078053A (en) | Recording device and program | |
JP4503062B2 (en) | Playback device | |
JP4931979B2 (en) | Drive recorder | |
JP4684272B2 (en) | Drive recorder | |
JP4531085B2 (en) | Drive recorder | |
WO2009041721A1 (en) | Drive recorder | |
JP2009087066A (en) | Drive recorder setting method | |
JP5289015B2 (en) | Memory card reading control device and program | |
JP2010250608A (en) | Drive recorder and method for correcting sensibility of the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: FUJITSU TEN LIMITED, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YAGO, MARIKO;ISHIMIZU, ATSUSHI;TONOKAWA, FUJIO;AND OTHERS;REEL/FRAME:023798/0798 Effective date: 20091209 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20210416 |