JP2009284470A - In-vehicle camera apparatus - Google Patents

In-vehicle camera apparatus Download PDF

Info

Publication number
JP2009284470A
JP2009284470A JP2009083974A JP2009083974A JP2009284470A JP 2009284470 A JP2009284470 A JP 2009284470A JP 2009083974 A JP2009083974 A JP 2009083974A JP 2009083974 A JP2009083974 A JP 2009083974A JP 2009284470 A JP2009284470 A JP 2009284470A
Authority
JP
Japan
Prior art keywords
shutter
signal
monitor
vehicle camera
shutter signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2009083974A
Other languages
Japanese (ja)
Other versions
JP5103429B2 (en
Inventor
Jun Hayakawa
絢 早川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Priority to JP2009083974A priority Critical patent/JP5103429B2/en
Publication of JP2009284470A publication Critical patent/JP2009284470A/en
Application granted granted Critical
Publication of JP5103429B2 publication Critical patent/JP5103429B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide an in-vehicle camera apparatus for surely detecting whether a shutter signal is transferred from a control section to an imaging element. <P>SOLUTION: An in-vehicle camera apparatus includes: an imaging element; a vertical driver IC connected to the imaging element; a control section for controlling a shutter; a monitor circuit which acquires a monitor signal from wiring of the shutter signal between the imaging element and the vertical driver IC; and a microcomputer which is connected to the monitor circuit for monitoring whether or not the wiring of the shutter signal is normal, on the basis of the monitor signal. A bias voltage can also be applied to the shutter signal. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

本発明は、自動車に搭載する車載カメラ装置に関する。   The present invention relates to an in-vehicle camera device mounted on an automobile.

ＣＣＤのような撮像素子は、電子シャッターで電荷を捨てることで電荷量を調整することができる。つまり電子シャッターの開放時間を長く、又は短く制御することで明るさを変化させている（開放時間が長いと画面は明るく、短いと暗くなる）。ここで、制御信号の断線を回路的に検知する技術がある（特許文献１参照）。   An image sensor such as a CCD can adjust the amount of charge by discarding the charge with an electronic shutter. That is, the brightness is changed by controlling the opening time of the electronic shutter to be long or short (the screen is bright when the opening time is long, and dark when it is short). Here, there is a technique for detecting disconnection of a control signal in a circuit manner (see Patent Document 1).

特開平７−１４１５８３号公報Japanese Patent Application Laid-Open No. 7-141583

特許文献１によれば、シャッター信号の配線の断線を検出できるが、撮像素子内部で電圧バイアスが掛かっているＣＣＤのような場合、ＣＣＤの足が断線又はオープンしてしまうと検出できない、という課題がある。   According to Patent Document 1, the disconnection of the shutter signal wiring can be detected. However, in the case of a CCD in which a voltage bias is applied inside the imaging device, it cannot be detected if the CCD foot is disconnected or opened. There is.

そこで、本発明の目的は、シャッター信号が制御部から撮像素子に伝達されているかを確実に検出する車載カメラ装置を提供することにある。   Therefore, an object of the present invention is to provide an in-vehicle camera device that reliably detects whether a shutter signal is transmitted from a control unit to an image sensor.

上記課題を解決するため、本発明の望ましい態様の一つは次の通りである。   In order to solve the above problems, one of the desirable embodiments of the present invention is as follows.

車載カメラ装置は、撮像素子と、撮像素子に接続される垂直ドライバＩＣと、シャッターを制御する制御部と、撮像素子及び垂直ドライバＩＣ間のシャッター信号の配線からモニタ信号を取得するモニタ回路と、モニタ回路に接続され、モニタ信号に基づいてシャッター信号の配線が正常か否かをモニタするマイコンを備える。   The in-vehicle camera device includes an imaging device, a vertical driver IC connected to the imaging device, a control unit that controls a shutter, a monitor circuit that acquires a monitor signal from a wiring of a shutter signal between the imaging device and the vertical driver IC, A microcomputer is connected to the monitor circuit and monitors whether or not the shutter signal wiring is normal based on the monitor signal.

本発明によれば、シャッター信号が制御部から撮像素子に伝達されているかを確実に検出する車載カメラ装置を提供することができる。   ADVANTAGE OF THE INVENTION According to this invention, the vehicle-mounted camera apparatus which detects reliably whether the shutter signal is transmitted to the image pick-up element from a control part can be provided.

車載カメラ装置における機能モジュールの構成を示す図。The figure which shows the structure of the functional module in a vehicle-mounted camera apparatus. 通常時のシャッター信号及びモニタ信号の波形を示す図。The figure which shows the waveform of the shutter signal and monitor signal at the time of normal. マイコン１０５でのシャッター信号の診断方法を示す図。The figure which shows the diagnostic method of the shutter signal in the microcomputer 105. FIG. シャッター信号１が断線した場合について示す図。The figure shown about the case where the shutter signal 1 is disconnected. 制御部１０３からのシャッター信号１の様子を示す図。The figure which shows the mode of the shutter signal 1 from the control part 103. FIG. シャッター信号２のラインの、垂直ドライバＩＣ１０２側が断線した場合について示す図。The figure shown about the case where the vertical driver IC102 side of the line of the shutter signal 2 is disconnected. シャッター信号１の、通常時の動作を示す図。The figure which shows the operation | movement at the normal time of the shutter signal 1. FIG. シャッター信号２のラインの、ＣＣＤ１０１側が断線した場合について示す図。The figure shown about the case where the CCD101 side of the line of the shutter signal 2 is disconnected. シャッター信号１の、通常時の動作を示す図。The figure which shows the operation | movement at the normal time of the shutter signal 1. FIG. 通常のシャッター制御波形とその際に取得した画像を示す図。The figure which shows a normal shutter control waveform and the image acquired in that case. シャッター信号最大開放状態の様子を示す図。The figure which shows the mode of a shutter signal maximum open state. シャッター信号最小開放状態の様子を示す図。The figure which shows the mode of a shutter signal minimum open state.

以下、図面を用いて、実施例について説明する。   Embodiments will be described below with reference to the drawings.

図１は、車載カメラ装置における機能モジュールの構成を示す図である。   FIG. 1 is a diagram illustrating a configuration of a functional module in an in-vehicle camera device.

車載カメラ装置は、ＣＣＤ（撮像素子）１０１，垂直ドライバＩＣ１０２，シャッターを制御する制御部１０３，モニタ回路１０４、及びマイコン１０５から構成される。マイコン１０５は、ＣＣＤ１０１と垂直ドライバＩＣ１０２間のシャッター信号２の配線を、モニタ回路１０４を通じてモニタする。   The in-vehicle camera device includes a CCD (imaging device) 101, a vertical driver IC 102, a control unit 103 that controls a shutter, a monitor circuit 104, and a microcomputer 105. The microcomputer 105 monitors the wiring of the shutter signal 2 between the CCD 101 and the vertical driver IC 102 through the monitor circuit 104.

制御部１０３からのシャッター信号１は、垂直ドライバＩＣ１０２でバッファリング及び電圧変換（昇圧）され、シャッター信号２としてＣＣＤ１０１に入力される。   The shutter signal 1 from the control unit 103 is buffered and voltage-converted (boosted) by the vertical driver IC 102 and input to the CCD 101 as the shutter signal 2.

モニタ回路１０４は、ＣＣＤ１０１に入力される直前のラインの信号を、モニタ信号１として取り出し、マイコン１０５でモニタできる電圧まで降圧するなどの処理を施してモニタ信号２に変換し、マイコン１０５に送信する。マイコン１０５は、当該モニタ信号２をモニタする。   The monitor circuit 104 takes out the signal of the line immediately before being input to the CCD 101 as the monitor signal 1, performs processing such as stepping down to a voltage that can be monitored by the microcomputer 105, converts it to the monitor signal 2, and transmits it to the microcomputer 105. . The microcomputer 105 monitors the monitor signal 2.

図２は、通常時（シャッター信号の断線や地絡，天絡が無い状態）のシャッター信号及びモニタ信号の波形を示す図である。   FIG. 2 is a diagram illustrating the waveforms of the shutter signal and the monitor signal in a normal state (the state where there is no disconnection, ground fault, or sky fault of the shutter signal).

通常、シャッター信号１の電圧レベルは、制御部１０３のＩ／Ｏ電圧で決まり、パルスの周期に応じてシャッターの開放時間を決める。図２では、シャッター信号１の電圧は、０Ｖ〜３.３Ｖである。その後、シャッター信号１は垂直ドライバＩＣ１０２により反転バッファリング及び昇圧されてシャッター信号２となりＣＣＤ１０１へ入る。シャッター信号２の電圧は、７Ｖ〜２９Ｖになる。ここでシャッター信号２は、ＣＣＤ内部で通常７Ｖ程度バイアスを掛けられているため、電圧が７Ｖというバイアスを持っている。シャッター信号２のラインからモニタ信号１としてモニタ回路１０４へ入り、降圧した後のモニタ信号２の電圧は、マイコン１０５でモニタできる電圧になる。ここではマイコンのＩ／Ｏ電圧が０Ｖ〜３.３Ｖ（例：ＶＩＨ＝２.０Ｖ，ＶＩＬ＝０.７Ｖ）と仮定し、モニタ信号のラインを０.６Ｖ〜２.５Ｖ程度（電圧は、モニタ回路１０４で調整可能）とした。   Normally, the voltage level of the shutter signal 1 is determined by the I / O voltage of the control unit 103, and the shutter opening time is determined according to the pulse period. In FIG. 2, the voltage of the shutter signal 1 is 0V to 3.3V. Thereafter, the shutter signal 1 is inverted and buffered and boosted by the vertical driver IC 102 to become the shutter signal 2 and enters the CCD 101. The voltage of the shutter signal 2 is 7V to 29V. Here, since the shutter signal 2 is normally biased by about 7V inside the CCD, the voltage is 7V. The voltage of the monitor signal 2 after entering the monitor circuit 104 as the monitor signal 1 from the shutter signal 2 line and being stepped down becomes a voltage that can be monitored by the microcomputer 105. Here, it is assumed that the I / O voltage of the microcomputer is 0 V to 3.3 V (eg, VIH = 2.0 V, VIL = 0.7 V), and the monitor signal line is about 0.6 V to 2.5 V (the voltage is It can be adjusted by the monitor circuit 104).

図３は、マイコン１０５でのシャッター信号の診断方法を示す図である。図３（Ａ）は、一定期間の立上り又は立下りエッジのカウント数を診断し、図３（Ｂ）は、意図するカウント数から外れた場合に、フェールとする診断方法を示す。尚、パルスの周期を計測して意図する周期から外れている場合、フェールとする診断方法もある。   FIG. 3 is a diagram illustrating a shutter signal diagnosis method in the microcomputer 105. FIG. 3 (A) diagnoses the count number of rising or falling edges for a certain period, and FIG. 3 (B) shows a diagnosis method for failing when the count number deviates from the intended count number. There is also a diagnosis method in which a failure is determined when the pulse period is measured and deviates from the intended period.

図４は、シャッター信号１が断線した場合について示す図である。シャッター信号１が断線した場合、図５に示すように制御部１０３からのシャッター信号１は、断線しているので垂直ドライバＩＣ１０２では０Ｖ付近の一定電圧状態となり、更にシャッター信号２は垂直ドライバＩＣ１０２で反転バッファリング及び昇圧されてシャッター信号２となり電圧は２９Ｖ付近の一定電圧となる。シャッター信号２と同電位であるモニタ信号１はモニタ回路１０４で降圧され、２.５Ｖ付近の一定電圧がマイコン１０５に入力される。   FIG. 4 is a diagram illustrating a case where the shutter signal 1 is disconnected. When the shutter signal 1 is disconnected, as shown in FIG. 5, the shutter signal 1 from the control unit 103 is disconnected, so that the vertical driver IC 102 is in a constant voltage state near 0 V, and the shutter signal 2 is further transmitted by the vertical driver IC 102. Inverted buffering and boosting result in shutter signal 2, and the voltage is a constant voltage near 29V. The monitor signal 1 having the same potential as the shutter signal 2 is stepped down by the monitor circuit 104, and a constant voltage in the vicinity of 2.5 V is input to the microcomputer 105.

一定電圧がマイコン１０５でモニタされるため、前述のエッジのカウント数が０になる、又は、パルスの周期が長くなりすぎるため、マイコンで異常を検出することが可能になる。   Since the constant voltage is monitored by the microcomputer 105, the above-mentioned edge count becomes 0, or the pulse cycle becomes too long, so that the microcomputer can detect an abnormality.

図６は、シャッター信号２のラインの、垂直ドライバＩＣ１０２側が断線した場合について示す図である。シャッター信号２のラインで、モニタ信号１との分岐よりも垂直ドライバＩＣ１０２側が断線した場合、図７に示すようにシャッター信号１は通常通り（断線前の状態）であるが、シャッター信号２は、ＣＣＤ１０１の入力側では７Ｖ付近（ＣＣＤ内部でバイアス電圧が約７Ｖ掛かるため）の一定電圧となる。モニタ信号１も同様に７Ｖ付近の一定電圧となる。よって、モニタ回路１０４を通過した後のモニタ信号２は約０.６Ｖ程度になる。   FIG. 6 is a diagram illustrating a case where the line of the shutter signal 2 is disconnected on the vertical driver IC 102 side. When the vertical driver IC 102 is disconnected from the branch of the monitor signal 1 in the shutter signal 2 line, the shutter signal 1 is normal (state before disconnection) as shown in FIG. On the input side of the CCD 101, the voltage is a constant voltage around 7V (because a bias voltage of about 7V is applied inside the CCD). Similarly, the monitor signal 1 has a constant voltage in the vicinity of 7V. Therefore, the monitor signal 2 after passing through the monitor circuit 104 is about 0.6V.

一定電圧がマイコン１０５でモニタされるため、前述のエッジのカウント数が０になる、又は、パルスの周期が長くなりすぎるため、マイコン１０５で異常を検出することが可能になる。   Since the constant voltage is monitored by the microcomputer 105, the above-mentioned edge count becomes 0, or the pulse cycle becomes too long, so that the microcomputer 105 can detect an abnormality.

図８は、シャッター信号２のラインの、モニタ信号１との分岐よりもＣＣＤ１０１側が断線した場合について示す図である。   FIG. 8 is a diagram showing a case where the CCD 101 side is disconnected from the branch of the line of the shutter signal 2 with the monitor signal 1.

この場合、図９に示すようにシャッター信号１は通常通り（断線前の状態）であるが、シャッター信号２のラインの、モニタ信号１との分岐よりも垂直ドライバＩＣ１０２側は、ＣＣＤ１０１の内部のバイアス回路によりバイアスが発生しないため、７Ｖ〜２９Ｖの電圧波形からバイアス分７Ｖの電圧を差し引いた０Ｖ〜２２Ｖの電圧波形となる。モニタ信号も同様に０Ｖ〜２２Ｖの電圧波形となり、モニタ回路１０４で降圧され、モニタ信号２、電圧０Ｖ〜１.８Ｖの電圧となりマイコン１０５に入力される。   In this case, as shown in FIG. 9, the shutter signal 1 is normal (the state before disconnection), but the vertical driver IC 102 side of the shutter signal 2 line from the branch with the monitor signal 1 is inside the CCD 101. Since no bias is generated by the bias circuit, a voltage waveform of 0V to 22V is obtained by subtracting a voltage of 7V from the voltage waveform of 7V to 29V. Similarly, the monitor signal also has a voltage waveform of 0 V to 22 V, and is stepped down by the monitor circuit 104 to become the monitor signal 2, a voltage of 0 V to 1.8 V, and is input to the microcomputer 105.

マイコン１０５ではモニタ信号２の一定電圧が入力されるのではなく、０Ｖ〜１.８Ｖが入力される。しかし、マイコン１０５のＨＩとＬＯの閾値がＶＩＨ＝２.０Ｖ，ＶＩＬ＝０.７Ｖとするとモニタ信号２の０Ｖ〜１.８Ｖの電圧では、マイコン１０５のＶＩＨの閾値を超えることができないため、ＨＩとして認識されないことを利用することができる。即ち、マイコン１０５から見るとＬＯの一定電圧が検出されていることになり、前述のエッジのカウント数が０になる、又は、パルスの周期が長くなりすぎるため、マイコンで異常を検出することが可能になる。   In the microcomputer 105, the constant voltage of the monitor signal 2 is not input, but 0V to 1.8V is input. However, if the HI and LO thresholds of the microcomputer 105 are VIH = 2.0V and VIL = 0.7V, the monitor signal 2 voltage of 0V to 1.8V cannot exceed the VIH threshold of the microcomputer 105. The fact that it is not recognized as HI can be used. That is, when viewed from the microcomputer 105, a constant voltage of LO is detected, and the above-mentioned edge count becomes 0, or the pulse cycle becomes too long, so the microcomputer can detect an abnormality. It becomes possible.

モニタ回路１０４は、分圧抵抗で構成する場合、抵抗値を大きめにして大元のシャッター信号２に影響を及ぼさないようにする。但し、大きくしすぎるとモニタ信号２の出力インピーダンスが下がるため、数ｋΩ〜数百Ωが望ましい。   When the monitor circuit 104 is constituted by a voltage dividing resistor, the resistance value is increased so that the original shutter signal 2 is not affected. However, if the value is too large, the output impedance of the monitor signal 2 is lowered, so several kΩ to several hundred Ω is desirable.

モニタ回路１０４は、コンパレータ等で構成する場合、コンパレータの定数によりＨＩとＬＯの電圧を任意に設定できる。又、モニタ信号２の出力インピーダンスを低くできるメリットがある。   When the monitor circuit 104 is composed of a comparator or the like, the voltages of HI and LO can be arbitrarily set by the constants of the comparator. Further, there is an advantage that the output impedance of the monitor signal 2 can be lowered.

モニタ回路１０４は、高電圧を降圧するため、回路保護用のツェナダイオード又はクランプダイオード等を入れておく方が望ましい。但し、ツェナダイオード又はクランプダイオード等の寄生容量によりモニタ信号１の波形に影響を及ぼさないよう、寄生容量の少ないものが望ましい。   The monitor circuit 104 preferably includes a Zener diode or a clamp diode for circuit protection in order to step down a high voltage. However, it is desirable that the parasitic capacitance is small so that the waveform of the monitor signal 1 is not affected by the parasitic capacitance such as a Zener diode or a clamp diode.

次に、ハード的にモニタ回路を車載カメラに配置するのではなく、現存する車載カメラシステムにおいてソフトの処理だけでシャッター信号の断線を検知する方法について説明する。   Next, a method for detecting disconnection of a shutter signal only by software processing in an existing in-vehicle camera system, instead of arranging a monitor circuit in the in-vehicle camera in hardware, will be described.

ここで、シャッター信号の配線の断線が発生すると、一定の電子シャッターで撮像される画像は、開放時間が中途半端になる。即ち、シャッター時間が短すぎるのであれば暗い画像、長すぎれば明るい画像が撮像される。画像処理をしているマイコンが撮像した画面の明るさを比較して、明らかに明るすぎる又は明らかに暗すぎる画像であれば、シャッターの制御ができていないということで、シャッターの異常を検出できるが、シャッター時間が中途半端な場合、撮像される画面は普通に映っているように判断されてしまうため、異常を検出できない。又、周囲がやや明るめの環境や、逆にトンネルなどのように周囲がやや暗めの環境においても、意図しないシャッター値で撮像されているため、取得画像が明るすぎたり暗すぎたりする可能性がある。   Here, when disconnection of the shutter signal wiring occurs, an image captured with a certain electronic shutter has an open time halfway. That is, if the shutter time is too short, a dark image is captured, and if it is too long, a bright image is captured. Comparing the brightness of the screen imaged by the microcomputer that is processing the image, if the image is clearly too bright or clearly too dark, it can detect the shutter abnormality because the shutter cannot be controlled. However, when the shutter time is halfway, it is determined that the screen to be picked up appears to be normal, so an abnormality cannot be detected. Also, even in an environment where the surroundings are slightly bright, or conversely, such as tunnels, where the surroundings are slightly dark, images are captured with unintended shutter values, so the acquired image may be too bright or too dark. is there.

特に、車両や歩行者，車線などの立体物を認識する車載カメラ装置の場合、認識する上で最適なシャッター制御を行う必要がある。このシャッター制御が機能しないと、意図しない取得画像が明るすぎたり暗すぎたりするため、立体物を誤認識してしまう、又は、本来見えて欲しい立体物を認識できなくなるため、車両に誤った情報や誤制御をしてしまうという課題がある。   In particular, in the case of an in-vehicle camera device that recognizes a three-dimensional object such as a vehicle, a pedestrian, or a lane, it is necessary to perform optimum shutter control for recognition. If this shutter control does not function, an unintended acquired image may be too bright or too dark, which may result in misrecognizing a three-dimensional object, or a three-dimensional object that the user originally wants to see cannot be recognized. There is a problem of erroneous control.

図１０は、通常のシャッター制御波形とその際に取得した画像を示す図である。撮像する際に故意にシャッターを最大開放状態にして撮像する。すると、図１１のようにシャッター信号１と２のパルス数は少なくなり、撮像した画像は明るく撮像される。このときの画面の平均輝度を計算する。理論的には図１０で撮像した画像よりも明るくなる場合、シャッター機能が正常に機能していることになり、シャッター信号１と２が制御部１０３からＣＣＤ１０１まで伝送されていることを示す。   FIG. 10 is a diagram illustrating a normal shutter control waveform and an image acquired at that time. When taking an image, the image is intentionally set with the shutter fully open. Then, as shown in FIG. 11, the number of pulses of the shutter signals 1 and 2 decreases, and the captured image is captured brightly. The average brightness of the screen at this time is calculated. Theoretically, when the image becomes brighter than the image captured in FIG. 10, the shutter function is functioning normally, indicating that the shutter signals 1 and 2 are transmitted from the control unit 103 to the CCD 101.

又、撮像する際に故意にシャッターを最小開放状態（最大に閉じる状態）にして撮像する。すると、図１２のようにシャッター信号１と２のパルス数は多くなり、撮像した画像は暗く撮像される。このときの画面の平均輝度を計算する。理論的には図１０で撮像した画像よりも暗くなる。もちろん、図１１で撮像した画像よりも更に暗くなると言える。   In addition, when taking an image, the image is intentionally set to a minimum open state (a state in which the shutter is closed to the maximum). Then, as shown in FIG. 12, the number of pulses of the shutter signals 1 and 2 increases, and the captured image is captured darkly. The average brightness of the screen at this time is calculated. Theoretically, the image is darker than the image captured in FIG. Of course, it can be said that the image is darker than the image captured in FIG.

ソフトの処理だけでシャッター信号の断線を検知する方法は、車載カメラのアプリケーションが実行されている途中に上記の診断を入れることが可能であれば、断線を瞬時に検知できるため、入れるほうが望ましい。   As a method for detecting the disconnection of the shutter signal only by software processing, it is preferable to insert the above-mentioned diagnosis because the disconnection can be detected instantaneously if the above diagnosis can be performed while the application of the in-vehicle camera is being executed.

しかし、車載カメラのアプリケーションが実行されている途中に上記の診断を入れることが困難な場合（アプリケーションの負荷や性能に影響を及ぼす場合）は、カメラの起動時又は停止時等に実施することができる。   However, if it is difficult to put the above diagnosis in the middle of the application of the in-vehicle camera (if it affects the load or performance of the application), it can be performed when the camera is started or stopped. it can.

周囲の環境が真っ暗である場合、故意にシャッター信号を最大開放状態にしても撮像する画面の明るさが変化せず、平均輝度が高くならない場合もある。その際は、ドライバがヘッドライトを点灯するタイミング時、周囲の環境がある程度明るくなった場合に、診断を実施してもよい。   If the surrounding environment is completely dark, even if the shutter signal is intentionally opened to the maximum open state, the brightness of the screen to be captured does not change, and the average luminance may not increase. In that case, when the driver turns on the headlight, the diagnosis may be performed when the surrounding environment becomes bright to some extent.

周期の環境が明る過ぎる場合（太陽の逆光等）は、故意にシャッター信号を最小開放状態にしても撮像する画面の明るさが大きく変化せず、平均輝度が低くならない場合もある。その際は、ドライバが運転を始め逆光が出なくなった場合に診断を実施してもよい。   If the environment of the cycle is too bright (backlight from the sun, etc.), even if the shutter signal is intentionally in the minimum open state, the brightness of the screen to be imaged does not change significantly, and the average luminance may not be lowered. In that case, the diagnosis may be performed when the driver starts driving and no backlight is emitted.

次に、シャッター信号をハード的にモニタする診断又は、シャッターを最大開放状態又は最小開放状態にして撮像して画面の平均輝度の変化を見る診断によりＮＧが出た場合の処理について説明する。   Next, a description will be given of processing in the case where NG is output by a diagnosis in which the shutter signal is monitored in hardware or a diagnosis in which the shutter is set to the maximum open state or the minimum open state and the change in the average luminance of the screen is observed.

車載カメラ装置において、車両制御を実施している場合、カメラからの制御を停止状態にする（加速，減速，操舵，ランプ点灯，ワイパー，デフロスター等）。これは、シャッター信号異常により誤認識する可能性が高くなるため、例え誤認識したとしても誤認識による誤制御を防止するための安全確保を最優先にしている。   When vehicle control is performed in the in-vehicle camera device, control from the camera is stopped (acceleration, deceleration, steering, lamp lighting, wiper, defroster, etc.). This increases the possibility of misrecognition due to an abnormal shutter signal. Therefore, even if misrecognition is made, the highest priority is given to ensuring safety to prevent erroneous control due to misrecognition.

次に、車両制御する際の判断部の認識処理を停止する。制御不可であるため認識処理を停止することで最小限のハード・ソフト構成で動作させることが望ましい。   Next, the recognition process of the determination part at the time of vehicle control is stopped. Since control is impossible, it is desirable to operate with a minimum hardware / software configuration by stopping the recognition process.

その後、車両側には、ＣＡＮ等の車内ネットワークを介して、シャッター信号が異常であることを通知して、ドライバに注意を促す。   Thereafter, the vehicle side is notified via the in-vehicle network such as CAN that the shutter signal is abnormal, and the driver is alerted.

本実施例によれば、コンパレータや２ポート占有しない、低コストでシンプルな構成で、シャッター信号が制御側から撮像素子に伝達されているかを確実に検出するフェールセーフ機能を実現することができる。   According to the present embodiment, it is possible to realize a fail-safe function that reliably detects whether a shutter signal is transmitted from the control side to the image sensor with a low-cost and simple configuration that does not occupy a comparator or two ports.

尚、図１に示すようなハード的にシャッター信号をモニタする場合、モニタ回路１０４が故障すると、モニタ回路１０４が異常になりマイコン１０５で異常を検出する可能性がある。これは本来モニタしているシャッター信号２が断線など無く動いていても、マイコン１０５は異常と判断する。よって、このようなモニタ回路１０４の故障も検出できた方が、故障部位の検出が容易になる。そこで、図１０，図１１，図１２に示すようなソフトの処理だけでシャッター信号の断線を検知する方法を併用することでモニタ回路１０４の故障も検出可能となる。   When the shutter signal is monitored by hardware as shown in FIG. 1, if the monitor circuit 104 fails, the monitor circuit 104 becomes abnormal and the microcomputer 105 may detect the abnormality. This is because even if the shutter signal 2 originally monitored moves without disconnection or the like, the microcomputer 105 determines that it is abnormal. Therefore, it is easier to detect the faulty part if the fault of the monitor circuit 104 can be detected. Therefore, the failure of the monitor circuit 104 can also be detected by using a method of detecting the disconnection of the shutter signal only by software processing as shown in FIG. 10, FIG. 11, and FIG.

通常動作中は、車載カメラのアプリケーションが実行されている途中に、ソフトの処理だけでシャッター信号の断線を検知する診断を入れることが難しい場合が多い。そこで、通常動作中は図１のようなハード的なモニタ回路１０４を入れマイコン１０５でシャッター信号の断線を検知する。マイコン１０５が異常を検出した場合、まず車載カメラのアプリケーションを一時停止させて、図１０，図１１，図１２に示すようなソフトの処理だけでシャッター信号の断線を検知するソフトを起動してソフト的にシャッター信号が断線していないかを診断する。ここでソフト的に断線していると判断されれば実際に断線していると言える。   During normal operation, it is often difficult to put in a diagnosis that detects disconnection of the shutter signal only by software processing while the application for the in-vehicle camera is being executed. Therefore, during normal operation, the hardware monitor circuit 104 as shown in FIG. 1 is inserted and the microcomputer 105 detects the disconnection of the shutter signal. When the microcomputer 105 detects an abnormality, first, the application of the in-vehicle camera is temporarily stopped, and the software for detecting the disconnection of the shutter signal is started only by the software processing as shown in FIGS. Diagnose whether the shutter signal is broken. If it is judged here that it is disconnected in software, it can be said that it is actually disconnected.

一方、ソフト的に断線が検出できない場合は、モニタ回路１０４が故障している可能性が高い。車載カメラのアプリケーションは、車載カメラシステム上、安全面等を考慮して止める場合と、性能面からを動かし続ける場合がある。   On the other hand, if the disconnection cannot be detected by software, there is a high possibility that the monitor circuit 104 has failed. The application of the in-vehicle camera may be stopped in consideration of safety or the like on the in-vehicle camera system, or may continue to move from the performance aspect.

結果として、２つのハード的な診断とソフト的な診断を組み合わせることで、カメラ動作中も最小限の車載カメラのアプリケーション停止時間で、シャッター信号の断線をより確実に検出することが可能になる。   As a result, by combining the two hardware diagnosis and the software diagnosis, it becomes possible to more reliably detect the disconnection of the shutter signal with the minimum application stop time of the in-vehicle camera even during the operation of the camera.

１０１ ＣＣＤ
１０２ 垂直ドライバＩＣ
１０３ 制御部
１０４ モニタ回路
１０５ マイコン 101 CCD
102 Vertical driver IC
103 Control Unit 104 Monitor Circuit 105 Microcomputer

Claims (5)

撮像素子と、
前記撮像素子に接続される垂直ドライバＩＣと、
シャッターを制御する制御部と、
前記撮像素子及び前記垂直ドライバＩＣ間のシャッター信号の配線からモニタ信号を取得するモニタ回路と、
前記モニタ回路に接続され、前記モニタ信号に基づいて前記シャッター信号の配線が正常か否かをモニタするマイコンを備える、車載カメラ装置。 An image sensor;
A vertical driver IC connected to the image sensor;
A control unit for controlling the shutter;
A monitor circuit for obtaining a monitor signal from a wiring of a shutter signal between the image sensor and the vertical driver IC;
An in-vehicle camera device comprising a microcomputer connected to the monitor circuit and monitoring whether or not the shutter signal wiring is normal based on the monitor signal. 前記シャッター信号には、バイアス電圧が加えられる、請求項１記載の車載カメラ装置。   The in-vehicle camera device according to claim 1, wherein a bias voltage is applied to the shutter signal. シャッターを制御する制御部と、
シャッター信号の配線が正常か否かをモニタするモニタ部を備え、
前記制御部は、シャッターを最大開放状態にして撮像したときの第１の平均輝度、及び、シャッターを最大閉鎖状態にして撮像したときの第２の平均輝度を算出し、
前記モニタ部は、前記第１及び第２の平均輝度に基づいて、前記配線が正常か否かを判断する、車載カメラ装置。 A control unit for controlling the shutter;
A monitor unit is provided to monitor whether the shutter signal wiring is normal,
The control unit calculates a first average luminance when imaged with the shutter in the maximum open state, and a second average luminance when imaged with the shutter in the maximum closed state,
The monitor unit is an in-vehicle camera device that determines whether the wiring is normal based on the first and second average luminances. 前記モニタ部は、車載カメラが起動時又は停止時に、前記配線が正常か否かを判断する、請求項３記載の車載カメラ装置。   The in-vehicle camera device according to claim 3, wherein the monitor unit determines whether or not the wiring is normal when the in-vehicle camera is activated or stopped. 配線の異常を検知した場合、車載カメラの認識処理を停止し、異常が発生していることを運転者に知らせる機能を有する、請求項１記載または請求項２記載の車載カメラ装置。   The in-vehicle camera device according to claim 1 or 2, further comprising a function of stopping recognition processing of the in-vehicle camera and notifying the driver that an abnormality has occurred when an abnormality in wiring is detected.
JP2009083974A 2008-04-25 2009-03-31 In-vehicle camera device Active JP5103429B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2009083974A JP5103429B2 (en) 2008-04-25 2009-03-31 In-vehicle camera device

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2008114760 2008-04-25
JP2008114760 2008-04-25
JP2009083974A JP5103429B2 (en) 2008-04-25 2009-03-31 In-vehicle camera device

Publications (2)

Publication Number Publication Date
JP2009284470A true JP2009284470A (en) 2009-12-03
JP5103429B2 JP5103429B2 (en) 2012-12-19

Family

ID=41454392

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009083974A Active JP5103429B2 (en) 2008-04-25 2009-03-31 In-vehicle camera device

Country Status (1)

Country Link
JP (1) JP5103429B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017209221A1 (en) 2016-05-31 2017-12-07 ソニーセミコンダクタソリューションズ株式会社 Image capturing device, image capturing method, camera module, and electronic device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07141583A (en) * 1993-11-12 1995-06-02 Yazaki Corp Disconnection detection device
JP2000223688A (en) * 1999-01-29 2000-08-11 Sony Corp Solid state image pickup device and camera system
JP2002181867A (en) * 2000-12-15 2002-06-26 Nippon Densan Corp State detection device for sensor
JP2003038435A (en) * 2001-07-27 2003-02-12 Pentax Corp Electronic endoscope device
JP2004363846A (en) * 2003-06-04 2004-12-24 Calsonic Kansei Corp Image processing apparatus
JP2005073296A (en) * 2004-10-27 2005-03-17 Mitsubishi Electric Corp Exposure control apparatus for on-vehicle camera
JP2006212248A (en) * 2005-02-04 2006-08-17 Pentax Corp Damage prevention system for ccd

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07141583A (en) * 1993-11-12 1995-06-02 Yazaki Corp Disconnection detection device
JP2000223688A (en) * 1999-01-29 2000-08-11 Sony Corp Solid state image pickup device and camera system
JP2002181867A (en) * 2000-12-15 2002-06-26 Nippon Densan Corp State detection device for sensor
JP2003038435A (en) * 2001-07-27 2003-02-12 Pentax Corp Electronic endoscope device
JP2004363846A (en) * 2003-06-04 2004-12-24 Calsonic Kansei Corp Image processing apparatus
JP2005073296A (en) * 2004-10-27 2005-03-17 Mitsubishi Electric Corp Exposure control apparatus for on-vehicle camera
JP2006212248A (en) * 2005-02-04 2006-08-17 Pentax Corp Damage prevention system for ccd

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017209221A1 (en) 2016-05-31 2017-12-07 ソニーセミコンダクタソリューションズ株式会社 Image capturing device, image capturing method, camera module, and electronic device
KR20190015201A (en) 2016-05-31 2019-02-13 소니 세미컨덕터 솔루션즈 가부시키가이샤 IMAGING APPARATUS AND IMAGING METHOD, CAMERA MODULE,
KR20190092620A (en) 2016-05-31 2019-08-07 소니 세미컨덕터 솔루션즈 가부시키가이샤 Imaging apparatus and imaging method, camera module module, and electronic apparatus
US10659707B2 (en) 2016-05-31 2020-05-19 Sony Semiconductor Solutions Corporation Imaging apparatus and imaging method, camera module, and electronic apparatus capable of detecting a failure in a structure in which substrates are stacked
KR20200067927A (en) 2016-05-31 2020-06-12 소니 세미컨덕터 솔루션즈 가부시키가이샤 Imaging apparatus and imaging method, camera module, and electronic apparatus
EP3726830A1 (en) 2016-05-31 2020-10-21 Sony Semiconductor Solutions Corporation Image capturing device, image capturing method, camera module, and electronic device
EP3748955A1 (en) 2016-05-31 2020-12-09 Sony Semiconductor Solutions Corporation Imaging apparatus and imaging method, camera module, and electronic apparatus
KR20210046858A (en) 2016-05-31 2021-04-28 소니 세미컨덕터 솔루션즈 가부시키가이샤 Imaging apparatus and imaging method, camera module, and electronic apparatus
US11082651B2 (en) 2016-05-31 2021-08-03 Sony Semiconductor Solutions Corporation Imaging apparatus and imaging method, camera module, and electronic apparatus capable of detecting a failure in a structure in which substrates are stacked
US11089248B2 (en) 2016-05-31 2021-08-10 Sony Semiconductor Solutions Corporation Imaging apparatus and imaging method, camera module, and electronic apparatus capable of detecting a failure in a structure in which substrates are stacked
US11588990B2 (en) 2016-05-31 2023-02-21 Sony Semiconductor Solutions Corporation Imaging apparatus and imaging method, camera module, and electronic apparatus capable of detecting a failure in a structure in which substrates are stacked
US11843881B2 (en) 2016-05-31 2023-12-12 Sony Semiconductor Solutions Corporation Imaging apparatus and imaging method, camera module, and electronic apparatus capable of detecting a failure in a structure in which substrates are stacked

Also Published As

Publication number Publication date
JP5103429B2 (en) 2012-12-19

Similar Documents

Publication Publication Date Title
JP4670940B2 (en) Electronic safing system
US7930080B2 (en) Passenger protecting apparatus and method for protecting passenger
US20130015797A1 (en) Electronic control unit for vehicle and semiconductor integrated circuit device
US6587769B2 (en) Method and device for controlling firing circuits for restraining devices
JP2015115692A (en) Semiconductor abnormality detection circuit
JP5506958B2 (en) Engine control apparatus and engine control method for operating current circuit
EP1883252B1 (en) Abnormality detecting apparatus
JP5103429B2 (en) In-vehicle camera device
JP2021503263A (en) Camera system test method, camera system controller, camera system, and vehicle with camera system
KR102100861B1 (en) An Apparatus And A Method For Testing A Low-side Driving IC
KR100488842B1 (en) Fault diagnosis system for vehicle
CN109690333B (en) Electronic control device and method for diagnosing connection state of electronic control device
JP5817585B2 (en) Electronic control unit
KR100552771B1 (en) automatic light system of vehicle
US6525478B2 (en) Device for checking the evaluation circuit for automatic switching operations of illumination device in vehicles
WO2013146744A1 (en) Image pickup apparatus
JPWO2020110821A1 (en) Control method of load drive device and fuel injection device
KR101024496B1 (en) Apparatus for protecting speed sensor in vehicle
KR100717950B1 (en) Lamp driving apparatus and method of car
GB2255410A (en) Digital sensors
KR102159363B1 (en) Lamp Fault Detection System and Method of
JP7124808B2 (en) power supply
KR20170030812A (en) Apparatuses And Methods For Diagnostic Of Rear Lamp
US11373283B2 (en) Object monitoring device
US20210295072A1 (en) Apparatus, method, and program for determining abnormality in internal devices

Legal Events

Date Code Title Description
A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A712

Effective date: 20100108

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20100910

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100910

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120111

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120117

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120319

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20120410

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120709

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120711

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20120801

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20120904

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20121001

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20151005

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Ref document number: 5103429

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350