WO2014196166A1 - Image pickup control apparatus - Google Patents
Image pickup control apparatus Download PDFInfo
- Publication number
- WO2014196166A1 WO2014196166A1 PCT/JP2014/002814 JP2014002814W WO2014196166A1 WO 2014196166 A1 WO2014196166 A1 WO 2014196166A1 JP 2014002814 W JP2014002814 W JP 2014002814W WO 2014196166 A1 WO2014196166 A1 WO 2014196166A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- imaging
- exposure time
- unit
- maximum
- amplification factor
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
- G03B7/30—Safety arrangements for control of exposure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
Definitions
- the present disclosure relates to an imaging control apparatus that controls an exposure time and an amplification factor when imaging is performed in an imaging apparatus.
- the imaging control device includes a temperature acquisition unit, a maximum time setting unit, an imaging setting unit, and an imaging instruction unit.
- the temperature acquisition unit acquires the temperature of the imaging device, and the maximum time setting unit sets a maximum exposure time that is the maximum value of the exposure time in the imaging device according to the temperature.
- the imaging setting unit sets the exposure time and the amplification factor of the imaging signal so as to be equal to or less than the maximum exposure time
- the imaging instruction unit causes the imaging device to perform imaging based on the exposure time and the amplification factor.
- the maximum exposure time is set and the exposure time is set to be equal to or less than the maximum exposure time, a favorable captured image can be obtained while reducing the hardware load of the imaging device as much as possible. Can be obtained.
- the computer may be an imaging control program for realizing the computer as each unit constituting the imaging control device. Further, the descriptions in the claims can be arbitrarily combined as much as possible. At this time, a part of the configuration may be excluded as long as the disclosed object can be achieved.
- FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 1 according to an embodiment to which the present disclosure is applied.
- 4 is a flowchart illustrating an imaging control process executed by the computer as functions of the image recognition unit 30 and the control unit 40. It is a map which shows the relationship between temperature and the maximum exposure time. It is a map which shows the relationship between exposure time and an analog gain value. It is a map which shows the relationship between average brightness
- the imaging device 1 of the present embodiment can obtain a good image by referring to a plurality of maps associated with control settings when performing imaging and performing imaging with settings based on the plurality of maps. Considered to be able to.
- the imaging device 1 includes an imaging unit 10, an illumination unit 20, an image recognition unit 30, a control unit 40, a dictionary unit 50, and a temperature sensor 60.
- the imaging device 1 is disposed, for example, inside a vehicle such as a passenger car, and is used for imaging a driver's face.
- the imaging unit 10 has a configuration as a well-known camera including a large number of imaging elements, lenses, and the like. Then, the imaging unit 10 images the imaging signal obtained from the imaging element with settings according to the drive signal transmitted from the control unit 40, and sends the captured image obtained by imaging to the image recognition unit 30.
- the illumination unit 20 is configured as an auxiliary illumination device including, for example, an LED that emits infrared light, and assists imaging by irradiating the imaging range of the imaging unit 10. Note that the illumination unit 20 operates in accordance with a drive signal from the control unit 40. Specifically, the illumination unit 20 is controlled to emit light only when the imaging unit 10 performs exposure.
- the image recognition unit 30 indicates a function executed by a computer (not shown) including a CPU, a ROM, a RAM, and the like. Specifically, in the function as the image recognition unit 30, the computer performs processing based on a program recorded in a memory such as a ROM, and in particular, detects the average luminance of a certain area constituting the captured image, and this average luminance Is sent to the control unit 40 as luminance information.
- a computer including a CPU, a ROM, a RAM, and the like.
- the computer performs processing based on a program recorded in a memory such as a ROM, and in particular, detects the average luminance of a certain area constituting the captured image, and this average luminance Is sent to the control unit 40 as luminance information.
- the control unit 40 shows the function executed by the computer, like the image recognition unit 30. Specifically, in the function of the control unit 40, the computer performs processing based on a program recorded in a memory such as a ROM, and in particular, corresponding control in a plurality of maps recorded in the dictionary unit 50 configured as a memory. A value is read, and an imaging control process (see FIG. 2) for imaging based on this control value is executed.
- the temperature sensor 60 is disposed, for example, on a substrate constituting the control unit 40 inside the imaging apparatus 1, and sends information on this temperature to the control unit 40.
- the imaging control process is a process that starts when, for example, the imaging apparatus 1 is turned on. First, temperature information is acquired from the temperature sensor 60 (S110). Subsequently, a control value for imaging is set (S120).
- the analog gain value and exposure time according to the temperature are set as control values. More specifically, the maximum exposure time corresponding to the temperature is set based on a map showing the relationship between the temperature and the maximum exposure time as shown in FIG. Then, an analog gain value is obtained based on a map showing the relationship between the exposure time and the analog gain value as shown in FIG. In these maps (FIGS. 3 to 7), the relationship is generally inversely proportional in any map.
- the exposure time can be arbitrarily set as long as it is equal to or shorter than the maximum exposure time. For this reason, for example, the exposure time may coincide with the maximum exposure time, or the maximum exposure time is multiplied by a factor (a value greater than 0 and less than or equal to 1) according to brightness (such as a luminance value described later) or temperature. It may be a value. In particular, in the example shown in FIG. 4, the exposure time is set to about 60% of the maximum exposure time.
- a drive signal for driving the imaging unit 10 and the illumination unit 20 is transmitted to the imaging unit 10 and the illumination unit 20 (S130).
- the drive signal is based on the set control values (analog gain and exposure time).
- the imaging unit 10 obtains a captured image.
- a captured image is acquired from the imaging unit 10 (S160). Then, image recognition is performed using the function of the image recognition unit 30 (S170). In the image recognition process, the position of facial parts such as eyes and nose included in the captured image is detected.
- a luminance calculation range is set (S180).
- the luminance calculation range indicates a region to be controlled to a target luminance value (average luminance) in the captured image. For example, based on the position of the face part, the entire face, cheek or forehead portion, etc. A preset area is set.
- the average luminance is calculated (S190).
- the average luminance indicates the average luminance within the above-described luminance calculation range.
- a control value for acquiring the captured image of the next frame is temporarily set based on the average luminance.
- the exposure time with respect to the average luminance is determined based on a map showing the relationship between the average luminance and the exposure time as shown in FIG.
- an analog gain value corresponding to the exposure time is set based on the map showing the relationship between the exposure time and the analog gain value shown in FIG.
- the exposure time here is set to a value equal to or less than the latest maximum exposure time set in the processing of S120 or S270.
- the control value set in this process is a “provisional” value, and is suspended until the process of S270 described later is performed, and is not reflected in the drive signal to the imaging unit 10. That is, until the process of S270 is performed, a drive signal based on the latest control value set previously is transmitted.
- temperature information is acquired again from the temperature sensor 60 (S220). Then, it is determined whether or not the control value needs to be changed based on the temperature information (S230).
- the difference temperature difference
- the process proceeds to S250 described later.
- the control value needs to be changed S230: YES
- the number M of imaging with the current control value is compared with a preset reference number n (S240).
- the reference number n is the number of times that the imaging setting (control value) for reducing the influence of the flickering of the screen and the noise due to the frequent change of the imaging setting is maintained, for example, a value of about 5 to 10 Set to
- the control unit 40 acquires the temperature of the imaging device and sets a maximum exposure time that is the maximum value of the exposure time in the imaging device according to the temperature. Then, the exposure time and the amplification factor of the imaging signal are set so as to be equal to or less than the maximum exposure time, and the imaging apparatus performs imaging based on the exposure time and the amplification factor.
- control unit 40 does not change the exposure time and the amplification factor by a predetermined number of times set in advance even if the exposure time or the amplification factor is changed (temporarily set). To perform imaging.
- the imaging apparatus 1 includes an illumination unit 20 that emits light in synchronization with the exposure time.
- heat generation due to the illumination unit 20 emitting light can be suppressed by reducing the exposure time.
- the control unit 40 sets the exposure time and the amplification factor according to the maximum exposure time, but instead of the maximum exposure time, sets the maximum light amount by the illumination unit 20 and is equal to or less than the maximum light amount.
- the light amount and the amplification factor by the illumination unit 20 may be set so that the exposure time is constant, and the imaging device 1 may be caused to perform imaging by changing the light amount and the amplification factor.
- the maximum light quantity in the illumination unit 20 is defined by the current value, and the current value corresponding to the temperature is set based on the map showing the relationship between the temperature and the current value as shown in FIG. That's fine. Further, an analog gain value corresponding to the current value may be set based on a map showing the relationship between the current value and the analog gain value as shown in FIG.
- an imaging apparatus 1 it is possible to reduce the burden on the hardware configuring the imaging apparatus 1 by changing the light amount by the illumination unit 20 to the maximum light amount or less instead of the exposure time.
- the analog gain value based on the exposure time is obtained based on the map shown in FIG. 4.
- imaging is performed by setting the exposure time and the analog gain value based on the point [A] shown in FIG.
- the analog gain value may be increased and changed to an analog gain value based on the [B] point, for example.
- the recognition rate of the target (driver's eyes etc.) in the captured image can be improved.
- control unit 40 of the above embodiment corresponds to an imaging control device. Further, the processing of S110 and S220 in the imaging control processing of the above embodiment corresponds to a temperature acquisition unit, and the processing of S120 of the above embodiment corresponds to a maximum time setting unit.
- processing of S120, S210, and S270 in the above embodiment corresponds to an imaging setting unit
- processing of S130, S230 to S250, and S280 in the above embodiment corresponds to an imaging instruction unit
- each section is expressed as S100, for example.
- each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section.
- each section configured in this manner can be referred to as a device, module, or means.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Exposure Control For Cameras (AREA)
- Stroboscope Apparatuses (AREA)
Abstract
This image pickup control apparatus acquires (S110, S220) a temperature of an image pickup apparatus, and corresponding to the temperature, the apparatus sets (S120) a maximum exposure time, i.e., a maximum value of an exposure time of the image pickup apparatus. Then, the apparatus sets (S120, S210, S270) the exposure time to be equal to or shorter than the maximum exposure time, and an amplification factor of image pickup signals, and the apparatus makes (S130, S230-S250, S280) the image pickup apparatus perform image pickup on the basis of the exposure time and the amplification factor. Since the image pickup control apparatus sets the maximum exposure time, and sets the exposure time to be equal to or shorter than the maximum exposure time, excellent picked up images can be obtained, while reducing as much as possible a load of hardware that constitutes the image pickup apparatus.
Description
本出願は、2013年6月5日に出願された日本出願番号2013-118979号に基づくもので、ここにその記載内容を援用する。
This application is based on Japanese Application No. 2013-118979 filed on June 5, 2013, the contents of which are incorporated herein by reference.
本開示は、撮像装置において撮像を行う際の露光時間および増幅率を制御する撮像制御装置に関する。
The present disclosure relates to an imaging control apparatus that controls an exposure time and an amplification factor when imaging is performed in an imaging apparatus.
上記の撮像制御装置として、撮像素子による撮像信号を増幅する際のアナログゲイン値と露光時間(露光時間)とをマップにおいて管理するものが知られている(例えば、特許文献1参照)。
As the above-described imaging control apparatus, there is known an apparatus that manages an analog gain value and an exposure time (exposure time) when amplifying an imaging signal by an imaging device in a map (for example, see Patent Document 1).
ところで一般的には、夜間の車両内部等、比較的暗い領域において撮像を行う場合、アナログゲイン値を小さくし、露光時間を長くするとノイズが少ない撮像画像が得られる傾向があることが知られている。しかしながら、露光時間を極端に長くすると、補助光源の駆動回路等、撮像に必要なハードウェアの消費電力が多くなったり発熱量が多くなったりするため、ハードウェアへの負担が大きくなってしまう。
By the way, it is generally known that when imaging is performed in a relatively dark area such as the interior of a vehicle at night, if the analog gain value is decreased and the exposure time is increased, a captured image with less noise tends to be obtained. Yes. However, if the exposure time is extremely long, power consumption of hardware necessary for imaging such as a driving circuit of an auxiliary light source increases and a heat generation amount increases, which increases the burden on the hardware.
本開示は、撮像装置による撮像時において、撮像装置を構成するハードウェアの負担を極力軽減しつつ、良好な撮像画像が得られるようにする撮像制御装置を提供することを目的とする。
It is an object of the present disclosure to provide an imaging control apparatus that can obtain a good captured image while reducing the burden on hardware constituting the imaging apparatus as much as possible during imaging by the imaging apparatus.
本開示の一態様によれば、撮像制御装置は、温度取得部と、最大時間設定部と、撮像設定部と、撮像指示部と、を備える。温度取得部は撮像装置の温度を取得し、最大時間設定部は温度に応じて撮像装置における露光時間の最大値である最大露光時間を設定する。そして、撮像設定部は、最大露光時間以下となるよう露光時間および撮像信号の増幅率を設定し、撮像指示部は、露光時間と増幅率とに基づいて撮像装置に撮像を実施させる。
According to one aspect of the present disclosure, the imaging control device includes a temperature acquisition unit, a maximum time setting unit, an imaging setting unit, and an imaging instruction unit. The temperature acquisition unit acquires the temperature of the imaging device, and the maximum time setting unit sets a maximum exposure time that is the maximum value of the exposure time in the imaging device according to the temperature. Then, the imaging setting unit sets the exposure time and the amplification factor of the imaging signal so as to be equal to or less than the maximum exposure time, and the imaging instruction unit causes the imaging device to perform imaging based on the exposure time and the amplification factor.
このような撮像制御装置によれば、最大露光時間を設定し、露光時間が最大露光時間以下になるよう設定するので、撮像装置を構成するハードウェアの負担を極力軽減しつつ、良好な撮像画像を得ることができる。
According to such an imaging control device, since the maximum exposure time is set and the exposure time is set to be equal to or less than the maximum exposure time, a favorable captured image can be obtained while reducing the hardware load of the imaging device as much as possible. Can be obtained.
なお、上記目的を達成するためには、コンピュータを、撮像制御装置を構成する各部として実現するための撮像制御プログラムとしてもよい。また、各請求項の記載は、可能な限りにおいて任意に組み合わせることができる。この際、開示の目的を達成できる範囲内において一部構成を除外してもよい。
In order to achieve the above object, the computer may be an imaging control program for realizing the computer as each unit constituting the imaging control device. Further, the descriptions in the claims can be arbitrarily combined as much as possible. At this time, a part of the configuration may be excluded as long as the disclosed object can be achieved.
本開示についての上記目的およびその他の目的、特徴や利点は、添付の図面を参照しながら下記の詳細な記述により、より明確になる。
本開示が適用された一実施形態にかかる撮像装置1の概略構成を示すブロック図である。
コンピュータが画像認識部30および制御部40の機能として実行する撮像制御処理を示すフローチャートである。
温度と最大露光時間との関係を示すマップである。
露光時間とアナログゲイン値との関係を示すマップである。
平均輝度と露光時間との関係を示すマップである。
温度と電流値との関係を示すマップである。
電流値とアナログゲイン値との関係を示すマップである。
The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings.
1 is a block diagram illustrating a schematic configuration of an imaging apparatus 1 according to an embodiment to which the present disclosure is applied. 4 is a flowchart illustrating an imaging control process executed by the computer as functions of the image recognition unit 30 and the control unit 40. It is a map which shows the relationship between temperature and the maximum exposure time. It is a map which shows the relationship between exposure time and an analog gain value. It is a map which shows the relationship between average brightness | luminance and exposure time. It is a map which shows the relationship between temperature and an electric current value. It is a map which shows the relationship between an electric current value and an analog gain value.
以下に本開示にかかる実施形態を図面と共に説明する。
Embodiments according to the present disclosure will be described below with reference to the drawings.
[実施形態の構成]
本実施形態の撮像装置1は、撮像を行う際の制御設定が対応付けられた複数のマップを参照し、これらの複数のマップに基づく設定で撮像を行うことで、良好な画像を得ることができるよう配慮されている。 [Configuration of the embodiment]
Theimaging device 1 of the present embodiment can obtain a good image by referring to a plurality of maps associated with control settings when performing imaging and performing imaging with settings based on the plurality of maps. Considered to be able to.
本実施形態の撮像装置1は、撮像を行う際の制御設定が対応付けられた複数のマップを参照し、これらの複数のマップに基づく設定で撮像を行うことで、良好な画像を得ることができるよう配慮されている。 [Configuration of the embodiment]
The
詳細には、図1に示すように、撮像装置1は、撮像部10、照明部20、画像認識部30、制御部40、辞書部50、および温度センサ60を備えて構成されている。撮像装置1は、例えば乗用車等の車両の内部に配置され、運転者の顔を撮像するため等に利用される。
Specifically, as illustrated in FIG. 1, the imaging device 1 includes an imaging unit 10, an illumination unit 20, an image recognition unit 30, a control unit 40, a dictionary unit 50, and a temperature sensor 60. The imaging device 1 is disposed, for example, inside a vehicle such as a passenger car, and is used for imaging a driver's face.
撮像部10は、多数の撮像素子やレンズ等を備えた周知のカメラとしての構成を備えている。そして撮像部10は、制御部40から送信される駆動信号に従った設定で撮像素子から得られる撮像信号を画像化し、画像化によって得られた撮像画像を画像認識部30に送る。
The imaging unit 10 has a configuration as a well-known camera including a large number of imaging elements, lenses, and the like. Then, the imaging unit 10 images the imaging signal obtained from the imaging element with settings according to the drive signal transmitted from the control unit 40, and sends the captured image obtained by imaging to the image recognition unit 30.
照明部20は、例えば赤外光を発するLED等を備えた補助照明装置として構成されており、撮像部10による撮像範囲内を照射することで、撮像を補助する。なお、照明部20は、制御部40による駆動信号に応じて作動し、詳細には、撮像部10が露光を行うタイミングだけ、発光するよう制御される。
The illumination unit 20 is configured as an auxiliary illumination device including, for example, an LED that emits infrared light, and assists imaging by irradiating the imaging range of the imaging unit 10. Note that the illumination unit 20 operates in accordance with a drive signal from the control unit 40. Specifically, the illumination unit 20 is controlled to emit light only when the imaging unit 10 performs exposure.
画像認識部30は、CPU、ROM、RAM等を備えたコンピュータ(図示省略)が実行する機能を示している。具体的に、画像認識部30としての機能では、コンピュータがROM等のメモリに記録されたプログラムに基づく処理を実施し、特に、撮像画像を構成するある領域の平均輝度を検出し、この平均輝度を輝度情報として制御部40に送る。
The image recognition unit 30 indicates a function executed by a computer (not shown) including a CPU, a ROM, a RAM, and the like. Specifically, in the function as the image recognition unit 30, the computer performs processing based on a program recorded in a memory such as a ROM, and in particular, detects the average luminance of a certain area constituting the captured image, and this average luminance Is sent to the control unit 40 as luminance information.
制御部40は、画像認識部30と同様に、コンピュータが実行する機能を示している。具体的には 制御部40の機能では、コンピュータがROM等のメモリに記録されたプログラムに基づく処理を実施し、特に、メモリとして構成された辞書部50に記録された複数のマップにおいて対応する制御値を読み出し、この制御値に基づいて撮像を行う撮像制御処理(図2参照)を実行する。
The control unit 40 shows the function executed by the computer, like the image recognition unit 30. Specifically, in the function of the control unit 40, the computer performs processing based on a program recorded in a memory such as a ROM, and in particular, corresponding control in a plurality of maps recorded in the dictionary unit 50 configured as a memory. A value is read, and an imaging control process (see FIG. 2) for imaging based on this control value is executed.
温度センサ60は、例えば、撮像装置1の内部において制御部40を構成する基板に配置されており、この温度の情報を制御部40に送る。
The temperature sensor 60 is disposed, for example, on a substrate constituting the control unit 40 inside the imaging apparatus 1, and sends information on this temperature to the control unit 40.
[本実施形態の処理]
次に、複数のマップを参照しつつ撮像処理を行う撮像制御処理について、図2を用いて説明する。撮像制御処理は、例えば、撮像装置1の電源が投入されると開始される処理であって、まず、温度センサ60から温度の情報を取得する(S110)。続いて、撮像を行う際の制御値を設定する(S120)。 [Process of this embodiment]
Next, an imaging control process for performing an imaging process with reference to a plurality of maps will be described with reference to FIG. The imaging control process is a process that starts when, for example, theimaging apparatus 1 is turned on. First, temperature information is acquired from the temperature sensor 60 (S110). Subsequently, a control value for imaging is set (S120).
次に、複数のマップを参照しつつ撮像処理を行う撮像制御処理について、図2を用いて説明する。撮像制御処理は、例えば、撮像装置1の電源が投入されると開始される処理であって、まず、温度センサ60から温度の情報を取得する(S110)。続いて、撮像を行う際の制御値を設定する(S120)。 [Process of this embodiment]
Next, an imaging control process for performing an imaging process with reference to a plurality of maps will be described with reference to FIG. The imaging control process is a process that starts when, for example, the
この処理では、温度に応じたアナログゲイン値および露光時間を制御値として設定する。より詳細には、図3に示すような、温度と最大露光時間との関係を示すマップに基づいて、温度に応じた最大露光時間を設定する。そして、図4に示すような、露光時間とアナログゲイン値との関係を示すマップに基づいてアナログゲイン値を求める。これらのマップ(図3~図7)においては、何れのマップにおいても概ね反比例の関係を示す。
In this process, the analog gain value and exposure time according to the temperature are set as control values. More specifically, the maximum exposure time corresponding to the temperature is set based on a map showing the relationship between the temperature and the maximum exposure time as shown in FIG. Then, an analog gain value is obtained based on a map showing the relationship between the exposure time and the analog gain value as shown in FIG. In these maps (FIGS. 3 to 7), the relationship is generally inversely proportional in any map.
なお、露光時間は、最大露光時間以下であれば任意に設定されうる。このため、例えば、露光時間は最大露光時間と一致してもよいし、最大露光時間に明るさ(後述する輝度値等)や温度に応じた係数(0より大きく1以下の値)を乗じた値としてもよい。特に、図4に示す例では、露光時間を最大露光時間の6割程度の時間に設定している。
The exposure time can be arbitrarily set as long as it is equal to or shorter than the maximum exposure time. For this reason, for example, the exposure time may coincide with the maximum exposure time, or the maximum exposure time is multiplied by a factor (a value greater than 0 and less than or equal to 1) according to brightness (such as a luminance value described later) or temperature. It may be a value. In particular, in the example shown in FIG. 4, the exposure time is set to about 60% of the maximum exposure time.
続いて、撮像部10および照明部20を駆動させるための駆動信号を撮像部10と照明部20とに送信する(S130)。駆動信号は、設定された制御値(アナログゲインおよび露光時間)に基づくものである。この駆動信号に従って、撮像部10は撮像画像を得る。
Subsequently, a drive signal for driving the imaging unit 10 and the illumination unit 20 is transmitted to the imaging unit 10 and the illumination unit 20 (S130). The drive signal is based on the set control values (analog gain and exposure time). In accordance with this drive signal, the imaging unit 10 obtains a captured image.
次に、撮像部10から撮像画像を取得する(S160)。そして、画像認識部30の機能を利用して画像認識を行う(S170)。画像認識の処理では、撮像画像に含まれる目や鼻等の顔部品の位置を検出する。
Next, a captured image is acquired from the imaging unit 10 (S160). Then, image recognition is performed using the function of the image recognition unit 30 (S170). In the image recognition process, the position of facial parts such as eyes and nose included in the captured image is detected.
続いて、輝度算出範囲を設定する(S180)。ここで、輝度算出範囲とは、撮像画像中において目標とする輝度値(平均輝度)に制御する領域を示し、例えば、顔部品の位置に基づいて、顔全体や、頬や額の部分等、予め設定された領域が設定される。
Subsequently, a luminance calculation range is set (S180). Here, the luminance calculation range indicates a region to be controlled to a target luminance value (average luminance) in the captured image. For example, based on the position of the face part, the entire face, cheek or forehead portion, etc. A preset area is set.
続いて、平均輝度を算出する(S190)。ここで、平均輝度は、前述の輝度算出範囲内の平均輝度を示す。
Subsequently, the average luminance is calculated (S190). Here, the average luminance indicates the average luminance within the above-described luminance calculation range.
そして、制御部40の機能を利用して、平均輝度に基づいて、次のフレームの撮像画像を取得する際の制御値を仮設定する。この処理では、図5に示すような、平均輝度と露光時間との関係を示すマップに基づいて、平均輝度に対する露光時間を決定する。また、図4に示す露光時間とアナログゲイン値との関係を示すマップに基づいて露光時間に対応するアナログゲイン値を設定する。
Then, by using the function of the control unit 40, a control value for acquiring the captured image of the next frame is temporarily set based on the average luminance. In this process, the exposure time with respect to the average luminance is determined based on a map showing the relationship between the average luminance and the exposure time as shown in FIG. Further, an analog gain value corresponding to the exposure time is set based on the map showing the relationship between the exposure time and the analog gain value shown in FIG.
なお、ここでの露光時間はS120またはS270の処理にて設定された最新の最大露光時間以下の値に設定される。また、この処理において設定された制御値は、「仮」の値であり、後述するS270の処理が実施されるまでは保留され、撮像部10への駆動信号には反映されない。つまり、S270の処理が実施されるまでは、以前に設定された最新の制御値に基づく駆動信号が送信される。
Note that the exposure time here is set to a value equal to or less than the latest maximum exposure time set in the processing of S120 or S270. Further, the control value set in this process is a “provisional” value, and is suspended until the process of S270 described later is performed, and is not reflected in the drive signal to the imaging unit 10. That is, until the process of S270 is performed, a drive signal based on the latest control value set previously is transmitted.
続いて、再び温度センサ60から温度の情報を取得する(S220)。そして、温度の情報に基づいて制御値を変更する必要があるか否かを判定する(S230)。ここで、制御値を変更する必要がある場合とは、前回取得された温度の情報と今回取得された温度の情報との差(温度差)が予め設定された規定温度差以上となり、露光時間(最大露光時間)を変更する必要がある場合を示す。
Subsequently, temperature information is acquired again from the temperature sensor 60 (S220). Then, it is determined whether or not the control value needs to be changed based on the temperature information (S230). Here, when the control value needs to be changed, the difference (temperature difference) between the temperature information acquired last time and the temperature information acquired this time is equal to or larger than a preset specified temperature difference, and the exposure time. The case where it is necessary to change (maximum exposure time) is shown.
制御値を変更する必要がない場合(S230:NO)、後述するS250の処理に移行する。また、制御値を変更する必要がある場合(S230:YES)、現在の制御値での撮像回数Mと予め設定された基準回数nとを比較する(S240)。ここで、基準回数nは、頻繁に撮像設定が変更されることによる画面のちらつきやノイズの影響を軽減するための撮像設定(制御値)を維持する回数であり、例えば5~10程度の値に設定される。
If it is not necessary to change the control value (S230: NO), the process proceeds to S250 described later. When the control value needs to be changed (S230: YES), the number M of imaging with the current control value is compared with a preset reference number n (S240). Here, the reference number n is the number of times that the imaging setting (control value) for reducing the influence of the flickering of the screen and the noise due to the frequent change of the imaging setting is maintained, for example, a value of about 5 to 10 Set to
現在の制御値での撮像回数Mが基準回数n未満であれば(S240:NO)、Mをインクリメントし(S250)、S160の処理に戻る。また、現在の制御値での撮像回数Mが基準回数n以上であれば(S240:YES)、Mをリセットし(M=0に設定し)(S260)、制御値をS210の処理において仮設定された制御値に変更する(S270)。
If the imaging number M at the current control value is less than the reference number n (S240: NO), M is incremented (S250), and the process returns to S160. If the number M of imaging with the current control value is equal to or greater than the reference number n (S240: YES), M is reset (M = 0 is set) (S260), and the control value is temporarily set in the process of S210. The control value is changed (S270).
そして、新たな制御値に基づいて、撮像部10および照明部20を駆動させるための駆動信号を生成し、この駆動信号を撮像部10と照明部20とに送信する(S280)。このような処理が終了するとS160の処理に戻る。
Then, based on the new control value, a drive signal for driving the imaging unit 10 and the illumination unit 20 is generated, and this drive signal is transmitted to the imaging unit 10 and the illumination unit 20 (S280). When such processing is completed, the processing returns to S160.
[本実施形態による効果]
以上のように詳述した撮像装置1において制御部40は、撮像装置の温度を取得し、温度に応じて撮像装置における露光時間の最大値である最大露光時間を設定する。そして、最大露光時間以下となるよう露光時間および撮像信号の増幅率を設定し、露光時間と増幅率とに基づいて撮像装置に撮像を実施させる。 [Effects of this embodiment]
In theimaging device 1 described in detail above, the control unit 40 acquires the temperature of the imaging device and sets a maximum exposure time that is the maximum value of the exposure time in the imaging device according to the temperature. Then, the exposure time and the amplification factor of the imaging signal are set so as to be equal to or less than the maximum exposure time, and the imaging apparatus performs imaging based on the exposure time and the amplification factor.
以上のように詳述した撮像装置1において制御部40は、撮像装置の温度を取得し、温度に応じて撮像装置における露光時間の最大値である最大露光時間を設定する。そして、最大露光時間以下となるよう露光時間および撮像信号の増幅率を設定し、露光時間と増幅率とに基づいて撮像装置に撮像を実施させる。 [Effects of this embodiment]
In the
このような撮像装置1によれば、最大露光時間を設定し、露光時間が最大露光時間以下になるよう設定するので、撮像装置を構成するハードウェアの負担を極力軽減しつつ、良好な撮像画像を得ることができる。
According to such an imaging apparatus 1, since the maximum exposure time is set and the exposure time is set to be equal to or less than the maximum exposure time, a favorable captured image can be obtained while reducing the hardware load of the imaging apparatus as much as possible. Can be obtained.
また、撮像装置1において制御部40は、露光時間または増幅率が変更(仮設定)された場合であっても、予め設定された規定回数だけ露光時間および増幅率を変更することなく撮像部10に撮像を実施させる。
Further, in the imaging apparatus 1, the control unit 40 does not change the exposure time and the amplification factor by a predetermined number of times set in advance even if the exposure time or the amplification factor is changed (temporarily set). To perform imaging.
このような撮像装置1によれば、規定回数(規定のフレーム数)は設定を変更することなく撮像を実施させるので、一瞬の明るさの変化やノイズの影響を軽減することができる。
According to such an imaging apparatus 1, since the imaging is performed without changing the setting for the specified number of times (the specified number of frames), it is possible to reduce the instantaneous brightness change and the influence of noise.
さらに、撮像装置1においては、露光時間と同期して発光する照明部20を備えている。
Furthermore, the imaging apparatus 1 includes an illumination unit 20 that emits light in synchronization with the exposure time.
このような撮像装置1によれば、照明部20が発光することによる発熱を、露光時間を短縮することで抑制することができる。
According to such an image pickup apparatus 1, heat generation due to the illumination unit 20 emitting light can be suppressed by reducing the exposure time.
[その他の実施形態]
本開示は、上記の実施形態によって何ら限定して解釈されない。また、上記の実施形態の構成の一部を、課題を解決できる限りにおいて省略した態様も本開示の実施形態である。また、上記の複数の実施形態を適宜組み合わせて構成される態様も本開示の実施形態である。また、請求の範囲に記載した文言のみによって特定される開示の本質を逸脱しない限度において考え得るあらゆる態様も本開示の実施形態である。また、上記の実施形態の説明で用いる符号は容易にする目的で使用している。 [Other Embodiments]
The present disclosure is not construed as being limited in any way by the above-described embodiments. Moreover, the aspect which abbreviate | omitted a part of structure of said embodiment as long as the subject could be solved is also embodiment of this indication. In addition, an aspect configured by appropriately combining the above-described plurality of embodiments is also an embodiment of the present disclosure. Further, any aspect that can be considered without departing from the essence of the disclosure that is specified only by the wording of the claims is an embodiment of the present disclosure. Moreover, the code | symbol used by description of said embodiment is used in order to make it easy.
本開示は、上記の実施形態によって何ら限定して解釈されない。また、上記の実施形態の構成の一部を、課題を解決できる限りにおいて省略した態様も本開示の実施形態である。また、上記の複数の実施形態を適宜組み合わせて構成される態様も本開示の実施形態である。また、請求の範囲に記載した文言のみによって特定される開示の本質を逸脱しない限度において考え得るあらゆる態様も本開示の実施形態である。また、上記の実施形態の説明で用いる符号は容易にする目的で使用している。 [Other Embodiments]
The present disclosure is not construed as being limited in any way by the above-described embodiments. Moreover, the aspect which abbreviate | omitted a part of structure of said embodiment as long as the subject could be solved is also embodiment of this indication. In addition, an aspect configured by appropriately combining the above-described plurality of embodiments is also an embodiment of the present disclosure. Further, any aspect that can be considered without departing from the essence of the disclosure that is specified only by the wording of the claims is an embodiment of the present disclosure. Moreover, the code | symbol used by description of said embodiment is used in order to make it easy.
例えば、上記実施形態の撮像装置1において制御部40は、最大露光時間に従って露光時間や増幅率を設定したが、最大露光時間に換えて、照明部20による最大光量を設定し、最大光量以下となるよう照明部20による光量および増幅率を設定し、露光時間は一定として、光量と増幅率を変化させることで撮像装置1に撮像を実施させるようにしてもよい。
For example, in the imaging device 1 of the above-described embodiment, the control unit 40 sets the exposure time and the amplification factor according to the maximum exposure time, but instead of the maximum exposure time, sets the maximum light amount by the illumination unit 20 and is equal to or less than the maximum light amount. The light amount and the amplification factor by the illumination unit 20 may be set so that the exposure time is constant, and the imaging device 1 may be caused to perform imaging by changing the light amount and the amplification factor.
このようにする場合、例えば、照明部20での最大光量を電流値で規定し、図6に示すような温度と電流値との関係を示すマップに基づいて温度に応じた電流値を設定すればよい。また、図7に示すような電流値とアナログゲイン値との関係を示すマップに基づいて電流値に応じたアナログゲイン値を設定すればよい。
In this case, for example, the maximum light quantity in the illumination unit 20 is defined by the current value, and the current value corresponding to the temperature is set based on the map showing the relationship between the temperature and the current value as shown in FIG. That's fine. Further, an analog gain value corresponding to the current value may be set based on a map showing the relationship between the current value and the analog gain value as shown in FIG.
このような撮像装置1によれば、露光時間に換えて照明部20による光量を最大光量以下にすることで撮像装置1を構成するハードウェアの負担を軽減することができる。
According to such an imaging apparatus 1, it is possible to reduce the burden on the hardware configuring the imaging apparatus 1 by changing the light amount by the illumination unit 20 to the maximum light amount or less instead of the exposure time.
さらに、上記実施形態では、図4に示すマップに基づいて露光時間に基づくアナログゲイン値を求めたが、例えば図4に示す[A]点に基づく露光時間およびアナログゲイン値の設定で撮像を行った結果、正常な撮像画像が得られなかった場合、アナログゲイン値を高くし、例えば[B]点に基づくアナログゲイン値に変更してもよい。
Furthermore, in the above-described embodiment, the analog gain value based on the exposure time is obtained based on the map shown in FIG. 4. However, for example, imaging is performed by setting the exposure time and the analog gain value based on the point [A] shown in FIG. As a result, when a normal captured image is not obtained, the analog gain value may be increased and changed to an analog gain value based on the [B] point, for example.
このようにすれば、アナログゲイン値を大きくすることにより撮像画像中におけるターゲット(ドライバの目の部分等)の認識率を向上させることができる。
In this way, by increasing the analog gain value, the recognition rate of the target (driver's eyes etc.) in the captured image can be improved.
[対応関係]
上記実施形態の制御部40は撮像制御装置に相当する。また、上記実施形態の撮像制御処理のうちのS110,S220の処理は温度取得部に相当し、上記実施形態のS120の処理は最大時間設定部に相当する。 [Correspondence]
Thecontrol unit 40 of the above embodiment corresponds to an imaging control device. Further, the processing of S110 and S220 in the imaging control processing of the above embodiment corresponds to a temperature acquisition unit, and the processing of S120 of the above embodiment corresponds to a maximum time setting unit.
上記実施形態の制御部40は撮像制御装置に相当する。また、上記実施形態の撮像制御処理のうちのS110,S220の処理は温度取得部に相当し、上記実施形態のS120の処理は最大時間設定部に相当する。 [Correspondence]
The
さらに、上記実施形態のS120,S210,S270の処理は撮像設定部に相当し、上記実施形態のS130,S230~S250,S280の処理は撮像指示部に相当する。
Furthermore, the processing of S120, S210, and S270 in the above embodiment corresponds to an imaging setting unit, and the processing of S130, S230 to S250, and S280 in the above embodiment corresponds to an imaging instruction unit.
ここで、この出願に記載されるフローチャート、あるいは、フローチャートの処理は、複数のセクション(あるいはステップと言及される)から構成され、各セクションは、例えば、S100と表現される。さらに、各セクションは、複数のサブセクションに分割されることができる、一方、複数のセクションが合わさって一つのセクションにすることも可能である。さらに、このように構成される各セクションは、デバイス、モジュール、ミーンズとして言及されることができる。
Here, the flowchart described in this application or the process of the flowchart is configured by a plurality of sections (or referred to as steps), and each section is expressed as S100, for example. Furthermore, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section. Further, each section configured in this manner can be referred to as a device, module, or means.
Claims (4)
- 撮像画像を生成する撮像装置(1)において撮像素子から得られた撮像信号を得る際の制御値を設定し、この制御値に基づいて撮像を実施させる撮像制御装置(40)であって、
前記撮像装置の温度を取得する温度取得部(S110,S220)と、
前記温度に応じて前記撮像装置における露光時間の最大値である最大露光時間を設定する最大時間設定部(S120)と、
前記最大露光時間以下となるよう前記露光時間および前記撮像信号の増幅率を設定する撮像設定部(S120,S210,S270)と、
前記露光時間と前記増幅率とに基づいて前記撮像装置に撮像を実施させる撮像指示部(S130,S230~S250,S280)と、
を備えたことを特徴とする撮像制御装置。 An imaging control device (40) that sets a control value for obtaining an imaging signal obtained from an imaging device in an imaging device (1) that generates a captured image, and that performs imaging based on the control value,
A temperature acquisition unit (S110, S220) for acquiring the temperature of the imaging device;
A maximum time setting unit (S120) for setting a maximum exposure time which is a maximum value of the exposure time in the imaging apparatus according to the temperature;
An imaging setting unit (S120, S210, S270) for setting the exposure time and the gain of the imaging signal so as to be equal to or less than the maximum exposure time;
An imaging instruction unit (S130, S230 to S250, S280) for causing the imaging device to perform imaging based on the exposure time and the amplification factor;
An imaging control apparatus comprising: - 請求項1に記載の撮像制御装置において、
当該撮像制御装置は、各部を繰り返し作動させることで、前記撮像装置に繰り返し撮像を実施させるよう設定されており、
前記撮像指示部は、前記撮像設定部にて前記露光時間または前記増幅率が変更された場合であっても、予め設定された規定回数だけ前記撮像装置が撮像を行うまでは、前記露光時間および前記増幅率を変更することなく前記撮像装置に撮像を実施させること
を特徴とする撮像制御装置。 The imaging control device according to claim 1,
The imaging control device is set so that the imaging device repeatedly performs imaging by repeatedly operating each unit,
Even if the exposure time or the amplification factor is changed in the imaging setting unit, the imaging instruction unit may perform the exposure time and the exposure time until the imaging device performs imaging for a predetermined number of times set in advance. An imaging control apparatus that causes the imaging apparatus to perform imaging without changing the amplification factor. - 請求項1または請求項2に記載の撮像制御装置において、
前記露光時間と同期して発光する発光部(20)を備えたこと
を備えたことを特徴とする撮像制御装置。 In the imaging control device according to claim 1 or 2,
An imaging control apparatus comprising: a light emitting unit (20) that emits light in synchronization with the exposure time. - 請求項3に記載の撮像制御装置において、
前記最大時間設定部は、前記最大露光時間に換えて、前記発光部による最大光量を設定し、
前記撮像設定部は、前記最大光量以下となるよう前記発光部による光量および前記増幅率を設定し、
前記撮像指示部は、前記光量と前記増幅率とに基づいて前記撮像装置に撮像を実施させること
を特徴とする撮像制御装置。 The imaging control device according to claim 3,
The maximum time setting unit sets the maximum light amount by the light emitting unit instead of the maximum exposure time,
The imaging setting unit sets the light amount and the amplification factor by the light emitting unit to be equal to or less than the maximum light amount,
The imaging control device, wherein the imaging instruction unit causes the imaging device to perform imaging based on the light amount and the amplification factor.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013118979A JP2014235410A (en) | 2013-06-05 | 2013-06-05 | Image capture controller |
JP2013-118979 | 2013-06-05 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014196166A1 true WO2014196166A1 (en) | 2014-12-11 |
Family
ID=52007825
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/002814 WO2014196166A1 (en) | 2013-06-05 | 2014-05-28 | Image pickup control apparatus |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2014235410A (en) |
WO (1) | WO2014196166A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6659080B2 (en) * | 2014-10-08 | 2020-03-04 | キヤノン株式会社 | Imaging apparatus, control method therefor, and program |
DE112017006801B4 (en) * | 2017-02-28 | 2020-10-22 | Mitsubishi Electric Corporation | Image pickup control device for a vehicle, driver observation device and image pickup control method for a vehicle |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001078083A (en) * | 1999-09-03 | 2001-03-23 | Asahi Optical Co Ltd | Exposure time controller for electronic still camera |
JP2005204120A (en) * | 2004-01-16 | 2005-07-28 | Casio Comput Co Ltd | Camera apparatus, program and method for setting photographic sensitivity |
JP2008054130A (en) * | 2006-08-25 | 2008-03-06 | Casio Comput Co Ltd | Imaging apparatus and program thereof |
JP2008205618A (en) * | 2007-02-16 | 2008-09-04 | Canon Inc | Imaging apparatus and control method thereof |
JP2009075317A (en) * | 2007-09-20 | 2009-04-09 | Canon Inc | Stroboscope device and imaging apparatus |
JP2009139519A (en) * | 2007-12-05 | 2009-06-25 | Canon Inc | Stroboscope device and imaging apparatus |
JP2011066827A (en) * | 2009-09-18 | 2011-03-31 | Casio Computer Co Ltd | Image processing apparatus, image processing method and program |
JP2011164244A (en) * | 2010-02-08 | 2011-08-25 | Casio Computer Co Ltd | Imaging apparatus and program |
JP2011188354A (en) * | 2010-03-10 | 2011-09-22 | Sony Corp | Imaging apparatus, method of controlling the same, and program |
JP2011244144A (en) * | 2010-05-17 | 2011-12-01 | Panasonic Corp | Imaging device |
-
2013
- 2013-06-05 JP JP2013118979A patent/JP2014235410A/en active Pending
-
2014
- 2014-05-28 WO PCT/JP2014/002814 patent/WO2014196166A1/en active Application Filing
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001078083A (en) * | 1999-09-03 | 2001-03-23 | Asahi Optical Co Ltd | Exposure time controller for electronic still camera |
JP2005204120A (en) * | 2004-01-16 | 2005-07-28 | Casio Comput Co Ltd | Camera apparatus, program and method for setting photographic sensitivity |
JP2008054130A (en) * | 2006-08-25 | 2008-03-06 | Casio Comput Co Ltd | Imaging apparatus and program thereof |
JP2008205618A (en) * | 2007-02-16 | 2008-09-04 | Canon Inc | Imaging apparatus and control method thereof |
JP2009075317A (en) * | 2007-09-20 | 2009-04-09 | Canon Inc | Stroboscope device and imaging apparatus |
JP2009139519A (en) * | 2007-12-05 | 2009-06-25 | Canon Inc | Stroboscope device and imaging apparatus |
JP2011066827A (en) * | 2009-09-18 | 2011-03-31 | Casio Computer Co Ltd | Image processing apparatus, image processing method and program |
JP2011164244A (en) * | 2010-02-08 | 2011-08-25 | Casio Computer Co Ltd | Imaging apparatus and program |
JP2011188354A (en) * | 2010-03-10 | 2011-09-22 | Sony Corp | Imaging apparatus, method of controlling the same, and program |
JP2011244144A (en) * | 2010-05-17 | 2011-12-01 | Panasonic Corp | Imaging device |
Also Published As
Publication number | Publication date |
---|---|
JP2014235410A (en) | 2014-12-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014054199A1 (en) | State monitoring device | |
US20200327323A1 (en) | System and method for improving signal to noise ratio in object tracking under poor light conditions | |
JP5860663B2 (en) | Stereo imaging device | |
JP6627866B2 (en) | Imaging device, imaging method, signal processing device, signal processing method, and program | |
JP6525543B2 (en) | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM | |
JP6305430B2 (en) | Imaging setting changing device, imaging system, and imaging setting changing method | |
US20190125174A1 (en) | Electronic endoscope system | |
US20150264236A1 (en) | Image pickup device, light projection device, beam light control method, and program | |
WO2014196166A1 (en) | Image pickup control apparatus | |
JP2010050535A (en) | Imaging apparatus | |
JP6480586B2 (en) | Image processing apparatus, imaging apparatus, driver monitoring system, moving object, and image processing method | |
JP6411644B2 (en) | Automatic vehicle camera device with histogram diffusion | |
JP6646879B2 (en) | Imaging device | |
JP6322723B2 (en) | Imaging apparatus and vehicle | |
JP2007013777A (en) | Imaging apparatus | |
JP2019220741A (en) | Document camera and document camera control method | |
JP5486242B2 (en) | Imaging device | |
JP2014098859A (en) | Imaging apparatus and imaging method | |
JP2011181019A (en) | Bird's-eye view image generation device | |
JP5765599B2 (en) | Imaging apparatus, image processing method, and program | |
JP2010273162A (en) | In-vehicle equipment and luminance adjusting method | |
JP5949442B2 (en) | Control table generation method and imaging control apparatus | |
JP2014146954A (en) | Image processing device, imaging device, and image processing method | |
JP2006060504A (en) | Exposure controller of camera for white line detection | |
JP2018074440A (en) | Vehicle rear image display device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14806806 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14806806 Country of ref document: EP Kind code of ref document: A1 |