CN102469243A - Image capturing apparatus capable of adjusting white balance - Google Patents

Abstract

An image capturing apparatus 1 includes an image capturing unit 20 that acquires data of a first image captured with light and a second image captured without light, a white balance gain calculation unit 15 that acquires gain values of each color component of the first and second images, an image partitioning unit 16 that divides the first and second images into areas, a luminance acquisition unit 17 that acquires luminance values for each area of the first and second images, a luminance acquisition unit 17 that calculates relative values with respect to luminance values for each area of the first image and second image, and a luminance acquisition unit 17 that selects specific relative values among the relative values. The white balance gain calculation unit 15 corrects the gain value for each color component of the first image, based on the specific relative values.

Description

The camera head of ability white balance adjustment

Technical field

The present invention relates to a kind of camera head and white balance adjustment method, especially, relate to a kind of with photoflash lamp when luminous the reproducibility of the color of captured image become the technology of more natural color.

Background technology

According to prior art, in order photoflash lamp to be more natural color by the different factitious white revisals that produced of color temperature when luminous, the adjustment white balance.

In japanese kokai publication hei 8-51632 communique; Known following method: as the method for adjustment of white balance; For example; Image with photoflash lamp when luminous and photoflash lamp do not have the image when luminous to be divided into a plurality of zones respectively, based on the luminance difference in each self-corresponding zone, white balance are set in each divided zone respectively.

Summary of the invention

The reproducibility of the color of captured image becomes more natural color when the objective of the invention is to make photoflash lamp luminous.

To achieve these goals; A kind of camera head of the present invention program's 1 record; It is characterized in that; Possess luminescence unit and image unit, also possess: the shooting control unit, it is controlled so that said image unit is taken and to be in image first image and this luminescence unit when bright through said luminescence unit luminous and not have image second image when luminous; First obtains the unit, and it obtains the yield value of the shades of colour component that is used for the white balance that sets when the shooting of said first image and said second image is adjusted respectively; Cutting unit, it will be divided into a plurality of zones by the camera watch region that said image unit is taken; Second obtains the unit, and it obtains the brightness value in a plurality of zones of cutting apart through said cutting unit respectively to said first image and said second image; Calculate the unit, its calculate respectively through said second obtain said first image of obtaining the unit the brightness value in the zone value after divided by the brightness value in the zone of said second image of correspondence as relative value; Selected cell, it is from calculating the relative value of calculating the unit preferential and select the high relative value of a plurality of values through said; And correcting unit; Its based on through said first obtain said first image obtained the unit and said second image each color component yield value and through the selected a plurality of relative values of said selected cell, the yield value of each color component of the image to being in through said luminescence unit luminous when bright carries out revisal.

In addition; To achieve these goals; The present invention program 2 camera head is characterised in that also have converter unit, its will through said first obtain the image of calculating the unit each color component be transformed to the group of the parameter of the pixel that comprises monochrome information at least in other color spaces; Said correcting unit is also based on the group of the parameter of the pixel through said converter unit conversion, and the yield value of said each color component is carried out revisal.

In addition, to achieve these goals, the present invention program 3 white balance adjustment method is characterised in that, may further comprise the steps: first obtains step, and it is obtained through luminous and is in image first image when bright and does not have image second image when luminous; Second obtains step, and it obtains the yield value of the shades of colour component that is used for the white balance that sets when the shooting of said first image and said second image is adjusted respectively; Segmentation procedure, it will obtain the image segmentation that step obtains by said first is a plurality of zones; The 3rd obtains step, and it obtains the brightness value in a plurality of zones of cutting apart through said segmentation procedure respectively to said first image and said second image; Calculate step, its calculate respectively through the said the 3rd obtain step the brightness value in zone of said first image that processing the obtained value after divided by the brightness value in the zone of said second image as relative value; Select step, its from through said calculate the relative value that step calculates preferential and select the high relative value of a plurality of values; With the revisal step; Its based on through said second obtain said first image that step obtains and said second image each color component yield value and through the selected a plurality of relative values of said selection step, to carrying out revisal through the luminous yield value that is in each color component of the image when bright.

Description of drawings

Fig. 1 is the administrative division map that the formation of the hardware of an execution mode of camera head of the present invention is represented.

Fig. 2 is the flow chart that the flow process that the photoflash lamp shooting that the camera head of the formation of the hardware with Fig. 1 is carried out is handled is described.

Fig. 3 be to find a view when not luminous (through) image or when luminous photographic images obtain the ideograph that the state of 64 cut zone of 8 * 8 is represented.

Fig. 4 is the sketch map of expression example of viewfinder image and the non-table that the brighteness ratio of each cut zone of photographic images is stored when luminous when luminous.

Fig. 5 is the flow chart of the 1st embodiment that the flow process that the white balance that the camera head of the formation of the hardware with Fig. 1 is carried out is handled is described.

Fig. 6 is the flow chart of the 2nd embodiment that the flow process that the white balance that the camera head of the formation of the hardware with Fig. 1 is carried out is handled is described.

Embodiment

(the 1st execution mode)

Below, use accompanying drawing, the 1st execution mode of the present invention is described.

Fig. 1 is the area schematic that the formation of the hardware of an execution mode of camera head 1 of the present invention is represented.

Camera head 1 shown in Figure 1 can constitute through for example digital facies unit.

Camera head 1 comprises: CPU (CPU) 11, ROM (read-only memory) 12, RAM (random access memory) 13, image processing part 14, white balance gains are calculated portion 15, image segmentation portion 16, brightness and are obtained portion 17, bus 18, input/output interface 19, image pickup part 20, illuminating part 21, operating portion 22, display part 23, storage part 24, Department of Communication Force 25 and driver 26.

CPU11 carries out various processing according to institute's program recorded among the ROM12 or from the program that storage part 24 is loaded into RAM13.

Necessary data etc. when also suitably having stored CPU11 among the RAM13 and carrying out various processing.

Image processing part 14 through moving with CPU11 association, is implemented various image processing to the data of image by DSP (digital signal processor) and VRAM formations such as (video RAMs).

For example, 14 pairs of image processing parts from after the data of photographic images of image pickup part 20 outputs stated implement that noise reduces, the image processing of the adjustment of white balance, hand jitter compensation etc.

White balance gains is calculated portion 15, in the middle of the image processing that image processing part 14 carries out, calculates the used white balance gains of adjustment of white balance.Calculate the further formation details of portion 15 for white balance gains, after state.

Image segmentation portion 16, in the middle of the image processing that image processing part 14 carries out, the data of the image that the adjustment of white balance is used are divided into the data in several zones on direction in space.For the further formation details of image segmentation portion 16, after state.

Brightness obtains portion 17, in the middle of the image processing that image processing part 14 carries out, from the data of the used image of the adjustment of white balance, obtains brightness value etc.Obtain the further formation details of portion 17 for brightness, comprise that also brightness ratio then states than portion 41.

CPU11, ROM12, RAM13, image processing part 14, white balance gains are calculated portion 15, image segmentation portion 16 and brightness and are obtained portion 17 and interconnect via bus 18.On this bus 18, also connected input/output interface 19.Image pickup part 20, illuminating part 21, operating portion 22, display part 23, storage part 24, Department of Communication Force 25 and driver 26 on input/output interface 19, have been connected.

Although do not illustrate, image pickup part 20 also comprises optical lens portion and imageing sensor.

Optical lens portion is for to being taken by being taken the photograph body, and for example condenser lens or zoom lens etc. constitute by being used for that light is carried out the lens of optically focused.

Condenser lens is to make shot object image be imaged on the lens on the light receiving surface of imageing sensor.Zoom lens are the lens that focal length freely changed in certain scope.

In optical lens portion, as required, be provided with peripheral circuit, this peripheral circuit is used to adjust the setup parameter of focus, exposure, white balance etc.

Imageing sensor is by the components of photo-electric conversion and AFE formations such as (AFE(analog front end)s).

The components of photo-electric conversion are by the formations such as the components of photo-electric conversion of for example CMOS (complementary Metal Oxide Semiconductor, complementary metal oxide semiconductors (CMOS)) type.Shot object image incides the components of photo-electric conversion from optical lens portion.Here, the components of photo-electric conversion carry out light-to-current inversion (shooting) to shot object image, and picture signal is accumulated certain hour, and the picture signal that will accumulate supplies to AFE successively as analog signal.

AFE carries out various signal processing such as A/D (analog/digital) conversion process to the picture signal of this simulation.Through various signal processing, generate digital signal, and export as the output signal of image pickup part 20.

Below, the output signal of image pickup part 20 is called " data of photographic images ".Therefore, from the data of image pickup part 20 output photographic images, calculate portion 15 etc. thereby suitably supply to CPU11, image processing part 14, white balance gains.

Illuminating part 21 has photoflash lamp, according to the control of CPU11, makes photoflash lamp luminous.In this 1st execution mode, the user is carried out the operational example of the record indication of the photographic images of operating portion 22 like the push that carried out release-push not shown in the middle of the operating portion 22 making photoflash lamp luminous as opportunity.

Operating portion 22 for example is made up of not shown various buttons such as release-push, accepts user's indication operation.

Display part 23 is made up of display that can show various images etc.

Storage part 24 is by DRAM (Dynamic Random Access Memory; Dynamic random access memory) data of the various images of the image that is synthesized on the original image of formation such as, and the viewfinder image of stating after the storage, display object, this original image etc.

Department of Communication Force 25 control via the network that comprises the internet with other device (not diagram) between carry out communicate by letter.

On driver 26, the removable media 31 that is made up of disk, CD, magneto optical disk or semiconductor memory etc. has been installed suitably.Through the program that driver 26 is read from removable media 31, as required, be installed in the storage part 24.In addition, removable media 31 also can be stored in the various data that storage part 24 is attend the data etc. of institute's image stored with storage part 24 equally.

More than, with reference to figure 1, the originally formation of the hardware of the camera head 1 of the 1st execution mode has been described.

Below, the flow process that photoflash lamp shooting that the camera head 1 of the formation with this hardware is carried out is handled is described.So-called photoflash lamp shooting is handled, and is to instigate luminous shooting of photoflash lamp to be taken the photograph body, and the data of the resulting photographic images of this result are carried out the adjustment of white balance, afterwards, and a series of processing till recording on removable media 31 grades.

Fig. 2 is the flow chart that the flow process that the photoflash lamp shooting that the camera head 1 of the formation of the hardware with Fig. 1 is carried out is handled is described.

At first, as the pattern of camera head 1, in this 1st execution mode, suppose to be provided with and do not make photoflash lamp luminous and take and taken the photograph the normal mode of body and make photoflash lamp luminous and the Flash Mode of body is taken the photograph in shooting.And the user can selectively indicate normal mode or Flash Mode, as pattern through carrying out the predetermined operation to operating portion 22.

In this case, when the selection of Flash Mode was indicated, the shooting of beginning photoflash lamp was handled.

In step S1, CPU11 carries out the shooting processing of viewfinder image and the demonstration of viewfinder image is handled.

That is, CPU11 control image pickup part 20 and image processing part 14 continue the shooting action of being undertaken by image pickup part 20.Then, CPU11 the shooting undertaken by image pickup part 20 action continue during, the data of the photographic images that will export successively from this image pickup part 20 temporarily are stored in the memory (storage part 24).A series of processing like this is said here " shooting of finding a view is handled ".

In addition, CPU11 reads out in successively when the shooting of finding a view is handled and is temporarily recorded in each data in the memory (storage part 24), and the photographic images corresponding with each data is presented on the display part 23 successively.A series of processing like this is said here " finds a view and show processing ".Below, will show that handling the photographic images that is presented on the display part 23 is called " viewfinder image " through finding a view.

In step S2, CPU11 judges whether to exist the record indication of photographic images.

As above-mentioned, through the user release-push in the middle of the operating portion 22 is carried out push, can carry out the record indication of photographic images.

Therefore, when release-push is not pressed operation,, be judged to be not, handle turning back to step S1 at step S2.That is, till release-push is pressed operation during, through the circular treatment of repeated execution of steps S1 and S2, repeating the shooting of finding a view and handling and find a view and show processing, and the viewfinder image of being taken the photograph body is continued to be presented on the display part 23 in real time.

In addition, although do not illustrate, even passed through the scheduled time, under release-push still was not pressed the situation of operating, CPU11 etc. also can finish the photoflash lamp shooting by the strong hand to be handled.

After this, under release-push was pressed the situation of operating, at step S2, being judged to be was to handle proceeding to step S3.

In step S3, the luminous control simultaneously of CPU11 control taken taking the photograph body.At length, CPU11 controls illuminating part 21, makes photoflash lamp luminous, and control image pickup part 20, is taken taking the photograph body.

This moment, the data from the photographic images of image pickup part 20 outputs temporarily were stored in the storage part 24 as the data that write down object.

In step S4; CPU11 uses to handle at photoflash lamp through the shooting of finding a view of step S1 not to be had to take the data of the viewfinder image of being taken the photograph body and the data of when photoflash lamp is luminous, taking the photographic images of being taken the photograph body through the processing of step S3 when luminous, carries out the processing that the white balance of the photographic images that writes down object is adjusted.

Below, with the record of Fig. 2, the processing of this step S4 is called " white balance processing ".In addition, below, will handle the data that do not have to take the viewfinder image of being taken the photograph body when luminous at photoflash lamp through the shooting of finding a view of step S1 and be called " data that do not have viewfinder image when luminous ".On the other hand, below, will be called through the photographic images of being taken the photograph body is taken in the processing of step S3 when photoflash lamp is luminous data the data of photographic images when luminous " ".

Here, the The data of the photographic images of hypothetical record object the data of photographic images when luminous.But, when luminous the data of photographic images, can also adopt to make for 1 time after the setting of white balance photoflash lamp is luminous, image pickup part 20 is taken the resulting photographic images of result of being taken the photograph body data again as the record object.In this case, the data of the photographic images of this record object are adjusted through the white balance that sets.

In addition, the further formation details of handling for white balance, after state.

At step S5, CPU11 will apply the data record of photographic images of the record object that white balance handles through the processing of step S4 to removable media 31.

Thus, the photoflash lamp shooting is handled and is become end.

More than, photoflash lamp shooting processing has been described.

Below, the white balance of being carried out by step S4 in the middle of shooting is handled to photoflash lamp is handled and is described.

Here, at first, explain to be used to carry out the function formation that white balance is handled, then, explain based on this function to constitute the flow process that performed white balance is handled.

Handle under the situation about being performed in white balance, in the middle of the camera head 1 of Fig. 1, white balance gains is calculated portion 15, image segmentation portion 16 and brightness and is obtained portion's 17 performance functions.

White balance gains is calculated portion 15, calculate respectively about the white balance gains that do not have viewfinder image when luminous and when luminous the white balance gains of photographic images.

At length, suppose not have viewfinder image when luminous and when luminous each data of photographic images (R: red, G: green, B: indigo plant) component constitutes by RGB.

In this case; White balance gains is calculated portion 15; As the white balance gains that does not have viewfinder image when luminous, calculate the gain (below be called " SBG ") of the gain (below be called " SRG ") of R component, the gain of G component (below be called " SGG "), B component respectively.And below SRG, SGG, SBG are called in the lump " yield value that does not have the RGB component of viewfinder image when luminous ".

In addition, white balance gains is calculated portion 15, and the white balance gains of photographic images when luminous is calculated the gain (below be called " LBG ") of the gain (below be called " LRG ") of R component, the gain of G component (below be called " LGG "), B component respectively.Below, SRG, SGG, SBG are called in the lump " yield value of the RGB component of photographic images when luminous ".

Then, white balance gains is calculated portion 15, will not have viewfinder image when luminous and when luminous each yield value of the RGB component of photographic images be transformed into YUV (Y: brightness, U: the aberration of brightness and blue component, V: the yield value of the component aberration of brightness and red component).

Below, each yield value of viewfinder image and the YUV component that each yield value conversion of the RGB component of photographic images comes when luminous is called " YUV transformed value " when never luminous.

Here, there is not the YUV transformed value of viewfinder image when luminous to constitute by the gain of gain of the gain of Y component (below be called SY), U component (below be called SU) and V component (below be called SV).

In this case, do not have that the YUV transformed value of viewfinder image carries out computing according to following formula (1) when luminous.

[formula 1]

And the left side of formula (1) is from the matrix of 3 row 3 row of premultiplication, and promptly to become the matrix of aij be the transformation matrix that the RGB component transformation is become the YUV component to the element of the capable j row of i (i, j are the integer values in separate 1 to 3 scope).

The YUV transformed value of photographic images is made up of the gain of gain of the gain of Y component (below be called LY), U component (below be called LU) and V component (below be called LV) when on the other hand, luminous.

The YUV transformed value of viewfinder image carries out computing according to following formula (2) when in this case, luminous.

[formula 2]

Then; White balance gains is calculated portion 15; Taking all factors into consideration does not have viewfinder image when luminous and the brighteness ratio (stating behind cut zone and the brighteness ratio) of each cut zone of photographic images when luminous, and the gain LY of the Y component when luminous in the middle of the YUV transformed value of photographic images carries out revisal.

Here, below, the gain of the Y component after the revisal when luminous in the middle of the YUV transformed value of photographic images is called " LY ' ".In other words, for LY, applied not having viewfinder image when luminous and the value of weighting after the brighteness ratio of each cut zone of photographic images has carried out taking all factors into consideration when luminous is LY '.

LY ' is for example tried to achieve by following formula (3).

[formula 3]

$\underset{\‾}{{\mathrm{LY}}^{\′}=\mathrm{SY}\×\frac{1}{C}+\mathrm{LY}\×\frac{C-1}{C}\·\·\·\left(3\right)}$

In formula (3), C is used to carry out to not having viewfinder image when luminous and the variable coefficient of weighting after the brighteness ratio of each cut zone of photographic images has carried out taking all factors into consideration when luminous, be by after the brightness ratio stated than the mean flow rate ratio of portion's 41 computings.

Then, white balance gains is calculated portion 15, through type (3) during with luminous after of Y component by revisal (weighting) the YUV transformed value inversion of photographic images change to the yield value of RGB component.Particularly, white balance gains is calculated portion 15, according to following formula (4), and the yield value of the RGB component of photographic images when trying to achieve luminous after the inverse transformation.

[formula 4]

The yield value of the RGB component of photographic images when in addition, the column vector on the right of formula (4) is represented luminous after the inverse transformation.The gain (following record with formula (4) is called " LR α ") of the R component of the yield value of the RGB component of photographic images after by inverse transformation, the gain (following record with formula (4) is called " LG α ") of the G component after the inverse transformation, the gain (following record with formula (4) is called " LB α ") of the B component after the inverse transformation constitute during luminous after the inverse transformation.

In addition, the left side in formula (4) is the inverse matrix of the transformation matrix that formula (1) and formula (2), uses from the matrix of premultiplication.

Then, white balance gains is calculated portion 15, and the yield value of the RGB component of photographic images during based on luminous after the inverse transformation writes down the white balance of the photographic images of object and sets.

Below, explain that a part that camera head 1 handles as white balance constitutes in the function of carrying out when the mean flow rate ratio C that is used by above-mentioned formula (3) carried out the processing of computing.In this case, image segmentation portion 16 obtains portion's 17 performance functions with brightness.

Image segmentation portion 16 will not have viewfinder image when luminous and each data of photographic images are divided into as shown in figure 3 64 zones of 8 * 8 respectively when luminous each data.

In addition, in this manual, the zone of being cut apart by image segmentation portion 16 like this is called as " cut zone " especially.

Fig. 3 be to viewfinder image when not luminous or when luminous photographic images obtain the ideograph that the state of 64 cut zone of 8 * 8 is represented.

As shown in the figure; To each cut zone; Added well-determined intrinsic sequence number; Be in particular: begin from the cut zone of left upper end, with horizontal direction towards right-hand to, vertical direction order towards lower direction, added 1,2,3,4,5,6,7,8,9,10 ..., 63,64 and so on sequence number.And, below, the sequence number of being added on the cut zone is called " cutting apart sequence number ".

For cutting apart the additional of sequence number; Not have when luminous viewfinder image and unifying in the photographic images when luminous in order to make; For not having viewfinder image when luminous and the cut zone of the same sequence number separately of photographic images when luminous, the position in the integral image, size and scope all become identical.

And the data of each cut zone for example are stored in the storage part with forms mode with additional sequence number associated in correspondence and are managed.

Brightness obtains portion 17, the viewfinder image and obtain brightness value in the data of photographic images when luminous when never luminous with cut zone unit.

Here, because cut zone is made up of a plurality of pixels, the therefore brightness of so-called cut zone is made as based on the brightness of each pixel that constitutes this cut zone and the value of computing, for example means the mean value of the brightness of each pixel.

Brightness obtains and is provided with brightness ratio in the portion 17 than portion 41.

Brightness ratio is calculated viewfinder image when luminous than portion 41 and the brighteness ratio of each cut zone of photographic images when not luminous.

The brighteness ratio Ck of zone sequence number k (k is the positive integer value of cutting apart below the sum, is the positive integer value below 64) is tried to achieve by following formula (5).

[formula 5]

$\underset{\‾}{\mathrm{Ck}=\frac{{\mathrm{Yk}}^{\′}}{\mathrm{Yk}}\·\·\·\left(5\right)}$

In formula (5), the brightness of k cut zone of photographic images when Yk ' expression is luminous.Yk representes the brightness of k cut zone of viewfinder image when not luminous.

The brightness ratio of being undertaken by such formula (5) is than the operation result of portion 41, for example is stored in the storage part 24 with form shown in Figure 4 and managed.

Fig. 4 representes an example of when luminous viewfinder image and the non-form that the brighteness ratio of each cut zone of photographic images is stored when luminous.

Because the form of Fig. 4 has the ranks structure, therefore below, with Fig. 4 middle horizontal square to the aggregate of project be called " OK ", the aggregate of the project of longitudinal direction in scheming is called " row ".On predetermined row associated in correspondence the predetermined zone sequence number.That is, on predetermined row, disposed the project of " regional sequence number ", when not luminous " brightness ", when luminous " brightness " and " brighteness ratio " and so on of the regional sequence number corresponding respectively with this row.

From on (wherein, put down in writing except the lastrow of entry name of Fig. 4 to K is capable.Below identical) " regional sequence number " on, stored regional sequence number K.

From in capable to K when not luminous " brightness ", stored the brightness Yk of k cut zone of viewfinder image when not luminous.

From in capable to K when luminous " brightness ", stored the brightness Yk ' of k cut zone of photographic images when luminous.

From on capable " brighteness ratio ", stored k brighteness ratio Ck, i.e. the operation result of formula (5) to K.

Then, brightness ratio is classified the brighteness ratio of each full cut zone than portion 41 by ratio order from high to low.

Then, brightness ratio is than portion 41, and in the middle of the brighteness ratio of each cut zone of being classified with brightness order from high to low, the mean value of trying to achieve high-order the 2nd to the 4th brighteness ratio is as above-mentioned mean flow rate ratio C.

Particularly, brightness ratio through the following formula of computing (6), is tried to achieve mean flow rate ratio C than portion 41.

[formula 6]

$\underset{\&OverBar;}{C=\frac{\mathrm{<figure-callout\; id="2"\; label="Ct"\; filenames="HDA0000105193960000031.png,HDA0000105193960000041.png"\; state="\{\{state\}\}">Ct</figure-callout>}2+\mathrm{<figure-callout\; id="3"\; label="Ct"\; filenames="HDA0000105193960000031.png"\; state="\{\{state\}\}">Ct</figure-callout>}3+\mathrm{<figure-callout\; id="4"\; label="Ct"\; filenames="HDA0000105193960000031.png"\; state="\{\{state\}\}">Ct</figure-callout>}4}{3}\&CenterDot;\&CenterDot;\&CenterDot;\left(6\right)}$

In formula (6), Ct2 representes high-order the 2nd to the 4th each brighteness ratio to each of Ct4.

For example, the brighteness ratio of full cut zone (C1=Y1 '/Y1, C2=Y2 '/Y2, C3=Y3 '/Y3 ..., C8=Y8 '/Y8 ..., C22=Y22 '/Y22 ..., in the middle of the C64=Y64 '/Y64), the brighteness ratio till high-order the 4th is made as as follows.Promptly be made as: the 1st: Ct1=C1=Y1 '/Y1, the 2nd: Ct2=C2=Y2 '/Y2, the 3rd: Ct3=C8=Y8 '/Y8, the 4th: Ct4=C22=Y22 '/Y22, in this case, mean flow rate ratio C is calculated by following formula (7).

[formula 7]

$\underset{\&OverBar;}{C=\frac{{\mathrm{<figure-callout\; id="2"\; label="Y"\; filenames="HDA0000105193960000031.png,HDA0000105193960000041.png"\; state="\{\{state\}\}">Y</figure-callout>}2}^{\&prime;}/\mathrm{<figure-callout\; id="2"\; label="Y"\; filenames="HDA0000105193960000031.png,HDA0000105193960000041.png"\; state="\{\{state\}\}">Y</figure-callout>}2+{\mathrm{<figure-callout\; id="8"\; label="Y"\; filenames="HDA0000105193960000031.png"\; state="\{\{state\}\}">Y</figure-callout>}8}^{\&prime;}/\mathrm{<figure-callout\; id="8"\; label="Y"\; filenames="HDA0000105193960000031.png"\; state="\{\{state\}\}">Y</figure-callout>}8+{\mathrm{<figure-callout\; id="22"\; label="Y"\; filenames="HDA0000105193960000051.png"\; state="\{\{state\}\}">Y</figure-callout>}22}^{\&prime;}/\mathrm{<figure-callout\; id="22"\; label="Y"\; filenames="HDA0000105193960000051.png"\; state="\{\{state\}\}">Y</figure-callout>}22}{3}\&CenterDot;\&CenterDot;\&CenterDot;\left(7\right)}$

The mean flow rate ratio C that tries to achieve like this is updated to above-mentioned formula (3) as coefficient and uses.

Above, with reference to figure 3 and Fig. 4, explained that the function that the white balance that in the middle of the function of the camera head 1 of Fig. 1 constitutes, is used for the step S4 of execution graph 2 is handled constitutes.

Below, the detailed process that white balance with step S4 that camera head 1 that such function constitutes carries out is handled is described.

In white balance is handled, under the control of CPU11, white balance gains calculate that portion 15 obtains portion 17 to brightness any one all carry out the processing of each step.But, in following explanation, omit about the explanation of the control of CPU11.

Fig. 5 is the flow chart that the details of the flow process that the white balance of step S4 was handled in the middle of the photoflash lamp shooting of Fig. 2 of camera head 1 execution of Fig. 1 was handled describes.

In step S21, white balance gains calculates that the yield value of each RGB component of viewfinder image when not luminous is calculated by portion 15 and the yield value of each RGB component of photographic images when luminous.

At length, white balance gains is calculated portion 15, and to calculate the gain of R component respectively be that the gain of SRG, G component is that the gain of SGG, B component is SBG, the white balance gains of viewfinder image when not luminous.

In addition, white balance gains is calculated portion 15, and to calculate the gain of R component respectively be that the gain of LRG, G component is that the gain of LGG, B component is LBG, the white balance gains of photographic images when luminous.

In step S22, image segmentation portion 16 obtains portion 17 with brightness, photographic images and viewfinder image is carried out 8 * 8 respectively cut apart, and calculates the brightness value in the zone of each image.

At length, at first, when image segmentation portion 16 respectively will be not luminous viewfinder image and when luminous each data of photographic images be divided into each data in 64 zones of 8 * 8 of a plurality of zones that kind shown in Figure 3.

Then, brightness obtains portion 17 viewfinder image and obtain brightness value with cut zone unit in the data of photographic images when luminous when never luminous.

In step S23, brightness ratio is calculated viewfinder image when luminous than portion 41 and the brighteness ratio of each cut zone of photographic images when not luminous.At length, brightness ratio through the above-mentioned formula of computing (5), is calculated brighteness ratio than portion 41.The brightness ratio of being undertaken by such formula (5) is than the operation result of portion 41, for example is stored in the storage part with form shown in Figure 4 and managed.

In step S24, brightness ratio begins from the high side of brighteness ratio than portion 41, selects the 2nd～4, thereby calculates average (the mean flow rate ratio) of each brighteness ratio.That is, brightness ratio is classified the brighteness ratio of each full cut zone in step S3 than portion 41 by ratio order from high to low.Then, brightness ratio is than portion 41, through the above-mentioned formula of computing (6), tries to achieve in the middle of the brighteness ratio of each cut zone of being classified by brightness order from high to low, the mean value of high-order the 2nd to the 4th brighteness ratio is mean flow rate ratio C.

In step S25, white balance gains is calculated portion 15, and the yield value of each RGB component that will try to achieve at step S21 is transformed to the YUV transformed value.At length, white balance gains is calculated portion 15, through above-mentioned formula of computing (1) and formula (2), will step S21 try to achieve not luminous the time viewfinder image and when luminous each yield value of the RGB component of photographic images be transformed into the YUV transformed value.

In step S26, white balance gains is calculated portion 15, is based on the mean flow rate ratio that step S24 tries to achieve, and calculates the yield value of Y component (LY ').At length; White balance gains is calculated portion 15; Through using the mean flow rate ratio of calculating and above-mentioned formula (3) being carried out computing at step S24; Thereby synthetically consider viewfinder image when not luminous and the brighteness ratio of each cut zone of photographic images when luminous, the gain LY revisal of the Y component when luminous in the middle of the YUV transformed value of photographic images is LY '.

In step S27, white balance gains is calculated portion 15, the YUV transformed value that has added weighting is inversely transformed into the yield value of RGB component.At length, white balance gains is calculated portion 15, according to above-mentioned formula (4), and the yield value of the RGB component of photographic images when trying to achieve luminous after the inverse transformation.

In step S28, white balance gains is calculated portion 15, based on the yield value of the RGB component of calculating, sets the white balance of photographic images.That is, white balance gains is calculated portion 15, and the yield value of the RGB component of photographic images during based on luminous after the inverse transformation writes down the white balance of the photographic images of object and sets.Thus, finish white balance and handle, turn back to the photoflash lamp shooting and handle, handle the step S5 that transfers to Fig. 2.

As described above, camera head 1 comprises: illuminating part 21, image pickup part 20, CPU11, white balance gains are calculated portion 15, image segmentation portion 16, brightness and are obtained portion 17 and brightness ratio than portion 41.

CPU11 control makes through user's operation, the image photographic images during luminous brightening that will be through being caused by illuminating part 21 when luminous (photographic images) and photographed on the image pickup part 20 by this luminous image viewfinder image when not luminous (viewfinder image) of not carrying out when luminous that causes.

White balance gains is calculated portion 15, calculates and obtain the yield value of each color component that the white balance that is used for when luminous photographic images and sets during the shooting of viewfinder image when not luminous adjusts respectively.

Image segmentation portion 16 will be divided into a plurality of zones by the camera watch region that image pickup part 20 is taken.

Brightness obtains portion 17, and photographic images and viewfinder image when not luminous when luminous are calculated the brightness value in a plurality of zones of being cut apart by image segmentation portion 16 respectively.

Brightness ratio is than portion 41, and the value behind the brightness value in the brightness value of calculating the zone of photographic images when obtaining luminous that portion 17 calculates by brightness respectively zone of viewfinder image during divided by correspondence not luminous is as relative value.

Brightness ratio is than portion 41, and is among the relative value of being calculated respectively than portion 41 by brightness ratio, preferential and select the high relative value of a plurality of values.

White balance gains is calculated portion 15; Based on calculate luminous the time photographic images and the value and a plurality of relative values of selecting than portion 41 by brightness ratio of each color component of viewfinder image when not luminous, to carrying out revisal through the luminous yield value that becomes each color component of the image when bright that causes by illuminating part 21.

In the camera head 1 that constitutes like this, in can be when photoflash lamp the is luminous captured image, the reproducibility of the natural color of image is improved.

In addition, white balance gains is calculated portion 15, with obtain luminous the time photographic images and when not luminous the RGB component transformation of viewfinder image to group (YUV transformed value) as the parameter of the pixel that comprises monochrome information at least of other color spaces.

In addition, white balance gains is calculated portion 15, also based on the group (YUV transformed value) of the parameter of the pixel of conversion, the yield value of RGB component is carried out revisal.

In the camera head 1 that constitutes like this; Owing to use the grey balance level to carry out the adjustment of brightness through transforming to the YUV transformed value; Therefore can not be created in photoflash lamp following specific change color that can produce of situation that each brightness of each color component of image captured when luminous is adjusted separately, thereby can further improve the reproducibility of the natural color of image.

And the present invention is not limited to above-mentioned execution mode, and the present invention also is included in distortion in the scope of the purpose that can realize the present invention, improvement etc.

In addition, in above-mentioned execution mode, try to achieve brighteness ratio Ck by above-mentioned formula (5), but be not limited thereto.Brighteness ratio Ck can be tried to achieve by following formula (8).In this case, for the mean flow rate ratio, used the from the next the 2nd to the 4th brighteness ratio Ck.

[formula 8]

$\underset{\&OverBar;}{\mathrm{Ck}=\frac{\mathrm{Yk}}{{\mathrm{Yk}}^{\&prime;}}\&CenterDot;\&CenterDot;\&CenterDot;\left(8\right)}$

In addition, in above-mentioned execution mode, the mean flow rate ratio is used from high-order the 2nd to the 4th brighteness ratio, but be not limited to this.The brighteness ratio that is used for the mean flow rate ratio can also be the brighteness ratio that becomes high relatively value at least at the full brightness ratio.

In addition, in above-mentioned execution mode, be constructed such that the brighteness ratio that does not use highest order, but be not limited thereto.If the brighteness ratio of highest order is compared the unsettled value that is not for outstanding high value etc. with other brighteness ratio, then also can constitute the brighteness ratio that uses highest order.

In addition; In above-mentioned execution mode; Image cut apart viewfinder image will be not luminous the time and each data of photographic images are divided into 64 zones of 8 * 8 of the shown in Figure 3 that kind of a plurality of zones in this execution mode respectively when luminous each data, but be not limited to this.Cutting apart also of image can be divided into a plurality of zones, and the decision of cutting apart number and cut zone can suitably determine.

In addition, in above-mentioned execution mode, use by image pickup part 20 take luminous the time photographic images viewfinder image when not luminous carry out white balance and handle, still be not limited to this.White balance is handled and for example can also be used photographic images and the viewfinder image that obtains from the outside through CPU11 or image processing part 14.In addition; In above-mentioned execution mode, through using when luminous photographic images and when not luminous viewfinder image carry out white balance and handle, but be not limited to this; For example, can also through use when luminous photographic images and when not luminous photographic images carry out white balance and handle.

(the 2nd execution mode)

Below, use description of drawings the 2nd execution mode of the present invention.

Execution mode 2 is handled on this aspect different with execution mode 1 in the white balance of the step S4 of Fig. 2.Therefore, as the explanation of execution mode 2, only explanation is handled relevant part with the white balance that step S4 carries out.

Handle under the situation about being performed in white balance, in the middle of the camera head 1 of Fig. 1, white balance gains is calculated portion 15, image segmentation portion 16 and brightness and is obtained portion's 17 performance functions.

White balance gains is calculated portion 15, the yield value of the RGB component of photographic images when respectively revisal is luminous to each of a plurality of cut zone.

Here, in this 2nd execution mode, a plurality of cut zone are classified as the sufficient cut zone of the rayed that is estimated as photoflash lamp (below be called " irradiation area ") or cut zone in addition (below be called " non-irradiation area ").In addition, for the sorting technique of irradiation area and non-irradiation area, after state.

Therefore, in this 2nd execution mode, the correction method of the yield value of the RGB component of photographic images becomes different at irradiation area with non-irradiation area when luminous.

Therefore, below, the correction method of the yield value of the RGB component of the non-irradiation area in the middle of the photographic images when luminous is described.

Even be non-irradiation area, the situation that flash light does not shine fully also is rare, and it is essential that the adjustment of having considered the white balance behind the irradiating state of photoflash lamp becomes.In order to carry out such adjustment, the yield value of the RGB component of the non-irradiation area when luminous in the middle of the photographic images is according to carrying out revisal as follows.

White balance gains is calculated portion 15; When not luminous viewfinder image and when luminous each yield value of the RGB component of the non-irradiation area of photographic images be transformed into YUV (Y: brightness; U: the aberration of brightness and blue component, V: the yield value of the component aberration of brightness and red component).

Below, each yield value and the execution mode 1 of viewfinder image and the YUV component that each yield value conversion of the RGB component of photographic images comes when luminous likewise are called " YUV transformed value " when never luminous.

Then; White balance gains is calculated portion 15; Taking all factors into consideration does not have viewfinder image when luminous and the brighteness ratio (stating behind the brighteness ratio) of each non-irradiation area of photographic images when luminous, and the gain LY of the Y component when luminous in the middle of the YUV transformed value of the non-irradiation area of photographic images carries out revisal.

Here, below, the gain of the Y component after the revisal when luminous in the middle of the YUV transformed value of the non-irradiation area of photographic images is called " LY ' ".In other words, for LY, applied not having viewfinder image when luminous and the value of weighting after the brighteness ratio of each non-irradiation area of photographic images has carried out taking all factors into consideration when luminous is LY '.

LY ' is for example likewise tried to achieve by formula (3) with execution mode 1.

White balance gains is calculated portion 15, and the yield value of RGB component is changed in the YUV transformed value inversion of through type (3) non-irradiation area of photographic images during with luminous after by revisal (weighting) of Y component.Particularly, white balance gains is calculated portion 15, according to the formula (4) of execution mode 1, and the yield value of the RGB component of the non-irradiation area of photographic images when trying to achieve luminous after the inverse transformation.

And, the yield value of the RGB component of the non-irradiation area of photographic images when the column vector on the right of formula (4) is represented luminous after the inverse transformation.The gain LR α of the R component of the yield value of the RGB component of the non-irradiation area of photographic images after by inverse transformation, the gain LG α of the G component after the inverse transformation, the gain LB α of the B component after the inverse transformation constitute during luminous after the inverse transformation.

Like this, revisal the yield value of the RGB component of the non-irradiation area in the middle of photographic images when luminous.

Above, the correction method of the yield value of the RGB component of the non-irradiation area in the middle of photographic images when luminous has been described.

In addition, the correction method of the yield value of the RGB component of the irradiation area when luminous in the middle of the photographic images limits especially, for example in this execution mode, adopt based on after the correction method of the brighteness ratio stated.

And white balance gains is calculated portion 15, and the yield value when luminous after the revisal of the RGB component of each cut zone of photographic images writes down the white balance of the photographic images of object and sets to each cut zone.

As described above, calculate in the processing of portion 15 in white balance gains, same with execution mode 1, it is essential that the brighteness ratio of each cut zone becomes.For computing of carrying out such brighteness ratio etc., be provided with brightness and obtain portion 17.

That is, brightness obtains portion 17, viewfinder image and obtain brightness value with cut zone unit in the data of photographic images when luminous when never luminous.

Here, because cut zone is made up of a plurality of pixels, the therefore brightness of so-called cut zone means to be made as based on the brightness of each pixel that constitutes this cut zone and the value of computing, the for example mean value of the brightness of each pixel.

Brightness obtains and is provided with brightness ratio in the portion 17 than portion 41.

Brightness ratio is than portion 41, is used to calculate viewfinder image when luminous and the brighteness ratio of each cut zone of photographic images when not luminous.

The brighteness ratio Pi of zone sequence number i (i is the positive integer value of cutting apart below the sum, is the positive integer value below 64 in this execution mode) is tried to achieve by following formula (9).

[formula 9]

$\mathrm{Pi}=\frac{{\mathrm{Yi}}^{\&prime;}}{\mathrm{Yi}}\&CenterDot;\&CenterDot;\&CenterDot;\left(9\right)$

In formula (9), the brightness of i cut zone of photographic images when Yi ' expression is luminous.Yi representes the brightness of i cut zone of viewfinder image when not luminous.

In this execution mode, the brightness ratio of being undertaken by such formula (9) is than the operation result of portion 41, for example is stored in the storage part 24 with form shown in Figure 4 and managed.

In the 2nd execution mode, based on the brighteness ratio of each cut zone of trying to achieve like this, each cut zone is classified into non-irradiation area or irradiation area.Particularly, for example, in this execution mode, the desired value as minimum in the middle of the brighteness ratio the when rayed of photoflash lamp becomes bright is preestablished as threshold value.In this case, if brighteness ratio Pi is below the threshold value, then i cut zone is classified as non-irradiation area, and on the other hand, if brighteness ratio Pi has surpassed threshold value, then i cut zone is classified as irradiation area.

Then, brightness ratio is classified the brighteness ratio prorate order from low to high of each full cut zone than portion 41.

Then, brightness ratio is than portion 41, tries to achieve in the middle of the brighteness ratio of each cut zone that prorate order from low to high classifies, the mean value of the the next the 2nd to the 4th brighteness ratio is as above-mentioned mean flow rate ratio C.

Particularly, brightness ratio is than portion 41, and is same with execution mode 1, through arithmetic expression (6), tries to achieve mean flow rate ratio C.

Here, according to execution mode 2, in formula (6), Ct2 representes the the next the 2nd to the 4th each brighteness ratio to each of Ct4.

For example, the brighteness ratio of full cut zone (C1=Y1 '/Y1, C2=Y2 '/Y2, C3=Y3 '/Y3 ..., C8=Y8 '/Y8 ..., C22=Y22 '/Y22 ..., C64=Y64 '/Y64) central, the brighteness ratio till the next the 4th is made as as follows.Promptly be made as: the 64th (under begin the 1st): Ct1=C1=Y1 '/Y1, the 63rd (under begin the 2nd): Ct=C2=Y2 '/Y2, the 62nd (under begin the 3rd): Ct3=C8=Y8 '/Y8, the 61st (under begin the 4th): Ct4=C22=Y22 '/Y22; In this case; Mean flow rate ratio C and execution mode 1 are same, are calculated by formula (7).

Above, with reference to figure 3 and Fig. 4, in the middle of the function of the camera head 1 of the Fig. 1 that has explained at this execution mode 2 constitutes, be used for the function that the white balance of the step S4 of execution graph 2 handles and constitute.

Below, the detailed process that white balance with step S4 that camera head 1 that such function constitutes carries out is handled is described.

In white balance is handled, under the control of CPU11, white balance gains calculate that portion 15 obtains portion 17 to brightness any one all carry out the processing of each step.But, in following explanation, omit about the explanation of the control of CPU11.

Fig. 5 is the flow chart that the details of the flow process that the white balance of step S4 was handled in the middle of the photoflash lamp shooting of Fig. 2 of camera head 1 execution of Fig. 1 was handled describes.

In step S31, when image segmentation portion 15 respectively will be not luminous viewfinder image and when luminous each data of photographic images be divided into 8 * 8 cut zone, brightness obtains the brightness value that portion 17 obtains each cut zone.

In step S32, brightness ratio is calculated the brightness value of viewfinder image when not luminous than portion 41 respectively to each cut zone and the brighteness ratio between the brightness value of photographic images when luminous.

At length, brightness ratio through the above-mentioned formula of computing (6), is calculated the brighteness ratio Pi about i cut zone than portion 41.The computing of such formula (6) is carried out each of the 1st to the 64th, thereby is calculated brighteness ratio P1 to P64.

In this execution mode, the brightness ratio of being undertaken by such formula (6) is than the operation result of portion 41, for example is stored storage part with form shown in Figure 4 to each cut zone and managed.

In step S33, white balance gains is calculated portion 15, and viewfinder image and each data of photographic images when luminous when not luminous are set the yield value of the RGB component of each cut zone.

In step S34, white balance gains is calculated portion 15, sets " 1 " (i=1) as the area code i of process object.That is, in this execution mode, the step S25 that states after becoming arrives the cut zone of the process object till the step S30, comes to set successively with the order of cutting apart number.Therefore, at first set " 1 " and cut apart number i as process object.

In step S35, white balance gains is calculated portion 15, judges whether brighteness ratio Pi has surpassed threshold value (Pi＞threshold value).

The so-called brighteness ratio Pi situation higher than threshold value, as above-mentioned, the cut zone that means the area code i of process object is the situation of irradiation area.Under these circumstances, in the processing of step S25, being judged to be is to handle proceeding to step S26.

In step S36, white balance gains is calculated portion 15, based on brighteness ratio Pi, the yield value of the RGB component of the cut zone (irradiation area) of area code i is carried out revisal.

Thus, processing proceeds to step S31.Wherein, for the later processing of step S31, after state.

Relative therewith, so-called brighteness ratio Pi is the situation below the threshold value, and as above-mentioned, the cut zone that means the area code i of process object is the situation of non-irradiation area.Under these circumstances, in the processing of step S35, be judged to be not, handle proceeding to step S37.

Then, carry out the processing of the step S37 of following that kind, the yield value of the RGB component of the cut zone of revisal area code i to S40.

That is, in step S37, brightness ratio based on by the brighteness ratio of the full brightness ratio P1 of the processing institute computing of the step S32 low level the 2nd in the middle of the P64 to the 4th, is calculated mean flow rate ratio C than portion 41.

Particularly, according to above-mentioned formula (6), arithmetic average brighteness ratio C.

In addition, the processing of step S37, if after the processing by step S35 is judged to be not for the first time, only carry out 1 time with regard to enough, after this, also it doesn't matter even omit.

In step S38, white balance gains is calculated portion 15, and the yield value of the RGB component of the cut zone (irradiation area) of the number i in the middle of the yield value that will be set by the processing of step S33 is transformed into the YUV transformed value.

At length, white balance gains is calculated portion 15, according to above-mentioned formula (1), tries to achieve the YUV transformed value of the cut zone (non-irradiation area) of area code i.

In step S39; White balance gains is calculated portion 15; Based on the mean flow rate ratio C that tries to achieve by the processing of step S27; The value of the Y component in the middle of the YUV transformed value of the cut zone (non-irradiation area) of the area code i through photographic images when luminous is carried out revisal, calculates the value of the Y component after the weighting.

At length; White balance gains is calculated portion 15; According to the above-mentioned formula (3) that will be used as coefficient by the mean flow rate ratio C that the processing of step S34 is calculated, the gain LY revisal of the Y component when luminous in the middle of the YUV transformed value of the cut zone (non-irradiation area) of the area code i of photographic images is gain LY '.

Like this; Take all factors into consideration viewfinder image when not luminous and the brighteness ratio of the non-irradiation area in the middle of each cut zone of photographic images when luminous; The gain LY of the Y component when coming revisal luminous in the middle of the YUV transformed value of the cut zone of the area code i of photographic images (non-irradiation area), thus the gain LY ' of the Y component after the revisal become.

In step S40, white balance gains is calculated portion 15, will be about the interpolation of the cut zone (non-irradiation area) of area code i the YUV transformed value of weighting be inversely transformed into the yield value of RGB component.

At length, white balance gains is calculated portion 15, according to above-mentioned formula (4), tries to achieve the yield value after the inverse transformation of the RGB component in the cut zone (non-irradiation area) of the area code i of photographic images when luminous.

Promptly; White balance gains is calculated portion 15, and the YUV transformed value of the cut zone (non-irradiation area) of the number i of photographic images in the time of will having been added weighting luminous by the processing of step S29 (LY ', LU, LV) inversion respectively changes the gain (LR α) of R component, the gain (LG α) of G component and the gain (LB α) of B component into.

Through like this, the yield value of the RGB component of the cut zone of the area code i of photographic images when luminous is under the situation of irradiation area (becoming under the situation that is being judged by the processing of step S35) in this cut zone, through the processing of step S36 by revisal; Be under the situation of non-irradiation area (becoming under the situation not judging) in this cut zone by the processing of step S35, through step S37 to the processing of S40 and by revisal.

Thus, processing proceeds to step S41.

In step S41, white balance gains is calculated portion 15 increases by 1 (i=i+1) with area code i.

In step S42, white balance gains is calculated the 15 determinating area number i of portion and whether has been surpassed 64.

Do not have under 64 the situation of surpassing at area code i; That is, the yield value of the RGB component of photographic images is not by under the situation of the cut zone of revisal existence when luminous, and in step S42, judging becomes not; Processing turns back to step S35, and repeats its later processing.

That is, to the cut zone of area code 1 to 64 each, each implementation step S35 are to the circular treatment of S42.In this case, for the cut zone that is categorized as irradiation area (the processing judgement by step S35 becomes the cut zone that is), through the processing of step S36, the yield value of the RGB component of photographic images when coming revisal luminous.Relative therewith, for the cut zone that is categorized as non-irradiation area (the processing judgement by step S35 becomes cut zone not), through the processing of step S37 to S40, the yield value of the RGB component of photographic images when coming revisal luminous.

And when carrying out when being the processing of step S41 of cut zone of area code 64 about last cut zone, area code i becomes 65, surpasses 64.Therefore, in next procedure S42, judged to become to be to handle proceeding to step S43.

In step S43, white balance gains is calculated portion 15, to each cut zone, about irradiation area, based on the yield value by the RGB component of the processing institute revisal of step S36, comes when luminous the white balance of photographic images to set; About non-irradiation area, based on by the yield value of step S37, come when luminous the white balance of photographic images to set to the RGB component of the processing institute revisal of S40.

Thus, finishing white balance handles.That is, the processing of the step S4 of Fig. 2 finishes, and handles proceeding to step S5.

That kind as described above, camera head 1 comprises: illuminating part 21, image pickup part 20, CPU11, white balance gains are calculated portion 15, image segmentation portion 15, brightness and are calculated portion and brightness ratio than portion 41.

CPU11 control makes through user's operation, when the image during luminous brightening that will be through being caused by illuminating part 21 is luminous photographic images and do not carry out by this illuminating part 21 cause luminous the time image when not luminous viewfinder image photograph on the image pickup part 20.

White balance gains is calculated portion 15, the yield value of photographic images and each color component that the white balance of viewfinder image is adjusted when not luminous when calculating be used for setting when taking luminous respectively.

Image segmentation portion 15 will be divided into a plurality of zones by the camera watch region that image pickup part 20 is taken.

Brightness obtains portion 17, and photographic images and viewfinder image when not luminous for by 15 zones of cutting apart respectively of image segmentation portion luminous the time are calculated the brightness value in a plurality of zones of being cut apart by image segmentation portion 15 respectively.

Brightness ratio is than portion 41, and the value behind the brightness value in the brightness value of calculating the zone of photographic images when obtaining luminous that portion 17 calculates by brightness respectively zone of viewfinder image when not luminous is as relative value.

White balance gains is calculated portion 15, is that zone below the predetermined value is confirmed to the relative value of being calculated respectively than portion 41 by brightness ratio.

Brightness ratio is than portion 41, and is among the relative value of calculating respectively, preferential and select the low relative value of a plurality of selective values.

White balance gains is calculated portion 15, based on calculate luminous the time photographic images and the value and a plurality of relative values of selecting than portion 41 by brightness ratio of each color component of viewfinder image when not luminous, the yield value of each color component of photographic images carries out revisal when luminous.

In the camera head 1 that constitutes like this, in can be when photoflash lamp the is luminous captured image, the reproducibility of the natural color of image is improved.

In addition, white balance gains is calculated portion 15, with obtain luminous the time photographic images and when not luminous the RGB component transformation of viewfinder image to group (YUV transformed value) as the parameter of the pixel that comprises monochrome information at least of other color spaces.

In addition, white balance gains is calculated portion 15, also based on the group (YUV transformed value) of the parameter of the pixel of conversion, the yield value of RGB component is carried out revisal.

In the camera head 1 that constitutes like this; Owing to use the grey balance level to carry out the adjustment of brightness through transforming to the YUV transformed value; Therefore can not be created in photoflash lamp following specific change color that can produce of situation that each brightness of each color component of image captured when luminous is adjusted separately, thereby can further improve the reproducibility of the natural color of image.

And the present invention is not limited to above-mentioned execution mode, and the present invention also is included in distortion in the scope of the purpose that can realize the present invention, improvement etc.

In addition, in above-mentioned execution mode, try to achieve brighteness ratio Pi by above-mentioned formula (5), but be not limited thereto.For example brighteness ratio Pi can be tried to achieve by following formula (10).In this case, for mean flow rate ratio C, used from each brighteness ratio Pi of high-order the 2nd to the 4th.

[formula 10]

$\mathrm{Pi}=\frac{\mathrm{Pi}}{{\mathrm{Pi}}^{\&prime;}}\&CenterDot;\&CenterDot;\&CenterDot;\left(10\right)$

In addition, in above-mentioned execution mode, the mean flow rate ratio has been used the from the next the 2nd to the 4th brighteness ratio, but be not limited to this.The brighteness ratio that is used for the mean flow rate ratio can also be the brighteness ratio that becomes low relatively value at least at the full brightness ratio.

In addition, in above-mentioned execution mode, be constructed such that and do not use the most the next brighteness ratio, but be not limited thereto.If the most the next brighteness ratio is compared the unsettled value that is not for outstanding low value etc. with other brighteness ratio, then also can constitute the most the next brighteness ratio of use.

In addition; In above-mentioned execution mode; Image cut apart viewfinder image will be not luminous the time and each data of photographic images are divided into 64 cut zone of 8 * 8 of the shown in Figure 3 that kind of a plurality of zones in this execution mode respectively when luminous each data, but be not limited to this.Cutting apart also of image can be divided into a plurality of zones, and the decision of cutting apart number and cut zone can suitably determine.

In addition, in above-mentioned execution mode, use by image pickup part 20 take luminous the time photographic images viewfinder image when not luminous carry out white balance and handle, still be not limited to this.White balance is handled and for example can also be used photographic images and the viewfinder image that obtains from the outside through CPU11 or image processing part 14.In addition; In above-mentioned execution mode, through using when luminous photographic images and when not luminous viewfinder image carry out white balance and handle, but be not limited to this; For example, can also through use when luminous photographic images and when not luminous photographic images carry out white balance and handle.

In addition, in above-mentioned execution mode, be suitable for electronic installation of the present invention, still be not confined to this especially through camera heads such as digital camera 1 are illustrated as an example.The present invention can be generally applicable to carry out the electronic equipment that above-mentioned white balance is handled.Particularly, for example, the present invention can be applicable to personal computer, video camera, portable navigating device, portable phone unit, portable game machine, WEB camera of notebook type etc.

Above-mentioned a series of processing also can be carried out through hardware, also can carry out through software.For example, above-mentioned a series of processing can either be carried out through hardware, also can carry out through software.In other words, the formation of the hardware of Fig. 1 is exemplary only, limits especially.That is, be included in the camera head 1 if can carry out the function of above-mentioned a series of processing as a whole, just enough, use what kind of functional block not to be confined to the example of Fig. 1 especially in order to realize this function.In addition, a functional block can be made up of the hardware monomer, also can be made up of the software monomer, can also constituting by them.

Under the situation that a series of processing is carried out by software, the program that constitutes this software is installed on computer etc. from network or recording medium.Computer also can be the computer that special-purpose hardware has been installed.In addition, computer can be the computer that can carry out various functions through various programs are installed, for example is general personal computer.

The recording medium that comprises such program for program is offered the user, not only is made up of the removable media 31 of separating the Fig. 1 that scatters with apparatus main body, and is made up of the recording medium that offers the user with the state that is installed on apparatus main body in advance etc.Removable media 31, for example, by formations such as disk (comprising floppy disk), CD or magneto optical disks.CD is for example by CD-ROM (compact Disk-Read Only Memory, compact disk-read-only memory), DVD formations such as (digital universal discs).Magneto optical disk is by MD formations such as (mini-disk).In addition, offer user's recording medium, for example constitute by the hard disk in the ROM12 of the Fig. 1 that has write down program and the storage part 24 that is included in Fig. 1 etc. with the state that is installed on apparatus main body in advance.

In addition, in this manual, attend the step of institute's program recorded,, obviously may not on sequential, handle the processing that can also comprise side by side or carry out individually along the processing that its order is accomplished on sequential for recording and narrating recording medium.

Claims (5)

1. a camera head is characterized in that, comprising:

Luminescence unit;

Image unit;

Image is obtained the unit, the 2nd image of obtaining the 1st image when said luminescence unit luminous, taken through said image unit and when said luminescence unit not luminous, taking through said image unit;

Yield value is obtained the unit, obtains the yield value of obtaining each color component of said the 1st image obtained the unit and said the 2nd image through said image respectively;

Cutting unit will be obtained the 1st image of obtaining the unit through said image and become a plurality of zones with the 2nd image segmentation;

Brightness value is obtained the unit, to each zone in said a plurality of zones, obtains respectively through said cutting unit and is divided into the 1st image in a plurality of zones and the brightness value of the 2nd image;

Calculate the unit, calculate the relative value of each regional brightness value that obtains each regional brightness value and said the 2nd image of said the 1st image of obtaining the unit through said brightness value respectively;

Selected cell from calculating among the relative value of calculating respectively the unit through said, is selected a plurality of relative values of confirming; And

Correcting unit is based on a plurality of relative values of confirming of selecting through said selected cell, the yield value of each color component in the zone of at least a portion of said the 1st image of revisal.

2. camera head according to claim 1 is characterized in that,

The said unit of calculating, calculate obtain said the 1st image of obtaining the unit through said brightness value the value of each regional brightness value after divided by each regional brightness value of said the 2nd image as said relative value,

Said selected cell, from calculating among the relative value of calculating respectively the unit through said, the high a plurality of relative values confirmed of selective value preferentially;

Said correcting unit, based on through the said the 1st obtain each color component of the 1st image obtained the unit and the 2nd image yield value and a plurality of relative values of confirming of selecting through said selected cell, the yield value of each color component of said the 1st image of revisal.

3. camera head according to claim 1 is characterized in that,

Also comprise definite unit, confirm through the said relative value of calculating respectively the unit of calculating to be the zone below the predetermined value,

The said unit of calculating, calculate obtain said the 1st image of obtaining the unit through said brightness value the value of each regional brightness value after divided by each regional brightness value of said the 2nd image as said relative value,

Said selected cell, from calculating among the relative value of calculating respectively the unit through the said the 2nd, low a plurality of relative values of selective value preferentially;

Said correcting unit, based on a plurality of relative values of confirming of selecting through said selected cell, the yield value of revisal and each color component through the 1st corresponding image of the determined relative value in said definite unit.

4. camera head according to claim 1 is characterized in that,

Also comprise converter unit, will be transformed into the group of the parameter of the pixel that comprises monochrome information at least in other color spaces through each color component that said image is obtained the 1st image obtained the unit and the 2nd image,

Said correcting unit, also based on the group of the parameter of the pixel through said converter unit conversion, the yield value of each color component of said the 1st image of revisal and said the 2nd image.

5. a white balance adjustment method is characterized in that, comprising:

Image is obtained step, obtains through luminous to be in the 1st bright image and through luminous and be not in the 2nd bright image;

Yield value is obtained step, obtains the yield value of obtaining each color component of said the 1st image that step obtains and said the 2nd image through image respectively;

Segmentation procedure will be divided into a plurality of zones respectively through the 1st image that processing obtained and said the 2nd image that said image is obtained step;

Brightness value is obtained step, to each zone in said a plurality of zones, obtains through said segmentation procedure and is divided into said the 1st image in a plurality of zones and the brightness value of said the 2nd image;

Calculate step, calculate the relative value of each regional brightness value that obtains each regional brightness value and said the 2nd image of said the 1st image that step obtains through said brightness value respectively;

Select step,, preferentially select a plurality of relative values of confirming from calculating through said brightness value among the relative value that step calculates respectively; And

The revisal step is based on through the selected definite a plurality of relative values of said selection step, the yield value of each color component in the zone of at least a portion of said the 1st image of revisal.

Images