CN1879126A

CN1879126A - Average maintenance interpolation operating circuit, pixel interpolation circuit, average maintenance interpolation operating method, pixel interpolatin method

Info

Publication number: CN1879126A
Application number: CN200480033136.7A
Authority: CN
Inventors: 山中聪; 奥野好章; 染谷润
Original assignee: Mitsubishi Electric Corp
Current assignee: Mitsubishi Electric Corp
Priority date: 2003-11-10
Filing date: 2004-06-18
Publication date: 2006-12-13
Anticipated expiration: 2024-06-18
Also published as: CN100590651C; JP3810404B2; EP1686529A4; US7738738B2; EP1686529A1; JP2005141611A; TWI271647B; WO2005045758A1; US20070092156A1; TW200516482A

Abstract

Interpolation data of a missing pixel is determined such that the average value of a plurality of pixels constituting a pixel set including a missing pixel becomes equal to the average value of a plurality of pixels constituting a pixel set not including a missing pixel. For example, the sum (SL) of values is determined (1) for pixels other than a missing pixel out of k pixels constituting a pixel set (LC) including the missing pixel (L), the sum (SA) of values of k pixels constituting a pixel set (NA) not including the missing pixel is determined (2), and then the difference is determined (3) thus obtaining interpolation data for missing. Interpolation error can be reduced when a high-periodicity image partially deficient in pixels is interpolated.

Description

On average keep interpolation arithmetic circuit, pixel interpolation circuit, on average keep interpolation arithmetic method and picture element interpolation method

Technical field

The present invention relates to the missing pixel in the digital picture is carried out interpolation arithmetic circuit, pixel interpolation circuit, interpolation arithmetic method and the picture element interpolation method of interpolation.

Background technology

In existing pixel interpolation circuit, use following method to calculate the interpolated data of missing pixel: with the mean value of the value of missing pixel pixel adjacent method as interpolated data; Obtain regression straight line with the missing pixel pixel adjacent with least square method, calculate the method for interpolated data according to this regression straight line; And, calculate (for example, with reference to the patent documentations 1) such as methods of interpolated datas according to these 4 formulas according to obtaining the curve of 4 formulas with 4 pixels of missing pixel adjacency.

Patent documentation 1: TOHKEMY 2003-101724 communique (paragraph 0040 to 0066, Fig. 3 to Fig. 5)

Summary of the invention

In existing interpolation arithmetic circuit, carry out linear interpolation or use higher order functionality to carry out interpolation, so when the high image of periodicity that has lacked one part of pixel carried out interpolation, error increased.

The present invention finishes in order to solve aforesaid problem exactly, and its purpose is to obtain suitably carrying out the missing pixel that is comprised in the periodically high image interpolation arithmetic circuit, pixel interpolation circuit, interpolation arithmetic method and the image interpolation method of interpolation.

The invention provides and on average keep the interpolation arithmetic circuit, it is characterized in that, obtain the interpolated data of missing pixel, make to constitute the mean value of value of a plurality of pixels of the pixel groups that comprises missing pixel and the mean value of value that constitutes a plurality of pixels of the pixel groups that does not comprise missing pixel and equate.

In based on interpolation arithmetic circuit of the present invention, obtain the interpolated data of missing pixel, make the mean value of the pixel column comprise missing pixel and the mean value that does not comprise the pixel column of missing pixel equate, thus can be suitably to the equal data of the mean value of the value of the pixel of the pixel column that comprises missing pixel and the pixel column that do not comprise missing pixel, for example have periodic data etc. and carry out interpolation.

Description of drawings

Fig. 1 is the block scheme of structure of the interpolation arithmetic circuit of expression embodiment 1.

Fig. 2 is the figure of expression by the pixel column of the interpolation arithmetic processing of circuit of embodiment 1.

Fig. 3 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 1.

Fig. 4 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 1.

Fig. 5 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 1.

Fig. 6 is the block scheme of structure example that expression has the pixel interpolation circuit of cycle detection circuit.

Fig. 7 is the figure of expression by the pixel column of the interpolation arithmetic processing of circuit of embodiment 2.

Fig. 8 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 2.

Fig. 9 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 2.

Figure 10 is the block scheme of structure of the interpolation arithmetic circuit of expression embodiment 3.

Figure 11 is the figure of expression by the pixel column of the interpolation arithmetic processing of circuit of embodiment 3.

Figure 12 is the figure of expression by the group of the pixel interpolation arithmetic processing of circuit, that be split into a plurality of row of embodiment 3.

Figure 13 is the figure of expression by pixel column interpolation arithmetic processing of circuit of the present invention, that be positioned at a plurality of row.

Figure 14 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 3.

Figure 15 is the block scheme that disappearance portion that expression has an a plurality of disappearance portion adding circuit adds up to the structure example of counting circuit.

Figure 16 is a block scheme of representing on average to keep the structure example of interpolation arithmetic circuit.

Figure 17 is the block scheme of structure of the pixel interpolation circuit of expression embodiment 4.

Figure 18 is the figure of relation pixel interpolation circuit, between pixel period and the interpolation error of expression embodiment 4.

Figure 19 (a) to (e) be expression embodiment 4 pixel interpolation circuit, for the figure of relation each parameter k, between pixel period and the interpolation error.

Figure 20 (a) to (c) be expression embodiment 4 pixel interpolation circuit, for the figure of relation each parameter k, between pixel period and the interpolation error.

Figure 21 is the block scheme of structure of the pixel interpolation circuit of expression embodiment 4.

Figure 22 (a) to (d) is the oscillogram of action of left and right sides average interpolation circuit of the pixel interpolation circuit of expression embodiment 4.

Figure 23 is the pixel period of left and right sides average interpolation circuit of pixel interpolation circuit of expression embodiment 4 and the figure of the relation between the interpolation error.

Figure 24 (a) to (c) is the pixel period of each interpolation arithmetic circuit of pixel interpolation circuit of expression embodiment 4 and the figure of the relation between the interpolation error.

Figure 25 is the figure of the relation picture element interpolation computing circuit, between parameter k and the interpolation error of expression embodiment 4.

Figure 26 (a) to (c) is the figure of the relation picture element interpolation computing circuit, between parameter k and the interpolation error of expression embodiment 4.

Figure 27 (a) to (c) is the figure of expression by the pixel column of the pixel interpolation circuit processing of embodiment 4.

Figure 28 (a) to (c) be illustrated in the embodiment 4, a plurality of of pixel interpolation circuit on average keep the figure that the interpolation arithmetic circuit brings good result's scope respectively.

Figure 29 is the block scheme of structure of the pixel interpolation circuit of expression embodiment 6.

Figure 30 (a) to (b) is the figure that is illustrated in the embodiment 6 group of the pixel column handled and pixel.

Figure 31 is the figure of the evaluation result of each the interpolation arithmetic circuit of expression when carrying out interpolation by the pixel interpolation circuit of embodiment 6 for a plurality of test pixel.

Figure 32 is the figure of comprehensive evaluation result of each interpolation arithmetic circuit of the pixel interpolation circuit of expression embodiment 6.

Figure 33 is the block scheme of concrete example of the pixel interpolation circuit of expression embodiment 6.

Figure 34 (a) is the oscillogram of expression by an example of the pixel data of the pixel interpolation circuit processing of embodiment 6, is to represent missing pixel and the figure that is positioned near its test pixel (b).

Figure 35 (a) to (c) is the figure of expression by the pixel column of the pixel interpolation circuit processing of embodiment 6.

Missing pixel in Figure 36 (a) to (e) a series of pixel that to be expression handled by the pixel interpolation circuit of embodiment 6 and the figure that is positioned near the test pixel it.

Missing pixel in Figure 37 (a) to (e) a series of pixel that to be expression handled by the pixel interpolation circuit of embodiment 6 and the figure that is positioned near the test pixel it.

Missing pixel in Figure 38 (a) to (e) a series of pixel that to be expression handled by the pixel interpolation circuit of embodiment 6 and the figure that is positioned near the test pixel it.

Figure 39 is the figure of the evaluation result of each the interpolation arithmetic circuit of expression when by the pixel interpolation circuit of embodiment 6 a plurality of test pixel having been carried out interpolation.

Figure 40 is the figure of comprehensive evaluation result of each interpolation arithmetic circuit of the pixel interpolation circuit of expression embodiment 6.

Figure 41 (a) is the oscillogram of expression by an example of the pixel data of the pixel interpolation circuit processing of embodiment 6, is to represent missing pixel and the figure that is positioned near its test pixel (b).

Figure 42 is the figure of the evaluation result of each the interpolation arithmetic circuit of expression when by the pixel interpolation circuit of embodiment 6 a plurality of test pixel having been carried out interpolation.

Figure 43 is the figure of comprehensive evaluation result of each interpolation arithmetic circuit of the pixel interpolation circuit of expression embodiment 6.

Figure 44 (a) is the oscillogram of expression by an example of the pixel data of the pixel interpolation circuit processing of embodiment 6, is to represent missing pixel and the figure that is positioned near its test pixel (b).

Figure 45 is the figure of the evaluation result of each the interpolation arithmetic circuit of expression when by the pixel interpolation circuit of embodiment 6 a plurality of test pixel having been carried out interpolation.

Figure 46 is the figure of comprehensive evaluation result of each interpolation arithmetic circuit of the pixel interpolation circuit of expression embodiment 6.

Figure 47 is the block scheme of structure of the interpolation arithmetic circuit of expression embodiment 7.

Figure 48 is the figure of expression by the pixel column of the interpolation arithmetic processing of circuit of embodiment 7.

Figure 49 is the block scheme of structure of the interpolation arithmetic circuit of expression embodiment 7.

Figure 50 is the oscillogram of expression by an example of the pixel data of the interpolation arithmetic processing of circuit of embodiment 7.

Figure 51 is the process flow diagram of treatment step in the picture element interpolation method of expression embodiment 8.

Figure 52 is the process flow diagram of treatment step in the picture element interpolation method of expression embodiment 9.

Symbol description

1 disappearance portion adding circuit, 1 (1) first disappearance portion adding circuit, 1 (2) second disappearance portion adding circuit, 2 non-disappearance portion adding circuits, 2 (1) first non-disappearance portion adding circuits, 2 (2) second non-disappearance portion adding circuits, 3 difference channels, 4 averaging circuits, 5 output circuits, 6 (0) left and right sides average interpolation computing circuits, 6 (1) first on average keep the interpolation arithmetic circuit, and 6 (2) second on average keep the interpolation arithmetic circuit, 6 (n-1) n-1 on average keeps the interpolation arithmetic circuit, 6 (n) n on average keeps the interpolation arithmetic circuit, and 6 (m-1) m-1 on average keeps the interpolation arithmetic circuit, 7 management circuits, 8 scoring circuit, 9 select signal generating unit, 10 output area generative circuits, 11 restricting circuits, 12 on average keep the interpolation arithmetic circuit, 13 export-restriction portions, 15 cycle detection circuit, 17 non-disappearance portions add up to counting circuit, 18 averaging circuits, 19 disappearance portions add up to counting circuit, 20 control circuits, 21 image data memories.

Embodiment

Following with reference to the description of drawings embodiments of the present invention.

Be a series of pixel of knowing the position of missing pixel in advance as process object in the following embodiments.Example as so a series of pixel, obtain when for example being pixel element reading images information shown in the above-mentioned patent documentation 1, that form by a plurality of chip line spread, in this case, when across the border of adjacency chip chamber and the mutual interval of the imaging apparatus of adjacency during greater than the mutual interval of the imaging apparatus in the same chip (1 pitch), for example during the 2 pitch left and right sides, think to have missing pixel and carry out interpolation processing.

Under the situation of the position of not knowing missing pixel in advance, the circuit of the position of additional detected missing pixel gets final product.

Several in the embodiments of the present invention have under the periodic situation when use performance effect in a series of pixel.

In addition, several embodiments is as the mode of knowing the cycle in advance, by bring into play best effect according to this cycle setup parameter.

Do not knowing that in advance under the periodic situation, the circuit in additional detected cycle gets final product.

Embodiment 1

Fig. 1 is the figure of expression based on the structure of interpolation arithmetic circuit of the present invention.

Have disappearance portion adding circuit 1, non-disappearance portion's adding circuit 2 and difference channel 3 based on interpolation arithmetic circuit of the present invention.As the back described in detail, disappearance portion adding circuit 1 was obtained in a series of pixel, constitutes in k the pixel of the pixel groups that comprises missing pixel, the value sum (SL) of missing pixel pixel in addition.Non-disappearance portion adding circuit 2 is obtained the total of value of k pixel that formation does not comprise the pixel groups of missing pixel.Difference channel 3 is obtained the interpolated data (L) of missing pixel by deduct the output (SL) of disappearance portion adding circuit 1 from the output (SA) of non-disappearance portion adding circuit 2.

Fig. 2 is the figure of the part of expression input picture DI, is illustrated in the position relation based on two pixel columns of calculating mean value in the interpolation arithmetic circuit of the present invention.In the following description, suppose to know in advance the position of the missing pixel among the input picture DI.Zero expression in esse pixel (non-missing pixel), * expression missing pixel.Label LC and NA represent respectively to constitute a series of pixels a part, k the pixel column that pixel constituted continuous, that one dimension is arranged mutually.Pixel column LC and pixel column NA do not repeat.Pixel column LC comprises missing pixel, and pixel column NA does not comprise missing pixel.

Use the action of Fig. 1 and Fig. 2 explanation based on interpolation arithmetic circuit of the present invention.

The interpolation arithmetic circuit of present embodiment carries out interpolation to missing pixel L, make the pixel column LC comprise missing pixel L mean value and not comprise the mean value of pixel column NA of missing pixel L equal.Input picture DI is inputed to disappearance portion adding circuit 1 and non-disappearance portion adding circuit 2.K is the parameter that is illustrated in the number of pixels of calculating mean value in the interpolation arithmetic circuit of the present invention, and expression constitutes the number of the pixel of pixel column LC, pixel column NA.Be transfused to disappearance portion adding circuit 1 and non-disappearance portion adding circuit 2.At first, disappearance portion adding circuit 1 with k pixel being comprised among the pixel column LC (LC[1], LC[2]～LC[k-1], L) in, beyond the missing pixel L and export as part and data SL.Part and data SL are

SL＝LC[1]+LC[2]+…+LC[k-1]。

Part and data SL are inputed to difference channel 3.

Non-disappearance portion adding circuit 2 is exported k pixel being comprised among the pixel column NC (NA[1]～NA[k]) sum as part and data SA.Part and data SA are

SA＝NA[1]+NA[2]+…+NA[k]。

Part and data SA are inputed to difference channel 3.

Difference channel 3 is set up equation based on part and data SL and SA, makes that the mean value of pixel column LC and NA is equal, obtains the interpolated data of missing pixel L.Equation is

(SL+L)/k＝SA/k，

Missing pixel L is

L＝SA-SL。

Interpolation arithmetic circuit based on present embodiment can suitably carry out interpolation to missing pixel at the view data with the equal characteristic of pixel column LC that comprises missing pixel L and the mean value of the pixel column NA that does not comprise missing pixel L.

In addition, owing to calculate the interpolated data of missing pixel based on the interpolation arithmetic circuit of present embodiment, make comprise the pixel column of missing pixel and do not comprise the mean value of value of pixel of pixel column of missing pixel equal, so in following instructions, the above-mentioned interpolation arithmetic circuit based on present embodiment is made as on average keeps the interpolation arithmetic circuit.In addition, in the following description,, ' mean value of the value of the pixel of pixel column ' is called ' mean value of pixel column ' for simply.Equally, the meaning of ' total of the value of pixel ', ' the value sum of pixel ' also is expressed as ' pixel sum ', ' total of pixel ' sometimes.

Then, have periodic situation, the example that missing pixel is carried out interpolation is shown about view data.

Fig. 3 is the figure that expression has an example of periodic view data.Transverse axis X remarked pixel position, longitudinal axis D indicated concentration value.

Illustrate and have periodic view data.

The view data of Fig. 3 is the data of the data Dorg that repeats certain variation according to some cycles Pd having been carried out discretize at each sampling period Ps.In Fig. 3, so Pd=5Ps is with the pixel period of Pp=Pd/Ps=5 as view data.Pixel period Pp represents the sampling number in per 1 cycle.That is, pixel period is the cycle that changes with the pixel that number of pixels is represented.In addition, in Fig. 3, suppose that the value of data repeats 100,143,126,74,57 at each cycle data Pd.

At first, the view data for pixel period Pp=5 is shown, on average keeps interpolation arithmetic circuit (Fig. 1) carries out interpolation to missing pixel example by k=5.

Fig. 4 is the figure of the view data under the situation of pixel L of the expression view data that lacked Fig. 3, is illustrated on average keeping in the interpolation arithmetic circuit of k=5, the correspondence of the pixel column LC of calculating mean value and the relation of the position between the NA (Fig. 2).

Because being the k with Fig. 1, the structure of on average keeping the interpolation arithmetic circuit of k=5 is made as 5 situation, so omit explanation.

Use Fig. 1 and Fig. 4 that the action of on average keeping the interpolation arithmetic circuit of k=5 is described.

Disappearance portion adding circuit 1 with 5 pixels being comprised among the pixel column LC (LC[1]～LC[4], L) in, beyond the missing pixel L and export as part and data SL.Because LC[1]=143, LC[2]=74, LC[3]=57, LC[4]=100, so part and data SL become

SL＝LC[1]+LC[2]+LC[3]+LC[4]

＝143+74+57+100

＝374。

Non-disappearance portion adding circuit 2 is exported 5 pixels being comprised among the pixel column NA (NA[1]～NA[5]) sum as part and data SA.Because NA[1]=57, NA[2]=100, NA[3]=143, NA[4]=126, NA[5]=74, so part and data SA become

SA＝NA[1]+NA[2]+NA[3]+NA[4]+NA[5]

＝57+100+143+126+74

＝500。

Difference channel 3 is set up equation based on part and data SL and SA, makes that the mean value of pixel column LC and NA is equal, obtains the interpolated data of missing pixel L.Equation becomes

(SL+L)/5＝SA/5，

Missing pixel L becomes

L＝SA-SL

＝500-374

＝126。

As shown in Figure 3, the raw data of missing pixel L is 126, and the interpolated data of on average keeping the interpolation arithmetic circuit of k=5 is with respect to error=0 of raw data.K=5 on average keeps the interpolation arithmetic circuit and can suitably carry out interpolation to missing pixel for the view data of 5 pixel period.

Then, the view data at pixel period Pp=5 is shown, on average keeps the interpolation arithmetic circuit carries out interpolation to missing pixel example by k=3.

Fig. 5 is the figure of the view data under the situation of pixel L of the expression view data that lacked Fig. 3, is illustrated on average keeping in the interpolation arithmetic circuit of k=3, the correspondence of the pixel column LC of calculating mean value and the relation of the position between the NA (Fig. 2).

Because being the k with Fig. 1, the structure of on average keeping the interpolation arithmetic circuit of k=3 is made as 3 situation, so omit explanation.

Use Fig. 1 and Fig. 5 that the action of on average keeping the interpolation arithmetic circuit of k=3 is described.

Disappearance portion adding circuit 1 with 3 pixels being comprised among the pixel column LC (LC[1], LC[2], L) in, beyond the missing pixel L and export as part and data SL.Because LC[1]=143, LC[2]=74, so part and data SL become

SL＝LC[1]+LC[2]

＝143+74

＝217。

Non-disappearance portion adding circuit 2 is exported 3 pixels being comprised among the pixel column NA (NA[1]～NA[3]) sum as part and data SA.Because NA[1]=100, NA[2]=143, NA[3]=126, so part and data SA become

SA＝NA[1]+NA[2]+NA[3]

＝100+143+126

＝369。

(SL+L)/3＝SA/3，

Missing pixel L becomes

L＝SA-SL

＝369-217

＝152。

As shown in Figure 3, the raw data of missing pixel L is 126, and the interpolated data of on average keeping the interpolation arithmetic circuit of k=3 has with respect to raw data | the error of 152-126|=26.

Because the view data of Fig. 5 is at each pixel period Pp=5 repeating data 100,143,126,74,57, so the mean value of the continuous value of 5 pixels arbitrarily in the view data is and constant by (100+143+126+74+57)/5=100.And for the integral multiple of pixel period Pp, be that the mean value of N*Pp pixel is too

N* (100+143+126+74+57)/N*5=100 is constant (N is a positive integer).

In the example of on average keeping the interpolation arithmetic circuit of the k=5 of Fig. 4, parameter k equates with pixel period Pp, therefore comprise the mean value of pixel column LC of missing pixel and the mean value that does not comprise the pixel column NA of missing pixel and be 100, can suitably obtain the interpolated data of missing pixel by the equation of difference channel 3.

In the example of on average keeping the interpolation arithmetic circuit of the k=3 of Fig. 5, parameter k is the integral multiple of pixel period Pp, so the interpolated data of missing pixel has error.

As mentioned above, the error of interpolated data reduces under parameter k and pixel period Pp or its integral multiple situation about equally, so it is for example shown in Figure 6, on average keep the interpolation arithmetic circuit and also can add the cycle detection circuit 15 that receives view data DI and detect pixel period Pp, determine parameter k based on detected pixel period Pp.

In addition, in the above description, supposed to know in advance the position of missing pixel, but under the situation of the position of not knowing missing pixel, the circuit of position that also can the additional detected missing pixel.As such circuit, for example can make and use known error correction circuit.

Like this, under the parameter k that on average keeps the interpolation arithmetic circuit and situation that pixel period Pp equates, can suitably carry out interpolation to missing pixel.In addition, the parameter k that on average keeps the interpolation arithmetic circuit be under the situation of integral multiple (k=N*Pp) of pixel period Pp too, the mean value of pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel can suitably be obtained the interpolated data of missing pixel by the equation of difference channel 3 for equating.

In addition, as above-mentioned embodiment, the pixel column NA that comprises the pixel column LC of missing pixel L and do not comprise missing pixel L is made of k pixel respectively, obtain among the pixel column LC that comprises missing pixel L by disappearance portion adding circuit 1, the total of the value of the pixel beyond the missing pixel L, when obtaining the total of value of the pixel that constitutes the pixel column NA that does not comprise missing pixel L by non-disappearance portion adding circuit 2, by obtaining poor that these add up to, can obtain the interpolated data of missing pixel, make the mean value of value of pixel of two pixel columns equate mutually.That is,, also can determine the interpolated data of pixel, make mean value equate mutually even do not carry out obtaining the calculating of mean value for each pixel column.

Embodiment 2

Fig. 7 is the figure that similarly represents the part of input picture DI with Fig. 2, is illustrated in the position relation between two pixel columns on average keeping calculating mean value in the interpolation arithmetic circuit.Label LC and NA represent respectively to constitute a series of pixel a part, k the pixel column that pixel constituted continuous, that one dimension is arranged mutually.Pixel column LC and pixel column NA repeat the i pixel.Pixel column LC comprises missing pixel, and pixel column NA does not comprise missing pixel.In addition, the zone or the part that among label NA ' the remarked pixel row NA, do not repeat with pixel column LC, the part that among label LC ' the remarked pixel row LC, does not repeat with pixel column NA is among label AD remarked pixel row NA and the pixel column LC, the part of repetition mutually.

As shown in the figure, pixel column is constituted as missing pixel L and is not contained in the repeating part AD.

Because comprise the pixel column of missing pixel and do not comprise the structure of on average keeping the interpolation arithmetic circuit under the situation that the pixel column of missing pixel repeats, action and Fig. 1 and Fig. 2 structure, move identical, so the omission explanation.

Comprise the pixel column of missing pixel and do not comprise and on average keep the interpolation arithmetic circuit under the situation that the pixel column of missing pixel repeats, with the pixel column that comprises missing pixel shown in the embodiment 1 and do not comprise under the unduplicated situation of pixel column of missing pixel on average to keep the interpolation arithmetic circuit same, the parameter k that on average keeps the interpolation arithmetic circuit is under the situation of integral multiple (k=N*Pp) of pixel period Pp, comprise the mean value of pixel column LC of missing pixel and the mean value of pixel column NA that do not comprise missing pixel for equating, can suitably carry out interpolation missing pixel.

In addition, as following being described in detail, value behind the number of pixels i that deducts repeating part from the parameter k that on average keeps the interpolation arithmetic circuit is that the integral multiple of pixel period Pp is (under the situation of (k-i)=N*Pp), comprise the mean value of pixel column LC of missing pixel and the mean value of pixel column NA that do not comprise missing pixel also for equating, can suitably carry out interpolation missing pixel.

As shown in Figure 7, the part of pixel column LC and data SL become by the part of pixel column LC ' and part and the data SAD of data SL ' and pixel column AD

SL＝SL’+SAD。

In addition, the part of pixel column NA and data SA become by the part of pixel column NA ' and part and the data SAD of data SA ' and pixel column AD

SA＝SA’+SAD。

Set up equation, make when pixel column LC and NA equate, become

(SL+L)/k＝SA/k，

During with part and data SL and the substitution of SA difference, become

(SL’+SAD+L)/k＝(SA’+SAD)/k。

Because comprise the pixel column of missing pixel and do not comprise the pixel column repetition of missing pixel, so the part of pixel column NA and data SAD are cancelled, equation becomes

(SL’+L)/k＝SA’/k。

When k/ (k-i) is multiply by on both sides, become

(SL’+L)/(k-i)＝SA’/(k-i)，

The mean value of (k-i) the individual pixel column that is comprised respectively among the pixel column LC ' of the pixel column NA ' of the unduplicated part of equation remarked pixel row NA and the unduplicated part of pixel column LC equates.

Thereby, comprise the pixel column of missing pixel and do not comprise and on average keep the interpolation arithmetic circuit under the situation that the pixel column of missing pixel repeats, also can suitably carry out interpolation for the view data of the characteristic that equates for mean value with pixel column NA ' and LC '.

At first, the view data at pixel period Pp=5 is shown, repeat by pixel column that comprises missing pixel and the pixel column that do not comprise missing pixel 4 pixels k=9 on average keep the example that the interpolation arithmetic circuit comes missing pixel is carried out interpolation.

Fig. 8 is the figure of the view data under the situation of pixel L of the expression view data that lacked Fig. 3, is illustrated in the pixel column that comprises missing pixel and repeats the pixel column LC that on average keeps calculating mean value in the interpolation arithmetic circuit of k=9 of 4 pixels and the correspondence of the relation of the position between the NA (Fig. 7) pixel column that does not comprise missing pixel.

The structure of on average keeping the interpolation arithmetic circuit of k=9 is same with the situation that the k of Fig. 1 is made as 9, so omit explanation.

The pixel column that uses Fig. 1 and Fig. 8 explanation to comprise the pixel column of missing pixel and do not comprise missing pixel repeats the action of on average keeping the interpolation arithmetic circuit of the k=9 of 4 pixels.

Disappearance portion adding circuit 1 with 9 pixels being comprised among the pixel column LC (AD[1]～AD[4], L, LC[1]～LC[4]) in, beyond the missing pixel L and export as part and data SL.Because AD[1]=74, AD[2]=57, AD[3]=100, AD[4]=143, LC[1]=74, LC[2]=57, LC[3]=100, LC[4]=143, so part and data SL become

SL＝AD[1]+AD[2]+AD[3]+AD[4]+LC[1]+LC[2]+LC[3]+LC[4]

＝74+57+100+143+74+57+100+143

＝748。

Non-disappearance portion adding circuit 2 with 9 pixels being comprised among the pixel column NA (NA[1]～NA[5], AD[1]～AD[4]) sum exports as part and data SA.Because NA[1]=74, NA[2]=57, NA[3]=100, NA[4]=143, NA[5]=126, AD[1]=74, AD[2]=57, AD[3]=100, AD[4]=143, so part and data SA become

SA＝NA[1]+NA[2]+NA[3]+NA[4]+NA[5]+AD[1]+AD[2]+AD[3]+AD[4]

＝74+57+100+143+126+74+57+100+143

＝874。

(SL+L)/9＝SA/9，

Missing pixel L becomes

L＝SA-SL

＝874-748

＝126。

As shown in Figure 3, the raw data of missing pixel L is 126, and the pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeats the interpolated data of on average keeping the interpolation arithmetic circuit of k=9 of 4 pixels with respect to error=0 of raw data.The pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeat 4 pixels k=9 on average keep the pixel data of interpolation arithmetic circuit for 5 pixel period, can suitably carry out interpolation to missing pixel.

Then, the view data at pixel period Pp=5 is shown, repeat by pixel column that comprises missing pixel and the pixel column that do not comprise missing pixel 5 pixels k=9 on average keep the interpolation arithmetic circuit carries out interpolation to missing pixel example.

Fig. 9 is the figure of the view data under the situation of pixel L of the expression view data that lacked Fig. 3, on average the keeping in the interpolation arithmetic circuit of k=9 that is illustrated in the pixel column that comprises missing pixel and repeats 5 pixels the pixel column that does not comprise missing pixel, the correspondence of the pixel column LC of calculating mean value and the relation of the position between the NA (Fig. 7).

Use Fig. 1 and Fig. 9 that the action of on average keeping the interpolation arithmetic circuit of k=9 is described.

Disappearance portion adding circuit 1 with 9 pixels being comprised among the pixel column LC (AD[1]～AD[5], L, LC[1]～LC[3]) in, beyond the missing pixel L and export as part and data SL.Because AD[1]=126, AD[2]=74, AD[3]=57, AD[4]=100, AD[5]=143, LC[1]=74, LC[2]=57, LC[3]=100, so part and data SL become

SL＝AD[1]+AD[2]+AD[3]+AD[4]+AD[5]+LC[1]+LC[2]+LC[3]

＝126+74+57+100+143+74+57+100

＝731。

Non-disappearance portion adding circuit 2 with 9 pixels being comprised among the pixel column NA (NA[1]～NA[4], AD[1]～AD[5]) sum exports as part and data SA.Because NA[1]=74, NA[2]=57, NA[3]=100, NA[4]=143, AD[1]=126, AD[2]=74, AD[3]=57, AD[4]=100, AD[5]=143, so part and data SA become

SA＝NA[1]+NA[2]+NA[3]+NA[4]+AD[1]+AD[2]+AD[3]

+AD[4]+AD[5]

＝74+57+100+143+126+74+57+100+143

＝874。

(SL+L)/9＝SA/9，

Missing pixel L becomes

L＝SA-SL

＝874-731

＝143。

As shown in Figure 3, the raw data of missing pixel L is 126, and the interpolated data of on average keeping the interpolation arithmetic circuit that the pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeats the k=9 of 5 pixels has with respect to raw data | the error of 143-126|=17.

Comprise the pixel column of missing pixel and do not comprise and on average keep the interpolation arithmetic circuit under the situation that the pixel column of missing pixel repeats, with the pixel column that comprises missing pixel shown in the embodiment 1 and do not comprise under the unduplicated situation of pixel column of missing pixel on average to keep the interpolation arithmetic circuit same, be under the situation of integral multiple (k=N*Pp) of pixel period Pp at parameter k, can suitably carry out interpolation missing pixel.

And then, repeat in the example of on average keeping the interpolation arithmetic circuit of k=9 of 4 pixels at the pixel column that comprises missing pixel of Fig. 8 and the pixel column that do not comprise missing pixel, the number of pixels of pixel column LC and the unduplicated part of NA equates with pixel period Pp, therefore the mean value of pixel column LC and unduplicated partial L C ' of NA and NA ' is 100, can suitably obtain the interpolated data of missing pixel by difference channel 3.

Repeat in the example of on average keeping the interpolation arithmetic circuit of k=9 of 5 pixels at the pixel column that comprises missing pixel of Fig. 9 and the pixel column that do not comprise missing pixel, the number of pixels that comprises the pixel column of missing pixel and do not comprise the unduplicated part of pixel column of missing pixel is not the integral multiple of pixel period Pp, so the interpolated data of missing pixel has error.

Like this, at the pixel column that comprises missing pixel with do not comprise under number of pixels and the situation that pixel period Pp equates of the unduplicated part of pixel column of missing pixel, can suitably carry out interpolation to missing pixel.In addition, be under the situation of integral multiple (k-i=N*Pp) of pixel period Pp in the pixel column that comprises missing pixel and the number of pixels that do not comprise the unduplicated part of pixel column of missing pixel, too, the mean value of the unduplicated part of pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel can suitably carry out interpolation to missing pixel for equating.

As mentioned above, under the number of pixels (k-i) and pixel period Pp or its integral multiple situation about equally of unduplicated part, the error of interpolated data reduces, so for example with shown in Figure 6 same, on average keep the interpolation arithmetic circuit and also can add the cycle detection circuit 15 that receives view data DI and detect pixel period Pp, determine parameter k and i based on detected pixel period Pp.

Embodiment 3

Figure 10 is that the interpolation of missing pixel is carried out in expression, make the pixel column that comprises missing pixel mean value and do not comprise the mean value of two pixel columns of missing pixel equal, on average keep the structure of interpolation arithmetic circuit.

The interpolation arithmetic circuit of on average keeping that makes the mean value of the pixel column that comprises missing pixel and do not comprise under the situation that the mean value of two pixel columns of missing pixel equates has: the non-disappearance of the non-disappearance of disappearance portion adding circuit 1, first portion adding circuit 2 (1), second portion adding circuit 2 (2), difference channel 3 and averaging circuit 4.

Figure 11 and Fig. 2 represent the part of input picture DI equally, are illustrated in the position relation between three pixel columns on average keeping calculating mean value in the interpolation arithmetic circuit.Pixel column LC, NA and NB are respectively the pixel columns of having arranged k pixel one-dimensionally, and pixel column LC and pixel column NA and pixel column LC and pixel column NB repeat the i pixel respectively.Pixel column LC comprises missing pixel, and pixel column NA and NB do not comprise missing pixel.In addition, label NA ' is illustrated among the NA not the part that repeats with LC, label NB ' is illustrated among the pixel column NB not the part that repeats with pixel column LC, label LCA ' is illustrated among the pixel column LC not the part that repeats with pixel column NA, and label LCB ' is illustrated among the pixel column LC not the part that repeats with pixel column NB.In addition, the part that label AD remarked pixel row NA and pixel column LC repeat, the part that label BD remarked pixel row NB and pixel column LC repeat.

In addition, as shown in figure 12, also can set the pixel column LC that comprises missing pixel, pixel column NA and the NB that does not comprise missing pixel two-dimensionally.

That is, also can be as shown in figure 12, a series of pixel is split into a plurality ofly arranges capablelyly and rectangularly, constitutes the part of a plurality of row respectively, constitutes pixel groups by mutual continuous a plurality of pixel columns that pixel constituted in each row.In this case, replace above-mentioned pixel column, and mutual in pixel groups, mean value is become mutually equate.Fig. 2 or situation shown in Figure 11 can think that the pixel that constitutes pixel groups classifies 1 example as.

In addition, for example as shown in figure 13, also can set a plurality of pixel columns that do not comprise missing pixel.In addition, the pixel column that does not comprise missing pixel also can stagger and sets with respect to the pixel column that comprises missing pixel.That is, a plurality of non-missing pixel row (NA, NB, NC) are made of the pixel of mutually different row.

In example shown in Figure 13, show three pixel columns that do not comprise missing pixel, in this case, in the structure of Figure 10, three non-disappearance portion adding circuits (circuit similar to the non-disappearance portion adding circuit 2 (1), 2 (2) of Figure 10) are set, and the average of output of obtaining them gets final product.

Use Figure 10 and Figure 11 explanation comprise missing pixel pixel column mean value and do not comprise the action of on average keeping the interpolation arithmetic circuit under the equal situation of the mean value of two pixel columns of missing pixel.

The interpolation arithmetic circuit of on average keeping that makes the pixel column that comprises missing pixel and do not comprise under the situation that the mean value of two pixel columns of missing pixel equates carries out interpolation to missing pixel L, make the pixel column LC that comprises missing pixel L mean value and do not comprise the pixel column NA of missing pixel L and the mean value of NB equal.Input picture DI is inputed to the non-disappearance of the non-disappearance of disappearance portion adding circuit 1, first portion adding circuit 2 (1) and second portion adding circuit 2 (2).K and Fig. 1 are same, are to be illustrated in the parameter of on average keeping the number of pixels of calculating mean value in the interpolation arithmetic circuit, are transfused to the non-disappearance of the non-disappearance of disappearance portion adding circuit 1, first portion adding circuit 2 (1) and second portion adding circuit 2 (2).At first, disappearance portion adding circuit 1 with k pixel being comprised among the pixel column LC (AD[1]～AD[i], LC[1]～LC[k-2i-1], BD[1]-BD[i]) in, beyond the missing pixel L and export as part and data SL.Part and data SL are

SL＝AD[1]+…+AD[i]+LC[1]+…LC[k-2i-1]+BD[1]+…+BD[i]。

Part and data SL are inputed to difference channel 3.

The first non-disappearance portion adding circuit 2 (1) with k pixel being comprised among the pixel column NA (NA[1]～NA[k-i], AD[1]～AD[i]) sum exports as part and data SA.Part and data SA are

SA＝NA[1]+…+NA[k-i]+AD[1]+…AD[i]。

Part and data SA are inputed to averaging circuit 4.

The second non-disappearance portion adding circuit 2 (2) is with k the pixel that is comprised among the pixel column NB

(BD[1]～BD[i], NB[1]～NB[k-i]) sum exports as part and data SB.Part and data SB are

SB＝BD[1]+…+BD[i]+NB[1]+…NB[k-i]。

Part and data SB are inputed to averaging circuit 4.

Averaging circuit 4 will not comprise the part of two pixel columns of missing pixel and the mean value of data SA and SB is exported according to AN on an average.Average data AN is

AN＝(SA+SB)/2。

Difference channel 3 is set up equation based on part and data SL and average data AN, makes that the mean value of pixel column LC, NA and NB is equal, obtains the interpolated data of missing pixel L.Equation is

(SL+L)/k＝(SA/k+SB/k)/2，

That is, for

(SL+L)/k＝AN/k，

Missing pixel L is

L＝AN-SL。

Make the pixel column that comprises missing pixel and do not comprise and on average keep the interpolation arithmetic circuit for having the pixel column LC that comprises missing pixel and not comprising two pixel column NA of missing pixel and the view data of the characteristic that the mean value of NB is equal under the situation that the mean value of two pixel columns of missing pixel equates, can suitably carry out interpolation.And then, with the pixel column that comprises missing pixel shown in the embodiment 2 and do not comprise under the situation that the pixel column of missing pixel repeats on average to keep the interpolation arithmetic circuit same, for the pixel column that comprises missing pixel with do not comprise the unduplicated part NA ' of pixel column of missing pixel and view data that the mean value of the mean value of LCA ' and NB ' and LCB ' equates, also can suitably carry out interpolation.In addition,, can reduce caused interpolation errors such as noise, improve interpolation precision by obtaining the mean value of two pixel columns that do not comprise missing pixel.

View data at pixel period Pp=5 is shown, repeat respectively by the pixel column that comprises missing pixel and two pixel columns not comprising missing pixel 4 pixels k=9 on average keep the interpolation arithmetic circuit carries out interpolation to missing pixel example.

Figure 14 is the figure of the view data under the situation of pixel L of the expression view data that lacked Fig. 3, is illustrated in the pixel column LC, the NA that on average keep calculating mean value in the interpolation arithmetic circuit of the k=9 under the situation that the mean value of two pixel columns that make the pixel column that comprises missing pixel and do not comprise missing pixel equates and the correspondence of the relation of the position between the NB (Figure 11).LC and NA and LC and NB repeat 4 pixels respectively.

The structure of on average keeping the interpolation arithmetic circuit that two pixel columns that comprise the pixel column of missing pixel and do not comprise missing pixel repeat the k=9 of 4 pixels respectively is that the k with Figure 10 is made as 9 situation, so omit explanation.

Two pixel columns that use Figure 10 and Figure 14 explanation to comprise the pixel column of missing pixel and do not comprise missing pixel repeat the action of on average keeping the interpolation arithmetic circuit of the k=9 of 4 pixels respectively.

Disappearance portion adding circuit 1 with 9 pixels being comprised among the pixel column LC (AD[1]～AD[4], L, BD[1]～BD[4]) in, beyond the missing pixel L and export as part and data SL.Because AD[1]=74, AD[2]=57, AD[3]=100, AD[4]=143, BD[1]=74, BD[2]=57, BD[3]=100, BD[4]=143, so part and data SL become

SL＝AD[1]+AD[2]+AD[3]+AD[4]+BD[1]+BD[2]+BD[3]+BD[4]

＝74+57+100+143+74+57+100+143

＝748。

The first non-disappearance portion adding circuit 2 (1) with 9 pixels being comprised among the pixel column NA (NA[1]～NA[5], AD[1]～AD[4]) sum exports as part and data SA.Because NA[1]=74, NA[2]=57, NA[3]=100, NA[4]=143, NA[5]=126, AD[1]=74, AD[2]=57, AD[3]=100, AD[4]=143, so part and data SA become

SA＝NA[1]+NA[2]+NA[3]+NA[4]+NA[5]+AD[1]+AD[2]+AD[3]+AD[4]

＝74+57+100+143+126+74+57+100+143

＝874。

The second non-disappearance portion adding circuit 2 (2) with 9 pixels being comprised among the pixel column NB (BD[1]～BD[4], NB[1]～NB[5]) sum exports as part and data SB.Because BD[1]=74, BD[2]=57, BD[3]=100, BD[4]=143, NB[1]=126, NB[2]=74, NB[3]=57, NB[4]=100, NB[5]=143, so part and data SB become

SB＝BD[1]+BD[2]+BD[3]+BD[4]+NB[1]+NB[2]+NB[3]+NB[4]+NB[5]

＝74+57+100+143+126+74+57+100+143

＝874。

Averaging circuit 4 is exported the mean value of part and data SA and SB on an average according to AN.Average data AN is

AN＝(SA+SB)/2

＝(874+874)/2

＝874。

Difference channel 3 is set up equation based on part and data SL and average data AN, makes that the mean value of pixel column LC, NA and NB is equal, obtains the interpolated data of missing pixel L.Equation becomes

(SL+L)/9＝(SA/9+SB/9)/2，

That is,

(SL+L)/9＝AN/9，

Missing pixel L becomes

L＝AN-SL

＝874-748

＝126。

As shown in Figure 3, the raw data of missing pixel L is 126, and two pixel columns that comprise the pixel column of missing pixel and do not comprise missing pixel repeat the interpolated data of on average keeping the interpolation arithmetic circuit of k=9 of 4 pixels respectively with respect to error=0 of raw data.Two pixel columns that comprise the pixel column of missing pixel and do not comprise missing pixel repeat respectively 4 pixels k=9 on average keep the pixel data of interpolation arithmetic circuit for pixel period Pp=5, can suitably carry out interpolation to missing pixel.

Like this, same with embodiment 2, can be the view data of the integral multiple (k-i=N*Pp) of pixel period Pp at pixel column that comprises missing pixel and the number of pixels that does not comprise two unduplicated parts of pixel column of missing pixel, suitably missing pixel be carried out interpolation.

And then, same with embodiment 1, comprise the pixel column of missing pixel and do not comprise on average keeping under the situation of integral multiple (k=N*Pp) that the interpolation arithmetic circuit is pixel period Pp at parameter k under the situation that two pixel columns of missing pixel repeat, also can suitably carry out interpolation missing pixel.

In addition, by calculating two mean values that do not comprise the part of missing pixel, when in pixel column NA that does not comprise missing pixel and NB either party contained noise, also because by 4 pairs of averaging of noise contribution of averaging circuit, so can reduce caused interpolation errors such as noise, improve interpolation precision.

In addition, in the structure of Figure 10, also have averaging circuit 4 to constitute non-disappearance portion by the first and second non-disappearance portion adding circuit 2 (1) and 2 (2) and add up to counting circuit 17, this non-disappearance portion adds up to counting circuit 17 to obtain the total of value of k pixel that formation does not comprise the pixel column of missing pixel.

In the structure of Fig. 1, only can think that having constituted so non-disappearance portion by non-disappearance portion adding circuit 2 adds up to counting circuit 17.

In addition, also can be in the structure of Figure 10, replace disappearance portion adding circuit 1, and as shown in figure 15, the averaging circuit 18 that is provided with a plurality of disappearance portion adding circuit 1 (1), 1 (2) and their output is averaged, constitute disappearance portion thus and add up to counting circuit 19, this disappearance portion adds up to counting circuit 19 to obtain the total SL of the value of the pixel in k the pixel that constitutes the pixel column that comprises missing pixel, beyond the missing pixel.

In the structure of Fig. 1 or Figure 10, can think that only having constituted such disappearance portion by disappearance portion adding circuit 1 adds up to counting circuit 19.

Thereby, when the structure of Fig. 1, Figure 10 is carried out vague generalization and is drawn as shown in figure 16.

Embodiment 4

Figure 17 is the figure of expression based on the structure of the pixel interpolation circuit of embodiment 4.This pixel interpolation circuit has: a plurality of on average keep interpolation arithmetic circuit 6 (1) to 6 (n-1), promptly first on average keep interpolation arithmetic circuit 6 (1), second on average keep interpolation arithmetic circuit 6 (2) ..., n-1 on average keeps interpolation arithmetic circuit 6 (n-1).These are on average kept interpolation arithmetic circuit 6 (1) to 6 (n-1) deducted i with parameter k or from parameter k (k-i) and are set at mutually different value.For example, on average keep interpolation arithmetic circuit 6 (1) input parameter k=2 to first, equally to second on average keep interpolation arithmetic circuit 6 (2) ..., n-1 on average keep interpolation arithmetic circuit 6 (n-1) import respectively and set k=3 ..., kn.

Output circuit 5 is for example based on selecting signal C, select on average to be kept in the interpolated data that interpolation arithmetic circuit 6 (1) to 6 (n-1) export respectively by a plurality of one, exports the data as missing pixel.

Figure 18 be illustrated in the pixel column that comprises missing pixel shown in the embodiment 1 and do not comprise k=kj under the unduplicated situation of pixel column of missing pixel on average keep in the interpolation arithmetic circuit curve map of the relation between pixel period and the interpolation error.Transverse axis Pp represents to have the pixel period of periodic view data, and longitudinal axis E represents interpolation error.

Illustrate that k=kj's on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error.

As shown in Embodiment 1, comprise the pixel column of missing pixel and do not comprise on average keeping under the situation of integral multiple (k=N*Pp) that the interpolation arithmetic circuit is pixel period Pp at parameter k under the unduplicated situation of pixel column of missing pixel, can suitably carry out interpolation missing pixel.

Thereby, as shown in figure 18, comprise the pixel column of missing pixel and do not comprise k=kj under the unduplicated situation of pixel column of missing pixel on average keep the interpolation arithmetic circuit to pixel period Pp be Pp=kj/Na1, kj/Na2 ..., kj (Na1＞Na2＞...＞0, Na1, Na2 ... be the approximate number of kj) view data when carrying out interpolation, interpolation error E is 0 or minimum.In addition, the pixel period Pp of the view data of interpolation depart from more Pp=kj/Na1, kj/Na2 ..., kj pixel period Pp, then interpolation error E is big more.

Figure 19 be under the unduplicated situation of pixel column that is illustrated in the pixel column that comprises missing pixel and does not comprise missing pixel k=2,3,4, kn-1, kn on average keep in the interpolation arithmetic circuit curve map of the relation between pixel period and the interpolation error.Figure 19 (a) expression k=2 on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error, Figure 19 (b) expression k=3 on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error, Figure 19 (c) expression k=4 on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error, Figure 19 (d) expression k=kn-1 on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error, and Figure 19 (e) expression k=kn on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error.

Illustrate that k=2,3,4, kn-1, kn's on average keeps pixel period in the interpolation arithmetic circuit and the relation between the interpolation error.

The parameter k that on average keeps the interpolation arithmetic circuit of k=2 is a prime number, so only in the view data of Pp=2, interpolation error E is 0 or minimum.About k=3 on average keep the interpolation arithmetic circuit too, only in the view data of Pp=3, interpolation error E is 0 or minimum.On average keep the interpolation arithmetic circuit about k=4, as shown in figure 18, in the view data as the view data of the Pp=2 of the approximate number of parameter k=4 and Pp=4, interpolation error E is 0 or minimum, but, near the characteristic the Pp=4 only is shown in curve map in order to show curve map simply.About k=kn-1 on average keep the interpolation arithmetic circuit also with k=4 on average to keep the interpolation arithmetic circuit same, near the characteristic the Pp=kn-1 only is shown in curve map.About k=kn on average keep the interpolation arithmetic circuit too, near the characteristic the Pp=kn only is shown in curve map.

Figure 20 be illustrated in pixel column that comprises missing pixel and the unduplicated k=2～k=kn of pixel column that does not comprise missing pixel on average keep in the interpolation arithmetic circuit, the curve map of the relation between pixel period and the interpolation error and each is shown on average keeps the figure of scope that the interpolation arithmetic circuit has produced (can carry out interpolation with smaller error) pixel period Pp of result.Figure 20 (a) expression is with the curve map of five curves overlapped on a coordinate axis of Figure 19 (a)～Figure 19 (e).Figure 20 (b) is that each interpolation error of on average keeping the interpolation arithmetic circuit of expression is the figure of the scope of minimum.R2 represents that the interpolation error of on average keeping the interpolation arithmetic circuit of k=2 is minimum scope.R3～Rn represents that the interpolation error of on average keeping the interpolation arithmetic circuit of k=3～k=kn is respectively minimum scope.The scope of on average keeping the pixel period Pp that the interpolation arithmetic circuit pays off respectively of Figure 20 (c) expression k=2～k=kn.

Illustrate that k=2～k=kn's on average keeps the pixel period that the interpolation arithmetic circuit pays off respectively.

The interpolation error of on average keeping the interpolation arithmetic circuit of k=2 is the scope (R2 that is equivalent to Figure 20 (b)) till the point of the curved intersection of on average keeping the interpolation arithmetic circuit of the curve of on average keeping the interpolation arithmetic circuit from the minimum value of Pp to k=2 and k=3 for minimum scope.The interpolation error of on average keeping the interpolation arithmetic circuit of k=3 for minimum scope be from the point of the curved intersection of on average keeping the interpolation arithmetic circuit of the curve of on average keeping the interpolation arithmetic circuit of k=3 and k=2 to the point of the curved intersection of on average keeping the interpolation arithmetic circuit of k=4 till scope (R3 that is equivalent to Figure 20 (b)).On average keep the interpolation arithmetic circuit too, the scope that the scope shown in R4, Rn-1, the Rn is minimum for each interpolation error of on average keeping the interpolation arithmetic circuit becomes for k=4, kn-1, kn.

Thereby shown in Figure 20 (c), each interpolation error of on average keeping the interpolation arithmetic circuit becomes the scope that each on average keeps the pixel period Pp that the interpolation arithmetic circuit pays off for minimum scope.

The action of pixel interpolation circuit shown in Figure 17 below is described.

Input picture DI is inputed to first on average to be kept interpolation arithmetic circuit 6 (1)～the n-1 and on average keeps interpolation arithmetic circuit 6 (n-1).As mentioned above, for example parameter k=2 is inputed to first and on average keep interpolation arithmetic circuit 6 (2).Equally, with parameter k=3 ..., kn input to respectively second on average keep interpolation arithmetic circuit 6 (2) ..., n-1 on average keeps interpolation arithmetic circuit 6 (n-1).

First on average keeps interpolation arithmetic circuit 6 (1) based on input picture DI and parameter k=2, the interpolated data D1 of output missing pixel.Second on average keep interpolation arithmetic circuit 6 (2) ..., n-1 on average keep interpolation arithmetic circuit 6 (n-1) too based on input picture DI and parameter k=3 ..., kn, export the interpolated data D2～Dn-1 of missing pixel respectively.Interpolated data D1～Dn-1 is inputed to output circuit 5.The selection signal C that for example aftermentioned is generated like that inputs to output circuit 5.Output circuit 5 is based on one that selects among signal C selection interpolated data D1～Dn-1, and output is as the interpolated data DO of missing pixel.

Pixel interpolation circuit shown in Figure 17 have a plurality of parameters different on average keep the interpolation arithmetic circuit, thereby can realize the characteristic of the interpolation error of Figure 20 (b), so shown in Figure 20 (c), can be applied to wide region from the view data in little cycle to the view data in big cycle.

Embodiment 5

Figure 21 represents the structure based on the pixel interpolation circuit of embodiment 5.

This pixel interpolation circuit also has left and right sides average interpolation computing circuit 6 (0) except the structure of Figure 17.On average keep interpolation arithmetic circuit 6 (1) to 6 (m-1) and Figure 17 on average to keep interpolation arithmetic circuit 6 (1) to 6 (n-1) be same, be provided with m-1.This m can be the identical value of n with the structure of Figure 17, also can adopt as described later the value less than n.In other words, under the situation that left and right sides average interpolation computing circuit 6 (0) is set, can reduce the quantity of on average keeping the interpolation arithmetic circuit.

Left and right sides average interpolation computing circuit 6 (0) generates the mean value of value of the adjacent pixels of the left and right sides that is positioned at missing pixel, as interpolated data.In addition, ' about ' expression of mentioning here arrange a series of pixel in the horizontal direction and when describing, be positioned at the left and right sides of missing pixel, with a series of pixel during as time series data, suitable therewith is to be positioned at ' front and back '.

Output circuit 5 is for example based on selecting signal (C), selects by one in described a plurality of interpolated datas of on average keeping interpolation arithmetic circuit 6 (1) to 6 (m-1) and 6 (0) outputs of left and right sides average interpolation computing circuit, and output is as the data of missing pixel.

Figure 22 is the view data that is used for illustrating at pixel period Pp=2,3,4, kn, uses left and right sides average interpolation computing circuit to come pixel is carried out the figure of the method for interpolation.In Figure 22, the maximum value (peak value in each cycle) that shows the pixel that the cycle is changed is carried out the situation of interpolation.Undertaken under the situation of interpolation by left and right sides average interpolation computing circuit, under the situation of the interpolation of as shown in the figure maximum value, error is maximum.Thereby, if, then become the research maximum error for maximum value research error.

Figure 22 (a) is the oscillogram of the view data of remarked pixel cycle Pp=2, Figure 22 (b) is the oscillogram of the view data of remarked pixel cycle Pp=3, Figure 22 (c) is the oscillogram of the view data of remarked pixel cycle Pp=4, and Figure 22 (d) is the oscillogram of the view data of remarked pixel cycle Pp=kn.The L missing pixel of interpolation of indicating in each oscillogram, LL represents and the adjacent pixel in a missing pixel L left side, LR represents the right adjacent pixel with missing pixel L, and LA represents that E2～En represents the error between interpolated data and the raw data respectively by the interpolated data of left and right sides average interpolation computing circuit generation.

The interpolation error of the left and right sides average interpolation computing circuit in the view data of pixels illustrated cycle Pp=2,3,4, kn.

Shown in Figure 22 (a)～Figure 22 (d), left and right sides average interpolation computing circuit will with the adjacent pixel LL in a missing pixel L left side and with the mean value of the right adjacent pixel LR of missing pixel interpolated data LA as missing pixel L.Interpolated data LA is

LA＝(LL+LR)/2。

In addition, in each oscillogram, the difference of the raw data of interpolated data LA and missing pixel L is interpolation error E2～En.

In each image maximum value is carried out under the situation of interpolation, pixel period Pp is big more, and then interpolation error is more little.Pixel period in the average interpolation computing circuit of the left and right sides shown in Figure 23 and the relation between the interpolation error.

Figure 24 is illustrated in the curve map of on average keeping the relation between the pixel period and interpolation error in the interpolation arithmetic circuit, and the figure that the scope of on average keeping the pixel period Pp that interpolation arithmetic circuit and left and right sides average interpolation computing circuit pay off of k=2～kn is shown.

The scope of the pixel period Pp that left and right sides average interpolation computing circuit pays off is described.

Figure 24 (a) is the pixel period in the expression left and right sides average interpolation computing circuit shown in Figure 23 and the curve map of the relation between the interpolation error.

Ep represents the higher limit of the error that can allow in the visuognosis.

Shown in Figure 24 (a), left and right sides average interpolation computing circuit is: E is more little for the big more then interpolation error of pixel period Pp, so in the view data of Pp=km+1～kn, interpolation error E is less than the higher limit Ep of the error that can allow in the visuognosis.Thereby, in the scope shown in the Rave, be in the view data of Pp=km+1～kn, left and right sides average interpolation computing circuit can be used for the interpolation of missing pixel.

The scope of on average keeping the pixel period Pp that the interpolation arithmetic circuit pays off of k=2～k=kn shown in Figure 24 (b) expression Figure 20 (c).Shown in Figure 24 (a), in the view data of Pp=km+1～kn, left and right sides average interpolation computing circuit can be used for the interpolation of missing pixel, so can use the output of left and right sides average interpolation computing circuit to replace parameter k=km+1～kn of Figure 17 (to suppose the output of on average keeping the interpolation arithmetic circuit of m＜n).Thereby (that supposes m＜n) on average keeps the interpolation arithmetic circuit can to omit parameter k=km+1～kn.

Be replaced into left and right sides average interpolation computing circuit by the interpolation arithmetic circuit of on average keeping, can cut down the kind of on average keeping the interpolation arithmetic circuit the k=km+1～kn in the structure of Figure 17.Thereby, can dwindle the circuit scale of the pixel interpolation circuit of the pixel period that can be applicable to wide region.

In addition, the pixel interpolation circuit that is made of left and right sides average interpolation computing circuit and a plurality of interpolation arithmetic circuit has the characteristic of interpolation error as shown in figure 25.Curve map shown in Figure 25 and Figure 20 (b) is same, and in R2, the interpolation error of on average keeping the interpolation arithmetic circuit of k=2 is for minimum, and in R3～Rm, it is minimum that the interpolation error of on average keeping the interpolation arithmetic circuit of k=3～km is respectively equally.In Rave, the interpolation error of left and right sides average interpolation computing circuit is minimum.

Figure 26 be the pixel column that is illustrated in the pixel column that comprises missing pixel shown in embodiment 2 and the embodiment 3 and do not comprise missing pixel repeat under the situation of i pixel k=kj on average keep in the interpolation arithmetic circuit curve map of the relation between pixel period Pp and the interpolation error.

Relation between pixels illustrated cycle and the interpolation error.

As implement shown in mode 2 and the embodiment 3, the interpolation arithmetic circuit of on average keeping that the pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeats under the situation of i pixel is: be the integral multiple (k=N*Pp) of pixel period Pp at parameter k, or the number of pixels k-i that comprises the pixel column of missing pixel and do not comprise the unduplicated part of the pixel column of missing pixel is under the situation of integral multiple (k-i=N*Pp) of pixel period Pp, can suitably carry out interpolation to missing pixel.

Shown in Figure 26 (a), the pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeat under the situation of i pixel k=kj on average keep the interpolation arithmetic circuit to pixel period Pp be Pp=kj/Na1 ..., kj (Na1＞...＞0, Na1 ... be the approximate number of kj) view data carry out under the situation of interpolation, interpolation error E is 0 or minimum, the pixel period Pp of the view data of interpolation depart from more Pp=kj/Na1, kj/Na2 ..., kj pixel period Pp, then interpolation error E is big more.

And then, shown in Figure 26 (b), to pixel period Pp be Pp=(kj-i)/Nb1 ..., kj-i (Nb＞...＞0, NB1 ... be the approximate number of kj-i) view data carry out under the situation of interpolation, interpolation error E also is 0 or minimum, pixel period Pp depart from more Pp=(kj-i)/Nb1 ..., kj-i pixel period Pp, then interpolation error E is big more.

Thereby, the pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeats on average to keep pixel period Pp in the interpolation arithmetic circuit and the relation between the interpolating pixel under the situation of i pixel, become with the curve of the curve of Figure 26 (a) and Figure 26 (b) in conjunction with and the curve map of Figure 26 (c) of obtaining.

Figure 27 be illustrated in shown in the embodiment 3 by the pixel column that comprises missing pixel and do not comprise on average keeping in the interpolation arithmetic circuit that two pixel columns of missing pixel realize, comprise the pixel column LC of missing pixel and do not comprise the pixel column NA of missing pixel and an example of the relation of the position between the NB.The pixel column LC that comprises missing pixel under the situation of Figure 27 (a) expression k=3, i=1 and do not comprise the pixel column NA and the relation of the position between the NB of missing pixel.The pixel column LC that comprises missing pixel under the situation of Figure 27 (b) expression k=5, i=2 and do not comprise the pixel column NA and the relation of the position between the NB of missing pixel.The pixel column LC that comprises missing pixel under the situation of Figure 27 (c) expression k=kn, i=(kn-1)/2 and do not comprise the pixel column NA and the relation of the position between the NB of missing pixel.

Explanation is at the pixel column that comprises missing pixel shown in Figure 27 and do not comprise on average keeping in the interpolation arithmetic circuit that two pixel columns of missing pixel realize, parameter k and i and can suitably carry out relation between the pixel period Pp of view data of interpolation.

As shown in figure 26, the pixel column that comprises the pixel column of missing pixel and do not comprise missing pixel repeat the i pixel k=kj on average keep the interpolation arithmetic circuit can be suitably to pixel period Pp be Pp=kj/Na1 ..., the view data of kj or Pp=(kj-i)/Nb1 ..., kj-i image carry out interpolation, so the pixel column that comprises missing pixel shown in Figure 27 (a) and two pixel columns not comprising missing pixel repeat on average the keeping the interpolation arithmetic circuit and can suitably carry out k=3 of interpolation to(for) the view data of Pp=k=3 or Pp=k-i=2 of 1 pixel.

Repeat about the pixel column that comprises missing pixel shown in Figure 27 (b) and two pixel columns not comprising missing pixel 2 pixels k=5 on average keep the interpolation arithmetic circuit too, can suitably carry out interpolation for the view data of Pp=k=5 or Pp=k-i=3.

Repeat about the pixel column that comprises missing pixel shown in Figure 27 (c) and the pixel column that do not comprise missing pixel (kn-1)/2 pixel k=kn on average keep the interpolation arithmetic circuit too, for Pp=kn/Na1 ..., the view data of kn or Pp=(kn-i)/Nb1 ..., kn-i view data can suitably carry out interpolation.

Figure 28 is illustrated in the pixel column that comprises missing pixel shown in Figure 27 and does not comprise on average keeping in the interpolation arithmetic circuit under the situation that two pixel columns of missing pixel repeat, and each on average keeps the figure of the scope of the pixel period Pp that the interpolation arithmetic circuit pays off.

K=3 on average keeps the scope that the interpolation arithmetic circuit is made as near the pixel period Pp the Pp=3 pixel period that pays off.About k=5 on average keep the interpolation arithmetic circuit too, near the pixel period Pp the Pp=5 is made as the scope of the pixel period that pays off.About k=(kn+1)/2, kn on average keep the interpolation arithmetic circuit too, near the pixel period Pp Pp=(kn+1)/2, the kn is made as the scope of the pixel period that pays off respectively.Thereby the scope of on average keeping the pixel period that the interpolation arithmetic circuit pays off respectively of k=3,5, (kn+1)/2, kn is as Figure 28 (a).

And then near the pixel period Pp the Pp=k-i=2 that on average keeps the interpolation arithmetic circuit of k=3 also is the scope of the pixel period that pays off.About k=5 on average keep the interpolation arithmetic circuit too, near the pixel period Pp the Pp=k-i=3 is made as the scope of the pixel period that pays off.About k=7,9, kn on average keep the interpolation arithmetic circuit too, near the pixel period Pp the Pp=4,5, (kn+1)/2 is made as the scope of the pixel period that pays off respectively.Thereby the scope of on average keeping the pixel period that the interpolation arithmetic circuit pays off respectively of k=3,5,7,9, (kn+1)/2 is as Figure 28 (b).

Thereby, comprise the pixel column of missing pixel and do not comprise on average keeping the interpolation arithmetic circuit and can being applied to altogether scope of Figure 28 (a) and Figure 28 (b), the i.e. view data of the scope shown in Figure 28 (c) of k=3,5 under the situation that two pixel columns of missing pixel repeat, (kn+1)/2, kn.

Like this, a plurality of interpolation arithmetic circuit of on average keeping are added left and right sides average interpolation computing circuit, select in the interpolated data that their generate, the interpolation error minimal data, thus can with the irrelevant situation of pixel period under export the little interpolated data of interpolation error all the time.

Embodiment 6

Figure 29 is the figure of the structure of the pixel interpolation circuit in the expression embodiment 6.

Pixel interpolation circuit in the embodiment 6 also has the selection signal generating unit 9, control circuit 20 and the image data memory 21 that generate the selection signal that inputs to output circuit except the structure of the Figure 21 shown in the embodiment 4.

Image data memory 21 temporary transient storage input image data DI according to the indication from control circuit 20, repeat to export identical view data.

Select signal generating unit 9 based near the raw data of the pixel the missing pixel and near the pixel this missing pixel, by the interpolated data that the method identical with the interpolated data of obtaining missing pixel tried to achieve, generate the selection signal C that selects from the interpolated data of a plurality of interpolation arithmetic circuit.

Illustrated selection signal generating unit 9 is made of management circuit 7 and scoring circuit 8.

A plurality of on average to keep interpolation arithmetic circuit 6 (1) to 6 (n) respectively for example shown in Figure 16, more specifically constitutes as shown in Figure 1.

20 pairs of control circuits are a plurality of on average keeps interpolation arithmetic circuit 6 (1) to 6 (n) separately, for example disappearance portion adds up to counting circuit 19 (Figure 16) input formation to comprise near k the pixel of test with the pixel groups of non-missing pixel of missing pixel, test with the pixel beyond the non-missing pixel, obtain the total SL of its value, to a plurality of interpolation arithmetic circuit separately, non-disappearance portion adds up to counting circuit 17 inputs to constitute and does not comprise k the pixel of test with the pixel groups of missing pixel, obtain the total of its value, make a plurality of interpolation arithmetic circuit difference channel 3 separately obtain the interpolated data of test with non-missing pixel by the output that deducts disappearance portion the output that adds up to counting circuit 17 from non-disappearance portion and add up to counting circuit 19.

Also 6 (0) inputs are positioned near the pixel of the test of missing pixel with the left and right sides of non-missing pixel to control circuit 20 to left and right sides average interpolation computing circuit, obtain the average of its value, and it is exported with the interpolated data of non-missing pixel as test.

Control circuit 20 carries out such processing for a plurality of mutually different tests with non-missing pixel.

Select signal generating unit 9 based on the test of obtaining respectively by a plurality of interpolation arithmetic circuit with the interpolated data of non-missing pixel and test raw data with non-missing pixel, the interpolation arithmetic circuit is estimated, determine to select the content of signal, make and select to obtain the best interpolation arithmetic circuit of estimating.

20 pairs of a plurality of disappearance portions that on average keep interpolation arithmetic circuit 6 (1) to 6 (n) of control circuit add up to counting circuit 19 inputs to constitute the pixel of the pixel groups that comprises missing pixel, add up to the counting circuit input to constitute the pixel of the pixel groups that does not comprise missing pixel to non-disappearance portion, make it carry out respectively on average keeping interpolation arithmetic for missing pixel, to 6 (0) inputs and missing pixel pixel adjacent of left and right sides average interpolation computing circuit, make it carry out left and right sides average interpolation computing for missing pixel, make output circuit 9 based on the selection signal C that has determined content as mentioned above, select from one in the interpolated data of a plurality of interpolation arithmetic circuit 6 (0) to 6 (n) and output.

In addition, in Figure 29, for convenience of explanation, the quantity of on average keeping the interpolation arithmetic circuit is different with the situation of Figure 17 and Figure 21, illustrates n.

The pixel interpolation circuit of Figure 29 carries out two kinds of processing at every turn as follows when providing input image data.

At first, first processing is also referred to as to estimate and handles, use the missing pixel pixel in addition in the input image data that is provided to carry out the evaluation of a plurality of interpolation arithmetic circuit, which interpolation arithmetic circuit to have obtained the content that best evaluation determines to select signal C according to.

Second processing is also referred to as interpolation and carries out processing, based on the content of selecting signal C, generates the interpolated data that the missing pixel in the input image data that is provided is carried out interpolation, carries out interpolation.

Owing to estimate to handle and interpolation is carried out and reused identical input image data DI in handling, so input image data DI temporarily is stored in the image data memory 21, repeats to read according to the indication from control circuit 20 then.

Interpolation arithmetic in interpolation arithmetic during evaluation is handled and the interpolation execution processing can carry out simultaneously concurrently, or also can finish the interpolation arithmetic in the laggard row interpolation execution processing at the interpolation arithmetic during evaluation is handled.Below, at first, the situation of carrying out concurrently as the interpolation arithmetic while in interpolation arithmetic in the evaluation processing and the interpolation execution processing illustrates summary, and then, the situation that finishes the interpolation arithmetic in the laggard row interpolation execution processing for the interpolation arithmetic in the evaluation processing at length describes.

Input picture DI input to left and right sides average interpolation computing circuit 6 (0) and n on average keep the interpolation arithmetic circuit (first on average keep interpolation arithmetic circuit 6 (1), second on average keep interpolation arithmetic circuit 6 (2) ..., n on average keeps interpolation arithmetic circuit 6 (n)) and scoring circuit 8.Parameter k=k1～the kn that on average keeps the interpolation arithmetic circuit is input to first respectively and on average keeps interpolation arithmetic circuit～n and on average keep in the interpolation arithmetic circuit.Left and right sides average interpolation computing circuit 6 (0) is based on input image data DI, and output is about interpolated data (test interpolated data) TD0[T1 of a plurality of tests with non-missing pixel (test pixel)]～the interpolated data D0 of [Tm] and missing pixel.From left and right sides average interpolation computing circuit 6 (0) output test interpolated data TD0[T1]～[Tm] be input to the scoring circuit 8 in, interpolated data D1D0 is transfused to output circuit 5.

First on average keeps interpolation arithmetic circuit 6 (1) based on input picture DI and parameter k=k1, and output is about the interpolated data TD1[T1 of a plurality of test pixel]～the interpolated data D1 of [Tm] and missing pixel.From the first test interpolated data TD1[T1 that on average keeps the interpolation arithmetic circuit 6 (1) output]～[Tm] be transfused to scoring circuit 8, and interpolated data D1 is transfused to output circuit 5.

On average keep interpolation arithmetic circuit 6 (2)～the n about second and on average keep interpolation arithmetic circuit 6 (n) too, based on input picture DI and parameter k=k2～k=kn, export interpolated data TD2[T1 respectively about a plurality of test pixel]～[Tm]～TDn[T1]～the interpolated data D2～Dn of [Tm] and missing pixel.On average keep the test interpolated data TD2[T1 that interpolation arithmetic circuit 6 (2)～the n on average keep the interpolation arithmetic circuit 6 (n) output from second]～[Tm]～TDn[T1]～[Tm] be transfused to scoring circuit 8, and interpolated data D2～Dn is transfused to output circuit 5.

Scoring circuit 8 is marked to the test interpolated data TD0 of output from left and right sides average interpolation computing circuit 6 (0) based on input picture DI, and its result is exported as score data M0.The score data M0 of output inputs to management circuit 7 from scoring circuit 8.

In addition, scoring circuit 8 is on average kept interpolation arithmetic circuit 6 (n) the test interpolated data TD1[T1 that exports on average keeping interpolation arithmetic circuit 6 (1)～the n from first]～[Tm]～TDn[T1]～[Tm] too, DI marks based on input picture, and each result is exported as score data M1～Mn.Score data M1～the Mn of output inputs to management circuit 7 from scoring circuit 8.

Management circuit 7 for example aftermentioned is estimated the score data M0～Mn that exports like this from scoring circuit 8, export based on its result and select signal C.The selection signal C of output inputs to output circuit 5 from management circuit 7.

Output circuit 5 is based on the selection signal C of output from management circuit 7, select left and right sides average interpolation computing circuit 6 (0) and first on average to keep among interpolated data D0～Dn that interpolation arithmetic circuit 6 (1)～the n on average keep interpolation arithmetic circuit 6 (n) output one, export as output data DO.

Below illustrate in greater detail the interpolation arithmetic of estimating in handling and finish the situation that laggard row interpolation is carried out the interpolation arithmetic in handling.

At first describe for estimating the action of handling.At this moment, the output circuit 5 of Figure 29 is not worked.That is, do not export interpolated data DO.

Figure 30 (a) is the figure of expression input picture DI, and expression missing pixel and test concern with the position between the non-missing pixel (test pixel).In Figure 30, the in esse pixel of zero expression, the pixel of * expression disappearance.

With respect to missing pixel L, near in esse pixel (non-missing pixel) shown in T1～Tm, that be positioned at the missing pixel L is defined as test pixel (supposing m=2k).Here, test pixel is meant near the pixel that is considered as missing pixel virtually and generates interpolated data missing pixel.Figure 30 (a) is to be that the center is one-dimensionally at the example of each side having set k test pixel with missing pixel L.

Test pixel can be set with respect to the missing pixel left and right sides unequally, also can be only about a side set.In addition, also can as Figure 30 (b), set two-dimensionally.

The left and right sides average interpolation computing circuit 6 (0), first that uses Figure 29 and Figure 30 (a) to explain among test pixel T1～Tm is on average kept the action that interpolation arithmetic circuit 6 (1)～the n on average keep interpolation arithmetic circuit 6 (n) and scoring circuit 8.

At first, in the position of test pixel T1, the test interpolated data TD0[T1 that left and right sides average interpolation computing circuit 6 (0) is exported under the situation that test pixel T1 is considered as lacking virtually].That is, obtain pixel average of the left and right sides that is positioned at test pixel T1, with its interpolated data output as test pixel T1.

Scoring circuit 8 is obtained the data DI[T1 of input picture DI of the position of test pixel T1] and described test interpolated data TD0[T1] the absolute value of difference, as score data M0[T1] export.Score data M0[T1] become

M0[T1]＝|TD0[T1]-DI[T1]|。

At score data M0[T1] under the little situation, expression test interpolated data is near input picture, that is and, in test pixel T1, the operational method of left and right sides average interpolation computing circuit 6 (0) is suitable.Otherwise, at score data M0[T1] under the big situation, be illustrated among the test pixel T1, the operational method of left and right sides average interpolation computing circuit 6 (0) is inappropriate.In other words, score data M0[T1] the appropriateness of left and right sides average interpolation computing circuit 6 (0) among the expression test pixel T1.

Then, left and right sides average interpolation computing circuit 6 (0) is exported the test interpolated data TD0[T2 under the situation that test pixel T2 is considered as lacking virtually about test pixel T2 too].Scoring circuit 8 is obtained the input picture DI[T2 of the position of test pixel T2] and described test interpolated data TD0[T2] the absolute value of difference, as score data M0[T2] export.Score data M0[T2] become

M0[T2]＝|TD0[T2]-DI[T2]|。

Score data M0[T2] the appropriateness of left and right sides average interpolation computing circuit 6 (0) among the expression test pixel T2.

Left and right sides average interpolation computing circuit 6 (0) is exported test interpolated data TD0[T3 similarly about remaining test pixel T3～Tm]～TD0[Tm].Scoring circuit 8 is obtained described test interpolated data TD0[T3]～TD0[Tm] and with the data DI[T3 of the corresponding input picture DI of each test interpolated data]～DI[Tm] the absolute value of difference, as score data M0[T3]～M0[Tm] output.Score data M0[T3]～M0[Tm] be

M0[T3]＝|TD0[T3]-DI[T3]|

～

M0[Tm]＝|TD0[Tm]-DI[Tm]|。

Score data M0[T3]～M0[Tm] the appropriateness of left and right sides average interpolation computing circuit 6 (0) among expression test pixel T3～Tm.

Like this, obtain the corresponding score data of being exported with left and right sides average interpolation computing circuit 6 (0) of test interpolated data among test pixel T1～Tm.

On average keep interpolation arithmetic circuit 6 (1) too, the test interpolated data TD1[T1 under the situation that the output of the position of test pixel T1 is considered as test pixel T1 to lack virtually for first].Scoring circuit 8 is obtained the data DI[T1 of input picture DI of the position of test pixel T1] and described test interpolated data TD1[T1] between the absolute value of difference, as score data M1[T1] export.Score data M1[T1] become

M1[T1]＝|TD1[T1]-DI[T1]|。

Score data M1[T1] represent that first among the test pixel T1 on average keeps the appropriateness of interpolation arithmetic circuit 6 (1).

First on average keeps interpolation arithmetic circuit 6 (1) exports test interpolated data TD1[T2 similarly about remaining test pixel T2～Tm]～TD1[Tm].Scoring circuit 8 is obtained described test interpolated data TD1[T2]～TD1[Tm] and with the data DI[T2 of the corresponding input picture DI of each test interpolated data]～DI[Tm] between the absolute value of difference, as score data M1[T2]～M1[Tm] output.Score data M1[T2]～M1[Tm] be

M1[T2]＝|TD1[T2]-DI[T2]|

～

M1[Tm]＝|TD1[Tm]-DI[Tm]|。

Score data M1[T2]～M1[Tm] represent that first among test pixel T2～Tm on average keeps the appropriateness of interpolation arithmetic circuit 6 (1).

On average keep interpolation arithmetic circuit 6 (2)～the n interpolation arithmetic circuit 6 (n) too about second, test interpolated data TD2[T1 among output test pixel T1～Tm] ... TD2[Tm]～TDn[T1] ... TDn[Tm], scoring circuit 8 is based on described test interpolated data TD2[T1] ... TD2[Tm]～TDn[T1] ... TDn[Tm], export score data M2[T1 respectively] ... M2[Tm]～Mn[T1] ... Mn[Tm].

Like this, in all test pixel T1～Tm, obtained and on average kept interpolation arithmetic circuit 6 (0) and first and on average keep the appropriateness that interpolation arithmetic circuit 6 (1)～the n on average keep each interpolation arithmetic circuit in the interpolation arithmetic circuit 6 (n).

Figure 31 is the table that the score data of each interpolation arithmetic circuit among test pixel T1～Tm is concentrated.

The absolute value of the difference between the input image data of the test interpolated data by the use test pixel and the position of test pixel can be obtained the appropriateness of interpolation method to each test pixel.

The action of management circuit 7 is described.

In order to estimate near the appropriateness of the left and right sides average interpolation computing circuit 6 (0) the missing pixel, management circuit 7 is with score data M0[T1]～M0[Tm] addition generates the evaluating data S0 of left and right sides average interpolation computing circuit 6 (1).Evaluating data S0 is

S0＝M0[T1]+M0[T2]+…+M0[Tm]。

Under the little situation of evaluating data S0, near the operational method of the left and right sides average interpolation computing circuit 6 (0) the expression missing pixel is suitable.Otherwise under the big situation of evaluating data S0, near the operational method of the left and right sides average interpolation computing circuit 6 (0) the expression missing pixel is inappropriate.

On average keep interpolation arithmetic circuit 6 (n) and estimate near the missing pixel appropriateness too in order on average to keep interpolation arithmetic circuit 6 (1)～the n to first, management circuit 7 is with score data M1[T1] ... M1[Tm]～Mn[T1] ... Mn[Tm] respectively the phase Calais generate first respectively and on average keep evaluating data S1～Sn that interpolation arithmetic circuit 6 (1)～the n on average keep interpolation arithmetic circuit 6 (n).Evaluating data S1～Sn is

S1＝M1[T1]+M1[T2]+…+M1[Tm]

～

Sn＝Mn[T1]+Mn[T2]+…+Mn[Tm]。

Figure 32 is the table that evaluating data S0～Sn is concentrated.

By score data addition, can obtain near the appropriateness of the interpolation method of missing pixel with each test pixel.

The more little interpolation arithmetic circuit of evaluating data is near the interpolation more suitably of the pixel the missing pixel, so can analogize for also can suitably carry out interpolation in missing pixel.Management circuit 7 determines to select the content of signal C, so that selection has the interpolated data that the interpolation arithmetic circuit of evaluating data minimum among evaluating data S0～Sn is exported.Selection signal C after definite like this content is output circuit 5 and uses in ensuing interpolation execution is handled.

The action that the interpolation execution is handled then is described.Carry out in the processing in interpolation, scoring circuit 8 is not worked.And management circuit 7 does not continue to export by estimating handles the selection signal C action in addition of having determined content.Interpolation is carried out the action of the interpolation arithmetic circuit 6 (0) to 6 (n) in handling with same with reference to the action of Figure 21 explanation.Promptly, 20 pairs of control circuits on average keep interpolation arithmetic circuit 6 (1) to 6 (n) separately, disappearance portion adds up to the counting circuit input to constitute the pixel of the pixel groups that comprises missing pixel, add up to the counting circuit input to constitute the pixel of the pixel groups that does not comprise missing pixel to non-disappearance portion, make it carry out interpolation arithmetic respectively, export interpolated data D1～Dn respectively.Control circuit 20 is also to left and right sides average interpolation computing circuit 6 (0) input and missing pixel pixel adjacent, makes it carry out left and right sides average interpolation computing for missing pixel, output interpolated data D0.Make output circuit 5 based on selecting signal C to select to export from one in the interpolated data of a plurality of interpolation arithmetic circuit (6 (0) to 6 (n)).Thereby, output circuit 5 is based on the selection signal C from management circuit 7 outputs, selection is on average kept among interpolated data D0～Dn that interpolation arithmetic circuit 6 (1)～the n on average keep the interpolation arithmetic circuit 6 (n) output one from left and right sides average interpolation computing circuit 6 (0) and first, exports as output data DO.

Like this, after the interpolation end for a missing pixel, beginning is for the interpolation of next missing pixel.

In near the pixel interpolation circuit shown in Figure 29 pixel missing pixel, carry out left and right sides average interpolation computing circuit 6 (0) and first and on average keep the scoring that interpolation arithmetic circuit 6 (1)～the n on average keep the test interpolated data that interpolation arithmetic circuit 6 (n) exported, estimate its result, therefore suitable interpolation arithmetic to the missing pixel place is analogized, and can come missing pixel is carried out interpolation by the interpolation arithmetic that is suitable near the image the missing pixel.

Then, use object lesson to describe.

Figure 33 be expression as a plurality of interpolation arithmetic circuit of on average keeping among Figure 29, have the figure of structure that first of parameter k=5 on average keeps the second average interpolation computing circuit of interpolation arithmetic circuit and parameter k=7.

The structure of pixel interpolation circuit of the concrete example of Figure 33 is described.

The pixel interpolation circuit of the concrete example of Figure 33 has output circuit 5, left and right sides average interpolation computing circuit 6 (0), first is on average kept interpolation arithmetic circuit 6 (1) and the 2nd and on average kept interpolation arithmetic circuit 6 (2), management circuit 7, scoring circuit 8.In addition, in this concrete example, also be provided with the part same, but omitted these diagrams with control circuit shown in Figure 29 20 and image data memory 21.

Input picture DI input to left and right sides average interpolation computing circuit 6 (0), first on average keep interpolation arithmetic circuit the 6 (1), the 2nd on average keep interpolation arithmetic circuit 6 (2) and the scoring circuit 8.Left and right sides average interpolation computing circuit 6 (0) is based on input picture DI output test interpolated data TD0 and interpolated data D0.Input to scoring circuit 8 from the test interpolated data TD0 of left and right sides average interpolation computing circuit 6 (0) outputs, interpolated data D0 inputs to output circuit 5.

Parameter k=5 inputs to the first average interpolation computing circuit 6 (1).First on average keeps interpolation arithmetic circuit 6 (1) based on input picture DI and parameter k=5, output test interpolated data TD1 and interpolated data D1.Input to scoring circuit 8 from the first test interpolated data TD1 that on average keeps 6 (1) outputs of interpolation arithmetic circuit, interpolated data D1 inputs to output circuit 5.

Parameter k=7 inputs to the second average interpolation computing circuit 6 (1).Second on average keeps interpolation arithmetic circuit 6 (2) based on input picture DI and parameter k=7, output test interpolated data TD2 and interpolated data D2.Input to scoring circuit 8 from the second test interpolated data TD2 that on average keeps 6 (2) outputs of interpolation arithmetic circuit, interpolated data D2 inputs to output circuit 5.

Scoring circuit 8 is marked to the test interpolated data TD0 from 6 (0) outputs of left and right sides average interpolation computing circuit based on input picture DI, and its result is exported as score data M0.

Scoring circuit 8, is exported its result marking from the first test interpolated data TD1 that on average keeps 6 (1) outputs of interpolation arithmetic circuit based on input picture DI as score data M1.

Scoring circuit 8, is exported its result marking from the second test interpolated data TD2 that on average keeps 6 (2) outputs of interpolation arithmetic circuit based on input picture DI as score data M2.Input to management circuit 7 from the score data M0～M2 of scoring circuit 8 outputs.

Management circuit 7 is based on the score data M0～M2 from 8 outputs of scoring circuit, and signal C is selected in output.Input to output circuit 5 from the selection signal C of management circuit 7 outputs.

Output circuit 5 is based on the selection signal C from management circuit 7 outputs, selection is on average kept interpolation arithmetic circuit 6 (1) and second from left and right sides average interpolation computing circuit 6 (0), first and is on average kept the interpolated data D0～D2 of interpolation arithmetic circuit 6 (2) output one, exports as output data DO.

Figure 34 is the figure that expression has an example of periodic view data.Figure 34 (a) is and Fig. 3 similarly location of pixels in the view data in remarked pixel cycle 5 and the oscillogram of the relation between the concentration value, repeats concentration value a=74, b=57, c=100, d=143, e=126.Position relation between Figure 34 (b) expression missing pixel and the test pixel.In addition, with missing pixel L be the center, about each two ground carry out one dimension and set, as the test pixel T1 corresponding～T4 with missing pixel L.

Figure 35 is the figure that is used to illustrate the test interpolation method of on average keeping interpolation arithmetic.

The pixel column that comprises missing pixel shown in Figure 35 (a) expression embodiment 3 and do not comprise on average keeping pixel column LC in the interpolation arithmetic circuit, that comprise missing pixel and not comprising the pixel column NA and the relation of the position between the NB of missing pixel under the situation that two pixel columns of missing pixel repeat.Figure 35 (b) expression is considered as missing pixel virtually with test pixel T and tests under the situation of interpolation, contains the position of the pixel column TB that does not comprise test pixel under the situation of missing pixel in comprising the pixel column TC of test pixel.Figure 35 (c) is illustrated in the position of the pixel column TA that does not comprise test pixel under the situation that does not comprise missing pixel among the pixel column TC that comprises test pixel.

The test interpolation method of on average keeping the interpolation arithmetic circuit is described.

On average keep the interpolation arithmetic circuit and near the pixel the missing pixel is being tested under the situation of interpolation, need change interpolation method according to the position of missing pixel.In addition, in the test interpolation, only use a certain side in two pixel columns that do not comprise test pixel.

Shown in Figure 35 (b), in comprising the pixel column TC of test pixel T, contain under the situation of missing pixel L, on average keep the interpolation arithmetic circuit and need consider that missing pixel L sets up equation.Thereby, set the pixel column TB that does not comprise test pixel T according to the mode that comprises missing pixel L, at the pixel column TC that comprises test pixel T with do not comprise among the pixel column TB of test pixel and comprise missing pixel, missing pixel is cancelled in equation thus, can suitably obtain the test interpolated data of test pixel T.Equation is

(TC[1]+…+TC[k-i-1]+T+L+TD[1]+…+TD[i-1])/k

＝(L+TD[1]+…+TD[i-1]+TB[1]+…+TB[k-i])/k。

Test pixel T is

T＝(TB[1]+…+TB[k-i])-(TC[1]+…+TC[k-i-1])。

Shown in Figure 35 (c), in comprising the pixel column TC of test pixel, do not comprise under the situation of missing pixel L, be set at and in not comprising the pixel column TA of test pixel, also do not comprise missing pixel.The equation of on average keeping the interpolation arithmetic circuit is

(TA[1]+…+TA[k-i]+TD[1]+…+TD[i])/k

＝(TD[1]+…+TD[i]+T+TC[1]+…+TC[k-i-1])，

Test pixel T is

T＝(TA[1]+…+TA[k-i])-(TC[1]+…+TC[k-i-1])。

Like this, considered the test interpolation method of the position of missing pixel by use, can suitably on average keep the interpolation arithmetic circuit and mark each.

Figure 36 is the figure that is used for illustrating the action of the left and right sides average interpolation computing circuit 6 (0) of test pixel T1～T4 and missing pixel L and scoring circuit 8.Figure 36 (a) is the figure of the situation of the expression test interpolated data that calculates the left and right sides average interpolation computing circuit 6 (0) among the T1, Figure 36 (b) is the figure of the situation of the expression test interpolated data that calculates the left and right sides average interpolation computing circuit 6 (0) among the T2, Figure 36 (c) is the figure of the situation of the expression test interpolated data that calculates the left and right sides average interpolation computing circuit 6 (0) among the T3, Figure 36 (d) is the figure of the situation of the expression test interpolated data that calculates the left and right sides average interpolation computing circuit 6 (0) among the T4, and Figure 36 (e) is the figure of the situation of the expression interpolated data that calculates the left and right sides average interpolation computing circuit 6 (0) among the missing pixel L.

The action of the left and right sides average interpolation computing circuit 6 (0) among test pixel T1～T4 and the missing pixel L and the circuit 8 of marking is described.

Shown in Figure 36 (a), left and right sides average interpolation computing circuit 6 (0) is with the mean value of pixel T1L and the T1R test interpolated data TD0[T1 as test pixel T1] output.Since T1L=b=57, T1R=d=143, test interpolated data TD0[T1] be

TD0[T1]＝(T1L+T1R)/2＝(57+143)/2＝100。

Scoring circuit 8 is with the data DI[T1 of the input picture DI of the position of test pixel T1] and test interpolated data TD0[T1] the absolute value of difference as score data M0[T1] export.Because TD0[T1]=100, DI[T1]=c=100, score data M0[T1] be

M0[T1]＝|TD0[T1]-DI[T1]|＝|100-100|＝0。

Shown in Figure 36 (b), left and right sides average interpolation computing circuit 6 (0) is with the mean value of pixel T2L and the T2R test interpolated data TD0[T2 as test pixel T2] output.Since T2L=c=100, T2R=a=74, test interpolated data TD0[T2] be

TD1＝(T2L+T2R)/2＝(100+74)/2＝87。

Scoring circuit 8 is with the data DI[T2 of the input picture DI of the position of test pixel T2] and test interpolated data TD0[T2] the absolute value of difference as score data M0[T2] export.Because TD0[T2]=87, DI[T2]=d=143, score data M0[T2] be

M0[T2]＝|TD0[T2]-DI[T2]|＝|87-143|＝56。

Shown in Figure 36 (c), left and right sides average interpolation computing circuit 6 (0) is with the mean value of pixel T3L and the T3R test interpolated data TD0[T3 as test pixel T3] output.Since T3L=d=143, T3R=b=57, test interpolated data TD0[T3] be

TD0＝(T3L+T3R)/2＝(143+57)/2＝100。

Scoring circuit 8 is with the data DI[T3 of the input picture DI of the position of test pixel T3] and test interpolated data TD0[T3] the absolute value of difference as score data M0[T3] export.Because TD0[T3]=87, DI[T3]=a=74, score data M0[T3] be

M0[T3]＝|TD0[T3]-DI[T3]|＝|100-74|＝26。

Shown in Figure 36 (d), left and right sides average interpolation computing circuit 6 (0) is with the mean value of pixel T4L and the T4R test interpolated data TD0[T4 as test pixel T4] output.Since T4L=a=74, T4R=c=100, test interpolated data TD0[T4] be

TD0[T4]＝(T4L+T4R)/2＝(74+100)/2＝87。

Scoring circuit 8 is with the data DI[T4 of the input picture DI of the position of test pixel T4] and test interpolated data TD0[T4] the absolute value of difference as score data M0[T4] export.Because TD0[T4]=87, DI[T4]=b=57, score data M1[T4] be

M0[T4]＝|TD0[T4]-DI[T4]|＝|87-57|＝30。

Shown in Figure 36 (e), left and right sides average interpolation computing circuit 6 (0) is with the interpolated data D0 output as missing pixel L of the mean value of the pixel LL of missing pixel left and right sides and LR.Since LL=d=143, LR=a=74, and interpolated data D0 is

D0＝(LL+LR)/2＝(143+74)/2＝108.5。

Figure 37 is used for illustrating that first of test pixel T1～T4 and missing pixel L on average keeps the figure of the action of interpolation arithmetic circuit 6 (1) and scoring circuit 8.Figure 37 (a) is that the figure of situation that first among the T1 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (1) is calculated in expression, Figure 37 (b) is that the figure of situation that first among the T2 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (1) is calculated in expression, Figure 37 (c) is that the figure of situation that first among the T3 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (1) is calculated in expression, Figure 37 (d) is that the figure of situation that first among the T4 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (1) is calculated in expression, and Figure 37 (e) is that the figure of situation that first among the missing pixel L on average keeps the interpolated data of interpolation arithmetic circuit 6 (1) is calculated in expression.

Illustrate that first among test pixel T1～T4 and the missing pixel L on average keeps the action of interpolation arithmetic circuit 6 (1) and scoring circuit 8.

Shown in Figure 37 (a), first on average keeps the test interpolated data TD1[T1 that interpolation arithmetic circuit 6 (1) is obtained test pixel T1], make the pixel column T1C comprise test pixel T1 mean value and not comprise the mean value of pixel column T1B of test pixel T1 equal.Thereby, by equation

(T1C[1]+T1C[2]+TD1[T1]+T1D[1]+L)/5

＝(T1D[1]+L+T1B[1]+T1B[2]+T1B[3])/5，

Test interpolated data TD1[T1] become

TD1[T1]＝(T1B[1]+T1B[2]+T1B[3])-(T1C[1]+T1C[2])。

Because T1C[1]=a=74, T1C[2]=b=57, T1B[1]=a=74, T1B[2]=b=57, T1B[3]=c=100, become

TD1[T1]＝(74+57+100)-(74+57)＝100。

Scoring circuit 8 is with the data DI[T1 of the input picture DI of the position of described test pixel T1] and test interpolated data TD1[T1] the absolute value of difference as score data M1[T1] export.Because TD1[T1]=100, DI[T1]=c=100, score data M1[T1] become

M1[T1]＝|TD1[T1]-DI[T1]|＝|100-100|＝0。

Shown in Figure 37 (b), first on average keeps the test interpolated data TD1[T2 that interpolation arithmetic circuit 6 (1) is obtained test pixel T2], make the pixel column T2C comprise test pixel T2 mean value and not comprise the mean value of pixel column T2B of test pixel T2 equal.Thereby, by equation

(T2C[1]+T2C[2]+TD1[T2]+L+T2D[1])/5

＝(L+T2D[1]+T2B[1]+T2B[2]+T2B[3])/5，

Test interpolated data TD1[T2] become

TD1[T2]＝(T2B[1]+T2B[2]+T2B[3])-(T2C[1]+T2C[2])。

Because T2C[1]=b=57, T2C[2]=c=100, T2B[1]=b=57, T2B[2]=c=100,

T2B[3]=d=143, become

TD1[T2]＝(57+100+143)-(57+100)＝143。

Scoring circuit 8 is with the data DI[T2 of the input picture DI of the position of described test pixel T2] and test interpolated data TD1[T2] between the absolute value of difference as score data M1[T2] export.Because TD1[T2]=143, DI[T2]=d=143, score data M1[T2] become

M1[T2]＝|TD1[T2]-DI[T2]|＝|143-143|＝0。

Shown in Figure 37 (c), first on average keeps the test interpolated data TD1[T3 that interpolation arithmetic circuit 6 (1) is obtained test pixel T3], make the pixel column T3C comprise test pixel T3 mean value and not comprise the mean value of pixel column T3A of test pixel T3 equal.Thereby, by equation

(T3A[1]+T3A[2]+T3A[3]+T3D[1]+L)/5

＝(T3D[1]+L+TD1[T3]+T3C[1]+T3C[2])/5，

Test interpolated data TD1[T3] become

TD1[T3]＝(T3A[1]+T3A[2]+T3A[3])-(T3C[1]+T3C[2])。

Because T3C[1]=b=57, T3C[2]=c=100, T3A[1]=a=74, T3A[2]=b=57, T3A[3]=c=100, become

TD1[T3]＝(74+57+100)-(57+100)＝74。

Scoring circuit 8 is with the data DI[T3 of the input picture DI of the position of described test pixel T3] and test interpolated data TD1[T3] between the absolute value of difference as score data M1[T3] export.Because TD1[T3]=74, DI[T3]=a=74, score data M1[T3] become

M1[T3]＝|TD1[T3]-DI[T3]|＝|74-74|＝0。

Shown in Figure 37 (d), first on average keeps the test interpolated data TD1[T4 that interpolation arithmetic circuit 6 (1) is obtained test pixel T4], make the pixel column T4C comprise test pixel T4 mean value and not comprise the mean value of pixel column T4A of test pixel T4 equal.Thereby, by equation

(T4A[1]+T4A[2]+T4A[3]+L+T4D[1])/5

＝(L+T4D[1]+TD1[T4]+T4C[1]+T4C[2])/5，

Test interpolated data TD1[T4] become

TD1[T4]＝(T4A[1]+T4A[2]+T4A[3])-(T4C[1]+T4C[2])。

Because T4C[1]=c=100, T4C[2]=d=143, T4A[1]=b=57, T4A[2]=c=100, T4A[3]=d=143, become

TD1[T1]＝(57+100+143)-(100+143)＝57。

Scoring circuit 8 is with the data DI[T4 of the input picture DI of the position of described test pixel T4] and test interpolated data TD1[T4] between the absolute value of difference as score data M1[T4] export.Because TD1[T4]=57, DI[T4]=b=57, score data M1[T4] become

M1[T4]＝|TD1[T4]-DI[T4]|＝|57-57|＝0。

Shown in Figure 37 (e), first on average keeps the interpolated data D1 that interpolation arithmetic circuit 6 (1) is obtained missing pixel L, make the pixel column LC comprise missing pixel L mean value and do not comprise the pixel column NA of missing pixel L and the mean value of NB equal.Thereby, by equation

(AD[1]+AD[2]+D1+BD[1]+BD[2])/5

＝((NA[1]+NA[2]+NA[3]+AD[1]+AD[2])/5

+(BD[1]+BD[2]+NB[1]+NB[2]+NB[3])/5)/2，

Interpolated data D1 becomes

D1＝((NA[1]+NA[2]+NA[3]+AD[1]+AD[2])

+(BD[1]+BD[2]+NB[1]+NB[2]+NB[3]))/2

-(AD[1]+AD[2]+BD[1]+BD[2])。

Because NA[1]=e=126, NA[2]=a=74, NA[3]=b=57, AD[1]=c=100, AD[2]=d=143, BD[1]=a=74, BD[2]=b=57, NB[1]=c=100, NB[2]=d=143, NB[3]=e=126, become

D1＝((126+74+57+100+143)+(74+57+100+143+126))/2

-(100+143+74+57)

＝126。

Figure 38 is used for illustrating that second of test pixel T1～T4 and missing pixel L on average keeps the figure of the action of interpolation arithmetic circuit 6 (2) and scoring circuit 8.Figure 38 (a) is that the figure of situation that second among the T1 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (2) is calculated in expression, Figure 38 (b) is that the figure of situation that second among the T2 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (2) is calculated in expression, Figure 38 (c) is that the figure of situation that second among the T3 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (2) is calculated in expression, Figure 38 (d) is that the figure of situation that second among the T4 on average keeps the test interpolated data of interpolation arithmetic circuit 6 (2) is calculated in expression, and Figure 38 (e) is that the figure of situation that second among the missing pixel L on average keeps the interpolated data of interpolation arithmetic circuit 6 (2) is calculated in expression.

Illustrate that second among test pixel T1～T4 and the missing pixel L on average keeps the action of interpolation arithmetic circuit 6 (2) and scoring circuit 8.

Shown in Figure 38 (a), second on average keeps the test interpolated data TD2[T1 that interpolation arithmetic circuit 6 (2) is obtained test pixel T1], make the pixel column T1C comprise test pixel T1 mean value and not comprise the mean value of pixel column T1B of test pixel T1 equal.Thereby, by equation

(T1C[1]+T1C[2]+T1C[3]+TD2[T1]+T1D[1]+L+T1D[2])/7

＝(T1D[1]+L+T1D[2]+T1B[1]+T1B[2]+T1B[3]+T1B[4])/7，

Test interpolated data TD1[T1] become

TD2[T1]＝(T1B[1]+T1B[2]+T1B[3]+T1B[4])

-(T1C[1]+T1C[2]+T1C[3])。

Because T1C[1]=e=126, T1C[2]=a=74, T1C[3]=b=57, T1B[1]=b=57, T1B[2]=c=100, T1B[3]=d=143, T1B[4]=e=126, become

TD2[T1]＝(57+100+143+126)-(126+74+57)＝169。

Scoring circuit 8 is with the data DI[T1 of the input picture DI of the position of described test pixel T1] and test interpolated data TD2[T1] between the absolute value of difference as score data M2[T1] export.Because TD2[T1]=169, DI[T1]=c=100, score data M2[T1] become

M2[T1]＝|TD2[T1]-DI[T1]|＝|169-100|＝69。

Shown in Figure 38 (b), second on average keeps the test interpolated data TD2[T2 that interpolation arithmetic circuit 6 (2) is obtained test pixel T2], make the pixel column T2C comprise test pixel T2 mean value and not comprise the mean value of pixel column T2B of test pixel T1 equal.Thereby, by equation

(T2C[1]+T2C[2]+T2C[3]+TD2[T2]+L+T2D[1]+T2D[2])/7

＝(L+T2D[1]+T2D[2]+T2B[1]+T2B[2]+T2B[3]+T2B[4])/7，

Test interpolated data TD2[T2] become

TD2[T2]＝(T2B[1]+T2B[2]+T2B[3]+T2B[4])

-(T2C[1]+T2C[2]+T2C[3])。

Because T2C[1]=a=74, T2C[2]=b=57, T2C[3]=c=100, T2B[1]=c=100, T2B[2]=d=143, T2B[3]=e=126, T2B[4]=a=74, become

TD2[T2]＝(100+143+126+74)-(74+57+100)＝212。

Scoring circuit 8 is with the data DI[T2 of the input picture DI of the position of described test pixel T2] and test interpolated data TD2[T2] between the absolute value of difference as score data M2[T2] export.Because TD2[T2]=212, DI[T2]=d=143, score data M2[T2] become

M2[T2]＝|TD2[T2]-DI[T2]|＝|212-143|＝69。

Shown in Figure 38 (c), second on average keeps the test interpolated data TD2[T3 that interpolation arithmetic circuit 6 (2) is obtained test pixel T3], make the pixel column T3C comprise test pixel T3 mean value and not comprise the mean value of pixel column T3A of test pixel T3 equal.Thereby, by equation

(T3A[1]+T3A[2]+T3A[3]+T3A[4]+T3D[1]+T3D[2]+L)/7

＝(T3D[1]+T3D[2]+L+TD2[T3]+T3C[1]+T3C[2]+T3C[3])/7，

Test interpolated data TD2[T3] become

TD2[T3]＝(T3A[1]+T3A[2]+T3A[3]+T3[4])

-(T3C[1]+T3C[2]+T3C[3])

Because T3C[1]=b=57, T3C[2]=c=100, T3C[3]=d=143, T3A[1]=d=143, T3A[2]=e=126, T3A[3]=a=74, T3A[4]=b=57, become

TD1[T3]＝(143+126+74+57)-(57+100+143)＝100。

Scoring circuit 8 is with the data DI[T3 of the input picture DI of the position of described test pixel T3] and test interpolated data TD2[T3] between the absolute value of difference as score data M2[T3] export.Because TD2[T3]=100, DI[T3]=a=74, score data M2[T3] become

M2[T3]＝|TD2[T3]-DI[T3]|＝|100-74|＝26。

Shown in Figure 38 (d), second on average keeps the test interpolated data TD2[T4 that interpolation arithmetic circuit 6 (2) is obtained test pixel T4], make the pixel column T4C comprise test pixel T4 mean value and not comprise the mean value of pixel column T4A of test pixel T3 equal.Thereby, by equation

(T4A[1]+T4A[2]+T4A[3]+T4A[4]+T4D[1]+L+T4D[2])/7

＝(T4D[1]+L+T4D[2]+TD2[T4]+T4C[1]+T4C[2]+T4C[3])/7，

Test interpolated data TD2[T4] become

TD2[T4]＝(T4A[1]+T4A[2]+T4A[3]+T4A[4])

-(T4C[1]+T4C[2]+T4C[3])。

Because T4C[1]=c=100, T4C[2]=d=143, T4C[3]=e=126, T4A[1]=e=126, T4A[2]=a=74, T4A[3]=b=57, T4A[4]=c=100, become

TD1[T1]＝(126+74+57+100)-(100+143+126)＝-12。

Scoring circuit 8 is with the data DI[T4 of the input picture DI of the position of described test pixel T4] and test interpolated data TD2[T4] the absolute value of difference as score data M2[T4] export.Because TD2[T4]=-12, DI[T4]=b=57, score data M2[T4] become

M2[T4]＝|TD2[T4]-DI[T4]|＝|-12-57|＝69。

Shown in Figure 38 (e), second on average keeps the interpolated data that interpolation arithmetic circuit 6 (2) is obtained missing pixel L, make the pixel column LC comprise missing pixel L mean value and do not comprise the pixel column NA of missing pixel L and the mean value of NB equal.Thereby, by equation

(AD[1]+AD[2]+AD[3]+D1+BD[1]+BD[2]+BD[3])/7

＝((NA[1]+NA[2]+NA[3]+NA[4]+AD[1]+AD[2]+AD[3])/7

+(BD[1]+BD[2]+BD[3]+NB[1]+NB[2]+NB[3]+NB[4])/7)/2，

Interpolated data D1 becomes

D1＝((NA[1]+NA[2]+A[3]+NA[4]+AD[1]+AD[2]+AD[3])

+(BD[1]+BD[2]+BD[3]+NB[1]+NB[2]+NB[3]+NB[4]))/2

-(AD[1]+AD[2]+AD[3]+BD[1]+BD[2]+BD[3])。

Because NA[1]=c=100, NA[2]=d=143, NA[3]=e=126, NA[4]=a=74, AD[1]=b=57, AD[2]=c=100, AD[3]=d=143, BD[1]=a=74, BD[2]=b=57, BD[3]=c=100, NB[1]=d=143, NB[2]=e=126, NB[3]=a=74, NB[4]=b=57, become

D1＝((100+143+126+74+57+100+143)

+(74+57+100+143+126+74+57))/2

-(57+100+143+74+57+100)

＝156。

Figure 39 is the table that the score data M0 among test pixel T1～T4～M2 is concentrated.

The action of management circuit 7 is described.

Management circuit 7 generates the score data M0[T1 of left and right sides average interpolation computing circuits 6 (0)]～M0[T4] value that obtains of addition is as evaluating data S0.Because M0[T1]=0, M0[T2]=56, M0[T3]=26, M0[T4]=30, so evaluating data S0 becomes

S0＝M0[T1]+M0[T2]+M0[T3]+M0[T4]

＝0+56+26+30＝112。

Management circuit 7 is on average kept interpolation arithmetic circuit 6 (1) too for first, generates score data M1[T1]～M1[T4] value that obtains of addition is as evaluating data S1.Because M1[T1]=0, M1[T2]=0, M1[T3]=0, M2[T4]=0, evaluating data S1 becomes

S1＝M1[T1]+M1[T2]+M1[T3]+M1[T4]

＝0+0+0+0＝0。

Management circuit 7 is on average kept interpolation arithmetic circuit 6 (2) too for second, generates score data M2[T1]～M2[T4] value that obtains of addition is as evaluating data S2.Because M2[T1]=69, M2[T2]=69, M2[T3]=26, M2[T4]=69, evaluating data S2 becomes

S2＝M2[T1]+M2[T2]+M2[T3]+M2[T4]

＝69+69+26+69＝233。

Figure 40 on average keeps interpolation arithmetic circuit 6 (1) and second with left and right sides average interpolation computing circuit 6 (0), first on average to keep the table that the evaluating data S0～S2 of interpolation arithmetic circuit 6 (2) concentrates.

The interpolation arithmetic circuit that evaluating data is more little can suitably carry out interpolation more near missing pixel, also can suitably carry out interpolation so can analogize in missing pixel.Management circuit 7 output is used for selecting having the first selection signal C that on average keeps the interpolated data that interpolation arithmetic circuit 6 (1) exported of evaluating data (S1=0) of the minimum of evaluating data S0～S2.

Output circuit 5 is exported the corresponding interpolated data D1=126 of selection signal C with management circuit 7 outputs.Shown in Figure 31 (a), the raw data of missing pixel L is 126 as can be known, can carry out interpolation with the error of minimum.

The pixel interpolation circuit of structure example shown in Figure 33 generates the test interpolated data of 3 interpolation arithmetic circuit among near the test pixel T1～T4 of missing pixel L, it is marked and estimates, select the interpolation arithmetic circuit that is suitable for picture material in 3 interpolation arithmetic circuit thus, so can suitably carry out interpolation to missing pixel.

Illustrate and use structure shown in Figure 33 another view data to be carried out the example of interpolation.

Figure 41 is the figure that expression has an example of periodic view data.Figure 41 (a) repeats concentration value a=80, b=56, c=65, d=100, e=135, f=144, g=120 according to pixel period Pp=7.Position relation between Figure 38 (b) expression missing pixel and the test pixel.In addition, with missing pixel L be the center, about each two ground one dimensions set, as the test pixel T1 corresponding～T4 with missing pixel L.

It is identical to use left and right sides average interpolation computing circuit 6 (0), the first average interpolation computing circuit 6 (1) and second on average to keep the method for the interpolation arithmetic circuit tests interpolation to test pixel T1～T4 of Figure 41 (b) method and Figure 36～shown in Figure 38, so the omission explanation.

Figure 42 is the table that the score data M0 among test pixel T1～T4～M2 is concentrated.

The action of management circuit 7 is described.

Management circuit 7 generates the score data M0[T1 of left and right sides average interpolation computing circuits 6 (0)]～M0[T4] value that obtains of addition is as evaluating data S0.Because M0[T1]=13, M0[T2]=4.5, M0[T3]=71, M0[T4]=8, evaluating data S0 becomes

S0＝M0[T1]+M0[T2]+M0[T3]+M0[T4]

＝13+4.5+71+8＝96.5。

Management circuit 7 is on average kept interpolation arithmetic circuit 6 (1) too for first, generates score data M1[T1]～M1[T4] value that obtains of addition is as evaluating data S1.Because M1[T1]=143, M1[T2]=35, M1[T3]=143, M2[T4]=35, evaluating data S1 becomes

S1＝M1[T1]+M1[T2]+M1[T3]+M1[T4]

＝143+35+143+35＝356。

Management circuit 7 is on average kept interpolation arithmetic circuit 6 (2) too for second, generates score data M2[T1]～M2[T4] value that obtains of addition is as evaluating data S2.Because M2[T1]=0, M2[T2]=0, M2[T3]=0, M2[T4]=0, evaluating data S2 becomes

S2＝M2[T1]+M2[T2]+M2[T3]+M2[T4]

＝0+0+0+0＝0。

Figure 43 on average keeps interpolation arithmetic circuit 6 (1) and second with left and right sides average interpolation computing circuit 6 (0), first on average to keep the table that the evaluating data S0～S2 of interpolation arithmetic circuit 6 (2) concentrates.

The interpolation arithmetic circuit that evaluating data is more little can suitably carry out interpolation more near missing pixel, also can suitably carry out interpolation so can analogize in missing pixel.Management circuit 7 output is used for selecting having the second selection signal C that on average keeps the interpolated data that interpolation arithmetic circuit 6 (2) exported of evaluating data (S2=0) of the minimum of evaluating data S0～S2.

Output circuit 5 is exported the corresponding interpolated data D2=135 of selection signal C with management circuit 7 outputs.Shown in Figure 31 (a), the raw data of missing pixel L is 135 as can be known, can carry out interpolation with the error of minimum.

The pixel interpolation circuit of structure example shown in Figure 33 generates the test interpolated data of 3 interpolation arithmetic circuit among near the test pixel T1～T4 of missing pixel L, it is marked and estimates, select the interpolation arithmetic circuit that is suitable for picture material in 3 interpolation arithmetic circuit thus, so also can suitably carry out interpolation to missing pixel about the data of Figure 41.

Figure 44 is the figure that expression has an example of periodic view data.Figure 44 (a) repeats concentration value a=100, b=116, c=130, d=140, e=145, f=143, g=136, h=124, i=108, j=92, k=76, l=64, m=57, n=55, o=60, p=70, q=84 according to pixel period Pp=17.Position relation between Figure 44 (b) expression missing pixel and the test pixel.In addition, with missing pixel L be the center, about each two ground one dimensions set, as the test pixel T1 corresponding～T4 with missing pixel L.

It is identical to use left and right sides average interpolation computing circuit 6 (0), the first average interpolation computing circuit 6 (1) and second on average to keep the method for the interpolation arithmetic circuit tests interpolation to test pixel T1～T4 of Figure 44 (b) method and Figure 36～shown in Figure 38, so the omission explanation.

Figure 45 is the table that the score data M0 among test pixel T1～T4～M2 is concentrated.

The action of management circuit 7 is described.

Management circuit 7 generates the score data M0[T1 of left and right sides average interpolation computing circuits 6 (0)]～M0[T4] value that obtains of addition is as evaluating data S0.Because M0[T1]=3.5, M0[T2]=8.5, M0[T3]=1.5, M0[T4]=0, evaluating data S0 becomes

S0＝M0[T1]+M0[T2]+M0[T3]+M0[T4]

＝3.5+8.5+1.5+0＝13.5。

Management circuit 7 is on average kept interpolation arithmetic circuit 6 (1) too for first, generates score data M1[T1]～M1[T4] value that obtains of addition is as evaluating data S1.Because M1[T1]=91, M1[T2]=152, M1[T3]=91, M2[T4]=152, evaluating data S1 becomes

S1＝M1[T1]+M1[T2]+M1[T3]+M1[T4]

＝91+152+91+152＝486。

Management circuit 7 is on average kept interpolation arithmetic circuit 6 (2) too for second, generates score data M2[T1]～M2[T4] value that obtains of addition is as evaluating data S2.Because M2[T1]=191, M2[T2]=269, M2[T3]=86, M2[T4]=191, evaluating data S2 becomes

S2＝M2[T1]+M2[T2]+M2[T3]+M2[T4]

＝191+269+86+191＝737。

Figure 46 on average keeps interpolation arithmetic circuit 6 (1) and second with left and right sides average interpolation computing circuit 6 (0), first on average to keep the table that the evaluating data S0～S2 of interpolation arithmetic circuit 6 (2) concentrates.

The interpolation arithmetic circuit that evaluating data is more little can suitably carry out interpolation more near missing pixel, also can suitably carry out interpolation so can analogize in missing pixel.Management circuit 7 output is used for selecting having the selection signal C of the interpolated data that the left and right sides average interpolation computing circuit 6 (0) of evaluating data (S0=13.5) of the minimum of evaluating data S0～S2 exported.

Output circuit 5 is exported the corresponding interpolated data D0=133.5 of selection signal C with management circuit 7 outputs.Shown in Figure 31 (a), the raw data of missing pixel L is 136 as can be known, can carry out interpolation with the error of minimum.

The pixel interpolation circuit of structure example shown in Figure 33 generates the test interpolated data of 3 interpolation arithmetic circuit among near the test pixel T1～T4 of missing pixel L, it is marked and estimates, select the interpolation arithmetic circuit that is suitable for picture material in 3 interpolation arithmetic circuit thus, so also can suitably carry out interpolation to missing pixel about the data of Figure 44.

Like this, the selection signal generating unit 9 that is made of management circuit 7, scoring circuit 8 can generate the selection signal of selecting by the interpolated data of suitable interpolation arithmetic circuit generation according to view data, no matter how the periodicity of view data all can make interpolation error become minimum.

In addition, because the employed interpolation arithmetic circuit of interpolated data of use missing pixel (for example, comprising disappearance portion adds up to counting circuit 19 and non-disappearance portion to add up to counting circuit 17) obtain the interpolated data of test pixel, so can under the situation that increases circuit scale not significantly, carry out the evaluation that realizes by test pixel.

In addition, in the pixel interpolation circuit of Figure 29, also can omit left and right sides average interpolation computing circuit 6 (0).In this case, estimate, select the wherein output of any one on average keeping interpolation arithmetic circuit 6 (1) to 6 (n).

Embodiment 7

Figure 47 is the figure of the structure of the interpolation arithmetic circuit in the expression embodiment 7.The structure of the interpolation arithmetic circuit in the embodiment 6 is: the interpolation arithmetic circuit of on average keeping shown in the embodiment 1～3 is appended the export-restriction portion 13 that the output of interpolation arithmetic circuit is on average kept in restriction.Export-restriction portion 13 is made of output area generative circuit 10 and restricting circuits 11, and restriction is because the interpolation error of on average keeping the interpolation arithmetic circuit of generations such as noise.

Figure 48 represents the part of input picture DI, the position relation between expression missing pixel and the comparable data scope.

The structure and the action of the interpolation arithmetic circuit in the embodiment 7 are described.

Interpolation arithmetic circuit in the embodiment 7 has output area generative circuit 10 and restricting circuits 11 and on average keeps interpolation arithmetic circuit 12.Input picture DI inputs to output area generative circuit 10 and on average keeps interpolation arithmetic circuit 12.Parameter k inputs to and on average keeps interpolation arithmetic circuit 12.On average keep the interpolation arithmetic circuit based on input picture DI and parameter k, data Da before the export-restriction.Data Da inputs to restricting circuits 11 before the restriction.

The data of the appointment comparable data scope r that provides from the outside are transfused to output area generative circuit 10.Output area generative circuit 10 generates output maximal value Lmax and output minimum value Lmin based on a right side r pixel and a left side r pixel of the missing pixel among the input picture DI.Output maximal value Lmax is

Lmax＝max(M[1]、…、M[r]、M[r+1]、…、M[2r])。

Here, max (M[1] ..., M[r], M[r+1] ..., M[2r]) be to obtain pixel M[1] ..., M[r], M[r+1] ..., M[2r] peaked function.Output maximal value Lmax inputs to restricting circuits 11.

In addition, output minimum value Lmin is

Lmin＝min(M[1]、…、M[r]、M[r+1]、…、M[2r])。

Here, min (M[1] ..., M[r], M[r+1] ..., M[2r]) be to obtain pixel M[1] ..., M[r], M[r+1] ..., M[2r] the function of minimum value.Output minimum value Lmin inputs to restricting circuits 11.

Restricting circuits 11 limits data Da before limiting based on output maximal value Lmax and output minimum value Lmin, as the data Db output of restriction back.Restriction back data Db

Under the situation of Da＜Lmin, be Db=Lmin,

Under the situation of Lmin≤Da≤Lmax, Db=Da,

Under the situation of Lmax＜Db, be Db=Lmax.

Interpolation arithmetic circuit in the embodiment 7 can will on average be kept near the scope of the 2r of an export-restriction missing pixel concentration value of interpolation arithmetic circuit.

The use concrete example describes.

Figure 49 is the structure of the interpolation arithmetic circuit of concrete example.

The view data of Figure 50 remarked pixel cycle Pp=5.In Figure 50, pixel NB[3] concentration value because noise and become 94 from 74.

Description architecture and action.

Input picture DI inputs to and on average keeps interpolation arithmetic circuit and output area generative circuit.Parameter k=9 inputs to and on average keeps interpolation arithmetic circuit 12.On average keep interpolation arithmetic circuit 12 and obtain the interpolated data of missing pixel L, make comprise the pixel column LC of missing pixel and do not comprise two pixel column NA of missing pixel and the mean value of NB equal.Equation is

(AD[1]+AD[2]+AD[3]+AD[4]+L

+BD[1]+BD[2]+BD[3]+BD[4])/9

＝((NA[1]+NA[2]+NA[3]+NA[4]+NA[5]

+AD[1]+AD[2]+AD[3]+AD[4])/9

+(BD[1]+BD[2]+BD[3]+BD[4]

+NB[1]+NB[2]+NB[3]+NB[4]+NB[5])/9)/2，

Missing pixel L is

L＝((NA[1]+NA[2]+NA[3]+NA[4]+NA[5]

+AD[1]+AD[2]+AD[3]+AD[4])

+(BD[1]+BD[2]+BD[3]+BD[4]

+NB[1]+NB[2]+NB[3]+NB[4]+NB[5]))/2

-(AD[1]+AD[2]+AD[3]+AD[4]+L

+BD[1]+BD[2]+BD[3]+BD[4])。

Because NA[1]=126, NA[2]=74, NA[3]=57, NA[4]=100, NA[5]=143, AD[1]=126, AD[2]=74, AD[3]=57, AD[4]=100, BD[1]=126, BD[2]=74, BD[3]=57, BD[4]=100, NB[1]=143, NB[2]=126, NB[3]=94, NB[4] 57, NB[5]=100, become

L＝((126+74+57+100+143+126+74+57+100)

+(126+74+57+100+143+126+94+57+100))/2

-(126+74+57+100+126+74+57+100)

＝153。

With the interpolated data L of missing pixel as restriction before data Da.Data Da inputs to restricting circuits 11 before the restriction.

Comparable data scope r=9 inputs to the output area generative circuit.The maximal value that 9 on the right side of missing pixel L among the output area generative circuit 10 output input picture DI and left side are 9 is as output maximal value Lmax.Output maximal value Lmax is

Lmax＝143。

Output maximal value Lmax inputs to restricting circuits.

In addition, the minimum value in 9 in 9 on the right side of the missing pixel L among the output area generative circuit 10 output input picture DI and left side is as output minimum value Lmin.Output minimum value Lmin is

Lmin＝57。

Output minimum value Lmin inputs to restricting circuits 11.

Restricting circuits 11 is proofreaied and correct and the data Db output of conduct restriction back data Da before limiting based on output maximal value Lmax and output minimum value Lmin.Because Da=153, Lmax=143, Lmin=57, Lmax＜Da sets up, so restriction back data Db is Db=Lmax=143.

According to Figure 50, the raw data of missing pixel L is 143, and the error of data Db=143 is after the restriction | 143-143|=0.The error of data is before the restriction | 153-143|=10 can reduce error by limiting.

Embodiment 8

In embodiment 1～3, illustrated by hardware and missing pixel has been carried out the structure of the interpolation arithmetic circuit of interpolation, but also can carry out interpolation to missing pixel by software by on average keeping interpolation arithmetic.In addition, also can use software and hardware simultaneously.

Figure 51 is explanation is carried out the action (interpolation arithmetic method) of interpolation by software processes to missing pixel a process flow diagram.

Also with reference to the action of Fig. 2 description of flow diagram.

In step s1, generate part and the data (being equivalent to the SL in the embodiment 1) of the pixel column LC that comprises missing pixel.

In step s2, generate part and the data (being equivalent to the SA in the embodiment 1) of the pixel column NA that does not comprise missing pixel.

As shown in figure 13, under the situation that has a plurality of pixel columns that do not comprise missing pixel, return step s2, generate various piece and data.(step s3)

In step s4, based on the part that in step s1, generates and data (data that are equivalent to SA) and part that in step s2, generates and data (data that are equivalent to SL), set up equation, make the pixel column comprise missing pixel mean value and not comprise the mean value of pixel column of missing pixel equal.

In step s5, the equation of setting up in step s4 is found the solution (for example deducting the data that are equivalent to SL from the data that are equivalent to SA), obtain the interpolated data of missing pixel.

Owing in embodiment 1～3, be shown specifically, omit explanation here about the contents processing in each step.

Embodiment 9

In embodiment 6, illustrated to make when on average keeping interpolation arithmetic and left and right sides average interpolation computing to be used for missing pixel is carried out the structure of the pixel interpolation circuit of interpolation, but also can come missing pixel is carried out interpolation by software by hardware.In addition, also can use software and hardware simultaneously.

Figure 52 is explanation is carried out the action (picture element interpolation method) of interpolation by software processes to missing pixel a process flow diagram.

Also with reference to the action of Figure 30 (a) description of flow diagram.

In step s1, the test interpolated data of the left and right sides average interpolation operational method among the generation test pixel T1 (TD0[T1 that is equivalent to embodiment 6]).

In step s2, generate the absolute value of the difference between the test interpolated data that is generated among the data (DI[T1 that is equivalent to embodiment 6]) of input picture DI of position of test pixel T1 and the step s1, as score data (M0[T1 that is equivalent to embodiment 6]).

Then, return step s1, the test interpolated data of the left and right sides average interpolation operational method among the generation test pixel T2 (TD0[T2 that is equivalent to embodiment 6]).

In step s2, generate the absolute value of the difference between the test interpolated data that is generated among the data (DI[T2 that is equivalent to embodiment 6]) of input picture DI of position of test pixel T2 and the step s1, as score data (M0[T2 that is equivalent to embodiment 6]).

For test pixel T3～Tm step (step s3) of repeating step s1 and step s2 similarly.Like this, obtain the score data of the left and right sides average interpolation operational method among all test pixel T1～Tm.

In step s4, generate the interpolated data of the left and right sides average interpolation operational method among the missing pixel L.

Then, return step s1, generate the test interpolated data that first among the test pixel T1 on average keep the interpolation arithmetic method (TD1[T1 that is equivalent to embodiment 6]).

In step s2, generate the absolute value of the difference between the test interpolated data that is generated among the data (DI[T1 that is equivalent to embodiment 6]) of input picture DI of position of test pixel T1 and the step s1, as score data (M1[T1 that is equivalent to embodiment 6]).

Then, return step s1, generate the test interpolated data that first among the test pixel T2 on average keep the interpolation arithmetic method (TD1[T2 that is equivalent to embodiment 1]).

In step s2, generate the absolute value of the difference between the test interpolated data that is generated among the data (DI[T2 that is equivalent to embodiment 6]) of input picture DI of position of test pixel T2 and the step s1, as score data (M1[T2 that is equivalent to embodiment 6]).

For test pixel T3～Tm step (step s3) of repeating step s1 and step s2 similarly.Like this, obtain the score data that first among all test pixel T1～Tm on average keeps the interpolation arithmetic method.

In step s4, generate the interpolated data that first among the missing pixel L on average keeps the interpolation arithmetic method.

On average keep interpolation arithmetic method～n for second and on average keep the interpolation arithmetic method step of repeating step s1～s4 (step s5) too.On average keep interpolation arithmetic method～n for left and right sides average interpolation operational method and first respectively and on average keep the interpolation arithmetic method, obtain score data among all test pixel T1～Tm and the interpolated data among the missing pixel L.

In step s6, score data is carried out addition and generates left and right sides average interpolation computing circuit and first on average keeping interpolation arithmetic method～n and on average keeping separately evaluating data of interpolation arithmetic method and (be equivalent to the S0 of embodiment 6～Sn) at each interpolation arithmetic method.

In step s7, select missing pixel is carried out the interpolated data of interpolation based on the evaluating data that is generated among the step s6.

The step that repeats above-mentioned steps s1～step s7 is till reaching last missing pixel (step s8).

Owing in embodiment 6, be shown specifically, omit explanation here about the contents processing in each step.

In addition, in each above-mentioned embodiment, on left and right directions, arranged pixel, in the average interpolation computing of the left and right sides, on average generated interpolated data by obtaining with non-missing pixel left and right sides pixel adjacent with missing pixel or test, but under the situation of pixel that has been arranged above and below, by obtain with missing pixel or test with non-missing pixel up and down pixel adjacent on average generate interpolated data.Such left and right sides average interpolation computing or up and down the average interpolation computing be generically and collectively referred to as the computing of adjacent pixels average interpolation.

Claims

1. on average keep the interpolation arithmetic circuit for one kind, it is characterized in that,

Obtain the interpolated data of missing pixel, make to constitute the mean value of value of a plurality of pixels of the pixel groups that comprises missing pixel and the mean value of value that constitutes a plurality of pixels of the pixel groups that does not comprise missing pixel and equate.

2. the interpolation arithmetic circuit of on average keeping as claimed in claim 1 is characterized in that,

The number of pixels that constitutes the pixel groups that comprises described missing pixel is k (k is a positive integer) with the number of pixels that constitutes the pixel groups that does not comprise described missing pixel,

This is on average kept the interpolation arithmetic circuit and has:

Disappearance portion adds up to counting circuit, and it obtains the total of the value of the pixel in k the pixel that constitutes the pixel groups that comprises described missing pixel, beyond the described missing pixel;

Non-disappearance portion adds up to counting circuit, and it obtains the total of value of k pixel that formation does not comprise the pixel groups of described missing pixel; And

Difference channel, it obtains the interpolated data of described missing pixel by deducting the output that described disappearance portion adds up to counting circuit the output that adds up to counting circuit from described non-disappearance portion.

3. the interpolation arithmetic circuit of on average keeping as claimed in claim 2 is characterized in that,

Described non-disappearance portion adds up to counting circuit to have:

The first non-disappearance portion adding circuit, it obtains the value sum of k pixel that formation does not comprise first pixel groups of described missing pixel;

The second non-disappearance portion adding circuit, it obtains the value sum of k pixel that formation does not comprise second pixel groups of described missing pixel; And

Averaging circuit, it obtains output average of the output of the described first non-disappearance portion adding circuit and the described second non-disappearance portion adding circuit, with this on average as described total output.

4. the interpolation arithmetic circuit of on average keeping as claimed in claim 2 is characterized in that,

Described pixel groups is the part of a series of pixels of formation cycle variation respectively,

In the pixel that constitutes the pixel groups do not comprise described missing pixel with constitute under the mutual unduplicated situation of pixel of the pixel groups that comprises pixel that comprises described missing pixel, described k is set to and the pixel period of change shown in the number of pixels or its integral multiple value about equally.

5. the interpolation arithmetic circuit of on average keeping as claimed in claim 2 is characterized in that,

I the pixel that constitutes in the pixel of the pixel groups that comprises pixel that i pixel (i is a positive integer) in the pixel of the pixel groups do not comprise described missing pixel and formation comprise described missing pixel repeats mutually, described k or from described k, deduct described i after value be set to and the pixel period of change shown in the number of pixels or its integral multiple value about equally.

6. pixel interpolation circuit is characterized in that having:

The described interpolation arithmetic circuit of on average keeping of claim 1; And with near the maximal value of the value of the pixel the missing pixel and the circuit that minimum value limits output area.

7. a pixel interpolation circuit is characterized in that,

Have the described interpolation arithmetic circuit of on average keeping of a plurality of claims 2,

These on average keep the described k of interpolation arithmetic circuit or (k-i) different,

Also have output circuit,

Described a plurality of interpolated data that the interpolation arithmetic circuit generates missing pixel respectively of on average keeping,

Described output circuit is selected described a plurality of of on average keeping in the interpolated data that the interpolation arithmetic circuit exported, as the interpolated data output of missing pixel.

8. pixel interpolation circuit as claimed in claim 7 is characterized in that,

Also have adjacent pixels average interpolation computing circuit, the mean value of the value of its generation and missing pixel pixel adjacent, as interpolated data,

Described output circuit is selected described a plurality of of on average keeping in the interpolated data that interpolation arithmetic circuit and described adjacent pixels average interpolation computing circuit exported, as the interpolated data output of missing pixel.

9. pixel interpolation circuit as claimed in claim 8 is characterized in that,

Also has the signal of selection generating unit, it generates and selects from one selection signal in the interpolated data of described a plurality of interpolation arithmetic circuit based near the raw data of the pixel the described missing pixel and near the pixel this missing pixel, according to the interpolated data that the method identical with the method for the interpolated data of obtaining described missing pixel tried to achieve.

10. pixel interpolation circuit as claimed in claim 9 is characterized in that,

Also have control circuit, this control circuit:

Described a plurality of interpolation arithmetic circuit described disappearance portions separately that on average keep are added up to counting circuit, input constitutes near comprise the described missing pixel k the pixel of test with the pixel groups of non-missing pixel, described test is with non-missing pixel pixel in addition, obtains the total of its value;

Described a plurality of interpolation arithmetic circuit described non-disappearance portions separately that on average keep are added up to counting circuit, and input constitutes and does not comprise k the pixel of described test with the pixel groups of non-missing pixel, obtains the total of its value;

Make described a plurality of interpolation arithmetic circuit described difference channel separately of on average keeping by deducting the output that described disappearance portion adds up to counting circuit the output that adds up to counting circuit from described non-disappearance portion, obtain the interpolated data of described test with non-missing pixel;

To the input of described adjacent pixels average interpolation computing circuit and be positioned near the described missing pixel, not with the test of described missing pixel adjacency with non-missing pixel pixel adjacent, obtain its mean value, as the interpolated data of described test with non-missing pixel,

Described selection signal generating unit based on the described test of obtaining respectively by described a plurality of interpolation arithmetic circuit with the interpolated data of non-missing pixel and described test raw data with non-missing pixel, estimate described interpolation arithmetic circuit, determine to select the content of signal, feasible selection obtains the best interpolation arithmetic circuit of estimating

Described control circuit adds up to the counting circuit input to constitute the pixel of the pixel groups that comprises described missing pixel to described a plurality of interpolation arithmetic circuit described disappearance portions separately that on average keep, add up to the counting circuit input to constitute the pixel of the pixel groups that does not comprise described missing pixel to described non-disappearance portion, to described adjacent pixels average interpolation computing circuit input and missing pixel pixel adjacent, make described output circuit based on the selection signal of having determined content as described above, select to export from one in the interpolated data of described interpolation arithmetic circuit.

11. pixel interpolation circuit as claimed in claim 7 is characterized in that,

Also has the signal of selection generating unit, it is based near the raw data of the pixel the described missing pixel, and the interpolated data of trying to achieve near the pixel this missing pixel, according to the method identical with the interpolated data of obtaining described missing pixel, generate one the selection signal of selecting from described a plurality of interpolated datas of on average keeping the interpolation arithmetic circuit.

12. pixel interpolation circuit as claimed in claim 11 is characterized in that,

Also have control circuit, this control circuit:

Make described a plurality of interpolation arithmetic circuit described difference channel separately of on average keeping by deducting the output that described disappearance portion adds up to counting circuit the output that adds up to counting circuit from described non-disappearance portion, obtain the interpolated data of described test with non-missing pixel,

Described selection signal generating unit is based on a plurality ofly on average keeping described test that the interpolation arithmetic circuit obtains respectively with the interpolated data of non-missing pixel and the described test raw data with non-missing pixel by described, estimate the described interpolation arithmetic circuit of on average keeping, determine to select the content of signal, feasible selection obtain best estimate on average keep the interpolation arithmetic circuit

Described control circuit adds up to the counting circuit input to constitute the pixel of the pixel groups that comprises described missing pixel to described a plurality of interpolation arithmetic circuit described disappearance portions separately that on average keep, add up to the counting circuit input to constitute the pixel of the pixel groups that does not comprise described missing pixel to described non-disappearance portion, make described output circuit based on the selection signal of having determined content as described above, select to export from one in the interpolated data of described a plurality of interpolation arithmetic circuit.

13. on average keep the interpolation arithmetic method for one kind, it is characterized in that,

14. the interpolation arithmetic method of on average keeping as claimed in claim 13 is characterized in that,

This is on average kept the interpolation arithmetic method and has:

Disappearance portion adds up to calculation procedure, obtains the total of the value of the pixel in k the pixel that constitutes the pixel groups that comprises described missing pixel, beyond the described missing pixel;

Non-disappearance portion adds up to calculation procedure, obtains the total of value of k pixel that formation does not comprise the pixel groups of described missing pixel; And

The difference step by deducting the result of calculation that described disappearance portion adds up to calculation procedure the result of calculation that adds up to calculation procedure from described non-disappearance portion, is obtained the interpolated data of described missing pixel.

15. the interpolation arithmetic method of on average keeping as claimed in claim 14 is characterized in that,

Described non-disappearance portion adds up to calculation procedure to have:

The first non-disappearance portion addition step is obtained the value sum of k pixel that formation does not comprise first pixel groups of described missing pixel;

The second non-disappearance portion addition step is obtained the value sum of k pixel that formation does not comprise second pixel groups of described missing pixel; And

Average step is obtained addition results average of the addition results of the described first non-disappearance portion addition step and the described second non-disappearance portion addition step, with this on average as described total output.

16. the interpolation arithmetic method of on average keeping as claimed in claim 14 is characterized in that,

17. the interpolation arithmetic circuit of on average keeping as claimed in claim 14 is characterized in that,

18. a picture element interpolation method is characterized in that,

Also have for by claim 13 on average keep the interpolated data that the interpolation arithmetic method is obtained, with near the maximal value of the value of the pixel the missing pixel and the step that minimum value limits output area.

19. a picture element interpolation method is characterized in that,

Carry out the described interpolation arithmetic step of on average keeping of claim 14 for a plurality of mutually different described k or (k-i), generate the interpolated data of missing pixel at every turn,

Described output step is selected described a plurality of of on average keeping in the interpolated data that the interpolation arithmetic step exported, as the interpolated data output of missing pixel.

20. picture element interpolation method as claimed in claim 19 is characterized in that,

Also have adjacent pixels average interpolation calculation step, the mean value of the value of generation and missing pixel pixel adjacent, as interpolated data,

Described output step is selected described a plurality of of on average keeping in the interpolated data that interpolation arithmetic step and described adjacent pixels average interpolation calculation step exported, as the interpolated data output of missing pixel.