JPH05191811A - Image pickup device - Google Patents

Abstract

PURPOSE:To make it possible to obtain a corrected picture with a high resolution by determining the value of a video signal of a position which is deviated from a picture element point necessary for the correction of the deviation of a registration by using a video signal of plural solid-state image pickup elements. CONSTITUTION:A deviation correction value is determined by inputting a video signal storage circuit 10, a signal Sr' stored in this circuit and a signal Sg' in an intermediate value interpolation arithmetic circuit 14 and by interpolating the value of a video signal in a point existing between the element point of the signal Sg'. The deviation correction value is combined with the value of the video signal of each picture element of the signal Sg' and a signal Sg with a high resolution having twice as many as the point of the picture element of the signal Sg' is determined. Subsequently, signals Sr, Sb for which the deviations of registrations are corrected by interpolation arithmetic circuits 11, 11' and a signal Sg interpolated and made into high resolution are inputted in a signal processing circuit 15 and are outputted after converting them into TV signals. Thus, the signal value of a position which is not included in the signal is interpolated by using the signals Sg', Sr obtained from two solid-state image pickup elements which receive different color light with each other and by determining the value of the video signal at a point existing between the position of the picture element of a solid-state image pickup element.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multi-panel type solid-state television camera in which pixel positions of a plurality of solid-state image pickup devices are shifted from each other so that an image having a resolution higher than that obtained by one solid-state image pickup device can be obtained. The present invention relates to a correction arithmetic circuit for correcting registration deviation in the above.

[0002]

2. Description of the Related Art In recent years, a multi-plate type solid-state television camera using a solid-state image pickup device has been widely used in broadcasting stations and the like. However, at present, the resolution of the solid-state image sensor is insufficient (the number of pixels in the horizontal direction is insufficient). As one of the methods for compensating for this lack of resolution, the spatial pixel shift method described below is usually adopted. That is, a solid-state image sensor (hereinafter referred to as G element) that receives a signal Sg ′ of a green component (hereinafter referred to as G light) of incident light, and a signal Sr of a red component and a blue component (hereinafter referred to as R light and B light). As for the solid-state image sensor (hereinafter referred to as R element and B element) that receives ', Sb', the positional relationship on the light receiving surface of the pixels of each solid-state image sensor is 1/2 in the horizontal direction as shown in FIG. Fix it so that it comes to the position where the pixel is displaced.

The video signal output from each solid-state image pickup device is time-corrected by an analog delay circuit for a time corresponding to a shift amount of the spatial position of the pixel point of each solid-state image pickup device. Then, the time-corrected video signal is passed through a luminance signal matrix circuit similar to a normal TV camera,
A luminance signal Y required for a television system such as the NTSC system is created. When the clock frequency determined by the number of horizontal pixels of the solid-state image sensor is fc, the frequency distribution of the signal Sg 'obtained from one solid-state image sensor is as shown in FIG. In the method in which the pixels are not displaced, the false signal generated when the first-order harmonic component 1 ′ folds back to the low frequency region is reduced, so that the signal Sg ′ is converted to a low-pass filter having the characteristics shown in 2 of FIG. Throughout, the luminance signal Y is calculated using the signal with the high frequency component cut at 0.5 fc.

However, when the pixel positions of the R element and the B element are shifted by 1/2 pixel with respect to the pixel position of the G element as shown in FIG. 9, the frequency distribution of the signals Sr 'and Sb' is shown in FIG. It becomes like 3, 3 '... That is, the phase of the first-order harmonic component 3 ′ is the same as the phase of the first-order harmonic component 1 ′ of the signal Sg ′.
The distribution is shifted by 180 degrees with respect to. Then, in the luminance signal Y obtained by multiplying the signals Sg ', Sr', Sb 'by a constant coefficient value and adding them, the first harmonic components of the signal Sg' and the signals Sr ', Sb' cancel each other out, and false The signal will be reduced. Therefore, the characteristics of the low-pass filter are shown in Fig. 1.
It can be doubled from 0 to 2 '. Therefore, it is possible to obtain a video signal having a resolution about twice that of the video signal of one solid-state image sensor (Television Society Technical Report, TEBS87-14; Vol.11, No.13, pp.13 ('87). )).

On the other hand, when a plurality of image pickup devices (image pickup tube or solid-state image pickup device) are used, if the positions of the images obtained from the respective image pickup devices deviate from each other, a double image is formed. This causes color bleeding and a reduction in resolution, deteriorating the image quality. Such image shift (hereinafter referred to as registration shift) is caused not only by an error in mounting the image sensor but also by chromatic aberration of the optical lens. That is, as illustrated in FIG. 12, on the light receiving surface of the R element, the position of the image to be formed at the pixel position a0 when an ideal optical system with no registration deviation is used is due to the registration deviation. It shifts to a0 'point. Moreover, since the amount of deviation at this time changes depending on the aperture of the optical lens, the zoom ratio, and other values, it is difficult to prevent this misregistration only with mechanical accuracy.

A method for electrically correcting this misregistration has already been proposed (JP-A-2-79685). This circuit configuration is shown in FIG. It should be noted that although many television systems employ an interlaced scanning system (interlaced scanning system), in order to avoid confusion in the description, all non-interlaced scanning will be described below.

The installation error amount storage arithmetic circuit 4 in the figure is
This is a circuit for storing information (parallel movement error amount, rotation angle, etc.) relating to an attachment error of the solid-state imaging device 7 with respect to the optical lens 5. Further, the lens registration shift amount storage arithmetic circuit 8
An image shift amount (a signal Sr 'with respect to the image of the normal signal Sg', which is complicatedly changed depending on the color of incident light and a lens state parameter value (lens zoom ratio Z, aperture value F, subject distance L, etc.)
This is a circuit for calculating and storing (Sb ′ image shift amount). The pixel point movement amount calculation circuit 9 is based on the data stored in the attachment error amount storage calculation circuit 4 and the lens registration shift amount storage calculation circuit 8 and the data such as the lens state parameter output from the optical lens 5 every moment. A circuit for obtaining the final shift amount for each pixel point on the screen.

In FIG. 13, the prism 6 makes R
The incident light divided into light beams of three colors of light, G light, and B light is converted into an electric signal by each solid-state image pickup device 7, and then is sequentially adjusted to the pixel point position of the image output, and the video signal storage circuit 1
0, 10 ", 10 '. By the way, for example, in FIG.
When the position of the image of the R element of No. 2 is corrected, the position of the pixel such as b0 of the R element is shifted to the position deviated from the position of the pixel of the G element such as the point a0, such as the point b0 ′ of FIG. come. Therefore, the interpolation calculation circuit 11 uses the shift amount obtained by the pixel point movement amount calculation circuit 9 and the signal Sr ′ detected by the pixel such as b0 of the R element and stored in the video signal storage circuit 10 to obtain M × Interpolation operations such as N matrix operations are performed. Then, the correction signal value Sr for the signal Sr 'at each pixel point position of the G element is obtained. This correction signal value Sr is the signal Sb ′ obtained in the same manner.
Correction signal Sb and the signal Sg time-adjusted by the video signal storage circuit 10 "(the signal Sg 'itself may be subjected to distortion correction), and are input to the signal processing circuit 12 to be converted into a television signal and output. To do.

[0009]

By the way, in the three-lens camera based on the spatial pixel shift method, if the conventional register shift correction arithmetic circuit of FIG. 13 is used as it is, the signal Sr ′ is obtained.
The first harmonic components of Sb 'and Sb' are corrected in the opposite direction to the fundamental wave component 3. Therefore, as shown in FIG. 15, the phase does not have a distribution shifted by 180 degrees with respect to the first harmonic component of the signal Sg '. Depending on the registration shift amount, the signal Sg ′ has the same phase as the first harmonic component and overlaps with each other, so that a large false signal is generated. Further, if an optical filter is used to reduce this spurious signal, the spatial frequency components in the high frequency band will be dropped, and there will be a problem in that an image with the required resolution cannot be obtained.

[0010]

An image pickup apparatus using the first means according to the present invention for solving the above-mentioned problems is constructed by using an intermediate value interpolation calculation circuit for performing the following interpolation calculation. It is a thing. That is, a fixed number such as M × N (M and N are positive integers) adjacent to a spatial position required for registration shift correction or an intermediate position (point of interest) between pixel points required for high resolution. The pixel points of are selected not only from the pixel points of one solid-state image sensor but also from the pixel points of a plurality of solid-state image sensors. Then, the video signal values of a fixed number of selected pixel points are subjected to a fixed calculation such as an M × N matrix calculation,
An intermediate value interpolation calculation circuit is used to obtain a video signal value of a point of interest such as a point necessary to correct the registration shift. For example,
A pixel adjacent to the point of interest is selected from the pixels of the two solid-state image pickup elements that receive the G light and the solid-state image pickup element that receives the R light in the spatial pixel shift method. Then, the video signal value of the point of interest is interpolated using the video signal value of the selected pixel.

The image pickup device according to the second means of the present invention adopts a dual green system ('85 TV full size, 4-5, pp.95) as a system of a multi-plate type solid-state television camera.
The television camera is configured so as to perform registration deviation correction on the obtained signals Sr 'and Sb'. That is,
The incident G light is received by two solid-state image pickup elements fixed by horizontally shifting by 1/2 pixel, and signals Sg'1 and Sg'2 are received.
Output as. Further, red and blue color filters are alternately formed in the horizontal direction in each pixel of the third solid-state image sensor, and a signal Sr 'for R light and a signal Sb' for B light are respectively output from the pixels at each color filter position. The method of obtaining and outputting is adopted.
The signal Sr 'and the signal Sb' obtained from the third solid-state image sensor
However, each registration shift correction is performed.

[0012]

In the image pickup apparatus using the first means according to the present invention, interpolation is performed by using a video signal having two times the number of pixels obtained by two solid-state image pickup elements whose pixel positions are shifted from each other. It will be calculated. Therefore, from the video signal that has been subjected to registration shift correction using the video signal value obtained by this interpolation calculation, it is almost the same as the video signal obtained by the solid-state image sensor with twice the number of pixels of the solid-state image sensor used. With the same high resolution,
Moreover, it is possible to obtain a good image in which the registration shift is corrected.

In the dual green system, two solid-state image pickup devices whose pixel positions are displaced from each other receive signals of the same color component and obtain a high frequency component from this video signal. Therefore, in the image pickup apparatus using the second means adopting the dual green method according to the present invention, even if the resolution of each signal obtained by performing the registration shift correction on the signal obtained from the remaining solid-state image pickup element is slightly inferior, It is possible to obtain a good image with high resolution and in which misregistration is corrected.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a circuit configuration example of an image pickup device according to a first embodiment of the present invention. The circuit of FIG. 1 differs from the conventional circuit of FIG. 13 in that an intermediate value interpolation calculation circuit 14 is newly provided. FIG. 2 shows a more detailed circuit configuration example of the intermediate value interpolation calculation circuit 14. FIG. 3 shows the pixel position of the R element when the image position is corrected and the pixel position of the G element in an overlapping manner. The V interpolation calculation circuit 20 of FIG. 2 has a horizontal line H0 that horizontally connects the curve passing through the points b'0 and b'1 of FIG. 3 and the pixel points of the G element ..., A-1, a0, a1 ,. A series of points such as the intersection point c0 with ..., c-1, c0, c
It is a circuit that finds the positions of 1, ..., And interpolates the video signal value at each point. That is, the coordinate values of the points b'0 and b'1 obtained by the pixel point movement amount calculation circuit 9 are (xb0,
yb0), (xb1, yb1), and its y coordinate and horizontal line H0
When the difference between the y-coordinates of the points is dyb0 and dyb1 (see FIG. 3), the x-coordinate value xc0 of the point c0 is approximated by, for example, a straight line between the points b0 ′ and b1 ′: xc0 = (xb0 × dyb1 + xb1 × dyb0) / (dyb0 + dyb1) (Equation 1) In addition, the video signal value at the point c0 is changed to the point b0 ',
b1 'or points before and after it ... b-1', b2 '...
, Etc. are interpolated from the image signal values of N points close to the point c0.

The h direction interpolation calculation circuit 21 of FIG. 2 has the points obtained by the V interpolation calculation circuit 20 ... C-1, c0, c1 ,.
The pixel point of the signal Sg 'from the video signal value Sr "of G and the signal Sg' of the G light ..., A-1, a0, a1 ,.
This is a circuit that interpolates the video signal values at -0.5, a0.5, a1.5, ... This video signal value is R at each point
It is calculated by utilizing the fact that the ratio pr of the levels of the signal and the G signal is considered to be substantially constant locally (the color of the image is locally constant). That is, under this assumption, in FIG. 4 schematically showing the relationship between the signal value obtained by multiplying the video signal value Sr ″ by pr and the signal Sg ′, for example, the video signal at the point a0.5 is Approximate a line between two points a0 and c0 that are close to each other, and interpolate from the video signal values at these two points to interpolate the video signal values at points ..., c-1, a0, c0, a1, c
It is also possible to improve the interpolation accuracy by a method such as interpolating using the image signal values of M points that are close to each other, assuming that the point intervals of 1, ... However, there is a drawback that the circuit is generally complicated.

The LPF circuits 22 and 23, the division circuit 24, and the multiplication circuit 25 shown in FIG.
And a signal Sg ′, a level ratio pr of the signal Sg ′ and a video signal value pr × Sr ″ used for the interpolation. To obtain the level ratio pr, the level value of the signal Sg ′ is calculated as the signal Sr (the signal Sr ′. Alternatively, the signal Sr "may be used, but it is preferable to use the signal Sr in which the registration shift is corrected). However, in order to reduce the influence of noise or the like, as shown in FIG. 2, for example, after passing through an LPF circuit by a method such as taking an arithmetic mean of the video signal values of two consecutive pixels, the ratio pr
It is desirable to ask for.

In the circuit of FIG. 1, the signal Sr 'and the signal Sb'.
The misregistration correction to the video signal storage circuit 10, 1
0'and the interpolation calculation circuits 11 and 11 'perform the same operation as in the conventional case. At the same time, the video signal storage circuit 10 and the signal Sr ′ and the signal Sg ′ stored in the video signal storage circuit 10 ″ are input to the intermediate value interpolation calculation circuit 14, and the points between the pixel points of the signal Sg ′ are ... a-0.5, a0.5, a1.5, ... (Fig. 4) are interpolated to obtain the value, and combined with the video signal value of each pixel of the signal Sg ', the number of pixel points of the signal Sg' A high-resolution signal Sg having double the number of pixel points is obtained, and then signals Sr and Sb whose registration deviations are corrected by the interpolation calculation circuits 11 and 11 'are obtained.
And the signal Sg which is interpolated and has a high resolution is added to the signal processing circuit 1
5, and converts it into a TV signal and outputs it.

As described above, in the image pickup apparatus according to this embodiment,
Using the signals Sg 'and Sr' obtained from the two solid-state image pickup elements that receive different color lights, the video signal value at a point between the pixel positions of one solid-state image pickup element is interpolated and obtained. Then, the signal Sg 'is obtained by the video signal value obtained by this interpolation.
Is used by interpolating the video signal value at a position not included in. Therefore, despite the registration deviation correction, the high resolution is almost the same as that of the video signal obtained by the solid-state image pickup device having twice the number of pixels of the solid-state image pickup device used without increasing the false signal. In addition, it is possible to obtain a good image in which the registration shift is corrected.

FIG. 5 shows a circuit configuration example of the image pickup device according to the second embodiment of the present invention. The circuit of FIG. 5 is different from the conventional circuit of FIG. 13 and the circuit of the first embodiment of FIG. 1 in that a dual green system is adopted as a system of a multi-plate type solid-state television camera.

That is, in the circuit of FIG. 5, the optical system for separating the prism 6 of FIG. 13 for separating the incident light into three color light beams is divided into two light beams of R light and B light and G light. Replace with system 16. Further, the two solid-state image pickup devices 7 and 7'which receive the G light are fixed so that the pixel positions of the two solid-state image pickup devices 7 and 7'are shifted from each other by about 1/2 pixel as shown in FIG. Further, as a solid-state image pickup element that receives a light flux composed of R light and B light, for example, as shown in FIG. 7, a solid-state image pickup element 17 in which red and blue color filters are alternately formed for each pixel arranged in the horizontal direction is used.

In the circuit of FIG. 5, the light flux composed of the R light and the B light separated by the optical system 16 is the solid-state image pickup device 17 in which red and blue color filters are alternately formed. Are converted into electric signals Sr 'and Sb'. Then, in the RB separation circuit 18, the signal S of each color
After being divided into r ′ and Sb ′, they are sequentially stored in the video signal storage circuits 10 and 10 ′ for each color signal in accordance with the pixel point position of the output image. Then, using the stored video signal and the shift amount obtained by the pixel point shift amount calculation circuit 9, the registration shift correction is performed in the same manner as in the conventional art by the interpolation calculation circuits 11 and 11 'for each color signal. On the other hand, the G light split by the optical system 16 and split into two is
Two solid-state image pickup devices 7 and 7 ′ whose pixel positions are displaced from each other are converted into electric signals Sg′1 and Sg′2. Then, according to the pixel point position of the image output, the signal S which has been increased in resolution after being temporarily stored in the video signal storage circuit 10 ″ and time-adjusted.
It is input to the signal processing circuit 15 as g. At the same time, the signals Sr and Sb in which the registration shift has been corrected are input to the signal processing circuit 15, which is converted into a television signal and output.

As described above, in the image pickup apparatus according to this embodiment,
The light flux of the green component, which is most sensitive to the resolution, is detected by using two solid-state image pickup elements whose pixel positions are displaced from each other by 1/2 pixel. Therefore, even if there is a registration shift due to chromatic aberration, etc., or even if this registration shift is electrically corrected, it is almost the same as when a solid-state image sensor with few false signals and practically twice the number of pixels is used. A high resolution video signal can be obtained. Further, in the method of the first embodiment, since the colors of the light components received by the two solid-state image pickup elements used are different, depending on the registration shift amount, for example, the pixel points a0 and b0 ′ in FIG.
May overlap, which makes it difficult to perform the interpolation calculation for the point a0.5. However, in this embodiment, since the signals of the two solid-state image pickup elements that receive the light flux of the same color are used, it is possible to always obtain a high-resolution video signal. Furthermore, in the method of the first embodiment, for the signals Sr 'and Sg',
A wideband signal that matches the high resolution signal that is being sought is required. Therefore, it is not possible to use an optical filter for dropping the high frequency component of the incident light which causes the false signal of the signal Sr, and there is a drawback that the false signal of the signal Sr is slightly increased. However, in this embodiment, neither the signal Sr 'nor Sb' is used in the calculation for obtaining the high frequency component, so that an optical filter having arbitrary characteristics can be used and a good video signal with few false signals can be obtained. .. Furthermore, since a circuit such as the intermediate value interpolation calculation circuit of the first embodiment is unnecessary, the circuit scale can be simplified.

As the interpolation calculation circuit 11 of the first embodiment, an interpolation calculation circuit having a circuit configuration as shown in FIG. 8 (Japanese Patent Application No. 2-330191) may be used. In FIG. 8, the V interpolation calculation circuit 30 has the points of FIG.
This is a circuit for interpolating and obtaining the video signal values at c0, c1, ... Further, the H interpolation calculation circuit 31 is
From the interpolated values for c-1, c0, c1, ... Pixel points required to correct the registration shift ... A-1, a0, a
This circuit interpolates the video signal values at 1, ... In this case, it is obvious that the value obtained by the V interpolation calculation circuit 30 of FIG. 8 may be used as it is, instead of using the V interpolation calculation circuit 20 of FIG.

Also, in the first embodiment, points ..., A-1.
The video signal value at 5, a-0.5, a0.5, a1.5, ... Was interpolated using only the signal Sg 'and the signal pr * Sr ". However, from the signal Sb' to the signal pr *. It is obvious that the signal pb * Sb "obtained in the same manner as Sr" may be added and interpolated. Note that the value of the ratio of pr, pb, etc. is assumed to be 1 to simplify the circuit. It goes without saying that it is okay.

Further, in the first embodiment, the intermediate value interpolation calculation circuit is provided only for the signal Sg to perform the interpolation calculation for higher resolution, but the signals Sr and Sb are also separately provided. An intermediate value interpolation calculation circuit may be provided to increase the resolution. By doing so, the signals Sr and Sb
False signals at can also be reduced.

Further, in the second embodiment, the high frequency component is obtained only for the signal Sg, but by extracting the high frequency component of this signal Sg and adding the component to the signal Sr or the signal Sb, Obviously, the bandwidth of Sr and the signal Sb may be widened.

Further, in the second embodiment, it is assumed that the registrations of the signal Sg'1 and the signal Sg'2 are correctly set in a state of being shifted by 1/2 pixel. However, when an error occurs in the attachment of the two solid-state image pickup devices 7 and 7'and the registration is misaligned, instead of the signals Sg 'and Sr' of the first embodiment,
It is also possible to correct the registration deviation due to this mounting error by adding the correction of the registration deviation to the signals Sg′1 and Sg′2 by the same interpolation calculation.

Further, in the above embodiments, the registration deviation correction is described as an example, but the present invention can be similarly applied to an arithmetic circuit such as an enhance circuit which performs an arithmetic operation such as an M × N matrix arithmetic operation centering on a point of interest. Is clear.

In each of the above embodiments, the case of a three-plate type camera has been described as an example. However, the R-light and B-light in the two-plate type or the dual green system are separated and received by the two solid-state image pickup devices. It goes without saying that the same can be applied to a four-panel camera or the like.

[0030]

In the image pickup apparatus according to the present invention, the resolution is almost as high as that of the video signal obtained by the solid-state image pickup device having twice the number of pixels of the solid-state image pickup device used and the misregistration is corrected. You can get good images.

[Brief description of drawings]

FIG. 1 is a circuit block diagram of a first embodiment of the present invention.

FIG. 2 is a circuit block diagram of an intermediate value interpolation calculation circuit.

FIG. 3 is an explanatory diagram of a calculation executed by a V interpolation calculation circuit.

FIG. 4 is an explanatory diagram of a calculation executed by an h-direction interpolation calculation circuit.

FIG. 5 is a circuit block diagram of a second embodiment of the present invention.

FIG. 6 is an explanatory diagram of a dual green system.

FIG. 7 is an explanatory diagram of a solid-state image sensor used in a dual green system.

FIG. 8 is a block diagram of an example of a circuit configuration of an interpolation calculation circuit.

FIG. 9 is an explanatory diagram of a spatial pixel shift system.

FIG. 10 is a frequency distribution chart of a spatial pixel shift type signal Sg ′.

FIG. 11 is a frequency distribution diagram of a spatial pixel shift type signal Sr ′.

FIG. 12 is an explanatory diagram of misregistration.

FIG. 13 is a block diagram of a conventional circuit for correcting misregistration.

FIG. 14 is an explanatory diagram of the positions of pixel points when the registration shift is corrected.

FIG. 15 is a frequency distribution diagram of the signal Sr after registration deviation correction.

[Explanation of symbols]

4: Mounting error amount storage arithmetic circuit, 8: Lens registration deviation amount storage arithmetic circuit, 9: Pixel point movement amount arithmetic circuit 10, 1
0 ', 10 ": video signal storage circuit, 11, 11': interpolation calculation circuit, 14: intermediate value interpolation calculation circuit.

Claims (4)

[Claims] 1. An image pickup apparatus having an optical lens and a plurality of image pickup devices for converting light passing through the optical lens into an electric signal, wherein among image signals obtained from the plurality of image pickup devices,
Video signal values of a fixed number of pixel points adjacent to the point of interest are extracted, and M is added to the extracted fixed number of video signal values.
An imaging device provided with a circuit for performing a constant operation such as a matrix operation of × N (M and N are positive integers). 2. A fixed number of extracted video signal values according to claim 1, wherein a constant calculation is performed according to an image shift amount at a point of interest due to a chromatic aberration of the optical lens, a mounting error of the image pickup device, or the like. An image pickup apparatus, wherein the image shift is corrected by adding the image shift. 3. A plurality of image pickup devices according to claim 1, wherein a clock frequency determined by the number of pixels of one image pickup device is fc, and a video signal of each image pickup device is S1 ', S2', S3 ',. The frequency fc / of the video signals S1 ', S2', S3 ', ...
Video signal components S1L, S2L, S3 in the frequency band lower than 2
Constants p1, p determined by the ratio of L, ...
2, p3, ..., The plurality of video signals S1 ', S2', S
Video signal value multiplied by 3 ', ... S1 "(= p1 x S1), S2"
(= P2 * S2), S3 "(= p3 * S3), ... Circuit part and the calculated video signal values S1", S2 ", S3", ..
Of the pixel points adjacent to the point of interest among the image signal values, and a circuit unit for performing a constant calculation determined by the position of the point of interest and the amount of registration shift with respect to each of the image signals. , Or the video signals S1 ', S2', S3 ',
.. At least one image signal having at least one circuit portion of the circuit portions for performing matrix calculation such as enhancement on the video signal. 4. An image pickup device having an optical lens and three or more solid-state image pickup devices for converting light passing through the optical lens into an electric signal. Of the green light component (hereinafter referred to as G light) is received by the two solid-state image pickup elements, and the pixel positions on the light-receiving surfaces of the two solid-state image pickup elements are shifted by about 1/2 pixel from each other. The other light components of the incident light (hereinafter referred to as R light and B light) are fixed by the third solid-state imaging device in which red and blue color filters are alternately formed on each pixel in the horizontal direction. , Or R light and B light are received by two independent solid-state image pickup devices, and at least M × N (M and N are positive for the R light signal Sr ′ and the B light signal Sb ′. It is characterized by having a circuit section that performs constant operations such as (integer) matrix operations. Image apparatus.