JP2001251648A - Focus adjustment mechanism of three-dimensional image detection device - Google Patents

Abstract

(57) [Problem] To quickly and always focus each detection in a three-dimensional image detecting apparatus that detects two-dimensional image information as visual information of a subject and three-dimensional image information as distance information of the subject by infrared rays. Perform in the state that was done. SOLUTION: The color separation filter F of the CCD has red (R),
A band filter having spectral transmittance characteristics only in a narrow band centered on each wavelength of green (G) and blue (B) and a band filter having spectral transmittance characteristics only in an infrared region are used. RG
The focus adjustment of the contrast method is performed on the pixel provided with the B color filter. After detecting the two-dimensional image information, the lens driving circuit 27 is driven based on the data recorded in the memory 24 to move the focal plane of the optical system by a predetermined distance. An infrared laser is emitted from the laser diode 14a and detected as three-dimensional image information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image detecting device capable of detecting a three-dimensional shape of a subject by using a light propagation time measuring method.

[0002]

2. Description of the Related Art Conventionally, as a three-dimensional image detecting apparatus for detecting a distance to a subject for each pixel, a "Measurement Scie
nce and Technology ”(S. Christie et al., vol. 6, p1301
-1308, 1995) and international publication 97/0111.
The one disclosed in Japanese Patent Publication No. 1 is known. In these three-dimensional image detection devices, the subject is irradiated with pulse-modulated laser light, and the reflected light is received by a two-dimensional CCD sensor and converted into an electric signal. At this time 2
With one shutter operation of an electro-optical shutter composed of a mechanical or liquid crystal element combined with a dimensional CCD, an electric signal correlated with the distance to the subject can be detected for each pixel of the CCD. From this electric signal, C
The distance to the subject corresponding to each pixel of the CD is detected as image information.

In a three-dimensional image detecting apparatus, image information corresponding to a distance to a subject (hereinafter referred to as three-dimensional image information) is obtained by visual image information of a subject obtained by normal photographing (hereinafter referred to as two-dimensional image information). ) And used for various image processing. Detection of two-dimensional image information is performed by forming an image of visible light on a CCD imaging surface, whereas detection of three-dimensional image information is generally performed by forming an image of light in an infrared wavelength region on the CCD imaging surface. Since the focal length for light in the visible wavelength range and the focal length for light in the infrared wavelength range are different in one imaging optical system, two-dimensional image information and three-dimensional image information are detected using the same imaging optical system. In this case, the position of the photographing optical system on the optical axis after the focus adjustment differs between the detection of two-dimensional image information and the detection of three-dimensional image information.

[0004]

Therefore, two-dimensional image information and three-dimensional image information are detected using the same photographing optical system, and three-dimensional image information is detected by irradiating an infrared laser. In the detection device, when the focus adjustment is performed on visible light, the three-dimensional image information is not focused and the distance detection accuracy is reduced. On the other hand, if the focus adjustment is performed on infrared light, the image quality of a two-dimensional image obtained by detecting visible light deteriorates.

The present invention relates to a three-dimensional image detecting apparatus for detecting two-dimensional image information and three-dimensional image information using the same photographing optical system and detecting the three-dimensional image information using light outside the visible wavelength. Detection is always performed in focus,
It is another object of the present invention to obtain a focus adjustment mechanism of a three-dimensional image detection device that can perform focus adjustment quickly.

[0006]

A focus adjusting mechanism of a three-dimensional image detecting apparatus according to the present invention comprises an image pickup lens, an image pickup section capable of accumulating signal charges corresponding to the amount of received light, and visible light incident from the image pickup lens. A two-dimensional image detecting means for detecting visual image information of a subject in the imaging unit, and a three-dimensional image for detecting distance information to the subject on a pixel-by-pixel basis in the imaging unit by light incident outside the visible wavelength range from an imaging lens A first means for adjusting a relative position between the imaging lens and the imaging unit such that the object is focused on the detection means and one of the two-dimensional image detection means and the three-dimensional image detection means; The relative position between the focus adjustment unit and the imaging lens and the imaging unit adjusted by the first focus adjustment unit is determined by moving at least one of the imaging lens and the imaging unit by a predetermined distance in the optical axis direction. Is displaced by causing moved, it is characterized by comprising a second focusing means for performing focus adjustment in the other image detection means is focusing not performed in the first focusing means.

Preferably, the first focus adjustment means and the second focus adjustment means adjust a relative position between the imaging lens and the imaging unit or move the imaging lens by a predetermined distance by moving the imaging lens. . Preferably, the light outside the visible wavelength range is light in the infrared wavelength range.

[0008] Preferably, data for moving by a predetermined distance is recorded in a memory. Also more preferably,
The imaging lens is a zoom lens, and data is recorded in a memory corresponding to each zooming of the imaging lens. Thereby, the focus adjustment can be performed more quickly.
For example, the first focus adjustment unit is driven either when image information is detected by the two-dimensional image detection unit or when distance information is detected by the three-dimensional image detection unit.

The focus adjusting mechanism of the three-dimensional image detecting apparatus according to the present invention comprises an image pickup lens, an image pickup section capable of accumulating signal charges corresponding to the amount of received light, and a visual image of a subject by visible light incident from the image pickup lens. Two-dimensional image detection means for detecting information in the imaging unit; three-dimensional image detection means for detecting distance information to the subject in the imaging unit for each pixel using light outside the visible wavelength range incident from the imaging lens; Each of the detection unit and the three-dimensional image detection unit includes a focus adjustment unit that adjusts a relative position between the imaging lens and the imaging unit so that a subject is focused.

[0010]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view of a camera-type image detection device according to a first embodiment of the present invention.

On the front of the camera body 10, a finder window 12 is provided at the upper left of the taking lens 11, and a flash 13 is provided at the upper right. A light emitting device (light source) 14 for irradiating a laser beam, which is a distance measuring light, is provided on the upper surface of the camera body 10 and directly above the taking lens 11. On the left side of the light emitting device 14, a release switch 15,
A liquid crystal display panel 16 is provided, and a mode switching dial 17 is provided on the right side. A card insertion slot 19 for inserting a recording medium such as an IC memory card is formed on a side surface of the camera body 10.
0, an interface connector 21 is provided.

FIG. 2 is a block diagram showing a circuit configuration of the camera shown in FIG. An aperture 25 is provided in the taking lens 11. The opening of the aperture 25 is determined by the iris drive circuit 2.
Adjusted by 6. The focus adjustment operation and the zooming operation of the taking lens 11 are controlled by a lens drive circuit 27.

An image pickup device (C
CD) 28, and a color separation filter F is provided on the front surface thereof. A subject image is formed on the imaging surface of the CCD 28 by the photographing lens 11. As a result, charges corresponding to the subject image are generated in the CCD 28. The charge accumulation operation and the charge readout operation in the CCD 28 are controlled by the CCD drive circuit 30. CCD
The charge signal, that is, the image signal, read out from 28 is amplified by the amplifier 31 and converted from an analog signal to a digital signal by the A / D converter 32. The digital image signal is subjected to processing such as gamma correction in the imaging signal processing circuit 33 and is temporarily stored in the image memory 34. Iris drive circuit 26, lens drive circuit 27, CC
The D drive circuit 30 and the imaging signal processing circuit 33 are controlled by a system control circuit 35. The lens drive circuit 27 also detects the position of the imaging lens 11, and adjusts the position of the imaging lens 11 based on the detection result and a control signal from the system control circuit to perform focus adjustment and zooming. Will be

The image signal is read from the image memory 34 and supplied to the LCD drive circuit 36. The LCD drive circuit 36 operates in accordance with the image signal, and thereby the image display L
An image corresponding to the image signal is displayed on the CD panel 37.

If the camera is connected to a monitor device 39 provided outside the camera body 10 by a cable, the image signal read from the image memory 34 is transmitted to the TV signal encoder 3.
8. It can be transmitted to the monitor device 39 via the video output terminal 20. The system control circuit 35 is connected to the interface circuit 40, and the interface circuit 40 is connected to the interface connector 21. Therefore, if the camera is connected to the computer 41 provided outside the camera body 10 via the interface cable 41, the image signal read from the image memory 34 can be transmitted to the computer. The system control circuit 35 is connected to the image recording device 43 via the recording medium control circuit 42. Therefore, the image signal read from the image memory 34 is
The data can be recorded on a recording medium M such as an IC memory card mounted on the image recording device 43.

The light emitting device 14 includes a light emitting element 14a and an illumination lens 14b. The light emitting operation of the light emitting element 14a is controlled by a light emitting element control circuit 44. Light emitting element 1
A laser diode (LD) 4a irradiates an infrared laser. The infrared laser is used as distance measuring light for detecting the distance to the subject, and is irradiated on the entire subject via the illumination lens 14b. The laser beam reflected by the subject enters the photographic lens 11 and is detected by the CCD 28, whereby distance information to the subject is detected.

The system control circuit 35 is connected to a switch group 45 comprising a release switch 15 and a mode switching dial 17, a memory 24, and a liquid crystal display panel (display element) 16. The memory 24 is a non-volatile memory, and is used for focus adjustment (3D focusing) when detecting three-dimensional image information as described later.

FIG. 3 is a diagram partially showing a color filter array of the color separation filter F provided in the CCD 28 of the present embodiment, and FIG. 4 is a diagram showing the spectral transmittance characteristics of each color filter. The CCD 28 and the color separation filter F used in the present embodiment will be described with reference to FIGS.

The color filters R, G, B, and Ir are band-pass filters (for example, interference filters) that selectively transmit red (R), green (G), blue (B), and infrared (Ir) light. The spectral transmittance characteristics are shown in FIG. The color filters R, G, B, and Ir are formed on a glass substrate in an arrangement as shown in FIG. 3, and constitute a color separation filter F as a whole. Each of the color filters R, G, B, and Ir corresponds to each pixel (photodiode) of the CCD 28, and the color separation filter F in which the color filter is formed on the glass substrate is such that each color filter corresponds to each pixel of the CCD 28. It is fixed to the surface of the CCD 28 after being accurately aligned so as to correspond. Although only color filters for 16 pixels are shown in FIG. 3, the color filters correspond to all the pixels of the CCD 28, and are arranged repeatedly in the arrangement shown in FIG.

In this embodiment, the color filters R, G, B
Using only the image signal of the pixel (first pixel group) corresponding to the (visible light transmitting filter), normal visual image information (hereinafter, referred to as two-dimensional image information) of the subject due to visible light is detected, Using only the image signal of the pixel (second pixel group) provided with the color filter Ir (infrared light transmission filter), the distance information representing the three-dimensional shape of the subject due to infrared rays is represented by CC.
It is detected as image information of D28 (hereinafter referred to as three-dimensional image information). The transmission wavelength band of the color filters R, G, B, and Ir is limited to a narrow band centered on the wavelengths of R, G, B, and Ir as shown in FIG. 4, and is used for detecting visible light. The color filters R, G, and B do not transmit infrared light, and the color filter Ir used for detecting infrared light does not transmit visible light. Therefore, two-dimensional image information can be detected without being affected by infrared rays, and three-dimensional image information can be detected without being affected by visible light.

FIG. 5 is a flowchart of a program for a photographing operation executed in the first embodiment. FIG.
The photographing operation in the first embodiment will be described with reference to FIG.

When it is confirmed in step 101 that the release switch 15 is fully depressed, step 1 is executed.
At 02, automatic focusing (2D focusing) using visible light is performed. That is, in order to detect sharp two-dimensional image information with proper focus adjustment, the CCD 2
Focus adjustment for visible light is performed by a conventionally known contrast method using an image signal of a pixel provided with R, G, and B color filters among the eight pixels. The focus adjustment is performed by adjusting the position of the imaging lens 11 using the lens driving circuit 27.

In step 103, two-dimensional image information is detected (2D photographing). That is, normal video control is performed in the CCD 28, and image data corresponding to the visual information of the subject is detected. The detected image data is stored in the image recording medium M as two-dimensional image data.

In step 104, the lens driving circuit 27
Is driven to move the position of the imaging lens 11 by a predetermined amount from the position set in 2D focusing (step 102). That is, since the focal length of the imaging lens 11 with respect to visible light is shorter than the focal length with respect to infrared light, in the detection of three-dimensional image information using infrared light, the position of the focal plane is two.
It is shifted backward from the position of the focal plane in D focusing. Therefore, in detecting the three-dimensional image information, the imaging lens 11 must be moved accordingly. This movement amount is recorded in the memory 24 in accordance with zooming of the imaging lens 11. The system control circuit 35 reads data indicating the movement amount corresponding to the current zooming from the memory 24 and sends the data to the lens drive circuit 27 to the imaging lens 11.
The amount of movement of The lens drive circuit 27 moves the position of the imaging lens 11 according to the instruction, and performs 3D focusing for detecting three-dimensional image information.

In step 105, three-dimensional image information corresponding to the distance information of the subject is detected (3D photographing) by a method described later in detail, and is stored in the image recording medium M as three-dimensional image data.

Next, the principle of the distance measurement executed in the present embodiment will be described with reference to FIGS. In FIG. 7, the horizontal axis is time t.

The distance measuring light output from the distance measuring device B is reflected by the subject S and received by a CCD (not shown). The distance measuring light is a pulsed light having a predetermined pulse width H, and therefore, the reflected light from the subject S is also a pulsed light having the same pulse width H. The rise of the reflected light pulse is delayed by a time δ · t (δ is a delay coefficient) from the rise of the distance measuring light pulse. Since the ranging light and the reflected light have traveled twice the distance r between the distance measuring device B and the subject S, the distance r is given by r = δ · t · C / 2 (1) can get. Where C is the speed of light.

For example, a state in which the reflected light can be detected from the rise of the pulse of the distance measuring light is determined, and the state is changed to an undetectable state before the reflected light pulse falls, that is, a reflected light detection period T is provided. And the received light amount A during the reflected light detection period T is a function of the distance r. That is, the light receiving amount A decreases as the distance r increases (the time δ · t increases).

In the present embodiment, utilizing the above-described principle,
The distance from the camera body 10 to each point on the surface of the subject S is detected by detecting the amount of received light A at each of a plurality of photodiodes provided in the CCD 28 and arranged two-dimensionally. Distance information relating to the shape is input collectively as three-dimensional image data.

FIG. 8 is a diagram showing the arrangement of the photodiode 51 and the vertical transfer unit 52 provided on the CCD 28.
FIG. 9 is a cross-sectional view of the CCD 28 cut along a plane perpendicular to the substrate 53. This CCD 28 is a conventionally known interline type CCD, and uses a VOD for sweeping out unnecessary charges.
(Vertical overflow drain) method.

The photodiode 51 and the vertical transfer section 52 are formed along the surface of the n-type substrate 53. The photodiodes 51 are two-dimensionally arranged in a lattice, and the vertical transfer units 52 are provided adjacent to the photodiodes 51 arranged in a line in a predetermined direction (vertical direction in FIG. 8). The vertical transfer section 52 has four vertical transfer electrodes 52a, 52b, 52c, and 52d for one photodiode 51. Therefore, in the vertical transfer section 52, four potential wells can be formed, and signal charges can be output from the CCD 28 by controlling the depths of these wells as conventionally known. The number of vertical transfer electrodes can be freely changed according to the purpose.

The photodiode 51 is formed in a p-type well formed on the surface of the substrate 53, and the p-type well is completely depleted by a reverse bias voltage applied between the p-type well and the n-type substrate 53. You. In this state, charges corresponding to the amount of incident light (reflected light from the subject) are accumulated in the photodiode 51. When the substrate voltage Vsub is increased to a predetermined value or more, the electric charge accumulated in the photodiode 51 is discharged to the substrate 53 side. On the other hand, when a charge transfer signal (voltage signal) is applied to the transfer gate unit 54, the charges accumulated in the photodiode 51 are transferred to the vertical transfer unit 52. That is, after the charges are swept to the substrate 53 side by the charge sweeping signal, the signal charges accumulated in the photodiode 51 are changed by the charge transfer signal to the vertical transfer unit 5.
It is transferred to the two sides. By repeating such an operation, signal charges are integrated in the vertical transfer unit 52, and a so-called electronic shutter operation is realized.

FIG. 10 is a timing chart of the three-dimensional image detecting operation executed in the 3D photographing in step 105 of FIG. 5 in order to obtain three-dimensional image data. The three-dimensional image detection operation according to the present embodiment will be described with reference to FIG. In the three-dimensional image detection operation of the present embodiment, unlike the description of the principle of the distance measurement performed with reference to FIG. 7, in order to reduce noise due to the influence of external light, the distance measurement pulse starts falling. The timing chart is configured such that the reflected light is set to a detectable state, and the state is switched to an undetectable state after the pulse of the reflected light has fallen. However, the timing chart is not different in principle.

A charge discharging signal (pulse signal) S1 is output in synchronization with the output of the vertical synchronizing signal (not shown), whereby unnecessary charges accumulated in the photodiode 51 are discharged in the direction of the substrate 53. Then, the accumulated charge amount in the photodiode 51 becomes zero (reference S2). After the start of output of the charge sweeping signal S1, pulse-shaped ranging light S3 having a constant pulse width is output. The period (pulse width) during which the ranging light S3 is output can be adjusted.
The adjustment is performed so that the distance measurement light S3 is turned off simultaneously with the output of the charge sweeping signal S1.

The distance measuring light S3 is reflected by the object,
It is incident on D28. That is, although the reflected light S4 from the subject is received by the CCD 28, the charge sweeping signal S1
Is not stored in the photodiode 51 (reference S2). Charge sweep signal S1
Is stopped, the photodiode 51 starts to accumulate charges by receiving the reflected light S4, and the reflected light S4
4 and the external light generate signal charges S5. When the reflected light S4 disappears (reference S6), the photodiode 51 ends the charge accumulation based on the reflected light (reference S7).
Charge accumulation due to only external light continues (reference S8).

Thereafter, when the charge transfer signal S9 is output, the charges stored in the photodiode 51 are transferred to the vertical transfer unit 52. This charge transfer is completed when the output of the charge transfer signal ends (reference S10). In other words, the charge accumulation in the photodiode 51 continues due to the presence of external light, but the signal charge S1 accumulated in the photodiode 51 until the output of the charge transfer signal ends.
1 is transferred to the vertical transfer unit 52. The charge S14 accumulated after the output of the charge transfer signal ends remains in the photodiode 51 as it is.

As described above, the period T from the end of the output of the charge sweeping signal S1 to the end of the output of the charge transfer signal S9.
_{During U1} , the photodiode 51 accumulates signal charges corresponding to the distance to the subject. Then, the reflected light S4
Until the end of light reception (reference S6), the charges accumulated in the photodiode 51 are transferred to the vertical transfer unit 52 as signal charges S12 (hatched portion) corresponding to the distance information of the subject,
Other signal charges S13 are caused only by external light.

After a predetermined time has elapsed from the output of the charge transfer signal S9, the charge sweeping signal S1 is output again, and after the transfer of the signal charge to the vertical transfer unit 52, the photodiode 51
Unnecessary charges accumulated in the substrate 53 are swept toward the substrate 53.
That is, accumulation of signal charges in the photodiode 51 is newly started. Then, as described above, when the charge accumulation period T _U1 has elapsed, the signal charge is transferred to the vertical transfer unit 52.

The vertical transfer section 5 of such signal charges S11
2 is repeatedly executed until the next vertical synchronization signal is output. As a result, in the vertical transfer unit 52, the signal charge S11 is integrated, and the signal charge S11 integrated in a period of one field (a period sandwiched between two vertical synchronization signals) is regarded as a period in which the subject is stationary. If possible, it corresponds to distance information to the subject. Since the signal charge S13 is smaller than the signal charge S12, the signal charge S11 can be regarded as being equal to the signal charge S12.

The operation of detecting the signal charge S11 described above is for one photodiode 51, and is shown in FIG.
Of all photodiodes 5 corresponding to the color filters Ir
1, such a detection operation is performed. That is, the distance information is detected every other pixel in both the horizontal and vertical directions. As a result of the detection operation in the period of one field,
Each part of the vertical transfer unit 52 adjacent to each photodiode 51 holds distance information detected by the photodiode 51. This distance information is transmitted to the vertical transfer unit 5
2 as the three-dimensional image data by the vertical transfer operation in
Output from CD28.

Next, the three-dimensional image detecting operation in the present embodiment will be described with reference to FIGS. 1, 2, 10, and FIG. 11, which is a flowchart of the three-dimensional image detecting operation.

In step 201, a vertical synchronizing signal is output, and ranging light control is started. That is, the light emitting device 14 is driven, and the pulse-shaped ranging light S3 is output intermittently. Next, step 202 is executed and the CCD
28 starts detection control. That is, the three-dimensional image detection operation described with reference to FIG. 10 is started, the charge sweeping signal S1 and the charge transfer signal S9 are output alternately, and the signal charge S11 of the distance information is integrated in the vertical transfer unit 52. .

In step 203, it is determined whether one field period has elapsed from the start of the three-dimensional image detection operation, that is, whether a new vertical synchronizing signal has been output. When one field period ends, the process proceeds to step 204, where the signal charge of the distance information integrated in the vertical transfer unit 52 is output from the CCD 28. This signal charge is temporarily stored in the image memory 34 in step 205.

In step 206, the distance measuring light control is turned off, and the light emitting operation of the light emitting device 14 is stopped. In step 207, arithmetic processing of distance data is performed.
In step 208, the calculated distance data is temporarily stored in the image memory 34 as three-dimensional image data and also stored in the recording medium M. Thus, the three-dimensional image detection operation performed in step 102 ends.

Next, step 207 of the three-dimensional image detecting operation
Will be described with reference to FIG.

It is assumed that a subject having a reflectance R is illuminated, and this subject is regarded as a secondary light source having a luminance I and is imaged on a CCD. At this time, the output S obtained by integrating the charge generated in the photodiode during the charge storage time t is obtained.
n is represented by: Sn = k · R · I · t (2) Here, k is a proportionality constant, which varies depending on the F number, magnification, and the like of the taking lens.

As shown in FIG. 10, the charge storage time is T
_U1, the pulse width T _S of the distance measuring light S3, a pulse width of the signal charges S12 in the distance information and T _D, when the charge storage time in one field period is to be repeated N times, the resulting output SM ₁₀ is , SM ₁₀ = Σk · R · I · T _D = k · N · R · I · T _D (3) The pulse width T _D can be expressed as T _D = δ · t = 2r / C (4) At this time, the distance r to the subject can be expressed as follows: r = C · SM ₁₀ / (2 · k · N · R · I) (5) Therefore, if the proportional constant k, the reflectance R, and the luminance I are obtained in advance, the distance r can be obtained.

As described above, according to the first embodiment, 2
The three-dimensional image information and the three-dimensional image information can be detected in a focused state. In the first embodiment, the automatic focus adjustment is performed only for the detection of two-dimensional image information by visible light, and the detection of three-dimensional image information by infrared light is performed based on the movement amount recorded in the memory 24 in advance. The focus is adjusted. Therefore, only one automatic focus adjustment is required, and quick focus adjustment can be performed.

FIG. 12 is a flowchart of a photographing operation program executed in the second embodiment. With reference to FIG. 12, a photographing operation in the second embodiment will be described. Note that the second embodiment is slightly different from the first embodiment in the photographing operation, and does not differ from the first embodiment in other points.

When it is confirmed in step 301 that the release switch 15 is fully depressed, step 3 is executed.
At 02, automatic focusing (3D focusing) using infrared light is performed. That is, in order to detect the three-dimensional image information for which the proper focus adjustment has been performed, the focus adjustment for the infrared light is performed by the conventionally known contrast method using the image signal of the pixel of the CCD 28 provided with the Ir color filter. Is performed.

In step 303, three-dimensional image information is detected (3D photographing), and the detected image data is
The image data is stored in the image recording medium M as two-dimensional image data.

In step 304, the lens driving circuit 27
Is driven to move the position of the imaging lens 11 by a predetermined amount from the position set in 3D focusing (step 302). This movement amount is recorded in the memory 24 in accordance with zooming of the imaging lens 11. The system control circuit 35 reads from the memory 24 data indicating the amount of movement corresponding to the current zooming,
7, the moving amount of the imaging lens 11 is instructed. The lens drive circuit 27 moves the position of the imaging lens 11 in accordance with the instruction, and performs focus adjustment for detecting two-dimensional image information.

In step 305, two-dimensional image information corresponding to the distance information of the subject (2D imaging) is detected by a method described later in detail, and stored in the image recording medium M as two-dimensional image data.

As described above, in the second embodiment, as in the first embodiment, it is possible to detect the two-dimensional image information and the three-dimensional image information in a focused state. Also,
In the second embodiment, the automatic focus adjustment is performed only for the detection of three-dimensional image information by infrared light, and the detection of two-dimensional image information by visible light focuses on the basis of the movement amount recorded in the memory 24 in advance. Adjustments are made. Therefore,
As in the first embodiment, only one automatic focus adjustment is required, and quick focus adjustment can be performed.

Next, a photographing operation performed by the three-dimensional image detecting apparatus according to the third embodiment of the present invention will be described with reference to FIG. FIG. 13 is a flowchart of a shooting operation program executed in the present embodiment. Third
The second embodiment is the same as the first embodiment except that the photographing operation is slightly different from that of the first embodiment.

If it is confirmed in step 401 that the release switch 15 is fully depressed, step 4 is executed.
At 02, automatic focusing (2D focusing) on visible light is performed. That is, in order to detect two-dimensional image information under appropriate focus adjustment, among image signals detected by the CCD 28, image signals detected by pixels corresponding to the R, G, and B color filters, for example, Focus adjustment is performed by applying a conventionally known contrast method.

In step 403, detection of two-dimensional image information (2D imaging) is performed. That is, normal video control is performed in the CCD 28, and image information of the RGB component and the Ir component is detected, and is temporarily stored in the image memory 34 as image data for each color component. Then RGB
Only the image data corresponding to the component is stored in the image recording medium M as two-dimensional image data.

In step 404, automatic focusing (3D focusing) for infrared light is performed. That is, in order to detect three-dimensional image information under appropriate focus adjustment, CC
Of the image signals detected in D28, focus adjustment is performed on image signals detected by pixels corresponding to the Ir color filter, for example, by applying a conventionally known contrast method.

In step 405, detection of three-dimensional image information (3D imaging) is performed. That is, the signal charge is detected in each pixel by the three-dimensional image detection operation. The image signal detected at each pixel is temporarily stored in the image memory 34 as image data for each color component as image information. Thereafter, distance data is calculated from the image data corresponding to the Ir component, and is stored in the image recording medium M as three-dimensional image data.

As described above, according to the third embodiment, it is possible to detect both the two-dimensional image information and the three-dimensional image information as a sharp image whose focus has been adjusted.

In this embodiment, the automatic focus adjustment includes:
Although the contrast method was used, the automatic focus adjustment method is not limited. In this embodiment, the focus adjustment is performed by adjusting the position of the imaging lens. However, an imaging surface such as a CCD may be moved, or both of them may be moved.

In the first and second embodiments, the focus adjustment for one of the three-dimensional image information and the two-dimensional image information is performed based on the data recorded in the memory 24, but the focus adjustment corresponds to the zooming of the imaging lens. The predetermined movement amount may be calculated using a preset mathematical expression.

[0063]

As described above, according to the present invention, two-dimensional image information and three-dimensional image information are detected using the same photographing optical system, and the detection of three-dimensional image information is performed using light outside the visible wavelength. In the three-dimensional image detection device, it is possible to obtain a focus adjustment mechanism of the three-dimensional image detection device in which each detection is always performed in a focused state, and the focus can be quickly adjusted.

[Brief description of the drawings]

FIG. 1 is a perspective view of a camera-type distance measuring apparatus according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a circuit configuration of the camera shown in FIG.

FIG. 3 is a diagram showing an arrangement of a color filter array provided in a CCD 28;

FIG. 4 is a diagram showing transmittance characteristics of a color filter provided in a CCD 28;

FIG. 5 is a flowchart of a shooting operation program according to the embodiment.

FIG. 6 is a diagram for explaining the principle of distance measurement using distance measurement light.

FIG. 7: distance measuring light, reflected light, gate pulse, and CCD
FIG. 4 is a diagram showing a distribution of the amount of light received by the light source.

FIG. 8 is a diagram showing an arrangement of a photodiode and a vertical transfer unit provided in a CCD.

FIG. 9 is a cross-sectional view of the CCD cut along a plane perpendicular to the substrate.

FIG. 10 is a timing chart of a three-dimensional image detection operation for detecting data relating to a distance to a subject.

FIG. 11 is a flowchart of a three-dimensional image detection operation.

FIG. 12 is a flowchart of a shooting operation according to the second embodiment.

FIG. 13 is a flowchart of a shooting operation according to the third embodiment.

[Explanation of symbols]

 Reference Signs List 11 imaging lens 14 light emitting device 24 memory 27 lens drive circuit 28 CCD

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) // G01B 11/00 G02B 7/11 N 5C061 G01C 3/06 G03B 3/00 A F-term (reference) 2F065 AA04 AA06 DD10 FF04 FF10 FF31 GG06 GG08 HH04 JJ26 LL22 NN08 NN12 QQ03 QQ24 SS13 2F112 AB10 AD01 CA02 EA05 FA07 FA21 FA35 FA45 2H011 AA03 BA31 BB04 CA11 DA08 2H051 AA00 BA47 BA70 CB13 CC03 CE14 DA02 AB12 AB13 AB03 AB03 AB14 AC42 AC54 AC69 AC74 AC80 5C061 AB03 AB06 AB08

Claims (8)

[Claims] 1. An image pickup lens, an image pickup unit capable of accumulating a signal charge corresponding to an amount of received light, and a two-dimensional image in which visual image information of a subject is detected by the image pickup unit by visible light incident from the image pickup lens. Detection means, and light outside the visible wavelength range incident from the imaging lens,
A three-dimensional image detecting unit that detects distance information to the subject for each pixel in the imaging unit; and a focus on the subject in one of the two-dimensional image detecting unit and the three-dimensional image detecting unit. A first focus adjustment unit that adjusts a relative position between the imaging lens and the imaging unit such that the imaging lens and the imaging unit are adjusted by the first focus adjustment unit. The relative position between the other is displaced by moving at least one of the imaging lens and the imaging unit in the optical axis direction by a predetermined distance, and the first focus adjustment unit does not perform focus adjustment. And a second focus adjusting means for adjusting the focus in the image detecting means. 2. The first focus adjusting means and the second focus adjusting means.
The focus adjustment means of (1) performs adjustment of a relative position between the imaging lens and the imaging unit or movement of the predetermined distance by moving the imaging lens. Focus adjustment mechanism of the three-dimensional image detection device. 3. The focus adjusting mechanism according to claim 1, wherein the light outside the visible wavelength range is light in an infrared wavelength range. 4. The focus adjusting mechanism according to claim 1, wherein data for moving the predetermined distance is stored in a memory. 5. The image pickup lens is a zoom lens,
5. The data recording apparatus according to claim 4, wherein the data is recorded in the memory corresponding to each zooming of the imaging lens.
3. A focus adjustment mechanism of the three-dimensional image detection device according to 1. 6. The three-dimensional image detecting apparatus according to claim 1, wherein the first focus adjusting means is driven when the image information is detected by the two-dimensional image detecting means. Focus adjustment mechanism. 7. The focus adjusting mechanism according to claim 1, wherein the focus adjusting unit is driven when the distance information is detected by the three-dimensional image detecting unit. . 8. An image pickup lens, an image pickup unit capable of accumulating signal charges corresponding to the amount of received light, and a two-dimensional image for detecting visual image information of a subject by visible light incident from the image pickup lens in the image pickup unit. Detection means, and light outside the visible wavelength range incident from the imaging lens,
A three-dimensional image detecting unit that detects distance information to the subject for each pixel in the image capturing unit; and the two-dimensional image detecting unit and the three-dimensional image detecting unit capture the image so that the subject is in focus. A focus adjustment mechanism for a three-dimensional image detection device, comprising: focus adjustment means for adjusting a relative position between a lens and the imaging unit.