JP2002290788A - In-vehicle imaging device - Google Patents

Abstract

(57) Abstract: An in-vehicle imaging device capable of capturing scenery in a plurality of directions without dividing an angle of view and an imaging surface using a single imaging device is provided. , A single image sensor 7 in which the same color filters of the same color are provided for each pixel
And light 17L, 17R,
Optical system 9, 11, 1 for guiding 17F onto image sensor 7
3, 15 and light components of different colors, which are arranged on the optical path of the lights 17L, 17R, and 17F and are different from each other in the colors used for the color filters, from the lights 17L, 17R, and 17F, respectively. One or more dichroic filters 11 that combine light components and guide the light onto the image sensor 7, and an image processing unit 4 that separately generates image signals of the scenery in a plurality of directions based on color signals obtained from the image sensor 7. And a display device 5 for displaying and outputting each image signal generated by the image processing unit 4.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an on-vehicle image pickup apparatus for picking up an image of a surrounding scene which is a blind spot of a driver in a situation where visibility is poor and displaying the image to the driver.

[0002]

2. Description of the Related Art A conventional on-vehicle imaging apparatus 100 of this kind is
As shown in FIG. 4 and FIG. 5, the main configuration is provided with an imaging device 101 installed in the front part of the vehicle such as a front bumper and a display device 102 installed in the vehicle interior.

[0003] The image pickup apparatus 101 includes a light-shielding case 103.
And a triangular prism 1 housed in the case 103
04 and an imaging unit 105.

[0004] The case 103 has transmission windows 106L, 106R, 10
6F is provided, and the prism 104 is located above the transmission window 106F provided diagonally below the front of the case 103, and the right and left prism side surfaces 104L, 1L are provided.
04R to the left and right transmission windows 106L, 10L of the case 103.
It is arranged facing 6R. The imaging unit 105
A single image sensor 107 and an imaging lens 108 disposed in front of the image sensor 107 are provided. The image sensor 107 is located on the rear side of the prism 104 and has an upper half area Vu of the horizontal angle of view V.
Light 109 to be described later emitted from the prism rear surface 104B
L, 109R are taken in, and light 1 from the obliquely lower transmission window 106F at the front of the case 103 is introduced into the lower half region Vd.
09F is arranged slightly downward so as to be taken in.

[0005] Then, from the left and right views, the left and right transmission windows 10 are displayed.
Each light 109L, 109 incident through 6L, 106R
R transmits through the left and right prism side surfaces 104L and 104R, is internally reflected by the opposite prism side surfaces 104R and 104L, exits from the prism rear surface 104B, and is respectively horizontal in the upper half region Vu of the vertical angle of view V of the imaging unit 105. From the right half area HR and the left half area HL of the angle of view H, the imaging unit 10
5 and the left half area 1 in the lower half area 107d of the imaging surface of the imaging element 107 via the imaging lens 108.
07L, and is focused on the right half region 107R. On the other hand, the light 109F incident from the front scene through the transmission window 106F.
Is taken into the imaging unit 105 from the lower half area Vd of the vertical angle of view V of the imaging unit 105 without passing through the prism 104, and is collected in the upper half area 107u of the imaging surface of the imaging element 107 via the imaging lens 108. Be lighted. This allows
The image sensor 10 has a single view of the left, right, left and front three sides.
7 are imaged simultaneously.

[0006] The image signal output from the image sensor 107 is subjected to processing such as inversion processing by a predetermined processing unit 110, and, for example, the image signal of the left view is displayed on the display device 102 in the upper half area of the display surface. Are displayed in the left half area 102L, the right side image signal is displayed in the right half area 102R in the upper half area of the display surface, and the front side image signal is displayed in the lower half area 102d of the display surface.

At this time, the images of the respective scenes displayed on the display device 102 are selectively displayed only on the necessary sides (the left and right sides and the front side) by an operation from a predetermined operation input unit (not shown). Is displayed.

[0008]

However, in the above-described in-vehicle imaging apparatus 100, the upper half area Vu and the lower half area Vd of the vertical angle of view V of the imaging unit 105 are respectively different from the left and right views and the front view. Light 109L, 109R,
Since it is assigned to capture of 109F, there is a drawback in that the imaging ranges in the vertical direction with respect to the left and right landscapes and the front landscape are limited. Similarly, since the left half area HL and the right half area HR of the horizontal angle of view H of the imaging unit 105 are assigned to capture the lights 109R and 109L from the right and left views, respectively, There is a disadvantage that the horizontal imaging range is limited.

If there is a scene that is not displayed among the scenes on the left and right sides and on the front side, the area of the angle of view assigned to capture light from the scene is not used during that time and is wasted. I have.

Similarly, the left half area 107L and the right side area 107R in the lower half area 107d of the imaging surface are allocated to the image formation of the lights 109L and 109R from the left and right views, and the upper half area 107u is located on the front side. Light from the scenery 1
Since there is a scene that is not displayed among the left and right sides and the front side scenes, the area of the imaging surface assigned to the imaging of that scene is not used during that time and is wasted. ing.

SUMMARY OF THE INVENTION An object of the present invention is to provide an in-vehicle image pickup apparatus capable of picking up scenes in a plurality of directions without dividing an angle of view and an image pickup plane using a single image pickup device.

[0012]

In order to solve the above-mentioned problems, according to the present invention, a single image pickup device in which the same plural color filters are provided for each pixel is provided. An optical system that guides the light taken from the scenery in the direction onto the image sensor, and a light that is arranged on an optical path of the light and has a color different from each other in the color used for the color filter among the lights. Components, extracting one or more dichroic filters for combining each of the extracted light components and guiding the light onto the image sensor, and converting the image signals of the scenery in the plurality of directions based on color signals obtained from the image sensor. And a display device for selectively displaying and outputting the scenery in the plurality of directions based on the image signals generated by the processing unit.

According to a second aspect of the present invention, the processing means selectively generates an image signal of the scenery in a predetermined direction based on the color signal obtained from the image sensor, and outputs the image signal to the display device. A display is output on the display device.

According to a third aspect of the present invention, the processing means outputs the color signal obtained from the image pickup device to the display device, and the display device side displays the color signal in a predetermined direction based on the color signal. The image signal of the scene is selectively generated and output for display.

According to a fourth aspect of the present invention, the display device displays and outputs the image signal in black and white.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. 1 and 2 are a schematic side sectional view and a schematic plan view, respectively, of an in-vehicle imaging device according to a first embodiment of the present invention.

The on-vehicle imaging apparatus 1 according to this embodiment
As shown in FIGS. 1 and 2, an image pickup device 3 installed at a front portion of a vehicle such as a front bumper to pick up each of the blind spot regions on both the left and right sides and the front side of the vehicle, and performs image processing on the image picked up by the image pickup device 3. An image processing unit (processing means) 4 is provided, and a display device 5 installed in the vehicle interior and displaying an image processed by the image processing unit 4 is provided.

The image pickup device 3 has its image pickup surface 7a forward (right side in the drawing) in a light-shielding case (not shown) provided with transmission windows on the left and right sides and diagonally below the front part.
, An imaging lens 9 and a dichroic mirror (dichroic filter) 11 sequentially arranged on the front side of the imaging element 7, and a front side of the dichroic mirror 11; The prism 13 projects the left and right scenes reflected from the transmission window to the imaging surface 7a of the imaging device 7 via the dichroic mirror 11 and the imaging lens 9, and the front scene reflected from the oblique lower transmission window of the case. A reflection mirror 15 that reflects the light and projects it on the dichroic mirror 11, reflects the light from the dichroic mirror 11, and projects the light onto the imaging surface 7 a of the imaging device 7 via the imaging lens 9. Here, the imaging lens 9, the dichroic mirror 11, the prism 13
The reflection mirror 15 forms an optical system.

The image sensor 7 is constructed by disposing color filters (not shown) of the same plurality of colors (for example, three primary colors of RGB) for each pixel on the image pickup surface 7a. As such an image pickup device 7, for example, a single-plate CCD image sensor in which RGB color filters are provided for each pixel is used.

The dichroic mirror 11 has a characteristic of reflecting, for example, a B-color light component and transmitting G- and R-color light components with respect to natural light incident on the front surface or the back surface of the reflection surface 11a. The transmission / reflection characteristics of the dichroic mirror 11 are based on the RG provided on each image of the image sensor 7.
This is the same characteristic as the transmission / reflection characteristic of the B color filter. More specifically, the RG extracted by the dichroic mirror 11
B light components are respectively assigned to RGs provided on the imaging surface 7a.
This is a characteristic in which the light passes through the color filter of B effectively without being attenuated.

The prism 13 is formed in the shape of a column having an isosceles triangular cross section. It is arranged facing the transmissive windows on the left and right sides of the case.

The reflection mirror 15 is arranged behind the transmission window on the obliquely lower side of the front part of the case and below the dichroic mirror 11.

The arrangement of the reflection mirror 15 and the dichroic mirror 11 and the angles of the reflection surfaces 15a, 11a are obliquely lower and lower than the front of the case according to the mutual arrangement and the angles of the reflection surfaces 15a, 11a. The front view reflected on the reflection mirror 15 from the side transmission window is set so as to be projected on the imaging surface 7a of the imaging element 7 as described above.

In the image pickup apparatus 3, as shown in FIGS. 1 and 2, each of the lights 17L and 17R incident from the left and right scenes through the left and right transmission windows of the case is respectively connected to the left and right prism side surfaces 13L. , 13R, and is internally reflected by the opposite prism side surfaces 13R, 13L and exits from the rear surface 13B of the prism. Both light components of B color are reflected by the dichroic mirror 11 and are excluded to the upper side. The light components of the colors are transmitted and extracted, and from the right half region HR and the left half region HL of the horizontal angle of view H of the image sensor 7 via the imaging lens 9, the left half region and the left half region of the image sensor 7. An image is formed in the right half area.

On the other hand, light 17F incident from the front view through the transmission window on the lower side of the case is reflected by the reflection mirror 1
The light component of G and R is transmitted through the dichroic mirror 11 and is excluded from the upper side, and the light component of B color is reflected on the image sensor 7 and extracted. The light passes through the same optical path as the G and R light components extracted by the above-described dichroic mirror 11 and propagated to the image sensor 7 side.
Is imaged on the entire surface of the imaging surface 7a.

In this way, each light 1 from the left and right scenes
7L and 17R are respectively imaged on the left half area and the right half area of the imaging surface 7a of the imaging device 7, and light 17F from the front scene is imaged on the entire imaging surface 7a. In the left half area of the imaging surface 7a, the left side view and the left half of the front side view are synthesized and imaged simultaneously, and in the right half area of the imaging side 7a, the right view and the right half of the front side view are synthesized. And simultaneously imaged.

The image processing section 4 performs necessary signal processing on the signal output from the image sensor 7 to extract each of the RGB color signals, and based on the B color signals obtained from all the pixels of the image pickup surface 7a, An image signal of the front side scene imaged from the transmission window on the obliquely lower front side of the case is generated, and R and G color signals obtained from pixels in the left half area of the imaging surface 7a of the imaging device 7 are generated. Based on the R and G color signals obtained from the pixels in the right half area of the imaging surface 7a, an image signal of the left scene captured from the left transmission window of the case is generated based on the image signal of the case. An image signal of the right scene taken from the right transmission window is generated.

Here, the image processing unit 4 is, for example, the operation input unit 1 of the RGB color signals obtained from the image sensor 7.
Scenes selected through the operation input of No. 9 (left and right side scenes,
Only the color signal corresponding to the front scene is output to the display device 5 as an image signal.

The display device 5 displays the image signal generated by the image processing section 4 in full screen display or divides the display screen into two parts according to the number of selected scenes and the scenery on which side. Output in black and white, for example. That is, when the display device 5 receives, for example, the B color signal from the image processing unit 4, the display device 5 displays the image signal in black and white on the entire display surface as an image signal of the front view, and displays the G signal from the left half area of the image sensor 7. When the color signals of R and R are received, the image signal is displayed in black and white on the left half of the display surface as an image signal of the left view, and the G and R color signals from the right half area of the image sensor 7 are received. Then, the image signal is displayed in black and white on the right half of the display surface as an image signal of the right scene.

Since the lights 17L, 17R, and 17F from the left and right scenes and the front scene are natural light and not monochromatic light, even if the light components are transmitted through the dichroic mirror 11 and the light components are restricted, the image shape is not changed. And the information of shading is retained.
Therefore, the presence or absence of an object around the vehicle can be sufficiently confirmed based on the monochrome captured image displayed on the display device 5.

According to the on-vehicle imaging device 1 configured as described above, each pixel on the imaging surface 7a of the imaging device 7 has, for example, R
A GB color filter is provided, and a dichroic mirror 11 controls each light 1 from the left and right scenes and the front scene.
Light components of different colors from each other among 7L, 17R, and 17F (here, R and G light components from the right and left landscape lights 17L and 17R, and B light components from the front landscape light 17F). ) Are extracted, and the extracted light components are combined and imaged by the image sensor 7, and the image signals of the left and right scenes and the front scene are separated according to the GRB color signal obtained from the image sensor 7. Therefore, unlike the related art, it is not necessary to separately use the imaging surface 7a and the vertical angle of view V of the imaging device 7 for the left and right views and the front view, respectively. For the imaging of the side scene, all the areas of the imaging surface 7a and the vertical angle of view V can be simultaneously used. Therefore, in addition to being able to image a wider range than before, an image with a higher resolution can be taken when imaging the same range as before.

Further, since the imaging surface 7a and the vertical angle of view V of the imaging device 7 are not used separately, even when either the left or right scene or the front scene is not displayed on the display device 5, the imaging device is always used. 7, the entire imaging surface 7a and the entire vertical angle of view V are effectively used.

Further, since the left and right scenes and the front scene are imaged by one set of the image sensor 7, the imaging lens 9, the case, etc., an apparatus capable of imaging scenes in a plurality of directions at low cost is provided. be able to.

Further, in the display device 5, since the image signal is displayed in black and white irrespective of the color of the light component extracted by the dichroic mirror 11, the image can be displayed easily.

Further, the image signals of the left and right scenes and the front scene that have been synthesized and picked up are selectively generated by the image processing unit 4 by being distinguished by color signals and output to the display device 5. At an appropriate stage, the image signal of the selected scene can be generated separately from the image signals of other scenes and displayed on the display device 5.

In this embodiment, a description will be given of a case where the image signals of the left and right scenes and the front scene, which are synthesized and captured, are selectively generated by the image processing unit 4 and output to the display device 5. However, instead of selectively generating them by the image processing unit 4, the RGB color signals obtained from the
The data may be output to the display device 5 using a method such as SC, and may be selectively generated and displayed on the display device 5 side. In this case, the image signal of the selected scene is generated separately from the other scenes and displayed on the display device 5 at an appropriate stage.

In this embodiment, the image pickup surface 7 of the image pickup device 7 is further provided for the left side view and the right side view.
In the case where all the areas of the horizontal angle of view a and the horizontal angle of view H can be used at the same time, two dichroic mirrors 19 and 21 are used instead of the prism 13 as shown in FIG.
The left and right scenes may be reflected and projected onto the entire surface of the image sensor 7 via the dichroic mirror 11 and the imaging lens 9. Here, the dichroic mirror 19 reflects, for example, a light component of G color on the reflection surface 19a of the light 17L from the left side scene by reflecting it toward the image sensor 7, and extracts B light.
The light components of the colors R and R are transmitted and excluded. Further, the dichroic mirror 21 extracts, for example, a light component of R color by reflecting the light 17R from the right side view toward the imaging device 7 side on the reflection surface 21a, and extracts each light component of B color and G color. Exclude through transmission. As a result, the light 17
L and 17R are dichroic mirrors 19 and 2, respectively.
At 1, the light components are restricted to light components of different colors (G color, R color), are combined, and form an image on the entire image pickup surface 7 a of the image pickup device 7. Then, as in the case of the first embodiment, the image processing unit 4 separates the left and right view image signals from the G and R color signals obtained from the image sensor 7 respectively. Generate and output to the display device 5. By doing so, the entire area of the imaging surface 7a of the image sensor 7 and the entire area of the horizontal angle of view H can be simultaneously used for imaging the left scene and the right scene. FIG. 3 is a diagram in which the prism 13 is replaced by dichroic mirrors 19 and 21 in FIG.

[0038]

According to the first aspect of the present invention, each pixel of the image sensor is provided with a plurality of color filters.
The dichroic filter extracts light components of different colors from each light from the scenery in a plurality of directions, and the extracted light components are combined and imaged by the image sensor, and the color signal obtained from the image sensor is converted into a color signal. Accordingly, since the image signals of the scenes in the multiple directions are separately generated, it is not necessary to use the imaging surface and the angle of view of the image sensor separately for the scenes in the multiple directions. For imaging, the entire area of the imaging surface and the angle of view of the imaging device can be used simultaneously and overlapped. Therefore, in addition to being able to image a wider range than before, in the case of imaging the same range as before, an image with higher resolution can be taken.

Further, since the imaging surface and the angle of view of the image sensor are not used separately, even when any of the scenery in the plurality of directions is not displayed on the display device, the entire imaging surface and the entire angle of view of the image sensor are always kept. It will be used effectively.

According to the second aspect of the present invention, the processing means selectively generates an image signal of the scenery in a predetermined direction based on a color signal obtained from the image sensor, and outputs the image signal to a display device for display output. At the appropriate stage, the image signal of the selected scene is generated separately from the image signals of other scenes,
It can be displayed on a display device.

According to the third aspect of the present invention, the processing means outputs a color signal obtained from the image pickup device to the display device, and the display device displays an image of a scene in a predetermined direction based on the color signal. Since the signal is selectively generated and output for display, at an appropriate stage, the image signal of the selected scene can be generated separately from the others and displayed on the display device.

According to the fourth aspect of the invention, in the display device, the image signal is displayed in black and white irrespective of the color of the light component extracted by the dichroic filter.

[Brief description of the drawings]

FIG. 1 is a schematic side cross-sectional view of an in-vehicle imaging device according to a first embodiment of the present invention.

FIG. 2 is a schematic plan cross-sectional view of the vehicle-mounted imaging device according to the first embodiment of the present invention.

FIG. 3 is a schematic plan cross-sectional view of a modified example of the vehicle-mounted imaging device according to the first embodiment of the present invention.

FIG. 4 is a schematic plan sectional view of a conventional vehicle-mounted imaging device.

FIG. 5 is a schematic side sectional view of a conventional vehicle-mounted imaging device.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 In-vehicle imaging device 3 Imaging device 4 Image processing unit 5 Display device 7 Image sensor 9 Imaging lens 11, 19, 21 Dichroic mirror 13 Prism 15 Reflection mirror 17L, 17R, 17F Light

 ──────────────────────────────────────────────────続 き Continuing from the front page (72) Inventor Junichi Ono 1-7-10 Kikuzumi, Minami-ku, Nagoya City, Aichi Prefecture Inside Auto Network Engineering Laboratory Co., Ltd. (72) Inventor Takayuki Tomita 1-Kikuzumi, Minami-ku, Nagoya City, Aichi Prefecture No. 7-10 Auto Network Engineering Laboratory Co., Ltd. F-term (reference) 2H042 CA08 CA10 CA14 CA17 5C022 AA04 AC42 AC51 AC55

Claims (4)

[Claims] 1. A single image sensor in which the same plurality of color filters are arranged in each pixel, an optical system for guiding light taken from scenes in a plurality of directions onto the image sensor, and Light components having different colors in the colors used for the color filters are extracted from the respective lights, and the extracted light components are combined to guide the light onto the image sensor. One or more dichroic filters to perform, processing means for separately generating image signals of the scenery in the plurality of directions based on color signals obtained from the image sensor, and based on the image signals generated by the processing means, A display device for selectively displaying and outputting scenery in a plurality of directions. 2. The processing means selectively generates an image signal of the scenery in a predetermined direction based on the color signal obtained from the image sensor, outputs the image signal to the display device, and causes the display device to output the image signal. The in-vehicle imaging device according to claim 1, wherein: 3. The processing means outputs the color signal obtained from the image sensor to the display device, and selectively displays the image signal of the scene in a predetermined direction on the display device side based on the color signal. The in-vehicle imaging device according to claim 1, wherein the in-vehicle image pickup device is generated and displayed. 4. The on-vehicle imaging device according to claim 1, wherein the display device displays and outputs the image signal in black and white.