JP2019001324A - Vehicular photographing device - Google Patents

Abstract

【Task】
To provide an in-vehicle photographing device capable of selecting an optimal visible light image or infrared light image.
[Solution]
Visible light imaging means for picking up a visible light image around the own vehicle, infrared light picking up means for picking up an infrared light image around the own vehicle, and an image of the visible light image or an image of the infrared light image Output selection means for selecting which to output, video display means for displaying the video selected by the output selection means, dark place detection means for detecting whether or not the periphery of the own vehicle is a dark place, and the own vehicle Vehicle information acquisition means for acquiring the vehicle information, and the output selection means selects an output based on whether the vehicle is in the dark place and the vehicle information.
[Selection] Figure 1

Description

  The present invention relates to a vehicle photographing apparatus, and particularly to a vehicle photographing apparatus using visible light and infrared light.

  Conventionally, for example, Japanese Patent No. 5452137 proposes an apparatus that captures an image of a state around a vehicle using an infrared light camera and displays the captured image in front of the driver's seat. Further, it has been proposed to provide an average illuminance detection unit that detects the average illuminance of the photoelectric conversion unit, and to switch from a captured image using visible light to a night-vision captured image using infrared light based on the average illuminance. According to this device, the driver can easily grasp the state of humans and obstacles that actually exist even in the surrounding situation of the vehicle at night, which is difficult for the driver to recognize due to human visual characteristics. , Driving operation can be effectively supported.

Japanese Patent No. 5452137

  However, in the prior art disclosed in the above-mentioned patent document, switching to the image of the infrared light camera is performed by determining whether the surroundings are dark at night or the like and the distance is difficult to see with the naked eye. However, this determination is not always desirable. In other words, the image from the visible light camera may be effective even at night, or the image from the infrared light camera may be effective even during the daytime.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an in-vehicle photographing apparatus that can select an optimal visible light image or infrared light image.

  In order to achieve the above object, the present invention provides a visible light imaging unit that captures a visible light image around the host vehicle, an infrared light imaging unit that captures an infrared light image around the host vehicle, and the visible light. Output selection means for selecting whether to output an optical image image or an infrared light image image, an image display means for displaying an image selected by the output selection means, and whether or not the periphery of the host vehicle is in a dark place A dark place detecting means for detecting the vehicle information and a vehicle information obtaining means for obtaining vehicle information of the host vehicle, wherein the output selecting means selects the output based on the dark information and the vehicle information. It is characterized by that.

  ADVANTAGE OF THE INVENTION According to this invention, the vehicle-mounted imaging device which enabled selection of the optimal visible light image or infrared light image can be provided.

1 is a block diagram illustrating a configuration of a photographing apparatus according to Embodiment 1. FIG. 3 is a flowchart illustrating a flow of output selection processing according to the first embodiment. FIG. 6 is a block diagram illustrating a configuration of a photographing apparatus according to a second embodiment. 6 illustrates an example of a color filter array of an image sensor according to the second embodiment. 10 is a flowchart illustrating a flow of output selection processing according to the second embodiment.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[Example 1]
A photographing apparatus according to the first embodiment of the present invention will be described below with reference to FIGS. FIG. 1 shows the configuration of a photographing apparatus according to the first embodiment of the present invention.

  The imaging device 100 is a vehicle imaging device mounted on a vehicle, and images the front of the vehicle for driving support or surrounding monitoring. The vehicle control device 200 is a control device composed of a computer or the like that controls the entire vehicle, and controls various vehicle-related controls such as controlling a vehicle function having power and brakes in accordance with a driver's operation and running the vehicle. Do. In the present embodiment, an example in which the vehicle control device 200 has a function of controlling the operation of the wiper for removing water droplets attached to the windshield according to an operation by the driver will be described. Furthermore, the monitor device 300 is a video display means for displaying a video to the driver, and displays the video shot by the shooting device 100.

  The imaging apparatus 100 includes a visible light imaging unit including a visible light imaging lens 101, a visible light imaging element 102, and a visible light image processing unit 103, an infrared light imaging lens 104, an infrared light imaging element 105, and an infrared light image processing. Infrared light imaging means comprising the unit 106 is provided. Furthermore, the imaging apparatus 100 includes an output selection unit 107 (output selection unit), an illuminance sensor 108 (dark place detection unit), and a vehicle information acquisition unit 109 (vehicle information acquisition unit).

  The visible light imaging lens 101 is a lens for condensing light on the visible light imaging element 102, and the visible light imaging element 102 has a bandpass filter that transmits light in the visible wavelength region, and Of the light that passes through the optical imaging lens 101, only visible light is received and subjected to photoelectric conversion. The visible light image processing unit 103 performs image processing on the signal from the visible light imaging element 102 and generates a visible light image.

  The infrared light imaging lens 104 is a lens for condensing light on the infrared light imaging element 105, and the infrared light imaging element 105 has a band-pass filter that transmits light in the wavelength region of infrared light. Then, only infrared light out of the light passing through the infrared light imaging lens 104 is received and subjected to photoelectric conversion. The infrared light image processing unit 106 performs image processing on the signal from the infrared light imaging element 105 to generate an infrared light image.

  The output selection unit 107 receives the images of the visible light image processing unit 103 and the infrared light image processing unit 106, and selects the image to be output to the monitor device 300 according to the output selection process described later. The illuminance sensor 108 is a sensor that detects the brightness around the vehicle, and outputs detection data to the output selection unit 107. The vehicle information acquisition unit 109 is connected to the vehicle control device 200 and acquires various vehicle information controlled by the vehicle control device 200. In this embodiment, an example in which information indicating whether or not the wiper is operating will be described.

  FIG. 2 is a flowchart illustrating a flow of output selection processing in the first embodiment. First, in step S10, detection data is acquired from the illuminance sensor 108. Next, in step S11, information on whether or not the wiper is operating is acquired as vehicle information from the vehicle information acquisition unit 109. In step S12, it is determined whether or not the periphery of the vehicle is dark from the detection data acquired in step S10. The determination is based on whether the illuminance is below a threshold, for example, whether it is nighttime or whether it is a tunnel or not, and whether it is easy to see far away where the headlight does not reach because the surroundings are dark. The threshold value for this.

  If it can be determined in step S12 that the periphery is dark, the process proceeds to step S13. If it is determined that the periphery is bright, the process proceeds to step S14. In step S <b> 13, the output selection unit 107 selects the image of the infrared light image processing unit 106 and outputs it to the monitor device 300. Therefore, when the surroundings of the vehicle are dark, such as at night, an infrared image is displayed on the monitor device 300, so that a person or an obstacle can be quickly recognized by looking at the monitor device 300 even when the headlight does not reach. be able to.

  Therefore, the effect of driving support for the driver can be obtained. If the periphery is bright, in step S14, it is determined whether or not the wiper is operating based on the vehicle information acquired in step S11. If the wiper is operating, the process proceeds to step S13. If the wiper is stopped, the process proceeds to step S15. In step S <b> 15, the output selection unit 107 selects the video of the visible light image processing unit 103 and outputs it to the monitor device 300. Therefore, when the surroundings of the vehicle such as daytime are bright, a visible light image is displayed on the monitor device 300, so that the blind spot of the vehicle body can be confirmed on the monitor device 300.

  However, when the wiper is in operation, it is predicted that it is raining or snowing, and even if the surroundings are bright, the surrounding environment may be difficult to recognize due to the effects of rain or snow. In addition, infrared light is different from visible light in terms of water transmittance and scattering, and because it detects heat in the far-infrared region, it is more infrared light than visible light in rainy or snowy environments. Is easier to recognize when looking at nearby people. Therefore, while the wiper is in operation, it is possible to supplement the visual recognition of the surroundings in a rainy or snowy environment by displaying an infrared image in step S13.

  As described above, when it is dark and cannot be seen far away, such as at night, a visible infrared image is displayed, and when it is bright such as in the daytime, a visible light image is displayed to recognize the blind spot of the vehicle body. I do. In addition, even in the daytime and other bright environments, it is determined whether the visibility of rain and snow is poor depending on whether the wiper is operating, and infrared image display that is less susceptible to these effects is displayed. I do. Therefore, not only the visible light image and the infrared light image are simply switched depending on whether the image is dark or not, but also by displaying the vehicle information together, a more optimal image display for driving support can be realized.

  Further, in this embodiment, an example in which the visible light imaging unit and the infrared light imaging unit are individually provided has been described. However, the present invention is not limited to this, and the visible light and infrared light imaging units are integrated. Imaging means may be used.

  Further, in the present embodiment, the example in which the monitor device is configured separately from the imaging device has been described. However, the present invention is not limited to this, and the display unit may be configured in the imaging device. Furthermore, in the present embodiment, the example in which the illuminance sensor is used for determining whether or not the periphery is dark has been described, but the present invention is not limited to this. For example, it may be determined from the luminance of the visible light image.

[Example 2]
Hereinafter, with reference to FIGS. 3 to 5, a photographing apparatus according to a second embodiment of the present invention will be described. FIG. 3 shows the configuration of an imaging apparatus according to the second embodiment of the present invention. Components similar to those described in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

  The imaging device 400 is a vehicle imaging device mounted on a vehicle, and images the front of the vehicle for driving support or surrounding monitoring. The vehicle control device 200 is a control device composed of a computer or the like that controls the entire vehicle, and performs various controls relating to the vehicle, such as controlling the vehicle functions having power and brakes, and driving the vehicle according to the operation of the driver. . In the present embodiment, an example in which the vehicle control device 200 has a function of detecting the traveling speed of the vehicle will be described. Further, the recording device 500 is a video recording means for recording a video, and records the video imaged by the imaging device 400. By recording the video with the recording device 500, the video can be used not only for driving assistance to the driver by the monitor device 300 but also for recording at the time of an accident or the like.

  The imaging device 400 includes visible light and infrared light integrated imaging means including an imaging lens 110, an imaging element 111, and an image processing unit 112. Furthermore, the imaging apparatus 400 includes an output selection unit 107 (output selection unit), an infrared projection unit 113, a luminance detection unit 114 (dark place detection unit), and a vehicle information acquisition unit 109 (vehicle information acquisition unit).

  The imaging lens 110 is a lens for condensing light on the imaging device 111, and the imaging device 111 is an imaging device having spectral sensitivity characteristics with a wide wavelength from visible light to infrared light. An example of the color filter array of the image sensor 111 is shown in FIG. A red pass filter 601, a green pass filter 602, a blue pass filter 603, and an infrared pass filter 604 are arranged as shown in the figure, and this is repeated as a unit. Since the image sensor 111 has a spectral sensitivity range from visible light to infrared light, by providing such visible light and infrared light color filters, the visible light and infrared light are simultaneously received and photoelectrically converted. To do. The image processing unit 112 performs image processing on the signal from the image sensor 111 to generate a visible light image and an infrared light image, respectively.

  The infrared projector 113 irradiates the front of the vehicle with infrared light in order to increase the intensity of infrared light received by the image sensor 111. The output selection unit 107 receives the visible light image and the infrared light image generated by the image processing unit 112, and selects the image to be output to the monitor device 300 and the recording device 500 in accordance with an output selection process described later.

  The luminance detection unit 114 calculates the luminance from the visible light video generated by the image processing unit 112 and outputs the luminance data to the output selection unit 107. The vehicle information acquisition unit 109 is connected to the vehicle control device 200 and acquires various vehicle information controlled by the vehicle control device 200. In the present embodiment, an example of acquiring information on the traveling speed of the vehicle will be described.

  FIG. 5 is a flowchart illustrating the flow of output selection processing according to the second embodiment. First, in step S20, luminance data is acquired from the luminance detecting unit 114. Next, in step S <b> 21, information on the traveling speed of the vehicle is acquired as vehicle information from the vehicle information acquisition unit 109. In step S22, it is determined from the luminance data acquired in step S20 whether or not the periphery of the vehicle is dark. The determination is based on whether the brightness is below a threshold, for example, whether it is nighttime or whether it is a tunnel, and whether it is easy to see far away where the headlight does not reach because the surroundings are dark. The threshold value for this. If it is determined in step S22 that the periphery is dark, the process proceeds to step S23. If it is determined that the periphery is bright, the process proceeds to step S25.

  In step S23, based on the vehicle information acquired in step S21, it is determined whether the traveling speed of the vehicle is equal to or higher than a threshold value. The threshold is set to 10 km / h or more, for example, and it is determined whether the running speed is not a stop or slow drive. If the traveling speed is fast, the process proceeds to step S24. If the traveling speed is slow or slow, the process proceeds to step S25. In step S <b> 24, the output selection unit 107 selects an infrared light image and outputs it to the monitor device 300 and the recording device 500. In step S <b> 25, the output selection unit 107 selects a visible light image and outputs it to the monitor device 300 and the recording device 500.

  Therefore, when the surroundings of the vehicle such as daytime are bright, a visible light image is displayed on the monitor device 300, so that the blind spot of the vehicle body can be confirmed on the monitor device 300. In addition, when the surroundings of the vehicle are dark, such as at night, and the traveling speed is high, an infrared image is displayed on the monitor device 300. You can quickly recognize things. Furthermore, even when the vehicle periphery is dark, such as at night, when the traveling speed is low, a visible light image is displayed on the monitor device 300.

  In this case, when stopping or slowing down, it is desirable to pay attention to the vicinity of the vehicle rather than far away. For example, when the blind spot of the vehicle is confirmed or when the imaging lens is wide-angle, it is desired to use the video for driving support such as confirmation of left and right when entering a crossroad or the like. Further, when checking the vicinity of the vehicle, it is more effective to display a visible light image that is clearer than an infrared light image because there is a headlight or the like even if the periphery is dark. Therefore, by simply displaying a visible light image when it is bright such as daytime and displaying an infrared light image when it is dark such as at night, it is also possible to display a visible light image when stopping or slowing down at night. This makes it easier to recognize the vicinity of the vehicle where attention should be paid. Therefore, it is possible to display optimal driving assistance video.

  In this embodiment, the example in which the visible light and infrared light imaging means are integrated imaging means has been described. However, the present invention is not limited to this, and the visible light imaging means and the infrared light imaging means are not limited. It may be a photographing device that is individually provided.

  Further, in the present embodiment, an example of acquiring travel speed information as vehicle information has been described, but the present invention is not limited to this. For example, information on ambient temperature may be acquired as vehicle information. When the infrared imaging means is in the far-infrared wavelength region, the infrared light image is an image in which the temperature of the subject is visualized, but the surrounding temperature is high even when it is dark such as at night Does not become a video that performs the function of driving support because the video has no contrast.

  In that case, it is desirable to display a visible light image so that only a lighted portion such as a headlight can be recognized. Therefore, information on the ambient temperature is acquired as vehicle information, and it is determined whether the ambient temperature is higher than a temperature close to the body temperature of a human or an animal (for example, 35 degrees Celsius). If the selection is high, a visible light image may be selected.

  As another example, information on the driver's line of sight may be acquired as vehicle information. Even if the captured image is displayed on the monitor device for driving support, the driving support effect cannot be obtained unless the driver looks at the monitor device. In that case, it is more effective to use it for the purpose of surrounding monitoring such as for recording at the time of accident than for the purpose of driving support. As described above, when the infrared imaging means is in the far-infrared wavelength region, since the infrared light image is an image in which the temperature of the subject is visualized, it is determined whether a human or an animal exists. Yes, but the image is not clear.

  Therefore, since it is difficult to judge more information from the video, an infrared light video is not effective as a video used for the purpose of surrounding monitoring. In addition, when recording an accident, the situation near the vehicle is important, and even if the surroundings are dark, there are headlights, etc., so a visible light image that is clearer than an infrared light image is recorded. Is effective. Therefore, the driver's line of sight information is acquired as vehicle information, and it is determined whether or not the line of sight is on the monitor device. If the line of sight is on the monitor device, the infrared light image is selected, and the line of sight is not on the monitor device. In this case, a visible light image may be selected.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

DESCRIPTION OF SYMBOLS 100 Imaging device 103 Visible light image processing part 106 Infrared light image processing part 107 Output selection part 108 Illuminance sensor 109 Vehicle information acquisition part 114 Luminance detection part 200 Monitor apparatus 500 Recording apparatus

Claims (6)

Visible light imaging means for capturing a visible light image around the host vehicle;
An infrared light imaging means for capturing an infrared light image around the host vehicle;
Output selection means for selecting whether to output the image of the visible light image or the image of the infrared light image;
Video display means for displaying the video selected by the output selection means;
Dark place detection means for detecting whether or not the surroundings of the host vehicle are dark places;
Vehicle information acquisition means for acquiring vehicle information of the host vehicle,
The output selection means includes
An in-vehicle imaging device, wherein an output is selected based on whether the vehicle is in a dark place and the vehicle information. The vehicle information is
It is information that shows the wiper status of whether or not the wiper of the host vehicle is operating,
The output selection means includes
When the periphery of the host vehicle is not in a dark place and the wiper state is operating,
The in-vehicle imaging device according to claim 1, wherein an output of an infrared light image is selected. The vehicle information is
It is information on the traveling speed of the vehicle,
The output selection means includes
When the periphery of the host vehicle is in a dark place and the traveling speed is a predetermined value or less,
The in-vehicle imaging device according to claim 1, wherein an output of a visible light image is selected. The vehicle information is
It is information on the line of sight of the driver driving the vehicle,
The output selection means includes
When the periphery of the host vehicle is a dark place and the line of sight is other than the image display means,
The in-vehicle imaging device according to claim 1, wherein an output of a visible light image is selected. The vehicle information is
It is information on the ambient temperature of the vehicle,
The output selection means includes
When the periphery of the vehicle is a dark place and the ambient temperature is equal to or higher than a predetermined value,
The in-vehicle imaging device according to claim 1, wherein an output of a visible light image is selected. Having video recording means for recording video;
The video recording means includes
The in-vehicle imaging device according to claim 1, wherein the output video selected by the output selection unit is recorded.