JP2023088182A - Electronic mirror device - Google Patents

Abstract

To provide an electronic mirror device which effectively switches between an optical mode and an image mode.SOLUTION: In an electronic mirror system 10, an environment determination section 40 detects: illuminance at the front and back of a vehicle through a camera 30 and an illuminance sensor 44; rainfall through performance of a wiper device 18; and presence or absence of an obstacle in a vehicle interior 14 through an indoor camera 46 and performance of a rear-seat entertainment system (RSE) system 20. When a detection result indicates that visual contact using an optical mirror is not appropriate, a display control section 42 switches a display mode of an inner mirror 26 from an optical mode to a camera mode. Thus, the electronic mirror system can keep a driver of a vehicle from reducing visibility outside the vehicle through the inner mirror 26 by effectively switching from the optical mode to the camera mode.SELECTED DRAWING: Figure 1

Description

The present invention relates to an electronic mirror device.

The electronic mirror device of Patent Document 1 operates in a display mode using a display unit or a mirror mode using an optical mirror. The electronic mirror device turns off the backlight of the display in the mirror mode to enable rearward visibility by the reflected image of the optical mirror, and turns on the backlight of the display in the display mode to display the camera image of the rear camera. to be visible through the optical mirror.

In this electronic mirror device, the ambient illuminance of the display unit and the temperature of the backlight are detected in the display mode, and the minimum guaranteed brightness set according to the ambient illuminance exceeds the upper limit allowable brightness set according to the ambient temperature. If so, you can switch from display mode to mirror mode.

JP 2018-171982 A

By the way, the optical mirror is arranged on the front side of the vehicle from the front seats in the passenger compartment, and reflects the inside of the passenger compartment as well as the rear of the vehicle seen through the rear shield glass, for example. Therefore, in the optical mirror, if water droplets, dirt, etc. adhere to the rear shield glass, there is a concern that the visibility behind the vehicle reflected through the rear shield glass will be reduced. Therefore, in the electronic mirror device, there is room for improvement in switching between an optical mode using an optical mirror and a video mode for displaying a captured image.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an electronic mirror device capable of effectively switching between an optical mode and an image mode.

In the electronic mirror device of claim 1 for achieving the above object, the display mode includes an optical mode for displaying the outside of the vehicle from the inside of the vehicle by optical reflection on an optical mirror, and is displayed on the display as an image captured by the imaging means, a display medium that can be switched to, and an environment for detecting environmental conditions regarding visual recognition of the interior and exterior of the vehicle using the optical mirror and detecting means for changing the display mode of the display medium from the optical mode when the environmental condition detected by the environment detecting means is an environmental condition set to be unsuitable for visual recognition using the optical mirror. display control means for switching to video mode.

In the electronic mirror device of claim 1, the display medium is provided with an optical mirror and a display, and the display mode of the display medium is switched between an optical mode and a video mode by the display control means. When the display medium is switched to the optical mode, the outside of the vehicle is reflected on the optical mirror from the inside of the vehicle due to optical reflection. is displayed on the display as a projected image.

Here, the environment detection means detects an environmental state regarding visual recognition of the interior and exterior of the vehicle using an optical mirror. Further, the display control means switches the display mode of the display medium from the optical mode to the video mode when the environmental state detected by the environment detection means is an environmental state set to be unsuitable for visual recognition using the optical mirror. .

As a result, even if the display medium is in the optical mode, the optical mode can be switched to the video mode when the environmental conditions are unsuitable for the optical mode, and the display medium can be used by effectively switching between the optical mode and the video mode. A decrease in visibility outside the vehicle can be suppressed.

The electronic mirror device according to claim 2 is the electronic mirror device according to claim 1, wherein the display control means eliminates the environmental state set as being unsuitable for visual recognition using the optical mirror. switching the display mode of the display medium from the video mode to the optical mode, if so.

In the electronic mirror device according to claim 2, when the environmental state detected by the environment detection means is set to be unsuitable for visual recognition using the optical mirror, the display control means changes the display mode of the display medium. switch from video mode to optical mode.

As a result, even if the display medium is in the video mode, the environmental conditions unsuitable for the optical mode can be eliminated, so that the video mode can be switched to the optical mode, and the display can be effectively switched between the optical mode and the video mode. Media can be inhibited from operating in video mode.

According to claim 3, the electronic mirror device according to claim 1 or claim 2, wherein the environment detection means includes indoor environment detection means for detecting an environmental state inside the vehicle, and the display control means and switching the display mode from the image mode to the optical mode when a predetermined environmental state or a predetermined change in the environmental state is detected by the indoor environment detection means in the above.

In the electronic mirror device according to claim 3, the environment detection means includes indoor environment detection means for detecting the environmental state inside the vehicle. The display control means switches the display mode from a video mode in which the interior of the vehicle is not displayed to an optical mode in which the interior of the vehicle can be visually recognized when the indoor environment detection means detects a predetermined environmental state or a predetermined change in the environmental state in the video mode. .

As a result, the display mode of the display medium can be effectively switched, and the occupant who has been viewing the outside of the vehicle through the display medium can view the interior of the vehicle.

As described above, according to the present invention, it is possible to effectively switch between the optical mode and the video mode of the display medium, thereby enabling the passenger to visually recognize the outside and inside of the vehicle.

1 is a schematic configuration diagram of an electronic mirror system 10 according to this embodiment; FIG. 1 is a plan view showing a schematic configuration of a vehicle; FIG. It is a front view of an inner mirror. It is a flow chart showing an outline of mode change processing of an inner mirror. (A) to (D) are flowcharts showing inner mirror mode switching processing using different environment detection means. (A) and (B) are flowcharts showing inner mirror mode switching processing using different indoor environment detection means.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram showing a schematic configuration of a vehicle electronic mirror system 10 as an electronic mirror device according to the present embodiment, and FIG. 2 is a plan view of a vehicle 12 according to the present embodiment. It is shown. In the drawings, the front side of the vehicle is indicated by an arrow FR, the right side in the vehicle width direction is indicated by an arrow HR, and the upward direction is indicated by an arrow UP.

As shown in FIG. 2, the vehicle 12 is provided with a front windshield glass (front glass) 16F on the vehicle front side of the cabin 14, and a rear windshield glass (rear glass) 16R on the vehicle rear side of the cabin 14. It is In the passenger compartment 14, a driver's seat 14D and a passenger's seat 14P on the left side of the driver's seat 14D in the vehicle width direction are arranged as seats for passengers to sit. A row of rear seats 14R is arranged, and the vehicle rear side of the rear seats 14R serves as a luggage compartment 14B (or the second row of rear seats 14R may be used). As such a vehicle 12, a station wagon, a minivan, an SUV (Sport Utility Vehicle), or a 1-box car or a 2-box car can be applied. Also, the vehicle 12 is not limited to this, and various types such as a 3-box car (so-called sedan type) can be applied.

The vehicle 12 is provided with a wiper device 18. When a wiper switch (not shown) is turned on, the wiper device 18 operates a wiper 18A (wiper blade) to wipe the outer surface of the windshield 16F (in front of the vehicle). side) to remove raindrops.

Also, the vehicle 12 according to the present embodiment may be provided with an RSE system (rear seat entertainment system) 20 . The RSE system 20 is intended for a configuration in which a ceiling-suspended monitor 22 is installed on the vehicle front side of the rear seat 14R and at the center in the vehicle width direction. The RSE system 20 displays various information such as video and television images on the monitor 22 .

In the RSE system 20, the monitor 22 is stored in the vehicle ceiling when not in operation, and the monitor 22 is suspended from the ceiling surface at the vehicle front side of the rear seat 14R (between the driver's seat 14D and the passenger's seat 14P) when it is in operation. be done. Accordingly, in the vehicle 12 , the RSE system 20 is operated so that the passenger sitting in the rear seat 14</b>R can visually recognize various information such as images displayed on the monitor 22 .

On the other hand, as shown in FIGS. 1 and 2, the electronic mirror system 10 includes an imaging unit 24 configured as imaging means for imaging the outside of the vehicle, an inner mirror 26 as a display medium, and an imaging unit for the inner mirror 26. A display controller (display ECU) 28 is provided as display control means for controlling the display of the photographed image of 24 .

The imaging unit 24 includes a camera 30 as imaging means for imaging the outside of the vehicle, and the camera 30 uses an imaging device (image sensor) such as a CCD image sensor or a CMOS image sensor. The camera 30 is installed in the vehicle interior 14 on the rear side of the vehicle (on the vehicle interior 14 side of the rear glass 16R) and on the ceiling surface at the center in the vehicle width direction. is imaged. Note that the camera 30 is not limited to the inside of the vehicle compartment 14, and it is sufficient if it can capture an image behind the vehicle 12 (outside the vehicle). may be attached.

As shown in FIG. 2, the inner mirror 26 is installed in the vehicle interior 14 on the front side of the vehicle (inside the vehicle interior 14 of the windshield 16F) and at the upper part of the center in the vehicle width direction. is directed to the rear of the vehicle. As a result, the inner mirror 26 can be visually recognized by the driver without obstructing the driver's field of vision in front of the vehicle when seated in the driver's seat 14D. FIG. 3 shows an outline of the inner mirror 26 in a front view viewed from the rear of the vehicle.

As shown in FIG. 3, the inner mirror 26 has an optical mirror 32 arranged on the display surface, and the optical mirror 32 is a semi-transparent half mirror that can function as a mirror. In addition, the inner mirror 26 is a display (monitor) 34 in which an LCD (Liquid Crystal Display) and a backlight using an LED or the like are integrated on the back side (vehicle front side) of an optical mirror (half mirror) 32. It has

The display 34 has a normally black type LCD, and the optical mirror 32 of the inner mirror 26 functions as an optical mirror when the display 34 is not in operation (image non-display state). In addition, in the display 34, the liquid crystal element of the LCD is polarized according to the electric signal, and the light of the backlight is transmitted. The inner mirror 26 displays an image (video) corresponding to the image data on the display 34 when an electrical signal corresponding to the image data is input to the display 34 .

The inner mirror 26 can be switched between an optical mode as a display mode and a camera mode as a video mode. The inner mirror 26 operates as a camera mode when an image (video) captured by the camera 30 is displayed on the display 34 , and the displayed image can be visually recognized through the optical mirror 32 . In addition, the inner mirror 26 operates in the optical mode by not displaying the image on the display 34, and the reflected image of the optical mirror 32 becomes visible.

As shown in FIG. 1, the display controller 28 includes an image processing section 36, a switching section 38, an environment determination section 40, and a display control section . In the display controller 28 , the camera 30 (imaging section 24 ) is connected to the image processing section 36 , and the display 34 of the inner mirror 26 is connected to the switching section 38 .

The display controller 28 includes a microcomputer in which a CPU, a ROM, a RAM, a nonvolatile memory storage, an input/output interface, etc., are interconnected via a bus so as to enable data communication. are connected (not shown). In the display controller 28, the CPU reads a program for switching the display mode stored in the ROM and storage and executes it while developing it in the RAM, thereby realizing functions according to the program. 38 , functions as an environment determination unit 40 and a display control unit 42 .

Image data (video data) of an image captured by the camera 30 is input to the image processing unit 36 of the display controller 28 . The image processing unit 36 performs required image processing on the image data to display an image (video) corresponding to the input image data on the inner mirror 26 (display 34). At this time, the image processing unit 36 performs image data processing such as viewpoint conversion for matching the captured image with the driver's viewpoint and left/right reversal of the captured image.

The image processing unit 36 performs gradation correction on the image data so that the luminance (brightness) of the image displayed on the display 34 is within a predetermined range. As a result, in the electronic mirror system 10, when the image captured by the camera 30 is displayed on the inner mirror 26 (display 34), if the area behind the vehicle 12 is too bright, the brightness is suppressed and the area behind the vehicle 12 is displayed. Darkness is reduced (brightened) when it is too dark.

The switching unit 38 switches operation/stop of the display 34 of the inner mirror 26 . When operating the display 34 , the switching unit 38 turns on the backlight of the display 34 and outputs the image data image-processed by the image processing unit 36 to the display 34 . As a result, the inner mirror 26 is operated in the camera mode, and the image captured by the camera 30 is displayed.

Further, when stopping the operation of the display 34 , the switching unit 38 turns off the backlight of the display 34 and stops outputting the image data image-processed by the image processing unit 36 to the display 34 . As a result, the inner mirror 26 is operated in the optical mode, and the interior of the vehicle and the rear of the vehicle are reflected on the optical mirror 32 .

In the electronic mirror system 10 according to this embodiment, as an example, it is set so that the operation in the optical mode is prioritized. The display control unit 42 controls the switching unit 38 so that the inner mirror 26 operates in the optical mode in the initial state. Note that the electronic mirror system 10 may be set so that operation in the camera mode is prioritized.

The display control unit 42 also controls the switching unit 38 to switch the inner mirror 26 from the optical mode to the camera mode based on the determination result of the environment determination unit 40 . Furthermore, the display control unit 42 controls the switching unit 38 to switch the inner mirror 26 from the camera mode to the optical mode based on the determination result of the environment determination unit 40 .

Here, the environment determination unit 40 is connected to environment detection means for detecting the environmental state of the visual recognition of the interior and exterior of the vehicle using the optical mirror 32. A room environment detection means is included for detecting the condition. Further, in the environment determination unit 40, a criterion for switching from the optical mode to the camera mode is set according to the environmental state detected by the environment detection means and the vehicle interior environment detection means. As this criterion, a threshold or the like is applied that indicates whether or not the environmental condition is not suitable for visual recognition using the optical mirror 32 . As a reference for the environmental state detected by the vehicle interior environment detection means, the environmental state or the change in the environmental state set by the driver (passenger) to visually recognize the interior of the vehicle is applied.

Environmental conditions include the viewing environment that affects the driver's visibility behind the vehicle using the optical mirrors 32 . The environmental conditions also include environmental conditions that make the driver want to use the optical mirror 32 to view the inside of the vehicle compartment 14 (especially the rear seat 14R).

The brightness of the outside of the vehicle (the rear of the vehicle) reflected on the optical mirror 32 (or the brightness of the front of the vehicle and the brightness of the rear of the vehicle) can be applied to such a viewing environment. An illuminance sensor 44 for detecting brightness (illuminance) in front of the vehicle is connected to the environment determination unit 40 as environment detection means, and a camera 30 for detecting brightness (illuminance) behind the vehicle is connected. It is connected.

As shown in FIG. 3, the illuminance sensor 44 is attached to the housing of the inner mirror 26 facing forward of the vehicle, and the illuminance sensor 44 receives a signal corresponding to the illuminance in front of the vehicle through the windshield 16F. to output Further, as shown in FIG. 1, an image captured by the camera 30 (image data that has not undergone gradation processing by the image processing unit 36) is input to the environment determination unit 40, and the environment determination unit 40 detects the illuminance behind the vehicle from the image captured by the camera 30 .

The environment determination unit 40 determines when the illuminance behind the vehicle is extremely high compared to the illuminance in front of the vehicle (the area behind the vehicle is bright) and when the illuminance behind the vehicle is extremely low compared to the illuminance in front of the vehicle (the area behind the vehicle is dark). ), it is determined that the visibility behind the vehicle using the optical mirror 32 is degraded, and that the camera mode is preferable to the optical mode.

Further, the environmental condition is applied to the weather outside the vehicle, particularly whether it is raining or not. The environment determination unit 40 is connected to a wiper device 18 that operates when it rains as environment detection means. The environment determination unit 40 detects whether it is raining based on whether the wiper device 18 is operating (whether the wiper switch is turned on). It is determined that the rearward visibility is degraded, and that the camera mode is preferable to the optical mode.

Furthermore, the environmental conditions can include conditions inside the vehicle, such as the condition of the passenger in the rear seat 14R and the condition of the luggage compartment 14B. The state in the vehicle interior 14 includes an environmental state in which at least a portion of the rear glass 16R reflected in the optical mirror 32 is blocked, thereby reducing the visibility behind the vehicle. Further, when the RSE system 20 is attached to the vehicle 12, the monitor 22 reduces the rearward visibility of the driver when the RSE system 20 is operated and the monitor 22 is suspended from the ceiling.

From here, the environment determination unit 40 is connected to the RSE system 20 as environment detection means. It is determined that the visibility behind the vehicle to be used is degraded, and that the camera mode is more suitable than the optical mode.

An indoor camera 46 is installed as environment detection means in the vehicle compartment 14 , and the indoor camera 46 is connected to the environment determination section 40 . The indoor camera 46 is attached, for example, to the housing of the inner mirror 26 so as to capture images from the front side to the rear side of the vehicle interior 14 (see FIG. 3).

The environment determination unit 40 determines whether or not an obstruction such as an occupant or an object that affects visibility behind the vehicle appears between the optical mirror 32 and the rear glass 16R from the image captured by the indoor camera 46 or not. Note that the indoor camera 46 is not limited to being attached to the inner mirror 26, and may be positioned so as to capture an image of the rear side of the vehicle interior 14 from the front side of the vehicle.

On the other hand, the environmental conditions can be applied to the movement of the occupant in the passenger compartment 14, the condition of the luggage loaded in the luggage compartment 14B, changes in the status, and the presence or absence of sounds heard in the passenger compartment 14 and changes in the sound. . From here, the environment determination unit 40 uses the indoor camera 46 as an indoor environment detection means. In addition, a microphone 48 as indoor environment detecting means and sound collecting means is connected to the environment determination unit 40, and the microphone 48 emits mainly from the vicinity of the rear seat 14R in the passenger compartment 14, for example. It is installed so as to collect sound.

The environment determination unit 40 preferably visually recognizes the state (appearance) of the rear seat 14R and the luggage compartment 14B from the sound (presence or absence of sound) in the vehicle compartment 14 detected by the microphone 48 and changes in the sound. necessary) or not. In addition, the environment determination unit 40 determines whether it is preferable (whether or not it is necessary to visually recognize) the state (appearance) of the rear seat 14R and the luggage compartment 14B based on the photographed image of the indoor camera 46 and changes in the photographed image. judge.

The display control unit 42 switches between the camera mode and the optical mode of the inner mirror 26 according to the determination by the environment determination unit 40 . The electronic mirror system 10 is provided with a mode switch (not shown), for example, on the periphery of the inner mirror 26 housing. mode can be switched alternately.

Next, the operation of the electronic mirror system 10 will be described as an effect of this embodiment.
The electronic mirror system 10 is activated and starts operating when an ignition switch (not shown) of the vehicle 12 is turned on, and stops operating when the ignition switch is turned off.

An inner mirror 26 is arranged in the vehicle compartment 14 , and in the electronic mirror system 10 , the inner mirror 26 functions as an optical mirror 32 when the ignition switch is turned off and the operation (power supply) is stopped. Further, when the electronic mirror system 10 starts operating, it becomes operable in an optical mode using the optical mirror 32, and a camera mode in which the rear of the vehicle is imaged by the camera 30 and the captured image is displayed on the inner mirror 26. operation becomes possible.

Here, in the electronic mirror system 10, the environmental conditions that affect the visibility inside the vehicle compartment 14 and behind the vehicle are detected using the optical mirrors 32, and the detected environmental conditions are determined to be suitable for visual recognition using the optical mirrors 32. It is determined whether or not it is in the set environmental state, and switching is performed between the optical mode and the camera mode based on the determination result. FIG. 4 is a flowchart showing an outline of the mode switching process executed by the display controller 28. As shown in FIG.

This flow chart is executed in the display controller 28 when the electronic mirror system 10 is activated and begins operation, and the display controller 28 sets the display mode to the optical mode in the first step 100 . When the inner mirror 26 is set to the optical mode, the operation of the display 34 is stopped, the optical mirror 32 functions, and the inside of the passenger compartment 14 and the rear of the vehicle are reflected on the optical mirror 32 through the rear glass 16R and the like. As a result, the driver seated in the driver's seat 14D can visually recognize the inside of the vehicle compartment 14 reflected in the inner mirror 26 and the rear of the vehicle through the rear glass 16R and the like.

On the other hand, in the display controller 28, in step 102, the environment detection means is used to detect the environmental state (visible environment) that affects the visual recognition of the passenger inside and outside the vehicle compartment 14, and in step 104, the optical mode is detected based on the detected environmental state. It is determined whether or not the environmental conditions are set to be suitable for (visual recognition using the optical mirror 32). At this time, in step 104, it is determined that any one of the plurality of environmental conditions is not suitable for visual recognition using the optical mirror 32, so the display controller 28 makes an affirmative determination in step 106 and proceeds to step 108. .

At step 108, the display controller 28 switches the display mode of the inner mirror 26 from optical mode to camera mode. When the inner mirror 26 is switched to the camera mode, the backlight of the display 34 is turned on, and the image data of the image captured by the camera 30 and subjected to image processing in the image processing section 36 is transmitted through the switching section 38. is input to the display 34.

As a result, an image of the rear of the vehicle captured by the camera 30 is displayed on the inner mirror 26, and the driver seated in the driver's seat 14D can view the image of the rear of the vehicle captured by the camera 30 and displayed on the inner mirror 26. Visible.

When switching from the optical mode to the camera mode, the display controller 28 may notify the driver of the switching to the camera mode. Various methods can be applied to the notification to the driver, such as displaying, for example, "Switching to camera mode" on the display 34 . Note that the driver may stop the mode switching from the optical mode to the camera mode (continue the optical mode) by operating the mode switching switch. You can prevent it from being broken. Further, when the mode switching is canceled by the intention of the driver, the display controller 28 interrupts the processing of steps 102 to 108 for a preset time (for example, a set time between several tens of seconds and several minutes). This can prevent the driver from feeling annoyed by frequent display of a message for switching to the camera mode or the like.

On the other hand, when the inner mirror 26 is switched to the camera mode, the display controller 28 detects an environmental condition for returning to the optical mode (switching from the camera mode to the optical mode). At step 110, the display controller 28 uses the environment detection means (including the indoor environment means) to determine environmental conditions that affect the visibility of the occupant inside and outside the vehicle compartment 14, or that the occupant wishes to switch to the optical mode. Detect environmental conditions.

Display controller 28 determines the viewing environment at step 112 . At this time, the display controller 28 determines whether or not the environmental condition determined to be unsuitable for the optical mode has been resolved, and also determines whether or not the environmental condition set to switch to the optical mode has been detected. do.

If it is determined in step 112 that the environmental conditions for which the optical mode is not suitable (all environmental conditions) have been resolved, or if an environmental condition setting the optical mode to switch has been detected, display controller 28 performs step An affirmative determination is made at 114 and the process proceeds to step 116 . In this step 116, display controller 28 switches the display mode from camera mode to optical mode.

When it is determined that an environmental condition for switching to the optical mode has been detected, the display controller 28 switches to the optical mode for a predetermined period of time, and proceeds to step 110 after the predetermined period of time has elapsed. , the process may proceed to step 116 when the environmental conditions (all environmental conditions) unsuitable for the optical mode are eliminated.

Next, with reference to FIGS. 5(A) to 5(D), determination for switching from the optical mode to the camera mode in the electronic mirror system 10 (steps 102 to 106 in FIG. 4), and from the camera mode The determination for switching to the optical mode (steps 110 to 114 in FIG. 4) will be specifically described. Note that in each of FIGS. 5A to 5D, step 100 of FIG. 4 is omitted and execution is started in the optical mode. For the processing corresponding to FIG. 4, the step numbers in FIG. 4 are also written in parentheses.

FIG. 5A shows the mode switching process according to the detected illuminance (illuminance environment) by detecting the illuminance in front of and behind the vehicle as the environmental state. In step 120, the display controller 28 detects the illuminance BRf on the front and rear sides of the vehicle and the illuminance BRr on the rear side of the vehicle. An illuminance sensor 44 is used to detect the illuminance BRf on the front side of the vehicle. An image captured by the camera 30 is used to detect the illuminance BRr on the rear side of the vehicle, and the illuminance BRr is calculated from the brightness of the captured image. The illuminance BRr may be obtained from the brightness (average brightness) of the area displayed on the inner mirror 26 (display 34), although the average brightness of the entire photographed image of the camera 30 may be applied. is preferred.

Further, in the display controller 28, a threshold value for the ratio of the illumination intensity BRr to the illumination intensity BRf (BRr/BRf) (which may be a threshold value for the ratio of the illumination intensity BRf to the illumination intensity BRr (BRf/BRr)) BRth is set as a reference value. is set. The threshold value BRth is the threshold value BRLth when the vehicle rear side is darker than the vehicle front side (illuminance BRr is low), and the threshold value when the vehicle rear side is brighter than the vehicle front side (illuminance BRr is high). BRHth is set. The threshold value BRLth is set based on the illuminances BRf and BRr at which the rear side of the vehicle is too dark and difficult to see when the optical mirror 32 is used. It is set based on illuminances BRf and BRr at which the rear side of the vehicle is too bright and hard to see.

In the next step 122, the display controller 28 determines the illuminance environment to determine whether the illuminance in front of and behind the vehicle is not suitable for the optical mode. In determining the illuminance environment, the display controller 28 determines whether the ratio BRr/BRf of the illuminance BRr to the illuminance BRf is equal to or greater than the threshold value BRHth in the optical mode, or determines whether the ratio BRr/BRf of the illuminance BRr to the illuminance BRf exceeds the threshold BRLth. Determine whether or not:

Here, for example, the front side of the vehicle becomes darker than the rear side of the vehicle (the rear side of the vehicle becomes brighter than the front side of the vehicle) when the vehicle 12 reaches the entrance of a tunnel, the entrance of an indoor parking lot (or an underground parking lot), or the like. , the ratio BRr/BRf is greater than or equal to the threshold value BRHth (BRr/BRf≧BRHth).

When the ratio BRr/BRf becomes equal to or greater than the threshold value BRHth, the display controller 28 makes an affirmative determination in step 122, proceeds to step 108, and switches the inner mirror 26 from the optical mode to the camera mode. In the camera mode, an image whose luminance is adjusted by the image processing unit 36 is displayed on the display 34 on the inner mirror 26 . As a result, it is possible to prevent the image displayed on the inner mirror 26 from becoming too bright, and it is possible to prevent the passenger from feeling that the rear of the vehicle is too bright and it is difficult to see.

Further, for example, the vehicle 12 is at the exit of a tunnel, the exit of an indoor parking lot (or an underground parking lot), etc., and the front side of the vehicle becomes brighter than the rear side of the vehicle (the rear side of the vehicle becomes darker than the front side of the vehicle). BRr/BRf becomes equal to or less than threshold value BRLth (BRr/BRf≤BRLth).

When the ratio BRr/BRf becomes equal to or less than the threshold value BRLth, the display controller 28 makes an affirmative determination in step 122, proceeds to step 108, and switches the inner mirror 26 from the optical mode to the camera mode. As a result, it is possible to prevent the image displayed on the inner mirror 26 from becoming too dark, and it is possible to prevent the rear of the vehicle from becoming too dark and making it difficult for the occupant to see.

When the inner mirror 26 is switched to the camera mode, the display controller 28 proceeds to step 124 and detects the illuminance BRf on the front and rear sides of the vehicle and the illuminance BRr on the rear side of the vehicle. In the next step 126, it is determined whether or not the illuminance environment has been resolved. That is, the display controller 28 determines whether the ratio BRr/BRf of the illumination intensity BRr to the illumination intensity BRf is less than the threshold value BRHth, and whether the ratio BRr/BRf of the illumination intensity BRr to the illumination intensity BRf exceeds the threshold value BRLth. judge.

Here, for example, the vehicle 12 passes through the entrance of a tunnel, the entrance of an indoor parking lot (or an underground parking lot), etc., or the exit of a tunnel, an exit of an indoor parking lot (or an underground parking lot), etc. As a result, the difference between the illuminance BRf and the illuminance BRr becomes smaller. As a result, when the ratio BRr/BRf of the illuminance BRr to the illuminance BRf becomes less than the threshold value BRHth and the ratio BRr/BRf of the illuminance BRr to the illuminance BRf exceeds the threshold BRLth, the display controller 28 in step 126 An affirmative determination is made and the process proceeds to step 116 .

At step 116, the display controller 28 switches the inner mirror 26 from the camera mode to the optical mode. At this time, the display controller 28 waits for a predetermined time (for example, a preset time from several tens of seconds to several minutes) after the illuminance in front of and behind the vehicle is generated (after switching from the optical mode to the camera mode). to optical mode. As a result, it is possible to prevent the occupant from feeling annoyed by frequent switching of the display mode of the inner mirror 26 .

In this example, the entrance/exit of a tunnel or the entrance/exit of an indoor parking lot was explained, but the optical mode can also be used when the headlights of a vehicle behind you feel dazzling at night or when you feel the headlights of an oncoming vehicle are dazzling. to switch to camera mode. As a result, it is possible to suppress the feeling that the visibility of the inner mirror 26 is lowered or lowered by the headlights of the vehicle behind or the headlights of the oncoming vehicle.

FIG. 5B shows mode switching processing in which a rainy (weather) environment is applied as the environmental condition, and in this mode switching processing, the wiper device 18 is applied as environment detection means. As the environment detection means, various sensors capable of detecting rainfall, such as a raindrop sensor, can be used in place of the wiper device 18 .

The display controller 28 detects the operating state of the wiper device 18 at step 130 and determines whether the wiper device 18 is operating at step 132 . When it starts to rain, the driver operates the wiper switch to operate the wiper device 18 in order to wipe off the raindrops adhering to the windshield 16F. Further, the driver stops the operation of the wiper device 18 when the rain stops and there is no need to wipe the raindrops. It should be noted that the operation of the wiper device 18 does not include the operation for cleaning the windshield 16F (spouting washer fluid).

When the display controller 28 detects that the wiper device 18 has been activated, the display controller 28 makes an affirmative determination in step 132, proceeds to step 108, and switches the display mode of the inner mirror 26 from the optical mode to the camera mode. The camera 30 is attached at a position closer to the rear glass 16R (near the rear glass 16R) than the inner mirror 26 (optical mirror 32). Therefore, in the inner mirror 26, the visibility behind the vehicle is improved in the camera mode rather than in the optical mode. As a result, it is possible to prevent raindrops adhering to the rear glass 16R from lowering the driver's visibility.

When the inner mirror 26 is switched to the camera mode, the display controller 28 proceeds to step 146 to detect the operating state of the wiper device 18. In step 136, it is determined whether or not the wiper device 18 is stopped.

When the rain stops and the wiper switch is turned off to stop the wiper device 18, the display controller 28 makes an affirmative determination in step 136, proceeds to step 116, and switches the display mode to the optical mode. As a result, the display mode of the inner mirror 26 is switched from the camera mode to the optical mode. At this time, the display controller 28 switches to the optical mode after a predetermined time (for example, a time set in advance in the range of several tens of seconds to several minutes) has elapsed since the wiper device 18 was operated. good too. As a result, for example, when the wiper device 18 is repeatedly operated/stopped in a light rain, the display mode of the inner mirror 26 is frequently switched, thereby preventing the occupant from feeling annoyed. can.

On the other hand, in the RSE system 20, the monitor 22 affects the visibility using the optical mirror 32, and hinders visibility behind the vehicle. FIG. 5C shows an outline of the mode switching process according to the operation of the RSE system 20 as an environmental state that hinders visibility (environment that hinders visibility).

In the mode switching process shown in FIG. 5C, the display controller 28 detects the operating state of the RSE system 20 (whether or not the monitor 22 is projected) in step 140, and determines whether the RSE system 20 is operating in step 142. judge. When the RSE system 20 is operated and the stowed monitor 22 is projected, the display controller 28 makes an affirmative determination in step 142, proceeds to step 108, and switches the display mode from the optical mode to the camera mode. As a result, the inner mirror 26 is switched from the optical mode to the camera mode, and it is possible to prevent the monitor 22 from obstructing the driver's rear view (causing a hindrance).

When the display controller 28 switches the display mode to the camera mode, the RSE system 20 detects the operating state (whether or not the monitor 22 is projected) in step 144, and determines whether the RSE system 20 is stopped in step 146. do. When the operation of the RSE system 20 is stopped and the monitor 22 is retracted, the display controller 28 makes an affirmative determination at step 142 and proceeds to step 116 . As a result, the display mode of the inner mirror 26 is switched from the camera mode to the optical mode, and the driver can view the inside of the vehicle compartment 14 reflected on the optical mirror 32 and the rear of the vehicle through the rear glass 16R.

Also, in the vehicle 12, the visibility using the optical mirror 32 may be affected by a passenger seated in the center of the rear seat 14R (the center in the vehicle width direction) or a large luggage placed in the luggage compartment 14B. FIG. 5(D) shows a mode switching process according to the detected visibility hindering environment detected in the vehicle interior 14 using the indoor camera 46 as the environment detection means.

In the mode switching process shown in FIG. 5(D), the display controller 28 images the inside of the vehicle compartment 14 with the indoor camera 46 in step 150, and an obstacle affecting visibility using the optical mirror 32 is detected in step 152. determine whether or not In order to determine whether or not an obstacle has been detected, the interior camera 46 is in a state (initial state) in which no luggage is loaded in the luggage compartment 14B (there is no luggage) and no occupant is seated in the rear seat 14R. A captured image is acquired in advance as a reference image. To determine whether or not an obstacle has been detected, the reference image is compared with the image captured by the indoor camera 46, and the visibility of the rear glass 16R is determined.

Here, on the image captured by the indoor camera 46, an image that is not included in the reference image and that overlaps the rear glass 16R is set as the target image, and the ratio of the area of the target image to the area of the rear glass 16R is set in advance. The target image is defined as an obstruction image when the ratio is greater than or equal to (for example, 1/4 or more) or when the target image is the central portion (vehicle width direction central portion) of the rear glass 16R.

the display controller 28; When the image of the obstacle is detected from the photographed image of the indoor camera 46, an affirmative determination is made in step 152, the process proceeds to step 108, and the inner mirror 26 is switched to the camera mode. As a result, the inner mirror 26 is switched from the optical mode to the camera mode, so that the driver's field of vision is not obstructed by the passenger seated in the center of the rear seat 14R or the cargo in the luggage compartment 14B. You can see behind the vehicle.

When the display controller 28 is switched to the camera mode, in step 154, the interior camera 46 images the inside of the vehicle interior 14 to detect obstacles. or not). At this time, if the image of the object is no longer detected from the photographed image of the indoor camera 46, an affirmative determination is made in step 156, the process proceeds to step 116, and the inner mirror 26 is switched to the optical mode.

On the other hand, the driver cannot see the inside of the vehicle compartment 14 in the camera mode of the inner mirror 26, but can see the inside of the vehicle compartment 14 (the rear seat 14R and the luggage compartment 14B) in the optical mode. Further, when the inner mirror 26 is in the camera mode and the environmental conditions inside the vehicle compartment 14 change, the driver switches the inner mirror 26 to the optical mode to view the state of the rear seat 14R in the vehicle compartment 14. Sometimes I want to check.

From here, the display controller 28 detects the environmental conditions and changes in the environmental conditions in the vehicle interior 14 using the vehicle interior environment detection means in the camera mode of the inner mirror 26 . Further, if the detected environmental conditions and changes in the environmental conditions inside the vehicle compartment 14 are preset environmental conditions and changes in the environmental conditions, the display controller 28 switches the inner mirror 26 from the camera mode to the optical mode. switch.

Next, FIGS. 6A and 6B are flow charts showing an outline of the switching of the display mode of the inner mirror 26 using the indoor environment detection means (mode switching processing from camera mode to optical mode). It is shown. 6A and 6B are executed when the inner mirror 26 is switched to the camera mode (step 108 in FIG. 4 is executed). In addition, in FIGS. 6A and 6B, the step numbers of FIG. 4 are also written in parentheses for the processing corresponding to FIG.

FIG. 6A shows mode switching processing using the indoor camera 46 as indoor environment detection means. In the mode switching process shown in FIG. 6A, in step 160, the display controller 28 captures an image of the inside of the vehicle compartment 14 using the indoor camera 46, and in step 162, the occupant in the rear seat 14R and the luggage in the luggage compartment 14B are detected from the captured image. is specified, and it is determined whether or not the specified determination target has a predetermined movement. The determination target can be specified by comparing a reference image of the inside of the passenger compartment 14 acquired in advance with an image captured by the indoor camera 46, or the like. In addition, the motion to be determined can be specified by comparing with the previously captured image.

Here, when the display controller 28 detects a motion that exceeds a preset motion (predetermined motion) for the determination target (for example, a motion set to require visual recognition or a motion set to be abnormal), in step 162 An affirmative determination is made and the process proceeds to step 164 . The display controller 28 proceeds to step 166 to switch the display mode of the inner mirror 26 from camera mode to optical mode.

As a result, the inner mirror 26 is switched to the optical mode, so that the inside of the vehicle interior 14 is reflected on the optical mirror 32, and the driver can use the inner mirror 26 (optical mirror 32) to assist an occupant (for example, children, etc.) and the state of luggage in the luggage compartment 14B. In other words, the driver can visually confirm whether or not the luggage in the luggage compartment 14B has collapsed and the condition of the passenger in the rear seat 14R without operating the mode changeover switch or the like (automatically).

FIG. 6B shows mode switching processing using the microphone 48 as the indoor environment detection means. In the mode switching process shown in FIG. 6B, the display controller 28 detects the sound inside the vehicle compartment 14 with the microphone 48 in step 170, and determines whether or not a predetermined sound or a change in sound is detected in step 172. do.

The predetermined sound is a sound that is set in advance, and is set to be loud enough for the driver to visually recognize the rear seat 14R (or to the rear seat 14R side as viewed from the driver) or to be visually recognized. You can apply the sound of the specified loudness, quality, etc. Further, the predetermined sound change is a preset sound change. It includes cases where irregularly changing sounds are interrupted or changed to regular changes, and cases where sounds that had not existed before suddenly appear. Such sounds and changes in sounds can be applied to sounds and changes in sounds that make the driver want to visually recognize the rear seat 14R and the luggage compartment 14B.

When a preset sound (predetermined sound) or a preset sound change (predetermined sound change) is detected, the display controller 28 makes an affirmative determination in step 172 and proceeds to step 166. Then, the display mode of the inner mirror 26 is switched from the camera mode to the optical mode.

As a result, the interior mirror 26 (optical mirror 32) reflects the inside of the vehicle interior 14, and the driver can use the interior mirror 26 (optical mirror 32) to see the state of the passenger seated in the rear seat 14R (for example, a sleeping child). The state of the child (such as when the child has woken up, the child has fallen asleep, etc.) and the state of the luggage in the luggage compartment 14B can be visually recognized. At this time, the driver can visually recognize the inside of the vehicle interior 14 without manually switching the display mode of the inner mirror 26 .

Note that the display controller 28 switches from the optical mode to the camera after a predetermined time (for example, several tens of seconds to several minutes) has passed after switching to the optical mode in step 166 (FIGS. 6A and 6B). mode and return to step 108 in Fig. 4. This can prevent the driver from continuing to have trouble seeing behind the vehicle.

Thus, the electronic mirror system 10 can effectively switch the display mode of the inner mirror 26 . At this time, the electronic mirror system detects the environmental conditions inside and outside the vehicle compartment 14 when the optical mirror 32 is used, and the detected environmental condition is set to be unsuitable for visual recognition using the optical mirror 32. , the display mode of the inner mirror 26 is switched from the optical mode to the image mode. As a result, even when the display mode of the inner mirror 26 is the optical mode, it is possible to suppress deterioration in visibility of the outside of the vehicle for the driver using the inner mirror 26 .

Further, in the electronic mirror system 10, when it is determined that the environmental state detected by the environmental detection means has been set to be unsuitable for visual recognition using the optical mirror 32, the display mode of the inner mirror 26 is changed. Switch from camera mode to optical mode. As a result, it is possible to prevent the inner mirror 26 from continuing to operate in the camera mode, thereby preventing deterioration of the display 34 used for the inner mirror 26 .

Further, in the electronic mirror system 10, when it is determined that the environmental state inside the vehicle detected by the indoor environment detection means such as the indoor camera 46 and the microphone 48 has undergone a predetermined environmental state or a predetermined change in the environmental state, the inner Switch the display mode of the mirror 26 to the optical mode. As a result, the driver can visually recognize the interior of the vehicle interior 14 reflected on the optical mirror 32, and is prevented from losing concentration on the driving operation due to the environmental conditions and changes in the environmental conditions within the vehicle interior 14. can.

The program for switching the display mode executed in the display controller 28 of the electronic mirror system 10 in this embodiment may be installed in the ROM or storage of the display controller 28 in advance. A program for switching the display mode is recorded in a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), and a USB (Universal Serial Bus) memory. It may be provided to the electronic mirror system 10 in the form of an external device, or may be downloaded from an external device to the display controller 28 via a network.

10 electronic mirror system (electronic mirror device)
18 wiper device (environment detection means)
20 RES system (environment detection means)
26 inner mirror (display medium)
28 display controller (display control means)
30 camera (imaging means, environment detection means)
32 optical mirror 34 display 38 switching unit 40 environment determination unit 42 display control unit 44 illuminance sensor (environment detection means)
46 indoor camera (environment detection means, indoor environment detection means)
48 microphone (indoor environment detection means)

Claims (3)

The display mode is an optical mode in which the outside of the vehicle is displayed from the inside of the vehicle by optical reflection on an optical mirror, and a video mode in which the outside of the vehicle reflected on the optical mirror is displayed on the display as an image captured by an imaging means. and a display medium that can be switched between
environment detection means for detecting environmental conditions for visual recognition of the interior and exterior of the vehicle using the optical mirror;
The display mode of the display medium is switched from the optical mode to the video mode when the environmental state detected by the environment detection means is set to be unsuitable for visual recognition using the optical mirror. display control means;
electronic mirror device including The display control means changes the display mode of the display medium to the display mode when the environmental state detected by the environment detection means is set to be unsuitable for visual recognition using the optical mirror. 2. The electronic mirror device of claim 1, comprising switching from a video mode to said optical mode. The environment detection means includes indoor environment detection means for detecting an environmental state inside the vehicle,
wherein the display control means switches the display mode from the video mode to the optical mode when a predetermined environmental state or a predetermined change in the environmental state is detected by the indoor environment detection means in the video mode. The electronic mirror device according to claim 1 or 2.

Images