JP2020045019A - Display device for vehicle - Google Patents

Abstract

To provide a display device for a vehicle, which enables the grasp of contents of a video picture during the time of looking aside from the video picture, even when a driver looks aside from the video picture during viewing due to driving operations and the like.SOLUTION: A head-up display device 1 according to the present invention comprises: a display part 6 for displaying a video picture to a driver in a vehicle; and a control part 8 which determines whether or not the driver visually recognizes the video picture, when the display part 6 displays the video picture, and which reproduces an auxiliary voice associated with the video picture, when determining that the driver does not visually recognize the video picture. Additionally, the control part 8 determines whether or not the driver visually recognizes the video picture, on the basis of the driver's line of sight, a direction of his/her face or his/her posture.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a vehicle display device that is provided in a vehicle and displays an image to a driver.

  In a vehicle, in general, a display device installed on an instrument panel or an actual scene (a scene in front of the vehicle) that transmits through a reflective translucent member such as a front windshield or a combiner of the vehicle is reflected on the reflective translucent member. A display device such as a head-up display device or the like that generates and displays a virtual image using the displayed display light allows various information related to the vehicle, route information of a navigation system, image information behind the vehicle captured by a camera, and the like to be visually recognized by a driver. Provided to

  Patent Document 1 discloses that entertainment information (information necessary for indicating the operation details when operating an entertainment-related in-vehicle device) that is not necessarily required for a driver is displayed on a display device (an in-vehicle display). Is disclosed. In the invention described in the patent document, the display / non-display of the entertainment information is controlled in accordance with the situation so that the attention of the driver who is driving in a high risk state is not lost.

JP 2012-81907 A

  By the way, when the driver does not need to concentrate on driving at all times due to the development of the automatic driving technology, the driver can also entertain the contents such as entertainment images and electronic books displayed on the display device (hereinafter referred to as vehicle driving). Unrelated information is referred to as “entertainment information.” This “entertainment information” is not limited to information necessary for indicating the operation content of the vehicle-mounted device, such as “entertainment information” described in Patent Document 1.) It becomes possible to enjoy while driving.

  On the other hand, even during automatic driving, depending on the level of automatic driving, or the driver's intention, etc., the driver performs some driving operation, or from the video displayed on the entertainment information or other display device. The driver may be distracted, during which time the driver cannot grasp the content of the video. In particular, if the video that the driver is watching is an entertainment video, and if it fails to grasp the important part in the content and story, even if the driver can enjoy the video while driving with automatic driving, The problem is that the enjoyment is diminished.

  The present invention has been made in view of the above circumstances, and provides a vehicular display device capable of grasping the contents of a video during a driving operation or the like even if the driver turns his / her eyes away from the video being viewed. The challenge is to do.

  In order to solve the above-mentioned problems, a display device for a vehicle according to the present invention includes a display unit that displays an image to a driver in a vehicle, and when the image is displayed by the display unit, the driver displays the image. Determining means for determining whether or not the driver is visually recognizing, and auxiliary sound reproducing means for reproducing auxiliary sound related to the image when the determining means determines that the driver is not visually recognizing the image. It is characterized by the following.

  The determination means determines whether or not the driver is visually recognizing the image by detecting the driver's line of sight, face direction or posture, or detection of a turn signal operation, a shift operation, or an operation of a navigation system of the vehicle. You may decide.

  Further, the auxiliary sound reproducing means, when the determination means determines that the driver is not visually recognizing the video, movement of a person or other creature or character in the video, or a change in the scene or scenery. At some point, the auxiliary sound may be reproduced.

  ADVANTAGE OF THE INVENTION According to the display apparatus for vehicles which concerns on this invention, even if a driver | operator turns his / her eyes away from the video being watched by driving operation etc., the content of the video | video in the meantime can be grasped.

It is an explanatory view showing a vehicle provided with a head-up display device according to an embodiment of the present invention. FIG. 2 is an explanatory diagram illustrating a configuration of a head-up display device in FIG. 1. 2 is a flowchart illustrating control by a control unit of the head-up display device in FIG. 1. FIG. 2 is an explanatory diagram illustrating an example of an image displayed on the head-up display device in FIG. 1.

  An embodiment for carrying out the present invention will be described with reference to the drawings.

  As shown in FIG. 1, a head-up display device (HUD) 1 according to the present embodiment is provided inside a dashboard 4 located below a front windshield 3 of a vehicle 2. The HUD 1 projects the display light L on a part of the front windshield 3, generates a virtual image with the display light L reflected on the front windshield 3, and transmits the virtual image to the driver D of the vehicle 2 through the front windshield 3. The virtual image is made visible on the real scene.

  As shown in FIG. 2, the HUD 1 includes a display unit (display unit) 6 and a reflection mirror 7 provided inside a case 5 having a light transmitting unit 5 a formed therein, and a control unit 8 that performs display control of the display unit 6. And a visual information acquisition unit 9, and a speaker 10 is connected to the control unit 8.

  An image signal of display information displayed by the HUD 1 is input to the control unit 8. As the display information, various information on the vehicle 2 (information on speed, remaining fuel, shift position, driving mode, warning, etc.), route information of a navigation system, a camera or other sensors, or obtained by vehicle-to-vehicle communication or road-to-vehicle communication Related to the driving of the vehicle 2 such as information about the surroundings of the vehicle 2, and a vehicle 2 such as a television image obtained by receiving a radio wave from a broadcasting station, a downloaded image from a cloud, and an image recorded on a recording medium such as a DVD. It is assumed that there is entertainment information unrelated to the driving of the user. Here, it is assumed that an image signal of an entertainment video (entertainment video), which is a type of entertainment information, is input to the control unit 8. The image signal input to the control unit 8 is output to the display unit 6.

  The display unit 6 includes a projection unit 6a including a projector using a reflective display device such as DMD or LCoS, and a screen 6b that receives the projection light from the projection unit 6a and emits the light toward the reflection mirror 7, When an image signal from the control unit 8 is input to the projection unit 6a, display light L for entertainment video is emitted from the screen 6b.

  The display light L from the display unit 6 is reflected by the concave reflecting mirror 7, passes through the light transmitting unit 5 a, and is projected on the front windshield 3. The display light L projected on the front windshield 3 is reflected on the driver D side to generate a virtual image, and displays an entertainment image to the driver D.

  The projection unit 6a of the display unit 6 may be configured by a combination of LED illumination and TFT liquid crystal, and the reflecting mirror 7 is rotated by a driving mechanism (not shown) to thereby generate the display light L. The projection position on the front windshield 3 may be changeable.

  The visibility information acquisition unit 9 includes a camera 11 for imaging the interior of the vehicle 2, a pressure sensor 12 built in a driver's seat, a turn signal operation detection unit 13 for detecting an operation of a turn signal lever, and a shift operation for detecting an operation of a shift lever. The detection unit 14 is connected to the navigation operation detection unit 15 that detects the operation of the navigation system, and is connected to the driver's D gaze and face direction detected by the camera 11 and the driver D's body detected by the pressure sensor 12. Change in the posture (change in the center of gravity), the operation of the turn signal lever detected by the turn signal operation detection unit 13, the operation of the shift lever detected by the shift operation detection unit 14, and the operation of the navigation system detected by the navigation operation detection unit 15 Get information.

  The control unit 8 of the HUD 1 outputs an image signal to the display unit 6 to display an entertainment image on the front windshield 3 as shown in FIG. 3 (Step 1 (described as “S.1” in FIG. 3. It is determined whether or not the driver D is visually recognizing the entertainment image (step 2) Specifically, (1) the line of sight of the driver D and the direction of the face detected by the camera 11; Does not face forward, or (2) it is estimated that the driver D's line of sight does not face forward due to a change in the posture of the driver D detected by the pressure sensor 12, or (3) the turn signal operation is detected. It is inferred that the driver D pays attention to the lane change or the left / right turn by the operation of the turn signal lever detected by the section 13 or (4) the driver operates by the operation of the shift lever detected by the shift operation detection section 14 D pays attention to retreat The driver D is inferred that he / she is paying attention to the navigation system due to the operation of the navigation system detected by the navigation operation detection unit 15. Determines that the driver D is not visually recognizing the entertainment image by the driver D. Alternatively, the controller 8 determines that the driver D is not recognizing the entertainment image when a plurality of conditions (1) to (5) are satisfied. May not be visually recognized.

  When the control unit 8 determines that the driver D is not visually recognizing the entertainment video, the control unit 8 generates and reproduces an auxiliary sound related to the entertainment video, and transmits the content of the entertainment video to the driver D through the speaker 10 (step 3). The auxiliary sound is generated by the control unit 8 analyzing the depiction of the video by image processing and converting the analyzed depiction into text, so that the driver D can understand the content of the video where / who / It is desirable to explain the scene including information such as what is being done. For example, as shown in FIG. 4, when the video V in which the woman L sits on the veranda 16 and looks at the fireworks 18 rising to the night sky under the wind chimes 17 flows, the control unit 8 determines that “a woman is watching fireworks on the veranda. Is generated, and this is reproduced on the speaker 10 as audio.

  The auxiliary sound does not necessarily need to be generated by image processing. For example, when there is a secondary sound in a television image or when there is sound for a visually impaired person, these may be used. If there is a subtitle in the video recorded in the, the control unit 8 may read it out.

  In addition, while the driver D is not visually recognizing the entertainment image, the assisting voice has a change in facial expression, movement, gesture, or the like of a character or other creature or character, or a scene (scene) in the image. There is a change in time and place, the scenery (scenery, scenery) in the video has movement, or the text information in the video has a movement that cannot be grasped without visual recognition. It may be reproduced only when the driver D performs, for example, that the wind chime 17 is swaying due to the wind in the image V if the driver D can recognize it by hearing even if the driver D does not visually recognize the image. The auxiliary sound need not be reproduced.

  The HUD 1 according to the present embodiment determines a display unit 6 that displays an image to the driver D, and determines whether the driver D is viewing the image when the image is displayed on the display unit 6. When the driver D determines that the video is not visually recognized, the control unit 8 reproduces an auxiliary sound related to the video. , The contents of the video during that time can be grasped audibly by the auxiliary sound.

  The determination by the control unit 8 as to whether or not the driver D is visually recognizing the image is based on detection of the driver's D's line of sight, face direction or posture, or the blinker operation, shift operation, or operation of the navigation system of the vehicle 2. Since this is performed, it is effectively suppressed that the driver D fails to grasp the contents of the image without providing the auxiliary sound.

  Further, while the driver D is not visually recognizing the image, the control unit 8 performs a motion of a person or other living thing or character, changes a scene or a scene, or visually recognizes text information or the like in the image. By reproducing the auxiliary sound when there is a change in an object that cannot be grasped unless otherwise, it is possible to prevent the auxiliary sound provided to the driver D from becoming excessive, and not only the driver D but also the vehicle It is possible to prevent a situation in which the second passenger feels annoying the auxiliary sound.

  As mentioned above, although the form for carrying out the present invention has been illustrated, the embodiment of the present invention is not limited to the above, and may be appropriately changed without departing from the spirit of the invention.

  For example, in the above-described embodiment, the front windshield 3 is used as the reflective and transmissive member of the HUD 1. However, a combiner may be used, and the display device is not a HUD but a display device provided on an instrument panel. It may be.

  Further, when other high-priority audio information, such as an alarm for driving, is sounding, the control unit 8 sounds the auxiliary audio at a volume lower than the audio, and the reproduction of the auxiliary audio is prioritized. You may make it not interfere with listening to high-level audio | voice information.

1 Head-up display device (vehicle display device)
2 Vehicle 6 display unit (display means)
8 control part (judgment means, auxiliary sound reproduction means)
9 Viewing information acquisition unit 10 Speaker D Driver V Video

Claims (3)

Display means for displaying an image to a driver in the vehicle;
When an image is displayed by the display unit, a determination unit that determines whether the driver is visually recognizing the image,
A display device for a vehicle, comprising: auxiliary sound reproducing means for reproducing auxiliary sound relating to the video when the determining means determines that the driver does not visually recognize the video.   The determination means determines whether or not the driver is visually recognizing the image by detecting the driver's line of sight, face direction or posture, or detection of a turn signal operation, a shift operation, or an operation of a navigation system of the vehicle. The display device for a vehicle according to claim 1, wherein the determination is performed.   The auxiliary sound reproducing means is provided when the determining means determines that the driver is not visually recognizing the video, and when the video has a motion of a person or other creature or character, or has a change in a scene or scenery. 3. The vehicle display device according to claim 1, wherein the auxiliary sound is reproduced.

Images