JP2018103646A - Vehicle information display device and vehicle information display program - Google Patents

Abstract

When displaying feedback information, which is information in response to a driver's gesture, with a head-up display, the driver's forward view is not obstructed. A control circuit performs a display suppression process by displaying a gesture trajectory when the vehicle is stopped and erasing the gesture trajectory while the vehicle is running. Thereby, the visibility of a gesture locus | trajectory can be improved, considering safety. Also, the driver can refrain from gesturing input when the vehicle is running, and can concentrate on driving. [Selection] Figure 1

Description

  The present invention relates to a vehicle information display device and a vehicle information display program.

  It is known that when a driver instructs a vehicle-mounted device by drawing a gesture using a part of the body, it is easier to input when there is various feedback than when there is no feedback. For example, as in Patent Document 1, the feedback is typically a gesture trajectory. Thereby, the user can recognize whether the gesture which he envisioned can be drawn correctly. Alternatively, even when a gesture is erroneously recognized or failed, the reason can be estimated, and the gesture input after the next time can be corrected.

JP-A-6-149467 Japanese Patent No. 2999335 JP 2004-303207 A Japanese Patent No. 5601405 JP 2014-67388 A JP 2002-149304 A JP 2002-259046 A

  In addition to the gesture trajectory, the feedback displays a gesture figure estimated at the current input time (see Patent Document 2 or Patent Document 3), and displays the progress of gesture input (see Patent Document 4). ), Those that display body parts at the time of gesture input as icons (see Patent Document 5), and those that display trajectories or the like with LEDs (see Patent Document 6).

  On the other hand, in Patent Document 7, feedback is displayed on a display of a wearable computer, but when applied to a vehicle, it is conceivable that the feedback of a gesture is displayed by a head-up display.

  However, when feedback information corresponding to a gesture is displayed in front of the eyes that are in front of the driver while traveling, the driver's front view is obstructed by the feedback information.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a vehicle that does not obstruct the driver's forward view when feedback information, which is information in response to the driver's gesture, is displayed on the head-up display. An object information display apparatus and a vehicle information display program are provided.

  According to the first aspect of the present invention, when the driver makes a gesture to instruct the vehicle information display device (1), the gesture detection unit (2a) detects the gesture input, and the recognition unit (2b) performs the gesture input. Since it recognizes, the information generation part (2c) produces | generates the feedback information which is the information according to gesture input. And a display suppression part (2d) performs the display suppression process which displays feedback information on a head-up display (10) in the aspect which does not prevent a driver | operator's front view. Thereby, since the driver's front view is not hindered by the feedback information, the feedback information can also be confirmed while confirming the traffic condition ahead.

Functional block diagram showing the configuration of the navigation device in the first embodiment Schematic diagram showing the configuration of the head-up display Perspective view around the instrument panel Front view of steering wheel showing fingertips Diagram showing an example of gesture input Front view of the steering wheel showing the display state of the gesture trajectory in the retreat area Flow chart showing operation of control circuit The figure which shows the display state of the gesture locus | trajectory to the front area | region in 2nd Embodiment. The figure which shows the non-display state of a gesture locus Flow chart showing operation of control circuit The figure which shows the display state of the gesture locus | trajectory to the front area | region in 4th Embodiment. Flow chart showing operation of control circuit The figure which shows the display state to the evacuation area | region of the gesture locus | trajectory in 5th Embodiment. Flow chart showing operation of control circuit The figure which shows the display of the gesture locus | trajectory in 6th Embodiment (the 1) The figure which shows the display of the gesture locus (the 2) A diagram showing the display of the gesture trajectory (Part 3) The figure which shows the display state to the front area | region in the command in 7th Embodiment Figure showing the display status of commands in the save area Flow chart showing operation of control circuit The figure which shows the error display in 8th Embodiment in the display state to a front area | region Figure showing the error display in the save area display state Flow chart showing operation of control circuit

(First embodiment)
Embodiments in which the present invention is applied to a vehicle navigation device will be described below. First, a first embodiment will be described with reference to FIGS.

  A navigation device 1 (corresponding to a vehicle information display device) shown in FIG. 1 includes a control circuit 2, a forward monitoring device 3, a GPS receiver 4, a distance sensor 5, an operation switch group 6, a display device 7, a voice output device 8, A gesture detection device 9, a head-up display (hereinafter referred to as “HUD”) 10, a communication device 11, a storage device 12 that stores a program, and an operation state detection device 13 that detects a driver's operation state are configured. The storage device 12 may be a non-transitional tangible recording medium such as a semiconductor memory represented by a hard disk drive or a flash memory.

  The control circuit 2 controls the entire operation of the navigation apparatus 1 and is mainly composed of a microcomputer. The control circuit 2 includes a known CPU, RAM, ROM, a bus line for connecting them, a power supply circuit, and the like.

  The front monitoring device 3 acquires an image of the front visual field of the vehicle for image analysis, and includes a front monitoring camera 3a, an A / D converter 3b, and an image processing circuit 3c. The front monitoring camera 3a is attached from the passenger compartment toward the front of the vehicle, acquires an analog image of the front view, and outputs it to the A / D converter 3b. The A / D converter 3b performs A / D conversion on the analog image signal from the front monitoring camera 3a to convert it into a digital signal, and outputs it to the image processing circuit 3c. The image processing circuit 3c processes the digital image signal, and outputs only the contour line and main shape line of the subject to the control circuit 2 so as to facilitate image analysis. The control circuit 2 measures, for example, the distance to the vehicle ahead and the distance to the obstacle located ahead based on the information from the front monitoring device 3, and if it is determined that the risk is high, the brake is applied. Decelerate or stop the vehicle.

  The GPS receiver 4 receives radio waves from a plurality of GPS artificial satellites, calculates the current position of the vehicle, and transmits it to the control circuit 2. The distance sensor 5 is a sensor for measuring the travel distance, and measures the travel distance by counting the number of rotations of the front wheel, for example. The measurement value of the distance sensor 5 is used for correcting the current position coordinates calculated by the GPS receiver 4. The GPS receiver 4 and the distance sensor 5 correspond to the position detection sensor of the position detection means. In addition to the position detection means, a vehicle body direction sensor, a speed sensor, and the like are also used for improving the position detection accuracy. It may be used.

  The operation switch group 6 is used to input commands and data to the control circuit 2 and includes, for example, a touch switch and a remote control switch formed on a color liquid crystal display. The display device 7 is for displaying the current vehicle position detected by the position detection unit in a superimposed manner on a road map, and is composed of, for example, a color liquid crystal display. The voice output device 8 changes the output information from the control circuit 2 to an artificial voice and transmits it to the driver.

  The communication device 11 is for receiving road traffic information such as traffic conditions, construction / traffic regulations, and required time as digital signals from VICS (Vehicle Information & Communication System, registered trademark).

  The storage device 12 stores map data including a road map in advance. This map data is used for confirmation of the position on the map where the vehicle is traveling, route search and route guidance, which are general navigation functions.

  In the storage device 12, a program for executing a general navigation function, for example, a function for correcting the position coordinates calculated by the GPS receiver 4 with the measured value of the distance sensor 5, and the corrected position coordinates on the map Map matching processing function to determine the current position of the vehicle by positioning, route search function to search the route from the current position to the destination upon receiving designation of the destination or waypoint, map the travel route according to the route search result A program for executing a route guidance function or the like displayed on the screen for guidance is stored in advance. In the present embodiment, a gesture recognition program described later is executed in addition to these programs.

  The driving state detection device 13 obtains an image from a monitoring camera (not shown) provided in the passenger compartment so as to photograph the driver, and analyzes the driver's state such as the driver's face and movement to determine the driving state. And it has the function to call a driver | operator's attention by notifying to the control circuit 2. FIG. The driving state includes, for example, the driver being vague, causing drowsiness, fatigue, reduced attention, or arousal level, or conversely being over-awakened. Since such an operating state is a state that is not suitable for driving, that is, an inappropriate operating state, it is desired that the driving state be an appropriate operating state. The driving state can be detected not only from the information from the monitoring camera, but also from the state of the vehicle obtained from the forward monitoring device 3 and various sensors for detecting the traveling state of the vehicle or various vehicle information. It can also be used as a component of the detection device 13.

  The HUD 10 is a device that allows a driver to view information without taking his / her line of sight from the front direction. As shown in FIG. 2, the HUD 10 includes a light source 10a, a liquid crystal panel 10b, a concave reflecting mirror 10c, and a dust cover 10d provided on the back side of the instrument panel 14. The liquid crystal panel 10b and the reflecting mirror 10c are located on the optical axis of the light source 10a, and the light irradiated on the optical axis from the light source passes through the liquid crystal panel 10b and is condensed by the reflecting mirror 10c upward in the figure. Reflected. The light reflected by this reflecting mirror forms an image on a predetermined display area 16 on the front windshield 15 shown in FIG. 3 through the dust cover 10d. Therefore, the driver can visually recognize the information formed on the display area 16 while looking forward through the front windshield 15.

  The gesture detection device 9 is provided on the instrument panel 14 and detects the position of the fingertip extended forward from the hand holding the steering wheel 17 positioned at a substantially neutral position as shown in FIG. In this case, the driver can instruct the navigation device 1 to perform various operations by drawing a predetermined figure with a gesture for moving the fingertip. A plurality of figures drawn by gestures are set as shown in FIG. 5. For example, an operation of moving to or selecting the next song or moving to or selecting the previous song by gesturing in a perpendicular direction is performed. Can be directed. Note that the figure shown in FIG. 5 is an example, and other operations (not shown) can be instructed by drawing a predetermined figure using a gesture.

  The gesture detection device 9 includes a light-emitting element that emits infrared rays to a predetermined gesture detection area, a light-receiving element that includes an image sensor that captures infrared rays reflected by a fingertip located in the gesture detection area, and the like. The gesture detection area is a range in which the fingertip of the hand holding the steering wheel 17 can be positioned as shown in FIG. The light receiving element is located in the gesture detection area, images the fingertip, generates a detection signal indicating the position of the fingertip, and outputs the detection signal to the control circuit 2.

  The control circuit 2 analyzes the detection signal input from the gesture detection device 9 to determine whether or not a gesture has been performed by the driver's fingertip. That is, the locus of the fingertip is detected as a gesture input by tracking the position of the fingertip.

  In this embodiment, the configuration for pointing with a gesture drawn with a fingertip in the air has been described. However, when drawing with an arm or a wrist instead of the fingertip, a mouse, a touch pad, or the like may be used, and a pointing device is used. It is not limited. Alternatively, the drawing may be performed not only with the steering wheel 17 being held but also with the hand released from the steering wheel 17.

  The control circuit 2 executes a gesture recognition program stored in the storage device 12 to thereby perform a gesture detection unit 2a, a recognition unit 2b, an information generation unit 2c, a display suppression unit 2d, an event detection unit 2e, and a recognition determination unit 2f. Perform the function.

  Now, when the driver operates the navigation device 1 with a fingertip gesture, as shown in FIG. 6, the fingertip of the hand holding the steering wheel is extended forward and the fingertip is moved in the manner of a single stroke. Draw a gesture. Then, the gesture detection device 9 comes to detect a gesture input by the driver. FIG. 6 shows that the update gesture shown in FIG. 5 is drawn.

  The control circuit 2 is executing the gesture recognition program shown in FIG. 7 and determines whether or not a gesture input is detected (S101: NO). If a gesture input by a fingertip is detected (S101: YES), A display suppression process is executed (S102). That is, as shown in FIG. 6, the gesture trajectory 18 is drawn in a region that does not obstruct the driver's forward view. The forward field of view means a forward field of view in which the driver focuses particularly on driving. Further, the area that does not obstruct the front view (hereinafter referred to as the retreat area 19) is an area that deviates from the area corresponding to the front view (hereinafter referred to as the front area 20) in the display area 16 shown in FIG.

  When drawing the gesture trajectory 18, the drawing of the gesture trajectory 18 is started from a position corresponding to the first detection position of the fingertip (indicated by a black circle in FIG. 6) in the lower right corner of the retreat area 19. Drawing is performed so that the movement locus to the position (indicated by an arrow in FIG. 6) remains. In this case, the drawing information of the gesture trajectory 18 corresponds to feedback information.

  Next, gesture recognition processing is executed (S103), and it is determined whether the gesture input has been confirmed (S104). That is, it is determined whether the gesture matches one of the gesture patterns shown in FIG. 5 or a gesture pattern (not shown). When the gesture is confirmed (S104: YES), an operation instructed by the gesture is executed (S105). When the gesture input is confirmed, the gesture locus 18 is deleted.

  As described above, various operations can be instructed to the navigation device 1 by the gesture of the fingertip of the hand holding the steering wheel 17. Such an instruction can also be performed by operating the operation switch group 6, but checking the position of the operation switch group 6 involves a large line of sight movement. On the other hand, since the instruction by the gesture can be performed while viewing the front, the safety is extremely excellent.

  According to such an embodiment, the control circuit 2 performs the display suppression process by always displaying the gesture trajectory 18 in the retreat area 19, so that the driver can keep a gaze while always checking the traffic situation ahead. The gesture trajectory 18 can also be confirmed without moving greatly.

(Second Embodiment)
Next, a second embodiment will be described with reference to FIGS. The second embodiment is characterized in that the gesture trajectory 18 is erased according to the driving situation.

  In the first embodiment, safety is taken into consideration by always displaying the gesture trajectory 18 in the evacuation area 19, but the evacuation area 19 is set out of the driver's front field of view, so the visibility is poor. By recognizing the driving situation such as the driver's load condition and the driving condition of the vehicle, and displaying the gesture trajectory 18 in the retreat area 19 according to the driving situation, the visibility of the gesture trajectory 18 is improved while considering safety. Is desirable. Visibility of the gesture trajectory 18 indicates the degree to which the driver looking at the front visually recognizes the gesture trajectory 18, and the state of high visibility is an aspect in which the driver's front view can be hindered by the gesture trajectory 18. .

  Here, it is considered that the load state of the driver is high when the driver needs to concentrate on driving and is low otherwise. Typically, the vehicle is in a running state, and it is not necessary to concentrate on driving unless there is a problem, but it is necessary to concentrate on driving while driving, the importance of which is proportional to speed, etc. And increase. The load state of the driver can be grasped by the determination of the driving state detection device 13, but the driving state of the vehicle may be acquired and determined from various ECUs (Electronic Control Units) provided in the vehicle. .

  As shown in FIG. 10, when detecting a gesture input (S201: YES), the control circuit 2 determines whether the vehicle is stopped (S202). That is, it is determined whether the vehicle is stopped based on the detection information from the distance sensor 5. When the vehicle is stopped (S202: YES), the gesture trajectory 18 is drawn on the front area 20 (S204). That is, as shown in FIG. 8, the drawing of the gesture locus 18 is started from the first detection position of the fingertip (indicated by a black circle in FIG. 8) in the front region 20, and the current position of the fingertip (indicated by an arrow in FIG. 8). Draw so that the movement trajectory up to

However, when the gesture trajectory 18 is displayed in the front area 20, the gesture trajectory 18 is located in the front area 20, which may hinder forward visibility.
Therefore, as shown in FIG. 10, the control circuit 2 executes a display suppression process (S203) when the vehicle is running (S202: NO). In this case, the display suppression process erases the gesture trajectory 18 as non-display as shown in FIG.
Thereafter, similarly to the first embodiment, the gesture recognition process is executed (S205), and when the gesture input is confirmed (S206: YES), the gesture function is executed (S207).

  According to such an embodiment, the control circuit 2 displays the gesture trajectory 18 when the vehicle is stopped, and executes the display suppression process by deleting the gesture trajectory 18 when the vehicle is running. The visibility of the gesture trajectory 18 can be improved while considering the above. Also, the driver can refrain from gesturing input when the vehicle is running, and can concentrate on driving.

(Third embodiment)
Next, a third embodiment will be described. The third embodiment is characterized in that the gesture trajectory 18 is displayed in the retreat area 19 according to the driving situation.

When executing the display suppression process of step S203 in FIG. 10, the control circuit 2 draws the evacuation area 19 instead of deleting the gesture trajectory 18 as shown in FIG.
According to such an embodiment, the gesture trajectory 18 is displayed in the front area 20 when the vehicle is stopped, and the gesture trajectory 18 is displayed in the retreat area 19 when the vehicle is running. The visibility of 18 can be improved.

(Fourth embodiment)
Next, a fourth embodiment will be described with reference to FIGS. The fourth embodiment is characterized in that the visibility of the gesture trajectory 18 is lowered according to the driving situation.

As shown in FIG. 12, when the gesture input is detected (S301: YES) and the vehicle is stopped (S302: YES), the control circuit 2 increases the brightness of the gesture trajectory 18 in the front area 20 as shown in FIG. To draw (S304). When the vehicle starts to travel (S302: NO), display suppression processing is executed (S303). In the display suppression process in this case, as shown in FIG. 11, the luminance of the gesture trajectory 18 is reduced to such an extent that the driver's front view is not hindered.
Thereafter, as in the first embodiment, the gesture recognition process is executed (S305), and when the gesture input is confirmed (S306: YES), the gesture function is executed (S307).

  According to such an embodiment, when the vehicle is stopped, the control circuit 2 displays the gesture trajectory 18 in the front area 20 in a state in which the luminance is increased, and the luminance of the gesture trajectory 18 in the traveling state of the vehicle. Since the display suppression process is executed by lowering, the driver can always check the gesture trajectory 18, but can surely check the traffic situation ahead when an event occurs.

  Instead of reducing the luminance of the gesture trajectory 18, the display suppression process may be executed by increasing the transparency of the gesture trajectory 18. A method for increasing the transparency can be realized by displaying the gesture trajectory 18 as particles or blinking.

(Fifth embodiment)
Next, a fifth embodiment will be described with reference to FIGS. The fifth embodiment is characterized in that display suppression processing is executed when an event that requires a driver to concentrate particularly on driving occurs in a state in which the gesture locus 18 is displayed in the front area 20. To do. The event is when the vehicle starts to run or when a high-risk event occurs. An event with a high degree of danger means that the forward monitoring device 3 detects that the distance from the vehicle traveling ahead has decreased sharply, or a vehicle, bicycle, person, etc. that obstructs traveling ahead of the vehicle. This is the case. Various sensors detect that the driver's blood pressure has suddenly increased or the number of breaths per unit time has suddenly increased, or if the vehicle or obstacle is blindly positioned in the direction of travel of the vehicle from the outside. May be received information.

  That is, in each of the above-described embodiments, in consideration of the fact that the driver's load is higher than when the vehicle is stopped in the running state of the vehicle, the gesture trajectory 18 is deleted or the evacuation area is executed by executing the display suppression process. For example, when the vehicle travels on a highway, the load on the driver is considered to be relatively small. That is, on the expressway, the driver can drive in a relatively relaxed state because it does not stop at an intersection or jump out of people or bicycles.

  Therefore, as shown in FIG. 14, when the gesture input is detected (S401: YES), the control circuit 2 determines whether it is on the highway (S402). Whether the vehicle is on a highway is determined by the fact that the current position of the vehicle has entered from the interchange and has not exited the interchange. In other words, it is determined that the vehicle is on the highway, including not only driving on the main road of the highway but also stopping in the service area or the parking area. If it is on the highway (S402: YES), after confirming that no event has occurred (S405: NO), the gesture locus 18 is drawn in the front area 20 (S406). On the other hand, when it is not on the expressway (S402: NO), it operates in the same manner as in the second embodiment (S403, S404, S407 to S409).

  However, even when it is determined that the vehicle is on a highway, when the vehicle starts running from a stopped state in the service area or the parking area, the vehicle merges from the rampway to the main road or exits from the main road to the rampway. If it is necessary to concentrate on driving, such as when the distance to the vehicle ahead is less than the set distance during traveling, or when changing lanes, it is determined that an event has occurred (S405). : YES), display suppression processing is executed (S404). The display suppression process in this case is the same as that in the second to fourth embodiments described above. That is, the gesture trajectory 18 is deleted as in the second embodiment, the gesture trajectory 18 is displayed in the retreat area 19 as in the third embodiment, and the visibility of the gesture trajectory 18 is increased as in the fourth embodiment. To lower. In addition, when the gesture trajectory 18 is drawn when the display suppression process is executed, the danger information for notifying that the gesture trajectory 18 is dangerous is simultaneously drawn as shown in FIG.

  According to such an embodiment, when an event occurs in a state where the gesture locus 18 is displayed in the front area 20, the control circuit 2 executes the same display suppression process as in the second to fourth embodiments. Therefore, the driver can surely confirm the traffic situation ahead when the event occurs while confirming the gesture locus 18.

  The driving situation in which the display suppression process is not executed in the running state of the vehicle is not limited to the expressway, and a forward view is good, such as a road with a long distance between the intersection and a suburban road. It may be a case of traveling on a road.

(Sixth embodiment)
Next, a sixth embodiment will be described with reference to FIGS. 15 to 17. The sixth embodiment is characterized in that the gesture trajectory 18 is always displayed in the front area 20.

  Since the gesture trajectory 18 is a temporary display that is erased when the gesture input is recognized as described above, even if the gesture trajectory 18 is displayed in the front area 20, the driver's front view may be hindered. It is temporary. Therefore, it is conceivable to always display the gesture locus 18 in the front area 20.

  However, when an event occurs when an effect that stands out with respect to the gesture trajectory 18 is performed, it is desirable to lower the effect level of the gesture trajectory 18 so that the gesture trajectory 18 does not stand out.

A specific example of reducing the effect level of the gesture trajectory 18 can be given as follows.
(1) As shown in FIG. 15, when an event is generated in a case where control is performed to perform rendering in which all the gesture trajectory 18 is left behind from the rear end, the rear end of the gesture trajectory 18 is gradually erased. Change to control. As a method of gradually erasing the rear end, there is a method of erasing the rear end of the gesture trajectory 18 as time elapses, and the rear of the gesture trajectory 18 so that the display distance from the display end of the gesture trajectory 18 is constant. A method of erasing the edge is conceivable.

  (2) When an event occurs when control is performed to draw the gesture trajectory 18 with a conspicuous color, the gesture trajectory 18 is drawn with an inconspicuous color. For example, the drawing is changed from red to light green, or the complementary color for the most occupied color in the image captured by the front monitoring device 3 is changed to drawing with a similar color.

  (3) When an event occurs when a predetermined decoration display is performed for drawing the gesture trajectory 18, the decoration display is stopped. For example, as shown in FIG. 16, when an event occurs when the gesture trajectory 18 is drawn with an aggregate of particles, the gesture trajectory 18 is drawn with a line as in the above embodiments.

(4) As shown in FIG. 17, when an event occurs when a virtual hand that draws the gesture trajectory 18 is added and drawing is performed, the drawing of the virtual hand is stopped.
According to such an embodiment, the control circuit 2 always displays the gesture trajectory 18 in the front area 20 and, when an event occurs, executes the display suppression process by reducing the effect level of the gesture trajectory 18. Therefore, the driver can surely confirm the traffic situation ahead of the vehicle when the event occurs while constantly confirming the gesture locus 18.

(Seventh embodiment)
Next, a seventh embodiment will be described with reference to FIGS. The seventh embodiment is characterized in that a recognition acceptance that recognizes a command is displayed as a recognition result of the gesture input.

  When displaying a gesture recognition result command instead of the gesture trajectory 18 as gesture input feedback information, it may be possible to display the command in the front area 20, but this may hinder the driver's forward view. .

  Therefore, as shown in FIG. 20, when the control circuit 2 determines the gesture input by executing a process in response to detecting the gesture input as in the second to fourth embodiments (S501 to S506). ), It is determined whether the vehicle is stopped (S507). When the vehicle is stopped (S507: YES), the command 21 is drawn on the front area 20 (S509).

  FIG. 18 shows a recognition acceptance indicating that a gesture input is accepted and the “select next song” command 21 is recognized when the vehicle is stopped. In this case, the recognition acceptance is displayed in the front area 20 and can interfere with the driver's front view.

  When the vehicle travels (S507: NO), the control circuit 2 executes display suppression processing (S508). The display suppression process in this case is the same as that in the second to fourth embodiments described above. That is, the gesture trajectory 18 is deleted as in the second embodiment, the gesture trajectory 18 is displayed in the retreat area 19 as in the third embodiment (see FIG. 19), or the gesture trajectory is similar to that in the fourth embodiment. The visibility of 18 is reduced. Further, when an event occurs in a state where the command 21 is displayed on the front area 20 on the highway as in the fifth embodiment, the display suppression process may be executed. Further, as in the sixth embodiment, the command 21 may be always displayed in the front area 20, and the degree of command effect may be reduced when an event occurs.

  According to such an embodiment, when the command 21 that is the recognition result of the gesture input is displayed on the front area 20, the display suppression process is executed according to the driving situation. When the necessity of concentrating is high, it is possible to suppress the command 21 from obstructing forward viewing.

(Eighth embodiment)
Next, an eighth embodiment will be described with reference to FIGS. The eighth embodiment is characterized in that the recognition result of the gesture input is notified to the driver by display suppression processing.

  In the gesture input in which the driver moves his / her fingertip in the air to input, it is difficult for the user to recognize the gesture trajectory drawn by himself / herself. Therefore, the gesture detection device 9 can know the reason when the gesture input is erroneously recognized or failed. difficult. On the other hand, it is conceivable to display the feedback information of the gesture input in the front area 20, but this may disturb the driver's front view.

  Therefore, as shown in FIG. 23, when the control circuit 2 executes processing corresponding to the detection of the gesture input (S601 to S604) as in the second to fourth embodiments, the gesture input has failed due to a timeout, for example. Is determined (S605). If the gesture input fails without determining the gesture input (S607: NO) (S605: YES), it is determined whether the vehicle is stopped (S609). If the vehicle is stopped (S609: YES), an error 22 (corresponding to error information) indicating the gesture recognition result is displayed in the front area 20 as shown in FIG. 21 (S610). When the vehicle is traveling (S609: NO), display suppression operation is executed (S611). The display suppression process in this case is the same as that in the second to fourth embodiments described above. That is, the error 22 is deleted as in the second embodiment, the error 22 is displayed in the save area 19 as in the third embodiment (see FIG. 22), and the error 22 is visually recognized as in the fourth embodiment. Decrease the sex. Moreover, when an event occurs in a state where the error 22 is displayed on the front area 20 on the expressway as in the fifth embodiment, a display suppression process may be executed. Furthermore, as in the sixth embodiment, the error 22 may always be displayed in the front area 20 so that the stage of the error 22 is reduced when an event occurs.

  According to such an embodiment, when the error 22 that is the recognition result of the gesture input is displayed in the front area 20, the display suppression process is executed according to the driving situation. When the necessity of concentrating is high, it is possible to suppress the error 22 from obstructing forward viewing.

(Ninth embodiment)
Next, a ninth embodiment will be described. The ninth embodiment is characterized in that a gesture trajectory is displayed using augmented reality.

  In each of the above embodiments, the gesture trajectory 18 is displayed in the front area 20 and the retreat area 19. However, in this case, the position of the driver's fingertip is shifted from the position of the gesture trajectory 18, which causes a sense of discomfort.

Under such circumstances, the positions of the driver's fingertip and the gesture trajectory 18 are displayed together, and augmented reality technology is adopted as a configuration for realizing such an action.
This augmented reality technology detects the driver's line-of-sight direction as shown in, for example, Japanese Patent Application Laid-Open No. 2005-138755, and sets the gesture locus 18 on the HUD 10 that is an extension line between the line-of-sight direction and the driver's fingertip. To display. In this case, when the position of the driver's face moves or the line of sight moves, the position of the gesture track 18 also moves accordingly, so that the fingertip and the gesture track 18 are positioned on the driver's line of sight. Therefore, the driver can always visually recognize the gesture trajectory 18 in a state where the positions of the fingertips match.

  According to such an embodiment, when the driver moves his / her fingertip, the driver feels as if he has drawn the gesture trajectory 18 with his / her fingertip. Therefore, the gesture trajectory 18 can be drawn smoothly, and the gesture input fails. Can be suppressed.

(Other embodiments)
As the head-up display, the gesture trajectory 18 or the like may be projected onto the hood of the vehicle or may be projected onto the road surface located in front of the vehicle.
The display position of the gesture trajectory 18 and the like during the display suppression process is not limited to the lower right corner of the evacuation area 19 and may be any part in the evacuation area 19.
In the second to fourth embodiments, the display suppression process is executed in the traveling state of the vehicle. However, the display suppression process is performed when the driver is in a relaxed state even when the vehicle is traveling. May be stopped.

  It is also possible to display the gesture trajectory 18 by predicting the gesture input in the middle of the gesture input, or to display characters indicating the gesture trajectory 18 instead of the predicted gesture trajectory 18.

If an event occurs while the gesture trajectory 18 is displayed in the retreat area 19, the gesture trajectory 18 may be deleted.
When displaying a command, an icon indicating the command may be displayed, or an item having a high possibility may be highlighted from a plurality of candidates.

As the feedback information, instead of the gesture path 18, turning the palm displays a picture of the knob that adjusts the volume, displays the desired menu screen with the number of fingers, and specifies the menu screen items with the number of fingers. You may make it.
You may make it apply this invention to vehicle equipment other than a navigation apparatus.

  Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments and structures. The present disclosure includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more or less, are within the scope and spirit of the present disclosure.

In the drawings, 1 is a navigation device (vehicle information display device), 2 is a control circuit, 2a is a gesture detection unit, 2b is a recognition unit, 2c is an information generation unit, 2d is a display suppression unit, 2e is an event detection unit, 2f Is a recognition determination unit, 10 is a head-up display, 16 is a display area, 21 is a command, and 22 is an error.

Claims (11)

A vehicle information display device (1) for displaying information by a head-up display (10) in a display area (16) provided so as to be positioned in a field of view in a forward direction of a driver,
A gesture detection unit (2a) for detecting a gesture input which is an input by a driver's gesture;
A recognition unit (2b) for recognizing the gesture input;
An information generator (2c) that generates feedback information that is information in response to the recognition;
A display suppression unit (2d) that executes a display suppression process for displaying the feedback information on the head-up display in a manner that does not interfere with the driver's forward view;
A vehicle information display device comprising:   2. The vehicle information display device according to claim 1, wherein the display suppression unit performs the display suppression process by always displaying the feedback information in a region that does not obstruct a driver's forward view.   2. The vehicle according to claim 1, wherein the display suppression unit displays the feedback information in an area that can obstruct a driver's forward view, and executes the display suppression process by erasing the feedback information according to a driving situation. Information display device.   The display suppression unit displays the feedback information in a region where the driver's forward view can be blocked, and displays the feedback information in a region where the driver's forward view is not blocked according to a driving situation. The vehicle information display device according to claim 1, wherein:   2. The display suppression unit always displays the feedback information in a region that can hinder the driver's forward visibility, and executes the display suppression process by reducing the visibility of the feedback information according to a driving situation. The vehicle information display device described in 1. It has an event detector that detects when an event has occurred that requires the driver to concentrate on driving.
The display suppression unit executes the display suppression process when the event detection unit detects the event in a state where the feedback information is displayed in a region where the driver's front view can be blocked. The vehicle information display device according to any one of claims 3 to 5. An event detector (2e) that detects that an event has occurred that requires a driver to concentrate particularly on driving,
The display suppression unit always displays the feedback information in a region that can hinder the driver's forward view, and when the event detection unit detects the event, the display degree is reduced by reducing the presentation degree of the feedback information. The vehicle information display device according to claim 1, wherein a suppression process is executed. A recognition determination unit (2f) for determining whether the recognition unit has successfully recognized the gesture input;
The display suppression unit displays an error when the recognition determination unit determines that recognition of the gesture input has failed, and executes the display suppression process for the error according to a driving situation. The vehicle information display device according to any one of claims 3 to 7.   The vehicle information display device according to claim 1, wherein the feedback information is a gesture trajectory corresponding to the gesture input.   The vehicle information display device according to any one of claims 1 to 8, wherein the feedback information is a command that is a recognition result of the gesture input. A vehicle information display program for displaying information by a head-up display in a display area provided to be located in a field of view in the forward direction of the driver,
A procedure for detecting gesture input, which is input by a driver's gesture;
Recognizing the gesture input;
Generating feedback information that is information in response to the recognition;
A procedure for executing a display suppression process for displaying the feedback information on the head-up display in a manner that does not interfere with the driver's forward view;
Vehicle information display program for executing

Images