JP2012162109A - Display apparatus for vehicle - Google Patents

Abstract

A vehicular display device in which a virtual image displayed on a window glass is hardly overlooked by a driver is provided.
A vehicular display device includes a specific object detecting unit that detects a specific object associated with an AR image that is a virtual image, and a virtual image acquiring unit that acquires a virtual image corresponding to the specific object. A display method acquiring unit that acquires a display method of the virtual image, a display unit that displays the virtual image acquired by the virtual image acquiring unit on the window glass by the display method acquired by the display method acquiring unit, and driving A visual condition estimating means for estimating a visual recognition situation around the user, and a display method correcting means for correcting the display method acquired by the display method acquiring means according to the visual recognition status estimated by the visual condition estimating means, When the display method is corrected by the display method correcting unit, the display unit displays the virtual image by the corrected display method.
[Selection] Figure 2

Description

  The present invention relates to a vehicle display device that displays on a window glass a virtual image corresponding to an object viewed from inside a vehicle compartment.

  As a conventional vehicle display device, a specific object detection unit that detects a specific object associated with a virtual image, and a virtual image that acquires a virtual image corresponding to the specific object detected by the specific object detection unit An acquisition unit, a display method acquisition unit that acquires a display method of a virtual image acquired by the virtual image acquisition unit, and a window that displays the virtual image acquired by the virtual image acquisition unit with the display method acquired by the display method acquisition unit What is provided with the display means displayed on glass is known (for example, refer patent document 1).

JP 2005-208157 A

  In the vehicular display device, once the virtual image is displayed according to the display method acquired by the display method acquisition means, it is hidden regardless of whether the virtual image is viewed by the driver thereafter. For this reason, the virtual image displayed on the window glass may be overlooked by the driver.

  An object of the present invention is to provide a vehicle display device in which a virtual image displayed on a window glass is hardly overlooked by a driver.

  The display device for a vehicle according to the present invention is a display device for a vehicle that displays a virtual image corresponding to an object viewed from inside a vehicle compartment on a window glass, and detects a specific object associated with the virtual image. Specific object detection means, virtual image acquisition means for acquiring a virtual image corresponding to a specific object detected by the specific object detection means, and display method acquisition for acquiring a display method of the virtual image acquired by the virtual image acquisition means Means, a display means for displaying the virtual image acquired by the virtual image acquisition means on the window glass by the display method acquired by the display method acquisition means, and a visual recognition state estimation means for estimating the peripheral visual recognition condition by the driver And display method correction means for correcting the display method acquired by the display method acquisition means according to the visual recognition status estimated by the visual recognition status estimation means. Display means, when the display method is corrected by the display method correction means, and displaying the virtual image in the display method after the correction.

  In such a vehicle display device, the virtual image acquired by the virtual image acquisition means is displayed on the window glass. Thereby, the surrounding environment visually recognized from the vehicle interior is supplemented with the virtual image. The virtual image is displayed by the display method acquired by the display method acquisition means. Thereby, it is possible to set and display an optimal display method for each virtual image. Further, the display method is corrected by the display method correcting means according to the visual recognition status estimated by the visual recognition status estimating means. The virtual image whose display method is corrected is displayed according to the corrected display method. Thereby, for example, a virtual image that the driver should visually recognize more clearly can be estimated from the surrounding visual status by the driver, and the virtual image can be displayed by a display method that is easier to visually recognize.

  Preferably, the visual recognition state estimation means estimates the visual recognition state of the virtual image by the driver.

  Preferably, the display method acquired by the display method acquiring means includes a display time of the virtual image, and the display method correcting means is estimated by the visual recognition state estimating means that the virtual image is not visually recognized by the driver. The display time acquired by the visual recognition state estimating means is extended. In this case, the display time of the virtual image that is not visually recognized by the driver is extended, and the virtual image is easily visually recognized by the driver.

  Preferably, the visual recognition state estimation means estimates the visual recognition state of a specific object by the driver.

  Preferably, the display method acquired by the display method acquiring unit includes a display time of the virtual image, and the display method correcting unit estimates that the specific object is not visually recognized by the driver by the visual state estimation unit. When this is done, the display time acquired by the visual status estimation means is extended. In this case, the display time of the virtual image corresponding to a specific object that is not visually recognized by the driver is extended, and the virtual image is easily visually recognized by the driver.

  Further, preferably, the visual recognition state estimation means estimates the visual recognition state based on the driver's line-of-sight direction. In this case, it is possible to accurately estimate the surrounding visual status by the driver.

  According to the vehicle display device of the present invention, it is possible to provide a vehicle display device in which a virtual image displayed on the window glass is hardly overlooked by the driver.

It is a functional block diagram which shows one Embodiment in the display apparatus for vehicles concerning this invention. It is a flowchart which shows the display procedure of a virtual image. It is a figure which illustrates the condition where a specific object is detected from the image outside the passenger compartment. It is a figure which shows the display part of the road sign of FIG. It is a figure which illustrates the window glass of the vehicle by which the virtual image corresponding to the road sign of FIG. 3 was displayed.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of a vehicle display device according to the present invention will be described in detail with reference to the drawings. In the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

  The vehicle display device 1 according to the present invention is a device that displays on a window glass a virtual image corresponding to an object visually recognized from the passenger compartment, and the virtual image is a so-called AR (Augmented Reality) image. FIG. 1 is a functional block diagram of the vehicle display device 1. As shown in FIG. 1, the vehicular display device 1 includes an AR display device 3, an outside-vehicle imaging device 4, a gaze direction detection device 5, a navigation device 6, an AR image storage device 7, and a communication device 8. And an AR control device 9.

  The AR display device 3 is a device that displays an AR image on a window glass (here, a windshield) of a vehicle. The AR display device 3 projects an image on a windshield by a projector built in a dashboard, for example. The AR display device 3 may be one in which a transparent display such as an organic EL display or a liquid crystal display is directly incorporated in the windshield.

  The vehicle interior imaging device 4 is a device that images the periphery of the vehicle. The vehicle exterior imaging device 4 is, for example, a CCD camera.

  The gaze direction detection device 5 is a device that detects the direction of the driver's gaze. The line-of-sight direction detection device 5 detects the direction of the driver's line of sight by, for example, capturing the driver's face with a CCD camera in the passenger compartment and identifying the driver's eyes by image processing.

  For example, the navigation device 6 is a device that detects position information of the host vehicle by GPS, and compares the detected position information with map information to guide a route to a destination.

  The AR image storage device 7 is a device that stores an AR image corresponding to a specific object visually recognized from the passenger compartment and a display method thereof. The AR image storage device 7 stores, for example, an enlarged image of a road sign, information indicating a facility type, information indicating a store type, and the like.

  The communication device 8 is a device that communicates with a facility outside the vehicle. The communication device 8 requests the information management center 2 storing the AR image to transmit the AR image and its display method, and receives the AR image and its display method.

  For example, the information management center 2 determines the display method of the AR image based on the driver's preference. For example, the display method of the AR image corresponding to the object that the driver likes is more easily visible than the display method of the AR image corresponding to the object that the driver does not like. Specifically, the display time of the AR image corresponding to the facility preferred by the driver is set longer than the display time of the AR image corresponding to the facility not preferred by the driver. Alternatively, the display size of the AR image corresponding to the facility preferred by the driver may be larger than the display size of the AR image corresponding to the facility not preferred by the driver. Alternatively, the display color of the AR image corresponding to the facility preferred by the driver may be easier to visually recognize than the display color of the AR image corresponding to the facility not preferred by the driver. The preference of the driver is determined based on, for example, registration information of the navigation device 6, registration information of the mobile phone, driver behavior in the car, conversation in the car, and the like.

  The information management center 2 transmits an AR image for advertisement to the vehicle, for example, and determines a display method based on the advertisement fee. For example, the information management center 2 uses a method of displaying an AR image with a high advertising fee as a method that is easier to visually recognize than a method of displaying an AR image with a low advertising fee.

  The information management center 2 determines the AR image display method based on, for example, the position of the vehicle requesting the display method. For example, when the vehicle is located outside the driver's daily life area, the AR image display method is made easier to see than when the vehicle is located within the driver's daily life area. Specifically, when the vehicle is located outside the driver's daily life area, the display time of the AR image is made longer than when the vehicle is located within the driver's daily life area. Alternatively, when the vehicle is located outside the driver's daily life area, the display size of the AR image may be larger than when the vehicle is located within the driver's daily life area. The display color of the image may be easily visible. When the display method of the AR image is determined based on the position of the vehicle, the vehicle requesting the display method receives the position information of the own vehicle detected by the navigation device 6 from the communication device 8 to the information management center. 2 to send.

  The AR control device 9 performs display control of the AR image according to the procedure shown in FIG. First, the AR control device 9 acquires an image captured by the vehicle exterior imaging device 4, processes the acquired image, and detects a specific object associated with the AR image (step S1). That is, the vehicle exterior imaging device 4 and the AR control device 9 operate as specific object detection means.

  When the AR control device 9 detects a specific object, the AR control device 9 acquires an AR image corresponding to the object (step S2). That is, the AR control device 9 operates as a virtual image acquisition unit. The AR image is acquired from the AR image storage device 7. Alternatively, the AR image may be acquired from the information management center 2 using the communication device 8.

  When the AR control device 9 acquires the AR image, the AR control device 9 acquires a display method of the AR image (step S3). That is, the AR control device 9 operates as a display method acquisition unit. The display method of the AR image includes, for example, display size, display time, display color, and the like. The display method of the AR image is acquired from the AR image storage device 7. Alternatively, the AR image display method may be acquired from the information management center 2 using the communication device 8. Alternatively, the AR image display method may be read from a marker displayed on a specific object as a reference for the display position of the AR image. When the display method of the AR image is read from the marker, for example, a two-dimensional barcode indicating the display method can be included in the marker.

  When acquiring the AR image, the AR control device 9 controls the AR display device 3 to start displaying the AR image acquired in step S1 (step S4). That is, the AR display device 3 and the AR control device 9 operate as display means. The AR image is displayed by the display method acquired in step S3.

  FIG. 3 shows a situation where the traveling road 10 is branched in a Y shape in front of the vehicle 11 and a road sign 12 is installed before the branch. FIG. 4 shows the display unit 13 of the road sign 12. The display unit 13 displays that the left side of the front branch is a traveling path for ordinary vehicles and the right side is a traveling path for large vehicles. In addition, the display unit 13 displays a marker 14 serving as a reference for a display position when displaying an AR image corresponding to the road sign 12. In this situation, the road sign 12 is detected as a specific object, and an AR image corresponding to the road sign 12 and its display method are acquired. When the marker 14 includes a two-dimensional barcode indicating the display method, the display method can be read from the two-dimensional barcode of the marker 14.

  FIG. 5 shows a state where the AR image 16 corresponding to the road sign 12 is displayed on the windshield 15 of the vehicle 11 of FIG. As shown in FIG. 5, the AR image is an enlarged view of the same content as the display unit 13 of the road sign 12. The display position of the AR image 16 is determined based on the marker 14. The display size, display color, and the like of the AR image 16 are determined according to the acquired display method.

  As shown in FIG. 2, when starting the display of the AR image, the AR control device 9 estimates the visual recognition status of the displayed AR image (step S5). Specifically, it is estimated whether or not the driver's line-of-sight direction detected by the line-of-sight direction detection device 5 is toward the AR image displayed by the AR display device 3. That is, the line-of-sight direction detection device 5 and the AR control device 9 operate as a visual recognition state estimation unit.

  Subsequently, the AR control device 9 estimates whether the AR image has been overlooked by the driver based on the estimated visual recognition state (step S6). Here, the AR control device 9 estimates that the AR image is overlooked by the driver when the driver's line-of-sight direction is not facing the AR image. Alternatively, the AR control device 9 may be overlooked by the driver when the period during which the driver's line-of-sight direction is facing the AR image is smaller than a predetermined period in the detection period of the driver's line-of-sight direction. May be estimated. When it is estimated that the AR image facing the AR image is not overlooked by the driver, the AR control device 9 ends the display of the AR image when the display time acquired in step S3 has elapsed (step S7). .

  On the other hand, when it is estimated that the AR image is overlooked by the driver, the AR control device 9 corrects the display method acquired in step S3 (step S8). That is, the AR control device 9 operates as a display method correcting unit. Specifically, the display time acquired in step S3 is corrected to a longer time. Alternatively, the display size acquired in step S3 is corrected to a larger size. Alternatively, the display color acquired in step S3 is corrected to a color that is more easily visible. Subsequently, the AR control device 9 displays the AR image again with the corrected display method (step S9). Then, the AR control device 9 ends the display of the AR image when the corrected display time has elapsed (step S7).

  In the vehicle display device 1 configured as described above, the AR image acquired by the AR control device 9 as a virtual image acquisition unit is displayed on the window glass. Thereby, the surrounding environment visually recognized from the vehicle interior is supplemented by the AR image. The AR image is displayed by the display method acquired by the AR control device 9 as the display method acquisition unit. Thereby, it is possible to set and display an optimal display method for each AR image. Furthermore, it is estimated whether the AR image is overlooked by the driver according to the visual status estimated by the AR control device 9 as the visual status estimation means. When it is estimated that the AR image has been overlooked by the driver, the display method is corrected by the AR control device 9 as the display method correcting means so that the driver can easily see the AR image. Thus, it is possible to estimate an AR image that the driver should visually recognize more clearly from the surrounding visual status by the driver, and display the AR image by a display method that is easier to visually recognize. This makes it difficult for the driver to overlook the AR image displayed on the window glass.

  Moreover, since the AR control device 9 as the visual recognition state estimation means estimates the visual recognition state of the driver based on the relationship between the driver's line-of-sight direction and the display position of the AR image, the AR image is displayed to the driver. It is possible to accurately estimate whether or not it has been visually recognized.

  The preferred embodiments of the present invention have been described above. However, the present invention is not necessarily limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  For example, the AR control device 9 estimates the visual recognition status of the AR image as the peripheral visual status by the driver, but is not limited thereto. For example, the AR control device 9 may estimate the visual recognition status of a specific object corresponding to the AR image. Furthermore, the AR control device 9 estimates the visibility of the specific object and the AR image corresponding to the specific object, and only when it is estimated that both the specific object and the AR image are overlooked by the driver. The display method of the AR image may be modified so that the driver can easily recognize it. In this case, the AR image whose display method should be corrected can be narrowed down, and the oversight of the AR image by the driver can be reduced more effectively.

  Further, the AR control device 9 uses the driver's line-of-sight direction detected by the line-of-sight direction detection device 5 to estimate the surrounding visual status of the driver, but is not limited thereto. For example, the AR control device 9 may estimate the visual recognition status of the AR image based on the position of the AR image on the windshield. Specifically, if the display position of the AR image on the windshield is outside the predetermined range, it is estimated that the driver is likely to be overlooked, and the AR image display method is corrected. May be.

  DESCRIPTION OF SYMBOLS 1 ... Display apparatus for vehicles, 3 ... AR display apparatus (display means), 4 ... Outside vehicle interior imaging apparatus (specific object detection means), 5 ... Gaze direction detection apparatus (visual recognition condition estimation means), 9 ... AR control apparatus (specification) (Object detection means, virtual image acquisition means, display method acquisition means, display means, visual recognition state estimation means, display method estimation means).

Claims (6)

A vehicle display device that displays on a window glass a virtual image corresponding to an object viewed from a vehicle interior,
Specific object detection means for detecting a specific object associated with the virtual image;
Virtual image acquisition means for acquiring the virtual image corresponding to the specific object detected by the specific object detection means;
Display method acquisition means for acquiring a display method of the virtual image acquired by the virtual image acquisition means;
Display means for displaying the virtual image acquired by the virtual image acquisition means on the window glass by the display method acquired by the display method acquisition means;
Visual status estimation means for estimating the visual status of the surroundings by the driver;
Display method correction means for correcting the display method acquired by the display method acquisition means according to the visual recognition status estimated by the visual recognition status estimation means,
The display unit displays the virtual image by the corrected display method when the display method is corrected by the display method correction unit.   The vehicle display device according to claim 1, wherein the visual recognition state estimation unit estimates a visual recognition state of the virtual image by a driver. The display method acquired by the display method acquisition means includes a display time of the virtual image,
The display method correcting means extends the display time acquired by the visual status estimating means when the visual status estimating means estimates that the virtual image is not visually recognized by a driver. The vehicle display device according to claim 2.   The vehicular display device according to claim 1, wherein the visual recognition state estimation unit estimates a visual recognition state of the specific object by a driver. The display method acquired by the display method acquisition means includes a display time of the virtual image,
The display method correcting unit extends the display time acquired by the visual recognition state estimation unit when the visual recognition state estimation unit estimates that the specific object is not visually recognized by a driver. The vehicle display device according to claim 4, wherein:   The vehicular display device according to claim 1, wherein the visual recognition state estimation unit estimates the visual recognition state based on a driver's line-of-sight direction.

Images