JP2019089553A - IMAGE DISPLAY DEVICE, MOBILE OBJECT, IMAGE DISPLAY METHOD, AND PROGRAM - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make a driver recognize information (surrounding object information) of a relative movement of an object (detection object) around a moving object with respect to the moving object by an image displayed in a display area in front of the moving body traveling direction. The challenge is to make it easier. An information providing device 200 including an image light projecting means 230 that projects image light onto a light transmitting member, and detects a relative distance in a moving body traveling direction of a detection object existing around the moving body. By changing the display position of the object image indicating the detection object according to the detection result of the distance detecting means 100, the viewpoint position detecting means for detecting the viewpoint position of the driver 301, and the viewpoint position detecting means. A display that controls the image light projection means so that the driver's perceived distance due to motion discrepancies with respect to the object image changes according to the relative distance in the moving object traveling direction of the detection object detected by the distance detecting means. It has a control means 250. [Selection diagram] Fig. 5

Description

  The present invention relates to an information providing apparatus, an information providing method, and a control program for providing information.

  A head-up display (HUD) that displays an image for providing information to a driver of a mobile object such as a vehicle, a ship, an aircraft, or an industrial robot moving with a driver as this type of information provision device ) A device using an apparatus etc. is known.

  Patent Document 1 discloses a HUD device that projects an image light on a windshield or the like (light transmission member) and displays an image superimposed on a landscape in front of a driver of a vehicle (moving body) through the windshield. It is done. This HUD device superimposes and displays on the front scenery the display object which shows the arrow which shows the advancing direction, speed, attention, warning, etc. as a virtual image. This HUD device is provided with a position detection unit (viewpoint position detection means) for imaging the driver and detecting the position of one eye of the driver, and according to the detection result, the position of each display object in the virtual image Perform the process of changing. In this process, when the driver moves the head and the viewpoint position (one-eye position) moves, the amount of movement of each display object in the virtual image is made different, so that movement parallax causes each display object to move in the depth direction. The driver is made to perceive that the display position (subjective depth position) is different.

  It would be useful if the driver could be provided with information on the relative movement of the object present around the mobile body (surrounding object information) by displaying the image using such a HUD device. . Moreover, in this provision, it is effective to use motion parallax so that the driver perceives that the depth position of the object display image changes according to the relative movement of the object relative to the moving object. Although Patent Document 1 describes display control using motion parallax, there is no mention of displaying surrounding object information indicating relative movement of an object present around a moving object.

  In order to solve the problems described above, according to the present invention, the moving object traveling direction ahead in which the driver visually recognizes the driver provided information image indicating the driver provided information to be provided to the driver of the moving object through the light transmitting member. An information providing apparatus including image light projecting means for projecting image light onto the light transmitting member so as to be displayed in a predetermined display area of the object, wherein the moving object travels with the detection object present around the moving object According to the detection result of the distance detection means for detecting the direction relative distance, the viewpoint position detection means for detecting the viewpoint position of the driver, and the display position of the object image showing the detection object according to the detection result of the viewpoint position detection means The image light projection is performed such that the driver's perceived distance due to the motion parallax of the object image changes according to the relative distance in the moving object traveling direction of the detection object detected by the distance detection means by changing it. means It characterized by having a display control means for controlling.

  According to the present invention, the driver displays information (surrounding object information) on the relative movement of an object (detection target object) around the moving object with the image displayed in the display area ahead of the moving object advancing direction. The excellent effect of being easy to make

In embodiment, it is explanatory drawing which shows an example of the virtual image displayed on a display area in piles on the front scenery of the own vehicle seen from a driver | operator over a windshield. BRIEF DESCRIPTION OF THE DRAWINGS It is the model which represented typically the structure of the motor vehicle carrying the HUD apparatus for motor vehicles in embodiment. It is a schematic diagram which represented the internal configuration of the HUD device for the vehicles typically. It is a hardware block diagram of a control system in the HUD device for the same car. BRIEF DESCRIPTION OF THE DRAWINGS It is a block diagram which shows schematic structure of the driver | operator information provision system in embodiment. It is explanatory drawing which shows the hardware constitutions of the object recognition apparatus in the driver | operator information provision system. It is a hardware block diagram which shows the main hardware of the image control apparatus in the HUD apparatus for the said motor vehicles. It is an explanatory view for explaining an image processing method of a virtual image which gave a sense of depth by motion parallax in an embodiment. It is an explanatory view showing an example of a picture of a situation of changing course at a nearest intersection. (A)-(e) is explanatory drawing which shows the example 1 of an image from which the image which shows front vehicle approach information changes according to the inter-vehicle distance with a leading vehicle. (A) And (b) is explanatory drawing which shows the other example 2 of an image from which the image which shows preceding vehicle approach information changes according to the inter-vehicle distance with a leading vehicle. (A)-(c) is an explanatory view showing other example 3 of an image which changes the picture which shows front car approach information according to the distance between two cars with a precedence vehicle. (A)-(c) is an explanatory view showing other example 4 of the situation of changing course at the nearest intersection. It is explanatory drawing which shows the image example 5 which displayed the attending school road warning image on the middle step display area, when the road the own vehicle is drive | working is a attending school road. It is explanatory drawing which shows the example 6 of an image which displayed the humanoid warning image on the middle stage display area, when the person who is going to cross the pedestrian crossing in the advancing direction of the own vehicle is detected.

Hereinafter, an embodiment in which the present invention is applied to a driver information providing system including an automotive head-up display (HUD) device as an information providing device will be described.
FIG. 1 is an explanatory view showing an example of a virtual image G displayed on the display area 700 in a superimposed manner on the front scenery of the host vehicle 301 viewed from the driver 300 through the windshield 302.
FIG. 2 is a schematic view schematically showing the structure of a car equipped with the car HUD device according to the present embodiment.
FIG. 3 is a schematic view schematically showing an internal configuration of the automotive HUD device in the present embodiment.

  The automotive HUD device 200 in the present embodiment is installed, for example, in the dashboard of the host vehicle 301 which is a traveling body as a moving body. Projection light L, which is image light emitted from the automotive HUD device 200 in the dashboard, is reflected by the windshield 302 as a light transmitting member, and travels to the driver 300. Thus, the driver 300 can visually recognize a HUD display image such as a navigation image described later as a virtual image. A combiner as a light transmitting member may be installed on the inner wall surface of the windshield 302 so that the driver can visually recognize a virtual image by the projection light L reflected by the combiner.

  In the present embodiment, the optical system or the like of the automotive HUD device 200 is configured such that the distance from the driver 300 to the virtual image G is 5 m or more. The conventional and general automotive HUD device has a distance from the driver 300 to the virtual image G of about 2 m. The driver 300 usually looks at an infinity point ahead of the vehicle or looks at a leading vehicle several tens of meters ahead. When the driver 300 focusing on such a distant place tries to visually recognize the virtual image G 2 m ahead, since the focal length is largely different, it is necessary to move the lens of the eyeball to a large extent. Therefore, the focus adjustment time to focus on the virtual image G becomes long, and it takes time to recognize the content of the virtual image G, and there is a problem that the eye of the driver 300 is easily fatigued. In addition, it is difficult for the driver to notice the content of the virtual image G, and it is difficult to appropriately provide information to the driver by the virtual image G.

  As in the present embodiment, if the distance to the virtual image G is 5 m or more, the amount of moving the lens of the eyeball is reduced compared to the prior art, the focus adjustment time to the virtual image G is shortened, and the content of the virtual image G is recognized early As a result, it is possible to reduce fatigue of the driver's 300 eyes. Furthermore, the driver can easily notice the content of the virtual image G, and the virtual image G facilitates the appropriate provision of information to the driver.

  Furthermore, when the distance to the virtual image G is about 2 m, focusing of the eye on the virtual image G at such a short distance usually requires convergence movement of the eye. The convergence movement is a factor that greatly affects the sense of distance and the sense of depth to the visual target. In the present embodiment, as described later, display control is performed in which the perceived distance of an image displayed as a virtual image G is perceived by motion parallax. In this case, when the eyeball converges to focus on the virtual image G, the effect of perceiving the sense of distance (change in perceived distance) and sense of depth (difference in perceived distance) due to motion parallax diminishes. This reduces the driver's information recognition effect, which will be described later, using differences and changes in perceived distance of

  If the distance to the virtual image G is 5 m or more, the virtual image G can be focused with almost no convergence movement of the eye. Therefore, the effect of causing the sense of distance (change in perceived distance) and the sense of depth (difference in perceived distance) to be perceived using motion parallax is suppressed from being reduced by convergence movement of the eye. Therefore, the driver's information perception effect using the sense of distance and the sense of depth of the image can be effectively exhibited.

  The automotive HUD device 200 includes red, green, and blue laser light sources 201R, 201G, and 201B in the HUD main body 230, collimator lenses 202, 203, and 204 provided for the respective laser light sources, and two dichroic mirrors 205. , A light amount adjustment unit 207, a light scanning device 208 as a light scanning means, a free curved surface mirror 209, a microlens array 210 as a light diverging member, and a projection mirror 211 as a light reflecting member. ing. In the light source unit 220 in the present embodiment, the laser light sources 201R, 201G, 201B, the collimator lenses 202, 203, 204, and the dichroic mirrors 205, 206 are unitized by an optical housing.

  As the laser light sources 201R, 201G, and 201B, LDs (semiconductor laser elements) can be used. The wavelength of the light beam emitted from the red laser light source 201R is, for example, 640 nm, the wavelength of the light beam emitted from the green laser light source 201G is, for example, 530 nm, and the wavelength of the light beam emitted from the blue laser light source 201B is, for example, 445 nm .

  The HUD device 200 for an automobile according to the present embodiment projects an intermediate image formed on the microlens array 210 onto the windshield 302 of the vehicle 301, thereby providing the driver 300 with a magnified image of the intermediate image. Make it visible. Laser beams of respective colors emitted from the laser light sources 201R, 201G, and 201B are collimated by the collimator lenses 202, 203, and 204, respectively, and are combined by two dichroic mirrors 205 and 206, respectively. The combined laser light is subjected to two-dimensional scanning by the mirror of the light scanning device 208 after the light quantity is adjusted by the light quantity adjustment unit 207. The scanning light L 'which has been two-dimensionally scanned by the light scanning device 208 is reflected by the free-form surface mirror 209 to be corrected for distortion, and then collected by the microlens array 210 to draw an intermediate image.

  In the present embodiment, the microlens array 210 is used as a light diverging member for individually diverging and emitting the light flux for each pixel (one point of the intermediate image) of the intermediate image, but another light diverging member is used May be Further, as a method of forming the intermediate image G ′, a method using a liquid crystal display (LCD) or a fluorescent display tube (VFD) may be used.

However, in order to display a large virtual image G with high luminance, a laser scanning method is preferable as in the present embodiment.
Further, in a method using a liquid crystal display (LCD) or a fluorescent display tube (VFD), light is slightly applied to a non-image portion in a display area where a virtual image G is displayed, and this is completely blocked. Is difficult. Therefore, there is a demerit that the visibility of the scenery in front of the own vehicle 301 through the non-image portion is bad. On the other hand, according to the laser scanning method as in the present embodiment, the non-image portion in the display area of the virtual image G is irradiated with light by turning off the laser light sources 201R, 201G, and 201B. Can be completely cut off. Therefore, the situation in which the visibility of the front scenery of the vehicle 301 through the non-image portion is reduced by the light emitted from the automotive HUD device 200 can be avoided, and the visibility of the front scenery is high.

  Furthermore, when the degree of warning is enhanced by gradually increasing the brightness of the warning image for giving a warning to the driver etc., only the brightness of the warning image among the various images displayed in the display area 700 Display control is required to gradually increase the The laser scanning method is also preferable in the case where display control is performed to partially increase the luminance of a partial image in the display area 700 as described above. In the method using a liquid crystal display (LCD) or a fluorescent display tube (VFD), the brightness of the images other than the warning image displayed in the display area 700 also increases, and the warning image and the other images are displayed. This is because the difference in luminance can not be broadened, and the effect of increasing the degree of the warning can not be sufficiently obtained by gradually increasing the luminance of the warning image.

  The optical scanning device 208 tilts the mirror in the main scanning direction and the sub scanning direction by a known actuator drive system such as MEMS (Micro Electro Mechanical Systems) to two-dimensionally scan (raster scan) laser light incident on the mirror. . The drive control of the mirror is performed in synchronization with the light emission timing of the laser light sources 201R, 201G, and 201B. The optical scanning device 208 is not limited to the configuration of the present embodiment, and may be configured by, for example, a mirror system including two mirrors that respectively swing or rotate around two axes orthogonal to each other.

FIG. 4 is a hardware block diagram of a control system in the automotive HUD device 200 of the present embodiment.
The control system of the automotive HUD device 200 mainly includes an FPGA 251, a CPU 252, a ROM 253, a RAM 254, an I / F 255, a bus line 256, an LD driver 257, and a MEMS controller 258. The FPGA 251 controls operation of the laser light sources 201R, 201G, and 201B of the light source unit 220 by the LD driver 257, and controls operation of the MEMS 208a of the light scanning device 208 by the MEMS controller 258. The CPU 252 controls each function of the automotive HUD device 200. The ROM 253 stores various programs such as an image processing program that the CPU 252 executes to control each function of the automotive HUD device 200. The RAM 254 is used as a work area of the CPU 252. The I / F 255 is an interface for communicating with an external controller or the like. For example, the object recognition apparatus 100, the vehicle navigation apparatus 400, various sensors 500, and the like described later via the CAN (Controller Area Network) of the own vehicle 301. Connected

FIG. 5 is a block diagram showing a schematic configuration of a driver information provision system in the present embodiment.
In the present embodiment, an object recognition device 100, a vehicle navigation device 400, a sensor device 500, and the like are provided as information acquisition means for acquiring driver provided information provided to the driver by the virtual image G. The automotive HUD device 200 in the present embodiment mainly includes a HUD main body 230 as an image light projection means and an image control device 250 as a display control means. Although the information acquisition means in the present embodiment is mounted on the own vehicle 301, using the information acquisition means installed outside the own vehicle 301, the information acquired by the information acquisition means is input via the communication means. It may be a configuration.

FIG. 6 is an explanatory view showing a hardware configuration of the object recognition apparatus 100 in the present embodiment.
The object recognition apparatus 100 according to the present embodiment exists in the imaging area based on the stereo camera unit 110 as an imaging unit that images the front area of the vehicle 301 as an imaging area, and the captured image data captured by the stereo camera unit 110 And an information processing unit 120 as an image processing unit that executes image processing for recognizing a predetermined recognition target object. Note that, instead of the stereo camera unit 110, a configuration in which a monocular camera as an imaging unit and a laser radar (millimeter wave radar) as a distance measuring unit may be adopted.

  The stereo camera unit 110 is configured by assembling in parallel two camera units of a first camera unit 110A for the left eye and a second camera unit 110B for the right eye. Each of the camera units 110A and 110B includes a lens 115, an image sensor 116, and a sensor controller 117. The image sensor 116 may be, for example, an image sensor configured of a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). The sensor controller 117 performs exposure control of the image sensor 116, image reading control, communication with an external circuit, transmission control of image data, and the like. The stereo camera unit 110 is installed near the rearview mirror of the windshield 302 of the vehicle 301.

  The information processing unit 120 includes a data bus line 121, a serial bus line 122, a central processing unit (CPU) 123, a field-programmable gate array (FPGA) 124, a read only memory (ROM) 125, and a random access memory (RAM) 126. A serial IF (Interface) 127 and a data IF 128 are included.

  The stereo camera unit 110 is connected to the information processing unit 120 via the data bus line 121 and the serial bus line 122. The CPU 123 controls execution of control of each sensor controller 117 of the stereo camera unit 110, operation of the entire information processing unit 120, image processing and the like. The luminance image data of the image captured by the image sensor 116 of each of the camera units 110A and 110B is written to the RAM 126 of the information processing unit 120 via the data bus line 121. Sensor exposure value change control data, image read parameter change control data, various setting data, and the like from the CPU 123 or the FPGA 124 are transmitted and received via the serial bus line 122.

  The FPGA 124 performs processing requiring real-time processing on image data stored in the RAM 126, such as gamma correction, distortion correction (parallelization of left and right images), and parallax calculation by block matching to generate a parallax image. Rewrite to the RAM 18 The ROM 125 is a recognition program for recognizing predetermined objects such as three-dimensional objects such as vehicles and pedestrians, lane boundaries such as white lines on the road surface, and curbs and median separators present on the road surface side. Is stored. The recognition program is an example of an image processing program.

  The CPU 123 acquires CAN information such as the vehicle speed, acceleration, steering angle, yaw rate, etc. from the sensor device 500 via the data IF 128, for example, via the CAN of the host vehicle 301. Then, the CPU 123 executes image processing using the luminance image and the parallax image stored in the RAM 126 in accordance with the recognition program stored in the ROM 125, and recognizes the object to be recognized such as the leading vehicle 350 and the lane boundary, for example. I do.

  The recognition result data of the recognition target object is supplied to an external device such as the image control device 250 and the vehicle travel control unit via the serial IF 127, for example. The vehicle travel control unit performs brake control, speed control, steering control, etc. of the vehicle 301 using the recognition result data of the recognition object, and, for example, maintains the vehicle 301 so as to maintain a preset inter-vehicle distance. It realizes cruise control to make the leading vehicle automatically track, and automatic brake control to avoid and reduce a collision with an obstacle ahead.

  The vehicle navigation device 400 in the present embodiment can widely use a known vehicle navigation device mounted on a car or the like. Information necessary for generating a route navigation image to be displayed on the virtual image G is output from the vehicle navigation device 400, and this information is input to the image control device 250. For example, as shown in FIG. 1, the number of lanes (traveling lanes) of the road on which the vehicle 301 is traveling, the distance to the point where the course change (right turn, left turn, branch etc.) is to be made next An image showing information such as the direction to move is included. These pieces of information are input from the vehicle navigation device 400 to the image control device 250, and under the control of the image control device 250, the car HUD device 200 causes the travel lane indication image 711, the route designation image 721, and the remaining distance image. Navigation images such as 722 and intersection name images 723 are displayed in the upper display area A and the middle display area B of the display area 700.

  Further, in the image example shown in FIG. 1, an image indicating road specific information (road name, speed limit, etc.) is displayed in the lower display area C of the display area 700. The specific information of the road is also input from the vehicle navigation device 400 to the image control device 250. The image control device 250 causes the car HUD device 200 to display the road name display image 701, the speed limit display image 702, the overtaking prohibition display image 703, and the like corresponding to the road specific information in the lower display area C of the display area 700. .

  The sensor device 500 in the present embodiment is configured of one or more sensors for detecting various information indicating the behavior of the host vehicle 301, the state of the host vehicle 301, the situation around the host vehicle 301, and the like. The sensor device 500 outputs sensing information necessary to generate an image to be displayed as a virtual image G, and the sensing information is input to the image control device 250. For example, in the image example shown in FIG. 1, a vehicle speed display image 704 (a character image “83 km / h” in FIG. 1) indicating the vehicle speed of the own vehicle 301 is displayed in the lower display area C of the display area 700. Therefore, vehicle speed information included in CAN information of the own vehicle 301 is input from the sensor device 500 to the image control device 250, and a character image indicating the vehicle speed is displayed by the automotive HUD device 200 under control of the image control device 250. It is displayed in the lower display area C of 700.

  In addition to the sensor that detects the vehicle speed of the host vehicle 301, the sensor device 500 may, for example, other vehicles, pedestrians, buildings (guard rails, utility poles, etc.) that exist around (forward, side, rear) the host vehicle 301. Radar sensor and imaging device that detect the distance between the vehicle and sensors for detecting external environment information (such as outside temperature, brightness, weather, etc.) of the vehicle, driving operation of the driver 300 (brake scan, degree of accelerator opening, etc. Sensor for detecting the remaining amount of fuel in the fuel tank of the vehicle 301, and sensors for detecting the state of various in-vehicle devices such as an engine and a battery. When such information is detected by the sensor device 500 and sent to the image control device 250, the information can be displayed as the virtual image G by the automotive HUD device 200 and provided to the driver 300.

FIG. 7 is a hardware block diagram showing the main hardware of the image control device 250. As shown in FIG.
In the image control apparatus 250, the CPU 251, the RAM 252, the ROM 253, the input data IF 254, and the output data IF 255 are mutually connected by a data bus line. Various recognition result data output from the object recognition device 100, sensing information output from the sensor device 500, various information output from the vehicle navigation device 400, and the like are input to the input data IF 254. A control signal or the like of the automotive HUD device 200 is output from the output data IF 255. The CPU 251 executes various computer programs such as an information providing control program stored in the ROM 253 or the like to cause the image control apparatus 250 to perform various controls and various processes described later.

Next, the virtual image G displayed by the automotive HUD device 200 will be described.
In the vehicle HUD device 200 in the present embodiment, the driver provided information provided to the driver by the virtual image G may be any information as long as the information is useful for the driver. In the present embodiment, driver-provided information is roughly divided into passive information and active information.

  Passive information is information that is passively recognized by the driver at the timing when a predetermined information provision condition is satisfied. Therefore, the information provided to the driver at the setting timing of the automotive HUD device 200 is included in the passive information, and the information having a certain relationship between the timing at which the information is provided and the content of the information is passive. Included in the information. The passive information includes, for example, information related to safety during driving, route navigation information, and the like. As information related to safety during driving, for example, inter-vehicle distance information between the host vehicle 301 and the preceding vehicle 350 (inter-vehicle distance presentation image 712), information having urgency related to driving (for instructing the driver to perform an emergency operation) Warning information such as emergency operation instruction information or warning information etc. may be mentioned. Further, the route navigation information is information for guiding a traveling route to a preset destination, and is provided to the driver by a known vehicle navigation device. As route navigation information, traveling lane instruction information (traveling lane instruction image 711) for instructing the traveling lane to be traveled at the nearest intersection, or the course change operation at the intersection or branch point for which the course should be changed next from straight ahead There is a course change operation instruction information to be instructed. More specifically, as route change operation instruction information, route specification information (route specification image 721) for performing route specification of which route should be taken at the intersection or the like, and the remainder to the intersection or the like for which the route change operation is performed. Distance information (remaining distance image 722), name information of the intersection etc. (intersection name image 723), etc. may be mentioned.

  Active information is information that is actively recognized by the driver at a timing determined by the driver himself. The active information is sufficient information as long as it is provided to the driver at the driver's desired timing. For example, information having a low or no relationship between the timing at which the information is provided and the content of the information is , Included in the active information. The active information is information that the driver obtains at a timing desired by the driver, and thus is information that is continuously displayed for a long period of time or at all times. For example, information specific to the road on which the host vehicle 301 is traveling, vehicle speed information of the host vehicle 301 (vehicle speed display image 704), current time information, and the like can be given. As specific information of a road, for example, the road name information (road name display image 701), restriction content information such as the speed limit of the road (speed limit display image 702, overtaking prohibition display image 703), and others related to the road Information is useful to the driver.

  In this embodiment, the passive information and the active information roughly classified in this manner are displayed in the corresponding display areas in the display area 700 capable of displaying the virtual image G. Specifically, in the present embodiment, the display area 700 is vertically divided into three display areas, and in the upper display area A and the middle display area B among them, passive information images corresponding to passive information are displayed, In the lower display area C, an active information image corresponding to the active information is displayed. Although part of the active information image may be displayed in the upper display area A or the middle display area B, in this case, the visibility of the passive information image displayed in the upper display area A or the middle display area B Display the active information image to prioritize.

  The passive information according to the present embodiment includes operation instruction information indicating the content of an operation instruction to the driver 300, such as route navigation information. When providing such a driver's command information to the driver, the driver is usually caused to display not only the driver's command image showing the latest driver's command content but also the user's driver's command image showing the user's subsequent driver's command content. Is preferable in that it can eliminate the anxiety of the subject (anxiety due to the unknown operation to be performed after that). In the example shown in FIG. 1 as well, along with the travel lane indication image 711 indicating the travel lane to be traveled at the nearest intersection, the route change operation at the intersection or branch point to be changed next from straight ahead is instructed The course change operation instruction images 721, 722, 723 are displayed.

  As described above, when a plurality of operation instruction images having different operation orders, that is, the traveling lane instruction image 711 and the course change operation instruction images 721, 722, and 723 are displayed in the display area 700 at the same time, each operation instruction It is desirable to avoid, as much as possible, a situation in which the driver is lost in the operation sequence of the operation instruction content indicated by the image.

  Therefore, in the present embodiment, the image display control is performed such that the operation instruction image for which the driver operates the plurality of operation instruction images different in operation order is displayed on the upper side in the display area 700 as the operation instruction image is later. Is going. That is, course change operation instruction images 721, 722, and 723 whose operation order is later than the traveling lane instruction image 711 are displayed above the traveling lane instruction image 711. As a result, it is possible to avoid a situation in which the driver loses the operation order regarding the operation instruction content of the traveling lane instruction image 711 and the operation instruction content of the course change operation instruction images 721, 722, and 723. This is due to the following reason.

  The driver 300 who is driving usually has an idea of a distance that an object located in front of the traveling vehicle 301 approaches toward the current position with the passage of time. On the other hand, the driver 300 also has an idea of time that future events will approach toward the current time as time passes. An object existing ahead of the own vehicle 301 advancing is faster in time to reach the position of the own vehicle 301 as the distance to the own vehicle 301 is shorter, and as the distance to the own vehicle 301 is longer, the position of the own vehicle 301 The time to reach is slow. Therefore, an object far ahead from the traveling vehicle 301 has a high affinity for cognition with events in the far future, and an object located near the front of the traveling vehicle 301 is a near future event There is a high degree of cognitive affinity between

  An operation instruction image of a distant future (an operation instruction image showing the content of an operation instruction whose operation order will be later), in consideration of this affinity, so as to overlap with a position where an object far away from the traveling vehicle 301 is viewed. That is, course change operation instruction images 721, 722, and 723) are displayed, and the operation of the near future (including the present) is performed so as to overlap with the position where the object located near the front of the own vehicle 301 advancing is viewed. If an instruction image (an operation instruction image indicating the operation instruction content whose operation order comes first, ie, the travel lane instruction image 711) is displayed, the driver can intuitively recognize the operation order of these operation instruction contents Can.

  Here, as described above, the driver 300 while driving is usually gazing at the infinity point ahead of the host vehicle or gazing at the back of the leading vehicle 350 traveling a few tens of meters ahead. And its gaze point is approximately near the vertical center of the front view seen from the windshield 302. In the present embodiment, the display area 700 where the traveling lane indication image 711 and the course change operation indication images 721, 722, and 723 having different operation orders are displayed is positioned under the front scenery seen from the windshield 302. . Therefore, the travel lane instruction image 711 and the course change operation instruction images 721, 722, and 723 are displayed on the lower side than the gaze point of the driver 300 so as to overlap with the front scenery. The forward landscape part below the gaze point of the driver 300 is viewed from above as objects farther from the host vehicle 301 and as viewed from below as objects closer to the host vehicle 301.

  Therefore, in the present embodiment, course change operation instruction images 721, 722, and 723 whose operation order is later than the travel lane instruction image 711 are displayed above the travel lane instruction image 711. Specifically, route change operation instruction images 721, 722, and 723 whose operation order is to be displayed are displayed in the upper display area A of the display area 700 overlapping the view position of an object far away from the host vehicle 301 moving forward. In the middle display area B of the display area 700 overlapping the visual recognition position of the object located near the front of the advancing vehicle 301, a traveling lane indication image 711 whose operation order comes first is displayed. Thus, the driver can intuitively recognize the operation order of these operation instruction contents from the high level of cognitive affinity described above, and the situation where the driver loses the operation order can be avoided. be able to.

  Conversely, for example, the display positions of the traveling lane instruction image 711 and the course change operation instruction images 721, 722, and 723 may be upside down from the present embodiment without considering the affinity of this recognition. When the driver is placed side by side, it is difficult for the driver to intuitively recognize the operation sequence, as the distance idea and the time idea described above interfere.

  In addition, in the present embodiment, a plurality of operation instruction images related to operation instruction contents having the same operation order are arranged side by side using this cognitive affinity. Specifically, with regard to the three course change operation instruction images 721, 722, and 723 displayed in the upper display area A, the course change operation at the intersection or branch point where the course should be changed next from the straight ahead direction Since the route change operation instruction information to be instructed is shown, it is arranged side by side in the upper display area A. According to the idea of the distance and the idea of time described above, the three course change operation instruction images 721, 722, and 723 arranged side by side at the same vertical position are information related to the operation instruction content at the same time. Easy to recognize intuitively. Therefore, the information of course change operation instruction images 721, 722, and 723 can be appropriately recognized.

  Further, in the present embodiment, a stereoscopic image represented using stereoscopic vision is used as the virtual image G displayed in the display area 700. Specifically, as the inter-vehicle distance presentation image 712 and the travel lane instruction image 711 displayed in the middle display area B of the display area 700, a perspective image represented by perspective is used.

  Specifically, the perspective of the inter-vehicle distance presentation image 712 drawn toward a vanishing point is set so that the lengths of the five horizontal lines constituting the inter-vehicle distance presentation image 712 become shorter toward the upper side. It is a legal image. In particular, in the present embodiment, since the inter-vehicle distance presentation image 712 is displayed such that the vanishing point is determined near the driver's gaze point, the driver 300 while driving perceives a sense of depth in the inter-vehicle distance presentation image 712 It is easy to do. Further, in the present embodiment, a perspective image is obtained in which the width of the horizontal line is further reduced toward the upper side, or the luminance of the horizontal line is decreased toward the upper side. As a result, the driver 300 while driving can more easily perceive the sense of depth of the inter-vehicle distance presentation image 712.

  By giving a sense of depth to the virtual image G displayed in the display area 700 using such a stereoscopic image, the vertical direction position of the image displayed in the display area 700 and the distance to the object in the front landscape It makes it easier for the driver to perceive the relevancy. As a result, the above-described cognitive affinity is more easily obtained, and the operation instruction content of the travel lane instruction image 711 displayed in the middle display area B of the display area 700 is in the upper display area A of the display area 700. The driver can easily intuitively recognize that the content is to be operated prior to the route change operation instruction images 721, 722, 723 displayed.

  Further, as with the inter-vehicle distance presentation image 712, the traveling lane indication image 711 is also drawn by perspective so that the same point as the vanishing point of the inter-vehicle distance presentation image 712 becomes the vanishing point. However, the travel lane instruction image 711 has an aspect of providing the driver with the content of the operation instruction. Therefore, in the case where it is prioritized that the operation instruction content of the traveling lane instruction image 711 is more clearly provided to the driver than giving a sense of depth, for example, three of the traveling lane instruction image 711 are configured. The arrow image may be made to be brighter toward the tip of the arrow. The laser scanning method makes it easy to adjust the brightness of each image area as compared with other methods, and therefore, the contrast between the low and high brightness areas can be largely increased. Therefore, as described above, it is effective in the case where the brightness of the tip of the arrow is increased to clearly provide information to the driver. In this case, the traveling lane indication image 711 has a lower luminance as it goes upward, so it is easier to give a sense of depth if the luminance is lowered as it goes upward, so the sense of depth can not be improved, but the arrow tip By increasing the brightness of the arrow, the visibility of the direction of the arrow is enhanced, and the operation instruction content of the traveling lane instruction image 711 can be provided to the driver more clearly. Even in this case, the travel lane indication image 711 is drawn by perspective, so that the sense of depth is not greatly impaired.

Next, a method of causing the sense of distance and the sense of depth to be perceived by using motion parallax to perceive the distance to the virtual image G will be described.
In the present embodiment, as the virtual image G, a motion parallax image represented by motion parallax is used. Motion parallax means parallax caused by movement of the eye position (viewpoint position) of the driver 300. When the eye position of the driver 300 moves, the sense of distance and the sense of depth due to motion parallax move more as the closer object in the landscape in front, and the more distant the object, the less object moves. The person 300 perceives a sense of distance to each object and a sense of depth.

  In the present embodiment, as shown in FIG. 2, the driver camera 150 as a viewpoint position detection unit for observing the position (viewpoint position) of the driver's 300 eyes is in the vicinity of the rearview mirror of the windshield 302 of the vehicle 301. is set up. The installation position of the driver camera 150 is preferably close to the midline of the driver 300 who sits in the driver's seat in order to accurately acquire the vertical and horizontal movements of the driver 300. However, it is preferable to arrange, for example, at the upper position so as not to block the view of the driver 300.

  The driver camera 150 is a monocular camera set so as to capture an area where the driver 300 sitting in the driver's seat is supposed to move the head during driving as an imaging area, and each of the stereo camera units 110 Like the camera units 110A and 110B, the camera unit 110A includes a lens, an image sensor, a sensor controller, and the like. A stereo camera may be used as the driver camera 150, and the position in the front-rear direction of the driver's eyes may also be grasped.

  The luminance image data of the captured image captured by the driver camera 150 is input to the image control device 250. The image control device 250 recognizes the position of the driver's 300 eye based on the luminance image data from the driver camera 150 by the CPU 251 executing the information providing control program stored in the ROM 253 or the like. In the present embodiment, the head position of the driver 300 is simply recognized based on the luminance image data from the driver camera 150, and the eye position of the driver 300 is estimated from the recognition result. As a method of recognizing the head position of the driver 300, a general recognition processing method can be widely adopted.

FIG. 8 is an explanatory view for explaining an image processing method of a virtual image G which gives a sense of depth by motion parallax in the present embodiment.
As shown in FIG. 8, when the head of the driver 300 moves by Dd, the visible position of the object Oa located at a distance La close to the driver 300 moves by Da, and the position is a distance Lb far from the driver 300 The visual position of the object Ob moves by Db less than Da, and the visual position of the object Oc located at a distance Lc farther from the driver 300 moves by Dc smaller than Db. Due to the difference in movement amounts Da, Db and Dc of the visual recognition position among these objects Oa, Ob and Oc, the driver 300 exists at a position where the object Oa is separated by the distance La and the object Ob is separated by the distance Lb It can be perceived that the object Oc is present at a position, and is present at a position separated by a distance Lc.

  The virtual image G in the present embodiment is displayed at a distance of 5 m from the driver 300, and any image portion on the virtual image G is displayed at a distance of 5 m from the driver 300. In the present embodiment, by using the motion parallax described above, the driver 300 is made to perceive as if a plurality of image portions on the virtual image G are displayed at different distances from one another.

  Specifically, the image control device 250 recognizes the head position of the driver 300 based on luminance image data of a captured image captured by the driver camera 150 at predetermined time intervals. Then, the image control device 250 calculates the driver's head movement amount Dd in which the driver's 300 head moves during the time interval. At this time, the visual recognition position of the virtual image G displayed at the distance 5 m is moved by Da.

  In the present embodiment, the display position in the display area 700 of the image portion displayed in the lower display area C is fixed. Therefore, the visual recognition position of the image portion displayed in the lower display area C moves by the same movement amount Da as the movement amount of the virtual image G. Thus, the image portion displayed in the lower display area C is perceived by the driver 300 as being displayed at the distance La (5 m).

  On the other hand, the image control device 250 controls the driver in the display area 700 for the image portion displayed in the middle display area B of the display area 700 of the virtual image G according to the calculated driver's head movement amount Dd. The head is moved by Da-Db in the direction opposite to the head movement direction of. As a result, for the image portion displayed in the middle display area B, the visual recognition position viewed from the driver 300 moves by the movement amount Db. As a result, the image portion displayed in the middle display area B is perceived by the driver 300 as being displayed at the distance Lb.

  Similarly, the image control device 250 drives the inside of the display area 700 for the image portion displayed in the upper display area A of the display area 700 of the virtual image G according to the calculated driver's head movement amount Dd. The head is moved by Da-Dc in the direction opposite to the head movement direction of the person. As a result, for the image portion displayed in the upper display area A, the visual recognition position viewed from the driver 300 moves by the movement amount Dc. As a result, the image portion displayed in the upper display area A is perceived by the driver 300 as displayed in the distance Lc.

  As described above, the virtual image G is projected while controlling the movement amounts Db and Dc of the visual recognition position of the image portion displayed in the upper display area A and the middle display area B according to the driver's head movement amount Dd. Thus, the driver 300 can display an image portion of the middle display area B (travel lane instruction) at a position farther than the image portion of the lower display area C (the road name display image 701, the speed limit display image 702, the overtaking prohibition display image 703, etc.). Image 711, inter-vehicle distance presentation image 712, etc.) is displayed, and the image portion of the upper display area A (course change operation instruction images 721, 722, 723, etc.) is displayed at a position further away than the image portion of middle display area B. Perception as you are. As described above, since the driver 300 can perceive image portions on the virtual image G displayed at the same distance as if they are displayed at different distances, a sense of depth of the virtual image G can be obtained.

  Particularly, in the present embodiment, the image portion of the middle display area B is divided into a plurality of parts in the vertical direction, and the movement amount is made different for each division according to the driver head movement amount Dd. It is perceived that the image part located at is displayed as far as possible. As a result of using not only the perspective expression but also the motion parallax with regard to the inter-vehicle distance presentation image 712 and the travel lane instruction image 711 displayed in the middle display area B, this makes it possible to further make the inter-depth interval.

FIG. 9 is an explanatory view showing an image example of a situation in which the course is changed at the nearest intersection.
When it becomes the situation of changing course at the nearest intersection, the example image shown in FIG. 1 is switched to the example image shown in FIG. That is, instead of the travel lane indication image 711 displayed in the middle display area B, the course designation image 717 similar to the course specification image 721 displayed in the upper display area A in the image example shown in FIG. Display in display area B. This is because the operation instruction content after the latest is the latest operation instruction. Thereby, the driver 300 can recognize that the driver may operate in accordance with the content of the operation instruction of the route specification image 721 displayed in the middle display area B at the next intersection or branch point.

  Further, in the image example shown in FIG. 9, the driver 300 is displayed on the route specification image 717 displayed in the middle display region B at the position of the route specification image 721 displayed in the upper display region A in the image example shown in FIG. A downward mark image 725 for guiding the gaze of the subject is displayed. This makes it easier for the driver 300 to recognize the route specification image 717 displayed in the middle display area B.

Next, display control of the inter-vehicle distance presentation image 712 and the preceding vehicle image 724 for notifying the driver of preceding vehicle approach information indicating that the inter-vehicle distance to the preceding vehicle 350 is narrow will be described.
In the present embodiment, the inter-vehicle distance to the leading vehicle 350 is recognized by distance detection means such as the object recognition device 100 or the sensor device 500. Then, the image control device 250 receives the recognition result data (forward interval information), and based on the recognition result data, the preceding vehicle image 724 displayed in the upper display area B and the inter-vehicle displayed in the middle display area B. The image display control is performed to change the display position in the display area 700, the brightness, the color, the image shape, and the like for the distance presentation image 712. In the present embodiment, the change in the inter-vehicle distance presentation image 712 and the preceding vehicle image 724 informs the driver 300 who visually recognizes this, to what extent the inter-vehicle distance from the preceding vehicle 350 is narrowed.

[Image example 1]
10 (a) to 10 (e) show an example of an image in which the image indicating the preceding vehicle approach information changes in accordance with the inter-vehicle distance to the leading vehicle 350 (hereinafter, this example image is referred to as "example 1"). FIG.
In the first image example, the destination is not set in the vehicle navigation device 400, and the operation instruction image according to the route navigation information is not displayed, but even when the operation instruction image according to the route navigation information is displayed And so on.

  In the first image example, when the leading vehicle 350 is not recognized, the image control device 250 has a shorter length and lower luminance in the middle display area B, as shown in FIG. 10A. An overall low brightness inter-vehicle distance presentation image 712 consisting of five horizontal lines is displayed. At this time, nothing is displayed in the upper display area A.

  Further, when the leading vehicle 350 is recognized and the inter-vehicle distance to the leading vehicle 350 is open enough to exceed the predetermined safe distance range, the image control device 250 sets the middle position as shown in FIG. 10B. Display control is performed to increase the brightness of the inter-vehicle distance presentation image 712 displayed in the display area B. Furthermore, in the first image example, the vehicle bumper image 712a is obtained by increasing the thickness of the line instead of the horizontal line image at the bottom of the inter-vehicle distance presentation image 712 and extending the both ends downward and outward. Implement display control to change the shape. The own vehicle bumper image reminds the driver 300 of the front bumper of the own vehicle 301.

  Furthermore, in the first image example, as shown in FIG. 10B, a low luminance leading vehicle image 724 simulating a vehicle rear surface is displayed in the upper display area A. The leading vehicle image 724 is display-controlled so that the driver 300 is perceived by the driving parallax so as to be displayed at the same perceived distance (Lc) as the other images displayed in the upper display area A. Ru.

  When the leading vehicle 350 is recognized and the distance between the leading vehicle 350 and the leading vehicle 350 is within the predetermined safe distance range, the image control device 250 displays in the middle display area B as shown in FIG. Display control is performed to increase the luminance of the displayed inter-vehicle distance presentation image 712 and the luminance of the preceding vehicle image 724 displayed in the upper display area A more than in the case of FIG. Furthermore, in the first image example, display control is also performed to change the second horizontal line image from the bottom to the vehicle bumper image 712a. Thus, the vehicle bumper image 712a is closer to the preceding vehicle image 724 than in the case of FIG. 10 (b), and the driver 300 is compared with the vehicle ahead 301 in the case of FIG. 10 (b). It can be made to recognize that it has approached 350.

  Furthermore, in the first image example, regarding the preceding vehicle image 724 shown in FIG. 10C, the perceived distance Le1 (Lb <Le1 <Lc) closer than the other images displayed in the upper display area A due to the driving parallax. The display is controlled so as to be perceived by the driver 300 as shown in FIG. Thus, the driver perceives that the leading vehicle image 724 is closer than in the case of FIG. 10B, so that the driver's vehicle 301 leads the case of FIG. 10B with respect to the driver 300. The fact that the vehicle 350 is approached can be more strongly recognized.

  When the leading vehicle 350 is recognized and the distance between the leading vehicle 350 and the leading vehicle 350 is closer than a predetermined safe distance range, but is longer than a predetermined required brake distance, the image control device 250 displays FIG. As shown in FIG. 10, the brightness of the inter-vehicle distance presentation image 712 displayed in the middle display area B and the brightness of the leading vehicle image 724 displayed in the upper display area A are the image example of FIG. Implement more display control than you do. Furthermore, in the first image example, display control is also performed to change the third horizontal line image from the bottom to the vehicle bumper image 712a. As a result, the vehicle bumper image 712a is closer to the preceding vehicle image 724 than in the case of FIG. 10C, and the driver's vehicle 301 is ahead of the case of FIG. 10C with respect to the driver 300. It can be recognized that the vehicle 350 is further approached.

  Furthermore, in the first image example, regarding the preceding vehicle image 724 shown in FIG. 10D, the perceived distance Le2 (Lb <Le2 <Le1) is closer than the other images displayed in the upper display area A due to the driving parallax. The display is controlled so as to be perceived by the driver 300 as displayed on the). Thus, the driver perceives that the leading vehicle image 724 is closer than in the case of FIG. 10C, so that the driver's vehicle 301 leads the case of FIG. 10C with respect to the driver 300. The fact that the vehicle 350 is further approached can be recognized more strongly.

  Further, when the leading vehicle 350 is recognized and the inter-vehicle distance with the leading vehicle 350 is narrowed to within the predetermined required brake distance range, the image control device 250 displays the middle display area B as shown in FIG. Display control is performed to change the inter-vehicle distance presentation image 712 displayed in the inside to a brake warning image 714 in which a character image of "brake!" Is drawn in a red trapezoidal shape. At this time, by lowering the luminance of the leading vehicle image 724 displayed in the upper display area A or stopping the image filling, the visibility of the leading vehicle image 724 is lowered, whereby the brake warning image 714 is further enhanced. It is preferable to make it stand out. The preceding vehicle image 724 in the upper display area A may be hidden so that the brake warning image is noticeable. At this time, in the case of the laser scanning method, since the light of the non-image portion can be completely blocked, the brake warning image can be made more noticeable, and the warning effect can be enhanced.

  The predetermined safety distance and the predetermined brake required distance described above may be a predetermined fixed distance, or may be a distance that fluctuates according to the vehicle speed of the host vehicle 301 or the like.

[Image example 2]
As an expression method for making the driver 300 notice that the inter-vehicle distance with the leading vehicle 350 is narrowed, the present invention is not limited to the above-described first image example. For example, an image example as shown in FIGS. 11 (a) and 11 (b) (Hereinafter, the present image example is referred to as “image example 2”).

  Similarly to the first image shown in FIGS. 10A to 10E, the second image example is also an image example in which the image indicating the preceding vehicle approach information changes according to the inter-vehicle distance from the leading vehicle 350. More specifically, the inter-vehicle distance presentation image 715 of the second image example is a trapezoidal image drawn by a perspective drawing toward the vanishing point instead of the five horizontal lines of the inter-vehicle distance presentation image 712 in the above-described image example 1 The one divided into four in the vertical direction is used. In the first image example described above, the second vehicle 350 and the second image example move in the same manner as the vehicle bumper image 712a moves upward so as to approach the preceding vehicle image 724 as the distance to the preceding vehicle 350 decreases. The high-brightness trapezoidal section 715a moves upward to approach the leading vehicle image 724 as the distance of The image in FIG. 11A corresponds to the image shown in FIG. 10D, and the leading vehicle 350 is recognized, and the distance between the leading vehicle 350 and the leading vehicle 350 is closer than a predetermined safe distance range. Is an example where the distance is longer than the predetermined required brake distance.

  Here, in the second image example, the destination is set in the vehicle navigation device 400, and the operation instruction image according to the route navigation information is displayed. Therefore, in a situation where the leading vehicle 350 is not recognized, a route designation image 721 is displayed near the center in the left-right direction (near the vanishing point) of the upper display area A as shown in FIG. The distance image 722 and the intersection etc name image 723 are displayed respectively.

  Under such circumstances, when the leading vehicle 350 is recognized and the leading vehicle image 724 is displayed in the upper display area A, the route change operation instruction images 721, 722, and 723 are all hidden from the upper display area A. Is also conceivable. However, in this case, the operation instruction content (the operation instruction content after the operation sequence) by the route change operation instruction images 721, 722, and 723 is not provided to the driver 300, which may cause the driver 300 to feel uneasy.

  On the other hand, when moving the course change operation instruction images 721, 722, and 723 displayed in the upper display area A to a display area different from the upper display area A and continuing the display, the driver moves the For example, it takes time to search for the course change operation instruction images 721, 722, and 723. Therefore, there is a possibility that the operation instruction content by the course change operation instruction images 721, 722, and 723 can not be provided appropriately to the driver 300.

  According to the second image example, even when the leading vehicle image 724 is displayed in the upper display area A in which the course change operation instruction images 721, 722, and 723 are displayed, the course change operation instruction images 721, 722, and 723 are displayed. Keep displaying in the upper display area A. Therefore, even when the leading vehicle image 724 is displayed in the upper display area A, the operation instruction content by the route change operation instruction images 721, 722, and 723 can be accurately provided to the driver 300.

  When the leading vehicle image 724 is displayed in the upper display area A in which the course change operation instruction images 721, 722, and 723 are displayed, all of the course change operation instruction images 721, 722, and 723 are in the upper display area A. It is not necessary to display the image continuously, for example, only the intersection etc. name image 723 may be hidden.

  Further, in the second image example, when the inter-vehicle distance with the leading vehicle 350 approaches within the predetermined required brake distance range, the image control device 250, as shown in FIG. A brake warning image 716 across the display area B is displayed. The brake warning image 716 is a combination of a red image obtained by enlarging the preceding vehicle image 724 displayed in the upper display area A and an image obtained by displaying all trapezoidal sections of the inter-vehicle distance presentation image 715 of the present image example 2 in red. It is Moreover, in the second image example, in order to make the brake warning image 716 more noticeable, all of the route change operation instruction images 721, 722, and 723 are not displayed.

[Image example 3]
As an expression method for making the driver 300 notice that the inter-vehicle distance with the leading vehicle 350 has become narrow, for example, an image example shown in FIGS. 12A and 12B (hereinafter, this image example Example 3 ”.
Similarly to the above-described first and second image examples, the third image example is also an image example in which an image indicating preceding vehicle approach information changes in accordance with the inter-vehicle distance from the leading vehicle 350. More specifically, the image showing the preceding vehicle approach information in the third image example is a simple figure (circular in the third image example 3) instead of the preceding vehicle image 724 or the inter-vehicle distance presentation image 712 imitating the back of the vehicle. A simple graphic image 713 configured is used. Then, in the third image example, display control is performed such that the perceived distance with the simple graphic image 713 is narrowed as the distance with the leading vehicle 350 is narrowed.

  Specifically, as shown in FIGS. 12A to 12C, as the distance to the leading vehicle 350 is narrowed, display control is performed so that the simple graphic image 713 is expanded, or the brightness of the simple graphic image 713 is Display control to increase. In particular, in the third image example, display control is performed so that the perceived distance due to the motion parallax of the simple graphic image 713 decreases as the distance to the leading vehicle 350 decreases.

  That is, the virtual image G including the simple graphic image 713 is displayed at a distance of 5 m from the driver 300, but is displayed in the case of FIG. 12A in which the distance to the leading vehicle 350 is large. Display control is performed so as to have a perceived distance (for example, 10 m) that is the same as or close to the perceived distance Lc of the region A. Specifically, the image control device 250 is simply displayed in the middle display area B of the display area 700 of the virtual image G according to the driver's head movement amount Dd calculated from the captured image data of the driver camera 150. By changing the position in the display area 700 of the graphic image 713, display control is performed so that the perceptual distance of the simple graphic image 713 becomes about 10 m as described above.

  Also, in the case of FIG. 12 (b) where the distance to the leading vehicle 350 is closer than in the case of FIG. 12 (a), the perception distance (eg 7 m) closer to the perception distance in the case of FIG. Perform display control on the Specifically, the image control device 250 is simply displayed in the middle display area B of the display area 700 of the virtual image G according to the driver's head movement amount Dd calculated from the captured image data of the driver camera 150. By changing the position in the display area 700 of the graphic image 713, display control is performed so that the perceived distance of the simple graphic image 713 becomes about 7 m described above.

  Similarly, in the case of FIG. 12 (c) in which the distance to the leading vehicle 350 is closer than in the case of FIG. 12 (b), the perception distance (eg 4 m) closer than the perception distance in the case of FIG. Control the display to become Specifically, the image control device 250 is simply displayed in the middle display area B of the display area 700 of the virtual image G according to the driver's head movement amount Dd calculated from the captured image data of the driver camera 150. By changing the position in the display area 700 of the graphic image 713, display control is performed so that the perceived distance of the simple graphic image 713 becomes about 4 m as described above. Although this perceived distance (4 m) is closer than the distance (5 m) of the virtual image G, this can also be realized by the display control described above.

[Image example 4]
Next, another image example (hereinafter, this image example is referred to as “image example 4”) showing a situation of changing the course at the latest intersection will be described.
When it comes to the situation of changing the course at the nearest intersection, the above-described embodiment provides the driver 300 with information on which intersection to go in which direction, using the image example shown in FIG. In the present image example 4, the image examples shown in FIGS. 13 (a) to 13 (c) are used.

  In the fourth image example, the route specification image 717 is displayed in the display area 700 so as to overlap the actual intersection visually recognized by the driver via the windshield 302. In the example of the image shown in FIG. 9, the remaining distance information as passive information indicating the remaining distance to the intersection etc. where the route change operation is performed is provided to the driver 300 by the remaining distance image 722 showing the remaining distance by a numerical image. doing. On the other hand, in the fourth image example, by changing the perceived distance of the route specification image 717 according to the remaining distance information, the remaining distance up to the intersection etc. where the route change operation is performed by the perceived distance of the route specification image 717 The information is provided to the driver 300.

  Specifically, the image control device 250 displays the course displayed in the middle display area B of the display area 700 of the virtual image G according to the driver's head movement amount Dd calculated from the captured image data of the driver camera 150. By changing the position in the display area 700 of the designated image 717, display control is performed so that the perceived distance of the simple graphic image 713 matches the distance to the actual intersection. The actual distance to the intersection can be obtained, for example, from the vehicle navigation device 400.

  The perceptual distance of the simple graphic image 713 and the distance to the actual intersection need not necessarily coincide with each other. By gradually narrowing the perceptual distance of the simple graphic image 713, the distance to the actual intersection is approaching. It is sufficient if the driver can be made aware.

[Image example 5]
In addition, of the information related to prohibition, restriction, and designation of traffic on the road on which the vehicle 301 is traveling, information particularly preferred to be provided to the driver 300 is displayed in the middle display area B as a warning image. You may For example, as shown in the image example shown in FIG. 14 (hereinafter, this image example will be referred to as “image example 5”), if the road on which the vehicle 301 is traveling is a attending school, The warning image 718 is displayed in the middle display area B. Specifically, the image control device 250 acquires the specific information of the road on which the vehicle 301 is traveling from the various information and the like output from the vehicle navigation device 400, and the acquired road specific information is in the middle display area B. When the target information is to be displayed on the display control unit 10, display control is performed to display a warning image corresponding to the road specific information in the middle display area B.

  As described above, the middle display area B is an area where the operation instruction image indicating the content of the operation instruction to be operated first among the plurality of operation instruction contents is displayed. Therefore, by displaying a warning image in the middle display area B as in this example 5 of the image, the driver prohibits, restricts, or designates traffic on the road on which the vehicle 301 is currently traveling by the warning image. You can intuitively recognize that you are done.

[Image example 6]
In addition, when a person who is trying to cross a pedestrian crossing in the traveling direction of the vehicle 301 is detected, the warning image may be displayed in the middle display area B. Humans are one of the most important targets for vehicles, and they are the ones that should be dealt with immediately. For example, as in the image example shown in FIG. 15 (hereinafter, this image example is referred to as “image example 6”), the human-type warning image 719 is displayed in the middle display area B. Specifically, the image control device 250 recognizes a person in front of the own vehicle by the object recognition device 100 and the sensor device 500. Then, the image control device 250 receives the recognition result data, and performs display control for displaying the humanoid warning image 719 in the middle display area B based on the recognition result data. In the sixth image example, the attending school road warning image 718 in the above-described image example 5 is also displayed. In addition, when the information provision apparatus of this embodiment is mounted, for example in ships other than a vehicle, it can replace with a human and can display other ships etc. of the circumference of the own ship.

The above-described one is an example, and each mode has the unique effect.
(Aspect A)
A predetermined moving direction ahead of the moving object in which the driver visually recognizes the driver provided information image indicating the driver provided information to be provided to the driver 300 of the moving object such as the own vehicle 301 via the light transmitting member such as the windshield 302 An information providing apparatus such as a HUD device 200 for an automobile including image light projecting means such as HUD main body 230 projecting image light to the light transmitting member so as to be displayed on the display area 700 of Distance detection means such as the object recognition device 100 for detecting the relative distance of the moving object in the traveling direction of the detection object such as the preceding vehicle 350 present in the surroundings, viewpoint position of the driver camera 150 etc. detecting the viewpoint position of the driver The object image is displayed by changing the display position of the object image such as the preceding vehicle image 724 indicating the object to be detected according to the detection means and the detection result of the viewpoint position detection means. The image control device 250 or the like for controlling the image light projection means such that the driver's perceived distance due to motion parallax changes according to the relative distance of the moving object traveling direction of the detection object detected by the distance detection means And the display control means of
It is useful to provide the driver with information on the relative movement of an object present around the mobile body (surrounding object information) by means of the image projected by the image light projection means. For example, in a situation where it is difficult for the driver to directly view an object around the moving object due to poor visibility around the moving object or the like, such surroundings are displayed by an object display image corresponding to the object displayed using the HUD device. If object information can be provided to the driver, it is possible to drive more safely. In addition, it is possible to drive more safely if surrounding object information regarding the movement of an object that is likely to be overlooked due to the driver's lack of attention etc. can be provided to the driver, not only in a situation where it is difficult for the driver to see directly. is there. Moreover, when providing surrounding object information to the driver in this manner, the driver is made to perceive that the depth position of the object display image changes in accordance with the relative movement of the object relative to the moving object. This is effective in making it easier for the driver to recognize surrounding object information. And, as a method of causing the driver to perceive in this way, it is effective to use motion parallax.
According to this aspect, the predetermined display area ahead of the moving object in the moving direction according to the relative distance (relative distance in the moving direction of the moving object) with the moving object in the moving direction of the detection object present around the moving object. The perceived distance of the object image displayed on can be changed. In this aspect, the driver is made to perceive the perceptual distance of the object image by the motion parallax, so the driver can easily recognize information (surrounding object information) of the movement of the detection object approaching or leaving the moving object. .

(Aspect B)
In the aspect A, the object to be detected is another moving body such as a leading vehicle 350 traveling in front of the moving body.
According to this, it becomes easy for the driver 300 to recognize information (front car approach information and the like) that the distance to the other moving object to be preceded is narrowed.

(Aspect C)
A predetermined moving direction ahead of the moving object in which the driver visually recognizes the driver provided information image indicating the driver provided information to be provided to the driver 300 of the moving object such as the own vehicle 301 via the light transmitting member such as the windshield 302 An information providing apparatus such as a HUD device 200 for an automobile including image light projection means such as a HUD main body 230 for projecting image light onto the light transmission member so as to be displayed in the display area 700 of The area is a road name display image 701 showing active information such as road specific information and vehicle speed information actively recognized by the driver, a speed limit display image 702, an overtaking prohibition display image 703, a vehicle speed display image 704 and the like. Active information image display area such as lower display area C where images are continuously displayed, and route navigation information and front car approach information etc. passively recognized by the driver It temporarily displays passive information images such as traveling lane indication image 711 indicating movement information, course change operation indication images 721, 722, and 723, inter-vehicle distance presentation image 712, preceding vehicle image 724, etc. at timing when predetermined information provision condition is satisfied. A viewpoint position detection unit such as a driver camera 150 that detects a viewpoint position of the driver, and a passive information image display region such as an upper display region A and a middle display region B, and detection of the viewpoint position detection device By changing the display position of the passive information image displayed in the passive information image display area according to the result, the driver's perceived distance Lb and Lc with respect to the passive information image due to motion parallax is the active information image display area Image control device for controlling the image light projection means to be longer than the driver's perceived distance La of the active information image displayed on the It characterized by having a display control means 250, and the like.
A driver who is driving usually looks at an infinity point ahead of the moving body, or looks at another moving body several tens of meters ahead, through the light transmitting member. For a driver who is driving in such a distant focus, as the image displayed farther, the difference in focal distance with respect to the point of gaze is smaller, so the user can easily perceive the image (it is easy to notice).
Here, passive information that is passively recognized by the driver is generally information that the driver wants to be provided at the timing determined by the information providing device, and usually, the timing at which the passive information is provided and the passive information. It is information that has a certain relationship with the content of the information. Therefore, it is important that the passive information image indicating the passive information be recognized by the driver 300 as soon as it is displayed.
On the other hand, the active information actively recognized by the driver is generally sufficient information provided to the driver at a timing desired by the driver, and the timing at which the active information is provided and the active information It is such that the relationship between content is low or absent. And, since the active information needs to be provided at the driver's desired timing, it is continuously displayed for a long period of time or at all times.
In this aspect, the driver perceives that the passive information image is displayed farther than the active information image by motion parallax. Therefore, for a driver driving while focusing on a distance, the passive information image is easier to recognize than the active information image. Therefore, when the passive information image is displayed, the driver is likely to notice the passive information image even if the active information image is displayed. Therefore, the driver 300 can easily recognize as soon as the passive information image is displayed, and can rapidly provide the passive information to the driver.
In addition, it is difficult for a driver who is in focus at a distance to recognize an active information image perceived to be displayed at a distance closer than the passive information image. However, since the active information image is to be viewed by the driver 300 with the intention of acquiring the active information, even when the active information image is more difficult to recognize than the passive information image, it is possible to provide the active information. Is not a problem.
Rather, since the active information image is continuously displayed for a long period of time as described above, if the active information image is easy to recognize, it causes the driver's awareness during driving. However, there is a risk of causing disadvantages.

(Aspect D)
In the mode C, the passive information includes a plurality of operation instruction information indicating different operation instruction contents to the driver of the moving body, and the display control unit is configured to transmit traveling lane instruction images 711 corresponding to the respective operation instruction information. And a plurality of operation instruction images such as a course change operation instruction image 721, 722, 723, etc. are displayed on the upper side in the passive information image display area so as to indicate the contents of the operation instruction for the driver to operate later. To control the image light projection means.
The driver usually thinks of a distance that an object located in front of a moving object approaches toward the current position with the passage of time, and future events approach the current time with the passage of time It combines with the idea of time. And, the time to reach the position of the moving body is quicker as the distance to the moving body is shorter, and the distance to the moving body is faster to reach the position of the moving body. Time is late. Therefore, an object located far from the moving object has high affinity for cognition with events in the far future, and an object located near to the moving object has cognitive affinity between the near future event. Is high. According to this aspect, in consideration of the affinity, the operation instruction image indicating the content of the operation instruction to be performed later by the driver is displayed on the upper side in the predetermined display area, so that these operations It is easy to make the driver intuitively recognize the operation order of the plurality of operation instruction contents indicated by the instruction image, and to avoid the situation where the driver loses the operation order.

(Aspect E)
In the aspect D, the image light projection unit is configured to transmit the light so that the passive information image display area is positioned below a landscape in front of the moving object traveling direction viewed by the driver via the light transmitting member. It is characterized in that the image light is projected to the member.
Usually, the driver 300 who visually recognizes the front scenery in the moving object traveling direction via the light transmission member often performs driving while gazing at a vicinity of the vertical center of the scenery in front of the front scenery as a fixation point. In this aspect, since the predetermined display area 700 in which the plurality of operation instruction images are displayed is located at the lower part of the front landscape, the plurality of operation instruction images are displayed vertically below the driver's gaze point It will be done. A landscape portion in which a plurality of operation instruction images displayed at this position overlap is visually recognized at the upper side in the vertical direction as an object farther from the moving body, and is visually recognized at the lower side in the vertical direction as the object closer to the moving body. Therefore, the position at which the object in the landscape part is visually recognized is gradually displaced downward as the moving object approaches the moving object.
When a plurality of operation instruction images are superimposed and displayed on such a landscape portion, as in the present aspect, the operation instruction image indicating the content of the operation instruction to be operated later by the driver is in the predetermined display area The display on the upper side can minimize the driver's confusion regarding the operation sequence. This is an operation instruction image showing the operation instruction content (operation instruction content to which the operation order will be later) which is distant so as to be superimposed on the position where the object distant from the moving object is viewed in consideration of the affinity of recognition described above. Can be displayed, and an operation instruction image can be displayed that indicates the near future operation instruction content (the operation instruction content for which the operation order comes first) so as to overlap the position where the object closer to the moving object is viewed. is there. If displayed in this manner, the driver can intuitively recognize the operation order of the plurality of operation instruction contents indicated by the operation instruction images. Conversely, when the predetermined display area 700 is located at the lower part of the front scenery, for example, the display positions of the plurality of operation instruction images are reversed from the above positions, or the display of the plurality of operation instruction images is performed. When the positions are arranged side by side, it is difficult for the driver to intuitively recognize the operation order, which is disturbed by the above-mentioned idea.

(Aspect F)
In the mode D or E, the driver sets the plurality of operation instruction images at different points on the movement route of the moving body (the nearest intersection and the intersection or branch point where the course should be changed next from the straight ahead direction) It is characterized in that it indicates an operation instruction content for instructing an operation content to be operated.
According to this, it is possible to avoid a situation in which the driver loses the operation order of a plurality of operation instruction contents different in the operation order by the route navigation information.

(Aspect G)
In any one of the above aspects A to F, the image light projection means displays the operation instruction image as a virtual image G in the predetermined display area by the image light to be projected, and the virtual image from the driver It is characterized by the distance to 5 m or more.
When the distance to the virtual image G is about 2 m in general, focusing the virtual image G at such a short distance requires convergence motion of the eye. As described above, the convergence motion is a factor that greatly affects the sense of distance to the visual object and the sense of depth, and when the eyeball converges to focus on the virtual image G, the sense of distance due to motion parallax (perception The effect of perceiving changes in distance) and sense of depth (difference in perceived distance) diminishes.
According to this aspect, since the distance to the virtual image G is 5 m or more, the virtual image G can be focused with almost no convergence movement of the eye. Therefore, the effect of causing the sense of distance (change in perceived distance) and the sense of depth (difference in perceived distance) to be perceived using motion parallax is suppressed from being reduced by convergence movement of the eye.

(Aspect H)
In any one of the above aspects A to G, the image light projection unit scans the image light irradiated from the light irradiation unit such as the light source unit 220 that emits the image light corresponding to the image information of the operation instruction image. The driver-provided information image is displayed in the predetermined display area by performing two-dimensional scanning by light scanning means such as the device 208 and projecting the light to the light transmitting member.
As described above, it is easier to display a large virtual image G with high luminance than a method using a liquid crystal display (LCD), a fluorescent display (VFD) or the like. Further, according to this aspect, with respect to the non-image portion of the virtual image G, it is possible to completely eliminate the light of the non-image portion by not irradiating the image light from the light irradiating means. Therefore, the situation in which the visibility of the front of the moving body through the non-image portion is reduced by the light emitted from the light irradiating means can be avoided, and the visibility of the front landscape is high.

(Aspect I)
The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing method for providing the driver-provided information to a driver by projecting an image light onto a transmissive member, wherein a relative distance between a moving object and a detection object present around the moving object is detected. By changing the display position of the object image showing the detection object according to the detection result in the distance detection step, the viewpoint position detection step for detecting the viewpoint position of the driver, and the viewpoint position detection step, And a display step of changing the perceived distance of the driver by the motion parallax of the object image in accordance with the relative distance of the moving object in the traveling direction of the detection object detected in the distance detection step.
According to this aspect, the driver is made to perceive the perceptual distance of the object image by the motion parallax, so the driver is notified of information (surrounding object information) about the movement of the detected object approaching or leaving the moving object. It is easy to do.

(Aspect J)
The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. Image light projection means for projecting image light onto the transmission member, distance detection means for detecting the relative distance of the moving object in the traveling direction of the detection object present around the movable body, and viewpoint position for detecting the viewpoint position of the driver And a control program for providing information of the information providing apparatus including the detection means, wherein the display position of the object image showing the detection object is changed according to the detection result of the viewpoint position detection means. Is set so that the driver's perceived distance due to the motion parallax of the object image changes in accordance with the relative distance of the moving object in the traveling direction of the detection object detected by the distance detection means. Display control means for controlling the image light projection means, characterized by causing the computer to function.
According to this aspect, the driver is made to perceive the perceptual distance of the object image by the motion parallax, so the driver is notified of information (surrounding object information) about the movement of the detected object approaching or leaving the moving object. It is easy to do.

(Aspect K)
The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing method for providing the driver-provided information to a driver by projecting image light onto a transmissive member, wherein the predetermined display area is an active information indicating active information actively recognized by the driver. An active information image display area for continuously displaying an information image and a passive information image display area for temporarily displaying a passive information image showing passive information passively recognized by the driver at a timing when a predetermined information provision condition is satisfied. A passive information image displayed in the passive information image display area according to a viewpoint position detecting step of detecting a viewpoint position of the driver, and a detection result in the viewpoint position detecting step By changing the display position, the driver's perceived distance for the passive information image due to motion parallax is longer than the driver's perceived distance for the active information image displayed in the active information image display area, And a display control step of controlling the image light projection means.
According to this aspect, since the passive information image is more easily recognized by the driver while driving while focusing on the distance than the active information image, the driver is activated when the passive information image is displayed. Even if the information image is displayed, it is easy to notice the passive information image. Therefore, the driver 300 can easily recognize as soon as the passive information image is displayed, and can rapidly provide the passive information to the driver.

(Aspect L)
The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing control program for causing a computer of an information providing apparatus to function, comprising: image light projecting means for projecting image light onto a transmitting member; and viewpoint position detecting means for detecting the viewpoint position of the driver, The predetermined display area is an active information image display area for continuously displaying an active information image showing active information actively recognized by the driver, and a passive information image showing passive information passively recognized by the driver. And a passive information image display area for temporarily displaying the information at a timing when a predetermined information provision condition is satisfied, and the passive information image table according to the detection result of the viewpoint position detecting means. By changing the display position of the passive information image displayed in the area, the driver's perceived distance with respect to the passive information image due to motion parallax is displayed in the active information image display area. The computer is caused to function as display control means for controlling the image light projection means so as to be farther than the perceived distance.
According to this aspect, since the passive information image is more easily recognized by the driver while driving while focusing on the distance than the active information image, the driver is activated when the passive information image is displayed. Even if the information image is displayed, it is easy to notice the passive information image. Therefore, the driver 300 can easily recognize as soon as the passive information image is displayed, and can rapidly provide the passive information to the driver.

  The above-described program can be distributed or obtained in the state of being recorded on a recording medium such as a CD-ROM. Alternatively, the above-described program may be loaded and distributed or received via a transmission medium such as a public telephone line, a dedicated line, or another communication network by transmitting or receiving a signal transmitted by a predetermined transmission device. It is available. At the time of this distribution, at least a part of the computer program may be transmitted in the transmission medium. That is, all the data making up the computer program need not be present on the transmission medium at one time. The signal carrying the program described above is a computer data signal embodied on a predetermined carrier including a computer program. In addition, the transmission method of transmitting a computer program from a predetermined transmission apparatus includes the case of continuously transmitting data constituting the program and the case of intermittently transmitting data.

DESCRIPTION OF SYMBOLS 100 Object recognition apparatus 110 Stereo camera part 120 Information processing part 150 Driver camera 200 HUD device 201R, 201G, 201B for motor vehicles Laser light source 207 Light quantity adjustment part 208 Optical scanning device 209 Free-form surface mirror 210 Micro lens array 211 Projection mirror 220 Light source unit 230 HUD main body 250 image control device 300 driver 301 own vehicle 302 windshield 350 leading vehicle 400 vehicle navigation device 500 sensor device 700 display area 701 road name display image 702 speed limit display image 703 overtaking prohibition display image 704 vehicle speed display image 711 Lane instruction image 712, 715 inter-vehicle distance presentation image 713 simple figure image 712a own vehicle bumper image 714, 716 brake warning image 718 school attending road warning image 719 people Warning image 717,721 course designated image 722 remaining distance image 723 intersections like name image 724 preceding vehicle image 725 downward mark image A upper display area B middle display area C lower display area G virtual image

Patent 4686586 gazette

The present invention relates to an image display device, the moving member and at about the image display method and a program.

It is in this type of image display apparatus, a head-up display for displaying vehicle that moves carrying the driver, a ship, an aircraft, an image for providing information to the driver of the moving object, such as industrial robots (HUD) A device using an apparatus or the like is known.

In order to solve the problems described above, the present invention provides a position detection unit that detects a viewpoint position of a driver driving a moving object, an active information image actively recognized by the driver, and predetermined information provision. And a display unit for visually displaying the passive information image displayed to be recognized by the driver when the conditions are satisfied to the driver via the light transmitting member, the display unit being configured to By changing and displaying the display position of the passive information image based on the detection information of the detection unit, the driver's perceived distance of the passive information image is made different from the driver's perceived distance of the active information image. It is characterized by displaying .

Claims (12)

The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing apparatus comprising image light projection means for projecting image light onto a transmission member, comprising:
Distance detection means for detecting the relative distance of the moving object in the traveling direction of the detection object present around the moving object;
Viewpoint position detecting means for detecting the viewpoint position of the driver;
By changing the display position of the object image showing the detection object according to the detection result of the viewpoint position detection means, the distance detection means detects the driver's perceived distance due to the motion parallax of the object image And a display control unit configured to control the image light projection unit so as to change in accordance with the relative distance of the moving object in the traveling direction of the detection target. In the information providing device according to claim 1,
The information providing apparatus, wherein the detection object is another moving object that travels in front of the moving object. The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing apparatus comprising image light projection means for projecting image light onto a transmission member, comprising:
The predetermined display area is an active information image display area for continuously displaying an active information image showing active information actively recognized by the driver, and a passive information image showing passive information passively recognized by the driver. And a passive information image display area for temporarily displaying at a timing when a predetermined information provision condition is satisfied,
Viewpoint position detecting means for detecting the viewpoint position of the driver;
By changing the display position of the passive information image displayed in the passive information image display area according to the detection result of the viewpoint position detection means, the driver's perceived distance with respect to the passive information image due to motion parallax is active And a display control unit configured to control the image light projection unit so as to be longer than a driver's perceived distance with respect to an active information image displayed in the information image display area. In the information providing device according to claim 3,
The passive information includes a plurality of operation instruction information indicating different operation instruction contents to the driver of the moving body,
The display control means displays a plurality of operation instruction images respectively corresponding to the respective operation instruction information, in the upper side of the passive information image display area, as indicating the contents of the operation instruction whose operation order after which the driver operates the later And controlling the image light projection means as described above. In the information providing device according to claim 4,
The image light projection means directs the image light to the light transmission member such that the passive information image display area is positioned under the landscape in front of the moving object traveling direction viewed by the driver via the light transmission member. An information providing apparatus characterized by projecting. In the information providing device according to claim 4 or 5,
The information providing apparatus according to claim 1, wherein the plurality of operation instruction images indicate operation instruction contents for instructing an operation content to be operated by the driver at different points on the moving route of the moving body. The information providing device according to any one of claims 1 to 6.
The image light projection means displays the operation instruction image as a virtual image in the predetermined display area by the image light to be projected.
The information providing device, wherein a distance from a driver to the virtual image is 5 m or more. The information providing device according to any one of claims 1 to 7.
The image light projection means two-dimensionally scans the image light emitted from the light irradiation means for emitting the image light corresponding to the image information of the operation instruction image by the light scanning means and projects the light to the light transmission member. An information providing apparatus characterized by displaying the driver provided information image in the predetermined display area. The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing method for providing the driver-provided information to a driver by projecting image light onto a transmissive member.
A distance detection step of detecting a relative distance of a moving object in the traveling direction of the detection object present around the moving object;
A viewpoint position detecting step of detecting a viewpoint position of the driver;
By changing the display position of the object image showing the detection object according to the detection result in the viewpoint position detection step, the driver's perceived distance due to the motion parallax of the object image is detected in the distance detection step And d. Displaying the detected object according to the relative distance of the moving object in the traveling direction of the object. The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. Image light projection means for projecting image light onto the transmission member, distance detection means for detecting the relative distance of the moving object in the traveling direction of the detection object present around the movable body, and viewpoint position for detecting the viewpoint position of the driver A control program for providing information, for causing a computer of an information provision device comprising a detection means to function,
By changing the display position of the object image showing the detection object according to the detection result of the viewpoint position detection means, the distance detection means detects the driver's perceived distance due to the motion parallax of the object image An information control program for causing the computer to function as display control means for controlling the image light projection means so as to change in accordance with the relative distance of the moving object traveling direction of the detection object. The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing method for providing the driver-provided information to a driver by projecting image light onto a transmissive member.
The predetermined display area is an active information image display area for continuously displaying an active information image showing active information actively recognized by the driver, and a passive information image showing passive information passively recognized by the driver. And a passive information image display area for temporarily displaying at a timing when a predetermined information provision condition is satisfied,
A viewpoint position detecting step of detecting a viewpoint position of the driver;
By changing the display position of the passive information image displayed in the passive information image display area according to the detection result in the viewpoint position detection step, the driver's perceived distance with respect to the passive information image due to motion parallax is A display control step of controlling the image light projection means so as to be longer than a driver's perceived distance with respect to an active information image displayed in an active information image display area. The light is provided so that a driver provided information image indicating driver provided information to be provided to the driver of the mobile object is displayed in a predetermined display area ahead of the mobile object traveling direction viewed by the driver via the light transmitting member. An information providing control program for causing a computer of an information providing apparatus to function, comprising: image light projecting means for projecting image light onto a transmitting member; and viewpoint position detecting means for detecting the viewpoint position of the driver,
The predetermined display area is an active information image display area for continuously displaying an active information image showing active information actively recognized by the driver, and a passive information image showing passive information passively recognized by the driver. And a passive information image display area for temporarily displaying at a timing when a predetermined information provision condition is satisfied,
By changing the display position of the passive information image displayed in the passive information image display area according to the detection result of the viewpoint position detection means, the driver's perceived distance with respect to the passive information image due to motion parallax is active Information provision characterized in that the computer functions as display control means for controlling the image light projection means so as to be farther than the driver's perceived distance with respect to the active information image displayed in the information image display area Control program.