JP2020158014A - Head-up display device, display control device, and display control program - Google Patents

Abstract

To achieve information perception at a virtual image display distance intended by an HUD device while reducing a burden, etc. on the HUD device, for example.SOLUTION: A head-up display (HUD) device capable of controlling a virtual image display distance on an object includes: an image display part 46 for displaying an image of the object; and a depth display control part 34 for, in causing the image of the object to be displayed in the image display part, causing the image of the object to be displayed by 3D display control including at least distance control for variably controlling the virtual image display distance when the virtual image display distance of the object is smaller than a threshold, and causing the image of the object to be displayed by pseudo 3D display control that achieves 3D display in a pseudo manner by changing a display mode on the object when the virtual image display distance of the object is larger than the threshold.SELECTED DRAWING: Figure 7

Description

The present invention relates to, for example, a head-up display (HUD) device, a display control device, a display control program, and the like mounted on a vehicle such as an automobile.

Patent Document 1 discloses a 3D navigation system in a head-up display (HUD) device in which graphic elements are made to appear three-dimensional by moving the focal plane or adjusting the distance between the focal plane and a vehicle. ing.

Further, Patent Document 2 discloses that, as one of the modes for changing the distance to a virtual image in the HUD device, a virtual image display surface is provided obliquely with respect to the road surface, and perspective control is performed by a display position. (For example, FIGS. 8 and 9).

Further, in Patent Document 3, in a HUD device that gives a three-dimensional effect by the shape or the like of a display object instead of adjusting the distance, the display control such that the shape or the like is changed or returned to the original state is provided depending on the situation. It is shown to do.

Japanese Unexamined Patent Publication No. 2015-69656 Japanese Unexamined Patent Publication No. 2016-117345 WO2016-166887

In the HUD device that controls the distance for displaying the virtual image (virtual image display distance) itself, if the distance control is always executed in the entire range of the virtual image display distance, the burden on the HUD device is heavy, and the package size of the HUD device is large. (Specifically, the size and dimensions of the housing and the like constituting the external shape of the HUD device) will be increased in size.

Further, if the load on the HUD device is increased, the time required for image processing or the like increases, which may cause a processing delay. Further, there is a concern that the power consumption of the HUD device may increase and the amount of heat generated may increase. Such a problem has been clarified by the examination of the present inventor.

The display control described in Patent Document 3 changes the shape of the displayed content to make it appear three-dimensional, and is not a method of variably controlling the virtual image display distance, and the technical content thereof is the same as that of the present invention. Is fundamentally different. Therefore, Patent Document 3 does not show the above-mentioned problems and the means for solving them.

One object of the present invention is, for example, to realize the perception of information at the virtual image display distance intended by the HUD device while reducing the burden on the HUD device.

Other objects of the invention will become apparent to those skilled in the art by reference to the embodiments and best embodiments exemplified below, as well as the accompanying drawings.

Hereinafter, in order to easily understand the outline of the present invention, embodiments according to the present invention will be illustrated.

In the first aspect, the head-up display device is mounted on a vehicle and projects an image of an object onto a projected member provided on the vehicle so that the user can visually recognize a virtual image of the image and on the user. Alternatively, it is a head-up display (HUD) device capable of controlling the virtual image display distance for the object when the distance from the reference point set on the vehicle to the virtual image is defined as the virtual image display distance.
An image display unit that displays an image of the object,
When the image of the object is displayed on the image display unit, when the virtual image display distance of the object is smaller than the threshold value, the image of the object is displayed by 3D display control including at least a distance control for variably controlling the virtual image display distance. Depth display control for displaying an image of the object by pseudo 3D display control that realizes pseudo 3D display by changing the display form of the object when the virtual image display distance of the object is larger than the threshold value. Has a part and.

In the first aspect, for example, for an object displayed within a range not exceeding a predetermined threshold value, processing including direct control of the virtual image display distance (pseudo 3D display control by changing the display form can be combined with these. Collectively, it is referred to as "3D display control"). On the other hand, for objects that are displayed far away beyond the threshold value, perspective enhancement (expressing perspective by changing the display form) by pseudo 3D image processing is performed through perception without direct distance control. Distance control will be implemented.

The convergence angle when a person sees an object (object) at a certain distance is sufficiently small, and it is difficult for the person to perceive a change in the convergence angle by distance control. Therefore, when the desired effect of perspective control cannot be expected, the direct distance control, which tends to involve complicated processing, is abandoned, and perspective enhancement is performed only by pseudo 3D image processing (for example, the size of the object is reduced). ) It was decided.

As a result, it becomes possible to effectively display a distant object with a sense of perspective. Further, the processing load of the display device is increased by controlling the distance only in the range effective for the human eye, instead of controlling the virtual image display distance over the entire range (total distance range) in which the HUD device can control the distance. Can be reduced. Therefore, the increase in size of the package of the display device (HUD device as a vehicle display device, etc.) is suppressed, which is advantageous in terms of cost, and the problem of heat generation is also suppressed. Therefore, it is possible to realize the perception of information at the virtual image display distance intended by the HUD device while reducing the burden on the HUD device.

In the second aspect, which is subordinate to the first aspect,
The depth display control unit
When the virtual image display distance of the object is larger than the threshold value, the distance indicated by the threshold value is defined as the virtual image display distance for the object, and the image of the object is controlled by the pseudo 3D display control on the virtual image display surface of the virtual image display distance. May be displayed.

In the second aspect, when the virtual image display distance of the object is larger than the threshold value and the pseudo 3D display control is executed to display the virtual image, the virtual image display distance is set to the distance indicated by the threshold value. As a result of comparing the actual virtual image display distance with the threshold value, when the virtual image display distance is larger than the threshold value, the threshold value itself used for the comparison is set as the virtual image display distance, so that the virtual image display distance is newly determined. There is no need to fix it, the burden on the device is reduced, and quick virtual image display processing becomes possible.

In the third aspect, which is subordinate to the first or second aspect, changing the display form of the object includes at least one of three-dimensionalization, shading, color change, shape change, and size change. May be included.

In the third aspect, the "change of display form", which is a kind of pseudo 3D display, includes three-dimensional drawing (drawing by perspective, for example, making a line diagonal) or the shape remains the same. You can create a sense of perspective by adding shadows, or change the color and shape, and change the size of all (appearance) of the object (however, it is not limited to this, and some sizes may be changed). Can be included. As a result, it is possible to easily and efficiently generate perspective perception by using various methods, the burden on the device can be reduced, and the size of the package can be reduced.

In the fourth aspect, which is subordinate to any one of the first to third aspects,
The 3D display control including at least the distance control for variably controlling the virtual image display distance may be the distance control alone or a combination of the distance control and the pseudo 3D display control.

In the fourth aspect, when the virtual image display distance is smaller than the threshold value and the virtual image display distance is directly controlled (3D control is performed), pseudo 3D control may be performed by changing the display form. This makes it possible to produce a sense of perspective more efficiently, which is also advantageous in ensuring the continuity of the displayed virtual image.

In the fifth aspect, which is subordinate to any one of the first to fourth aspects,
The depth display control unit
When the virtual image display surface is tilted without being erected perpendicular to the road surface or overlaps the road surface, the distance of the virtual image display surface that is tilted or overlaps the road surface is greater than the distance indicated by the threshold value. When displaying a virtual image of the object at a location far from the user, the entire virtual image portion corresponding to the location is displayed at the threshold value and the virtual image display distance in the vicinity thereof, and the virtual image is displayed. The pseudo 3D display control is performed on the image corresponding to the portion so that the virtual image portion is connected to the virtual image portion of the object closer to the user than the distance indicated by the threshold value with a sense of perspective. The display may be controlled.

In the fifth aspect, it is assumed that the virtual image display distance is directly controlled by changing the display position on the virtual image display surface that is tilted with respect to the road surface (or is superimposed on the road surface).

For example, even if the device cannot change the virtual image display distance by changing the optical path length, if the virtual image display surface is tilted (superimposed) with respect to the road surface, for example, the virtual image display surface can be changed. The lower virtual image portion can be seen in the foreground, and the upper side becomes farther visible, and the virtual image display distance can be adjusted according to the display position.

In this case, it is assumed that the present invention is applied. When the distance indicated by the above threshold value is within the variable distance range due to the position change on the tilted (or superposed) virtual image display surface, some virtual images are located farther than the threshold value. become. Images corresponding to some of the virtual images at this distant position are drawn collectively (at the same time) at a certain point in time, and at the time of drawing, the display form is changed (for example, the size is reduced). It is converted into a pseudo 3D image and drawn so that it is connected to the figures and the like that have been drawn up to that point, in other words, it is perceived with a sense of perspective. Even if the distance of the focal point of the eye and the virtual image display distance are far apart, the human eye grasps the distance (depth) by relying on the display form, so the human perception is the same. At a distance, the virtual image, which looks slightly blurry but small, gives the illusion that it is continuous with the virtual image corresponding to the most recently drawn image. In other words, the difference between the gaze distance of the user and the display distance of the virtual image causes two emphasis, but on the distant side, the degree of emphasis on the change in distance becomes smaller. As described above, the person (user) tries to grasp the distance (depth) by relying on the change in the display form (reduction of the above size, etc.). By such a perceptual action, it is possible to further reduce the degree of emphasis on 2 because it is distant. By such an action, perspective display is possible. In other words, as a preferable example, a display with a sense of perspective that maintains continuity with almost no discomfort is realized.

Images corresponding to virtual images far from the threshold need only be drawn by adjusting the size etc. at once, and it is not necessary to draw partial images in time division multiple times, so efficient image generation is possible. This is possible, and the processing load on the device is reduced accordingly.

In the sixth aspect, the display control device is a display control device as the depth display control unit, which is mounted on the head-up display device of any one of the first to fifth aspects and is realized by using a computer. is there.

By realizing a computer as a depth display control unit as, for example, a CPU or an MPU, it is possible to reduce the size, and it is also possible to apply it to a small HUD device for vehicles.

In the seventh aspect, the display control program is a display control program that causes the computer to operate as the display control device of the sixth aspect.

Since it can be constructed by software, it is easy to realize.

One of ordinary skill in the art will readily appreciate that the embodiments according to the invention exemplified may be further modified without departing from the spirit of the invention.

FIG. 1 is a diagram showing an example of displaying a virtual image of an object (navigation image or the like) which is display content in a driving scene in which a vehicle is traveling on a straight road. FIG. 2 is a diagram showing another example of displaying a virtual image of an object (navigation image or the like) which is display content in a driving scene in which a vehicle is traveling on a straight road. FIG. 3A is a diagram showing a display control example when the virtual image display distance of the object exceeds a predetermined value (threshold value), and FIG. 3B is a position and a display form of the virtual image display surface in the display control example. It is a figure for demonstrating control and the like. FIG. 4A is a diagram showing a display control example when the virtual image display distance of the object does not exceed a predetermined value (threshold value), and FIG. 4B is a position and display of the virtual image display surface in the display control example. It is a figure for demonstrating form control and the like. FIG. 5 is a diagram for explaining an example in which the virtual image display distance is variably controlled in the HUD device (here, it is assumed that the present invention is not applied). FIG. 6A is a diagram showing an example of setting a virtual image display surface in a multi-faceted HUD device capable of setting a plurality of virtual image display surfaces having different virtual image display distances, and FIG. 6B is a configuration of a main part of the multi-faceted HUD device. FIG. 6C, which shows an example, is a diagram for explaining a position control signal. FIG. 7 is a diagram showing an example of the overall configuration of the HUD device capable of controlling the virtual image display distance. FIG. 8 is a flowchart showing an example of a main operation procedure of the HUD device according to the embodiment of the present invention. FIG. 9A is a diagram showing a configuration example of a main part of the HUD device capable of tilting the virtual image display surface with respect to the road surface, and FIG. 9B is a virtual image display surface provided so as to overlap the road surface. It is a figure for demonstrating the principle of perspective display above. FIG. 10A shows an example of display control (when the left turn point is far away) when the present invention is applied in the case of performing perspective control using a virtual image display surface provided tilted with respect to the road surface. FIG. 10B is a diagram for explaining the position of the virtual image display surface in the display control example, display form control, and the like, and FIG. 10C is a display (drawing) of an image on the virtual image display surface. ) Is shown in the figure. FIG. 11A shows an example of display control (when the left turn point is near) when the present invention is applied in the case of performing perspective control using a virtual image display surface provided tilted with respect to the road surface. FIG. 11B is a diagram for explaining the position of the virtual image display surface, the display form control, and the like in the display control example.

The best embodiments described below have been used to facilitate understanding of the present invention. Therefore, one of ordinary skill in the art should note that the present invention is not unreasonably limited by the embodiments described below.

FIG. 1 is a diagram showing an example of displaying a virtual image of an object (navigation image) which is display content in a driving scene in which a vehicle is traveling on a straight road.

In FIG. 1, the vehicle (own vehicle) 10 is traveling on a straight road (road surface) 2 at a speed of 60 km. Here, the user (not shown in FIG. 1, reference numeral 1 in FIG. 2) is a driver who holds the steering wheel (steering wheel) 3. The front panel 5 is provided with a vehicle speed display meter (instrument) M1 and a meter (instrument) M2 indicating the engine speed. However, this is an example and is not limited. The information of these instruments may be displayed as a virtual image by the HUD device (it may be used in combination, which is used in FIG. 1).

In the driving scene of FIG. 1, there are two vehicles in front of the same lane, FC1 and FC2. Regarding the front vehicle FC1 on the front side, although the inter-vehicle distance is considerable, a caution mark (a type of superimposition mark) CU is superposed for reasons such as rapid deceleration. The front vehicle TC1 running in the overtaking lane is visible in the distance.

The vehicle speed display (virtual image SP) by the HUD device is displayed together with the three-dimensional shape (this can be referred to as a three-dimensional display, a display by a 3D object, a display by a three-dimensional effect processing object, or the like).

Further, on the slightly front side of the vehicle FC2 in front, a virtual sign NV having a considerable area as a navigation display is presented so as to overlap the sky in the background. The virtual sign NV includes place name displays C10 and C20 and arrow displays C30 and C40 as guides.

The virtual image produced by the HUD device is displayed in a virtual image display area (not shown in FIG. 1, reference numeral 7 in FIG. 2) on the windshield 6 as a projected member.

As shown in the figure, the user 1 is a driving scene in which it is necessary to simultaneously perceive various objects with a sense of perspective, and if the sense of perspective is erroneously grasped, it may lead to an accident. Therefore, the optimum distance It is important to display the object (virtual image to be displayed) with a feeling.

See FIG. FIG. 2 is a diagram showing another example of displaying a virtual image of an object (navigation image) which is display content in a driving scene in which a vehicle is traveling on a straight road. In FIG. 2, the same reference numerals are given to the parts common to those in FIG. 1 (this point is also common in the following drawings).

In the example of FIG. 2, three virtual signs C1, C2, and C3 are adjusted to different virtual image display distances and displayed (projection display). In particular, the navigation image C1 that displays the speed limit has a large virtual image display distance so as to match the traveling speed of the vehicle 10 in the front and flow from the back side to the front side when viewed from the viewpoint A of the user 1. It is controlled in stages. Such control can be achieved using a multi-layer HUD device (this point will be described later).

Next, refer to FIG. FIG. 3A is a diagram showing a display control example when the virtual image display distance of the object exceeds a predetermined value (threshold value), and FIG. 3B is a position and a display form of the virtual image display surface in the display control example. It is a figure for demonstrating control and the like. In addition, here, a predetermined "threshold value (threshold value as a reference for determining perspective)" will be described as "20 m".

In FIG. 3A, a person D1 who is about to cross the road (road surface 2) is seen in the far right (a position 30 m from the viewpoint A of the driver 1 as a user). The HUD device displays a frame for alerting (referred to as an alerting frame) J3 so as to be superimposed on the person D1.

Originally, the virtual image display distance of the frame J3 (sometimes referred to as an imaging distance, a focal length, etc.) intended by the HUD device is L2 (30 m), but this distance has a threshold value L1 (20 m). Over. Therefore, even if the virtual image display distance is accurately adjusted by moving the optical system, the degree of change in the convergence angle is small, and the change is not so noticeable to the human eye. On the other hand, there is a concern that the processing load on the device will increase and the package size will increase.

Therefore, the distance is not directly adjusted for the portion exceeding L1 (20 m), and the display is changed to a method that gives the user a perspective perception by using the change in the display form as a clue. Here, for example, a virtual image display surface (reference numeral PS1 in FIG. 3B) is assumed to be erected perpendicularly to the road surface 2 at a position of the threshold value L1 (20 m), and the original size is displayed on the display surface. Instead of the "frame J1" of, a smaller size "frame J2" that has undergone pseudo 3D conversion processing is displayed.

The virtual image display surface is set to the distance L1 (20 m) indicated by the threshold value because it saves the trouble of newly setting another distance, efficient processing can be performed, and it is advantageous in terms of processing speed and the like.

For the user 1, the "frame J2" appears to overlap the person D1. At this time, the distances do not match, but the human eye (viewpoint A) can perceive a sense of perspective by using the reduced size as a clue. Therefore, even if there is actually a difference in distance, the difference is compensated for, and it seems as if "frame J3 (indicated by the broken line of the thick line in the figure)" is superimposed on "person D1". .. Therefore, it is possible to give a sense of perspective without discomfort, and an effective stereoscopic display is obtained. In addition, the processing load of the device can be reduced, which can be expected to have effects such as cost reduction, reduction of package size, and suppression of heat generation problem.

As shown in FIG. 3B, the virtual image J2 whose size has been reduced is actually displayed on the virtual image display surface PS1 at a distance L1, but it is as if the user 1's eyes (viewpoint A) see it. It looks as if it is displayed on the virtual image display surface PS2 at a distance L2. Here, it is assumed that the virtual image display surfaces PS1 and PS2 are erected perpendicularly to the road surface 2. On the virtual image display surface, it is treated that the distance from the viewpoint A is the same regardless of the display position.

Next, refer to FIG. FIG. 4A is a diagram showing a display control example when the virtual image display distance of the object does not exceed a predetermined value (threshold value), and FIG. 4B is a position and display of the virtual image display surface in the display control example. It is a figure for demonstrating form control and the like.

The driving scene of FIG. 4 is the same as that of FIG. 3 (B). However, time has passed since the time of the driving scene depicted in FIG. 3, and the person D1 appears closer to the user, the driver 1.

In FIG. 4A, the person D1 is at a distance L3 (10 m), L1 is smaller than the threshold value L2 (20 m), and the virtual image display distance is directly controlled to effectively produce a stereoscopic effect. It is possible. Therefore, the HUD device sets the frame J4 to the distance L3 (10 m) and displays it by the distance control (3D control). As a result, the distances between the frame J4 and the person D1 are the same, and a display with a sense of perspective without discomfort is realized.

As shown in FIG. 4B, a frame (emphasis frame for calling attention) J4 is shown in its original size on the virtual image display surface PS3 at a distance L3. However, the present invention is not limited to this. In the example of FIG. 4, the distance can be directly controlled, and further, the pseudo 3D display by changing the expression mode can increase the stereoscopic effect and realize more effective perspective enhancement.

Next, refer to FIG. FIG. 5 is a diagram for explaining an example in which the virtual image display distance is variably controlled in the HUD device (here, it is assumed that the present invention is not applied). Here, an example of displaying the navigation image of FIG. 2 is shown.

As shown in FIG. 5, the HUD device 100 projects an image of an object (display object) onto the windshield 6 which is a projected member (in other words, irradiates a display light K for displaying the image). As a result, the user 1 displays the navigation images (virtual images) C1 to C3 on the virtual image display surfaces PS10, PS11, and PS12 set forward, respectively.

On each of the virtual image display surfaces PS10 to PS12, the virtual image display distance is the same regardless of the display position of the virtual image. In FIG. 5, the virtual image display distances of the virtual image display surfaces PS10, PS11, and PS12 are L201, L202, and L203. It is set to (L201 <L202 <L203).

Here, the navigation image C1 that displays the speed limit has a virtual image display distance that matches the traveling speed of the vehicle 10 in the forward direction and flows from the back side to the front side when viewed from the viewpoint A of the user 1. It is controlled in multiple stages. Such control is realized using a multi-layer HUD device (this point will be described later).

In the driving scene of FIG. 5, a plurality of objects (three types of navigation contents C1 to C3) having different virtual image display distances are simultaneously presented, and C1 which is a speed limit sign indicates the movement of the own vehicle 10. It can be said that it is a driving scene in which a visual discomfort is likely to occur because it is moved so as to flow toward the front side according to the above.

The HUD device 100 includes a depth display control unit (including a virtual image display distance control unit) 34 and a display form control unit (perspective correction unit) 900. The display form control unit (perspective correction unit) 900 generates a display element having a required form, for example, by rendering or by reading data from a memory when changing the form of the display object.

As shown in FIGS. 3 and 4, the depth display control unit (including the virtual image display distance control unit) 34 is for direct control of the virtual image display distance (3D control) and control of the display form (pseudo 3D control). Do at least one. The control mode can be adaptively changed in consideration of the distance of the object and the surrounding environment (for example, day / night, headlight up / down, season, weather, physical condition of the driver who is the user, etc. 1). It is possible. This enables a natural stereoscopic view that is more suitable for the user 1's vision.

Next, refer to FIG. FIG. 6A is a diagram showing an example of setting a virtual image display surface in a multi-faceted HUD device capable of setting a plurality of virtual image display surfaces having different virtual image display distances, and FIG. 6B is a configuration of a main part of the multi-faceted HUD device. FIG. 6C, which shows an example, is a diagram for explaining a position control signal.

The multi-layer HUD device is a HUD device capable of setting a multi-face (three or more faces) virtual image display surface. In other words, the virtual image display distance can be changed in m ways (m is a natural number of 3 or more). In FIG. 6A, virtual image display surfaces PS1 to PS45 can be set, where m = 45 and the virtual image display distances are different.

In the multi-layer HUD device, the virtual image display surface capable of displaying the virtual image is multi-layered (multi-layered), so that the virtual image display distance can be changed more freely, and the virtual image is three-dimensional with a sense of depth. Display is possible. In addition, the size and height of the object to be displayed can be changed as appropriate to give a sense of perspective, the size can be adjusted, the display position of the object can be adjusted, and the object has depth. Perform geometric three-dimensional decoration processing (sometimes called three-dimensional decoration) such as making it three-dimensional, adding shadows to objects, adopting perspective expression, and expressing the texture of objects precisely. By doing so (in other words, by using pseudo 3D image processing together), more realistic 3D display becomes possible.

See FIG. 6 (B). FIG. 6B shows the configuration of a main part of the optical scanning type HUD device. As shown in the figure, a position control signal generation unit 91 is provided, and the position control signal generation unit 91 receives a scanning drive signal rvs which is a control signal given from the display control unit 300 and generates a position control signal VPC. ,Output.

Further, the virtual image display distance changing unit 24 includes a lens driving unit 93 and a screen driving unit 95. Further, in FIG. 6B, an image processing unit 51 and a light source unit 53 are provided.

The image processing unit 51 generates a display image based on the display image data cv given by the display control unit 300, and supplies the generated display image to the light source driving unit 55.

Further, the light source unit 53 includes a light source driving unit 55 and a light source (here, a laser light source LD) 57. The position control signal VPC generated by the position control signal generation unit 91 is supplied to the lens drive unit 93 and the screen drive unit 95 of the virtual image display distance changing unit 24, and is also supplied to the light source drive unit 55 at the same time.

The virtual image display distance changing unit (or virtual image display distance control unit) 24 uses the screen 46 (and the lens 44) as the image display unit (which may be simply referred to as the display unit) as the optical axis of the screen 46 as the image display unit. By vibrating in a predetermined range (here, the distance range LZ) in the direction along (in other words, the direction along the optical path, in FIG. 6B, the direction indicated by the arrow in which the display light K travels). The optical path length from the screen 46 as the image display unit (more specifically, the display surface 47 on which the image M is displayed) to the projected member 3 is periodically changed. Further, the light source driving unit 55 of the light source unit 53 controls the emission timing of the light from the light source (laser light source LD) 57, so that the display timing of the image M on the display surface 47 of the screen 46 as the image display unit is displayed. (Display time) is controlled (adjusted).

Here, when the virtual image display surface corresponding to each of the virtual image display distances that can be changed in m ways is the first to mth virtual image display surface, the screen 46 (and the lens 44) as the image display unit is within a predetermined range. In (LZ), by control of vibrating at a predetermined cycle, control of the display timing of the image on the display surface 47 of the screen 46 as the image display unit, and control of changing the display content synchronized with the control of the display timing (combination). For example, it is possible to display a virtual image on each of at least two of the first to mth virtual image display surfaces, for example, for different non-superimposed contents (navigation display not premised on superimposition on a real scene, etc.). It is also possible to control the virtual image to flow with the passage of time.

The position control signal VPC generated by the position control signal generation unit 91 is, for example, a serrated (sawtooth wave) voltage signal (sawtooth wave voltage signal) as shown in FIG. 6C. In FIG. 6C, the time t is set on the horizontal axis and the voltage v is set on the vertical axis.

When the voltage of the position control signal VPC is 0, the screen 46 as the image display unit is located at the first position PT0, and when the voltage of the position control signal VPC is the peak value, the screen 46 as the image display unit is located. Is located at the second position PT1.

Here, for example, at each of the times t1 to t4, four display objects (virtual images) having different virtual image display distances can be displayed by outputting images of different display contents (display objects) from the light source unit 53. it can. By using this configuration, it is possible to realize the display of the object (information presentation by the display image) as shown in FIGS. 1 and 2.

The above configuration is an example, and the present invention is not limited to this. For example, a plurality of display units having a display surface may be provided in parallel, and the position of each display unit may be moved stepwise to change the virtual image display distance in multiple stages.

Next, refer to FIG. FIG. 7 is a diagram showing an overall configuration example of the HUD device capable of controlling the virtual image display distance. The vehicle display device is mounted on the vehicle 10, and by projecting an image onto the windshield 6 as a projected member provided on the vehicle 10, a virtual image V (virtual image display surface) of the image is projected to the user (here, the driver) 1. A vehicle display device having a head-up display (HUD) device 100 for visually recognizing (displayed on the PS), an image generation unit 32 for generating an image, and a display surface 47 on which an image (display image) M is formed. An optical system 52 including a display unit (here, a screen 46) that emits the display light K of the image M, and an optical member (here, a concave mirror 49) that reflects the display light K and projects it onto the projected member 3. And a virtual image display distance changing unit (reference numeral 24 in FIG. 6B, not shown in FIG. 7) that changes the virtual image display distance, which is the distance from the reference point set on the user 1 or the vehicle 10 to the virtual image. , The image generation unit 32 and the virtual image display distance changing unit (reference numeral 24 in FIG. 6B) are controlled so that each of the plurality of display objects (for example, C1 to C3 in FIG. 5) has a different virtual image display distance (FIG. 5). The display control unit 300 is capable of simultaneously displaying the display distances L201, L202, and L203).

The display control unit 300 includes an image generation unit 32, a scanning drive unit 33, a depth display control unit (including a virtual image display distance control unit) 34, and a display form control unit (perspective correction unit) 900.

The display form control unit (perspective correction unit) 900 generates a display element having a required form, for example, by rendering or by reading data from a memory when changing the form of the display object.

As shown in FIGS. 3 and 4, the depth display control unit (including the virtual image display distance control unit) 34 is for direct control of the virtual image display distance (3D control) and control of the display form (pseudo 3D control). Do at least one. The control mode can be adaptively changed in consideration of the distance of the object and the surrounding environment (for example, day / night, headlight up / down, season, weather, physical condition of the driver who is the user, etc. 1). It is possible. This enables a natural stereoscopic view that is more suitable for the user 1's vision.

The HUD device 100 is arranged in the dashboard 4. The optical system (projection optical system) 52 can irradiate the windshield 6 with the display light K of the image.

Further, in FIG. 7, the own vehicle 10 is provided with an external light intensity sensor 16 that detects the intensity of ambient light (external light). The detected external light intensity is a kind of ambient environment information such as for distinguishing between day and night, or for the intensity of reflection due to sunlight, and can be used in various ways.

Further, in FIG. 7, a driving scene determination unit 19 having an image processing unit 21 that performs image processing based on an image captured by the front (vehicle surrounding) image pickup camera 17 and a display that outputs virtual sign information (navigation information in a broad sense). An object information generation unit 400, a sonar unit 10, and a distance measuring unit 13 are provided. The sonar unit 10 is useful for instantly measuring, for example, the distance to the vehicle in front (inter-vehicle distance). The distance measuring unit 13 obtains the inter-vehicle distance and the like with high accuracy and accuracy by a predetermined calculation.

The display object information generation unit 400 includes a depth mapping unit 402, a display object (including information such as color and three-dimensional shape) generation unit 404, a driving route information acquisition unit 406, a vehicle position information acquisition unit 408, and a map. It has an information acquisition unit 410 and a storage unit (functioning as a database of maps, road guidance information, road signs, etc.) 412.

Vehicle information and the like collected by the vehicle-mounted ECU 700 are supplied to the display object information generation unit 400 via the bus (BUS).

Further, the communication unit 500 appropriately obtains various information acquired by wireless communication with the driving support system 600 installed outside the vehicle 10, as appropriate, in the own vehicle position information acquisition unit of the navigation unit (navigation ECU) 400. It may be supplied to 408 and the map information acquisition unit 410.

Further, the position information or the like received by the GPS receiving unit from the GPS satellite is appropriately supplied to the own vehicle position information acquisition unit 408 and the map information acquisition unit 410 of the display object information generation unit (specifically, the navigation ECU) 400. You may do so.

Next, refer to FIG. FIG. 8 is a flowchart showing an example of a main operation procedure of the HUD device according to the embodiment of the present invention.

The necessity of presenting information is determined in step 1. When N, the current state is maintained, and when Y, the process proceeds to step S2. In step 2, it is determined whether the virtual image display distance of the object to be presented by the HUD device is smaller than the threshold value (or less than the threshold value). It is also possible to determine whether it is less than the threshold value.

If it is Y, the process proceeds to step 3. Here, a display object is generated, and distance control (display form control can be used together if necessary) is performed. When N, a display object is generated and display form control is performed (step S4).

In step S5, the display object is drawn. As a result, the virtual image (reference numeral V in FIG. 7) is displayed in the virtual image display area 7 (see FIG. 2).

Next, refer to FIG. FIG. 9A is a diagram showing a configuration example of a main part of the HUD device capable of tilting the virtual image display surface with respect to the road surface, and FIG. 9B is a virtual image display surface provided so as to overlap the road surface. It is a figure for demonstrating the principle of perspective display above.

The HUD device 100 of FIG. 9A has a display control unit 301, a light projecting unit 42, a screen 46 inclined by a predetermined angle with respect to the vertical direction (y-axis direction), and a mirror 72. The display control unit 301 includes a depth display control unit 34, an image generation unit 32, and a light projection control unit 36. The reference numeral P indicates an optical axis, and K indicates an indicator light.

As a general rule, the HUD device 100 does not have a mechanism for moving the inclined screen 46 as an image display unit. Therefore, the virtual image display distance is changed by changing the position of the image M in the direction of the y-axis component on the display surface 47 of the screen 46. However, when the mechanism for moving the inclined screen is provided, the virtual image display distance can be changed by using the movement of the screen 46 and the change of the position of the image M on the display surface 47 in combination.

In FIG. 9A, the change in the position of the image M on the display surface 47 of the inclined screen 46 along the vertical direction is indicated by a broken line bidirectional arrow. By changing the position of the image M, for example, the virtual image VB moves to the position of the virtual image VB'on the virtual image display surface PS10 set on the road surface 2 shown in FIG. 9B. In this case, the virtual image display distance L40 is changed to the virtual image display distance L50.

In this way, the virtual image display distance can be variably controlled by changing the position by using the inclined (or, as a special aspect thereof, the virtual image display surface superimposed on the road surface). Since the distance can be controlled by a simple method, the burden on the HUD device 100 is reduced, and the cost increase can be easily suppressed.

Next, a case where the present invention is applied to a HUD device capable of changing the virtual image display distance by using an inclined virtual image display surface will be described. See FIG. FIG. 10A shows an example of display control (when the left turn point is far away) when the present invention is applied in the case of performing perspective control using a virtual image display surface provided tilted with respect to the road surface. FIG. 10B is a diagram for explaining the position of the virtual image display surface in the display control example, display form control, and the like, and FIG. 10C is a display (drawing) of an image on the virtual image display surface. ) Is shown in the figure.

In the example of FIG. 10, when the virtual image display surface is inclined without being erected perpendicularly to the road surface or overlaps with the road surface (here, the case where it overlaps with the road surface is taken as an example), the inclination is performed. Alternatively, when displaying a virtual image of an object on a virtual image display surface that overlaps the road surface at a location farther from the user than the distance indicated by the threshold value, the threshold value and its entire virtual image portion corresponding to that location are displayed. Pseudo 3D display control is performed on the image displayed at the virtual image display distance in the vicinity and corresponding to the virtual image portion, whereby the virtual image portion is the virtual image portion of the object closer to the user than the distance indicated by the threshold value. The display is controlled so that the connection is made continuously and with a sense of perspective.

In FIG. 10A, a navigation arrow 800 indicating a left turn position is displayed so as to be superimposed on the road surface 2. Here, the lower region shown in FIG. 10A is an region in which a virtual image in which the original distance is set is displayed on the front side of the threshold value, and this is referred to as the depth expression region Z1. The upper region is an region in which a virtual image in which the original distance is set is displayed farther than the threshold value, and this is referred to as the back surface expression region Z2.

Further, the display 802 of the depth expression area Z1 includes a portion of the arrow 800 on the side close to the own vehicle and a vehicle speed display (display of "40 km / h") SP.

In the display of the back surface expression area Z2, the portion including the tip of the arrow 800 (the portion on the side far from the own vehicle) 804 is displayed.

As shown in FIG. 10B, the virtual image display surface PS12 is provided at an angle of a predetermined angle with respect to a direction perpendicular to the road surface 2 (here, a vertical direction). The left end of the virtual image display surface PS12 is a distance L5 (for example, 10 m), and the right end is a distance L6 (for example, 30 m). The distance indicated by the threshold value is L2 (for example, 20 m).

In other words, the distance indicated by the threshold value is within the variable distance range due to the position change on the tilted virtual image display surface PS12, and a part of the virtual image 800 of the long extending navigation arrow is larger than the threshold value L2. It will be in a distant position.

As is clear from FIG. 10B, the display 802 extends so as to overlap the surface of the region of the tilted virtual image display surface PS12 on the front side of the distance L2 (threshold value).

On the other hand, the display 804 appears as if it is drawn on a virtual image display surface that stands perpendicular to the road surface 2 at a distance L2 (threshold value). This is an illusion of the human eye and the drawing method (by devising the timing and the image) when drawing the image M on the display surface 47 of the screen (image display unit) 46 shown in FIG. 9 (A). It is realized in a pseudo manner by.

Here, reference is made to FIG. 10 (C). As shown in FIG. 10C, in the display 802, image elements (strip-shaped images) M1 to M9 are displayed (drawn) in a time-division manner corresponding to each of the times t1 to tn. For example, the image element M1 on the foremost side is drawn, and then M2 is drawn. However, since each image element is drawn in a time division manner and because the display position is different, the imaging point is drawn. Is different, and the display positions appear to be drawn in a concatenated manner on the virtual image display surface. In other words, the virtual image display distance of the image element increases with time.

On the other hand, the images corresponding to the virtual image (in other words, display 804) farther than the threshold value L2 are drawn collectively (simultaneously) at time t (n + 1). Then, at the time of drawing, by changing the display form (for example, making full use of a perspective method such as reducing the size or changing the inclination of the line segment indicating the appearance shape), the drawing has been performed until then. It is converted into a pseudo 3D image and drawn so as to be connected (continuously) to the figure (image corresponding to the display 802), in other words, to be perceived with a sense of perspective.

Here, even if the distance between the focal points of the eyes and the virtual image display distance are different, the human eye will now rely on changes in the display form (reduction of the above size, etc.) to reduce the distance (depth). From this, human perception gives the illusion that a virtual image that looks slightly blurry but small at the same distance is continuous with the virtual image corresponding to the most recently drawn image. In other words, the difference between the gaze distance of the user and the display distance of the virtual image causes two emphasis, but on the distant side, the degree of emphasis on the change in distance becomes smaller. As described above, the person (user) tries to grasp the distance (depth) by relying on the change in the display form (reduction of the above size, etc.). By such a perceptual action, it is possible to further reduce the degree of emphasis on 2 because it is distant. By such an action, perspective display is possible. In other words, as a preferable example, a display with a sense of perspective that maintains continuity with almost no discomfort is realized.

According to this method, images corresponding to virtual images at locations farther than the threshold value (distance L2) need only be drawn by adjusting the size and the like (in other words, in pseudo 3D) all at once, and many times. Since it is not necessary to draw a partial image (partial image element) by division, efficient image generation is possible, and the processing load of the HUD device is reduced accordingly.

Next, refer to FIG. FIG. 11A shows an example of display control (when the left turn point is near) when the present invention is applied in the case of performing perspective control using a virtual image display surface provided tilted with respect to the road surface. FIG. 11B is a diagram for explaining the position of the virtual image display surface, the display form control, and the like in the display control example.

The driving scene of FIG. 11 is the same as that of FIG. However, time has passed since the time of the driving scene depicted in FIG. 10, and the left turn point is seen closer to the user, the driver 1.

In FIG. 11, the display 802'and the display 804' correspond to the displays 802 and 804 in FIG. 10, respectively. The vehicle speed display SP'has been changed to "30 km / h".

As shown in FIG. 11B, the distance at the left end of the virtual image display surface PS12'is L7, and the distance at the right end is L8. The display 802'is made so as to overlap the surface of the region on the front side of the threshold value (L2) of the virtual image display surface PS12'. In addition, the display 804'is collectively displayed at a distance of the threshold value (L2) (because it may be slightly deviated, it is in the vicinity of the distance). The display method is the same as that described above with reference to FIG.

As described above, according to the embodiment of the present invention, for example, it is possible to realize the perception of information at the virtual image display distance intended by the HUD device while reducing the burden on the HUD device and the like.

Although the present invention has been described above based on the embodiments, the present invention is not limited to these embodiments, and various modifications and applications are possible. For example, the virtual image position change control implemented in the present invention can be applied to a vehicle driving simulator and the like.

It should be noted that the term "vehicle" can be broadly interpreted as, for example, "vehicle" or "moving body". The HUD device can also be interpreted in a broad sense, such as an in-vehicle display device and a vehicle (moving body) display device. Further, the HUD device may be a device using a projector or a device called holography.

The present invention is not limited to the above-mentioned exemplary embodiments, and those skilled in the art will be able to easily modify the above-mentioned exemplary embodiments to the extent included in the claims. ..

1 ... User (driver, etc.), 2 ... Road surface (road), 3 ... Steering wheel (handle), 5 ... Front panel, 6 ... Projected member (windshield, etc.), 7 ... Virtual image display area, 10 ... Vehicle (own vehicle), 11 ... Sonar section, 13 ... Distance measurement section, 19 ... Driving scene determination section, 21 ... Image processing section, 32 ... Image generation unit, 33 ... Scan drive unit, 34 ... Depth display control unit (can include virtual image display distance control unit), 44 ... Lens (optical system), 46 ... -Screen (image display unit, display unit), 47 ... image display surface (display surface), 49 ... concave mirror (mirror), 52 ... projection optical system (optical system), 100 ... HUD device , 300 ... Display control unit, 802, 802'... Display on the front side of the threshold,
804,804'... Display farther than the threshold value, 900 ... Display form control unit (perspective correction unit), PS ... Virtual image display surface, K ... Display light, M ... Image, V ... Virtual image, Z1 ... Depth expression area, Z2 ... Back surface expression area

Claims (7)

By projecting an image of an object mounted on a vehicle onto a projected member provided on the vehicle, the user can visually recognize a virtual image of the image, and the reference point set on the user or the vehicle is used. A head-up display (HUD) device capable of controlling the virtual image display distance of the object when the distance to the virtual image is defined as the virtual image display distance.
An image display unit that displays an image of the object,
When the image of the object is displayed on the image display unit, when the virtual image display distance of the object is smaller than the threshold value, the image of the object is displayed by 3D display control including at least a distance control for variably controlling the virtual image display distance. Depth display control for displaying an image of the object by pseudo 3D display control that realizes pseudo 3D display by changing the display form of the object when the virtual image display distance of the object is larger than the threshold value. Department and
A head-up display device characterized by having. The depth display control unit
When the virtual image display distance of the object is larger than the threshold value, the distance indicated by the threshold value is defined as the virtual image display distance for the object, and the image of the object is controlled by the pseudo 3D display control on the virtual image display surface of the virtual image display distance. To display,
The head-up display device according to claim 1, wherein the head-up display device is characterized in that. The change in the display form of the object according to claim 1 or 2, wherein the change in the display form includes at least one of three-dimensionalization, shading, color change, shape change, and size change. Head-up display device. Claim 1 is characterized in that the 3D display control including at least the distance control for variably controlling the virtual image display distance is the distance control alone or a combination of the distance control and the pseudo 3D display control. The head-up display device according to any one of 3 to 3. The depth display control unit
When the virtual image display surface is tilted without being erected perpendicular to the road surface or overlaps the road surface, the distance of the virtual image display surface that is tilted or overlaps the road surface is greater than the distance indicated by the threshold value. When displaying a virtual image of the object at a location far from the user, the entire virtual image portion corresponding to the location is displayed at the threshold value and the virtual image display distance in the vicinity thereof, and the virtual image is displayed. The pseudo 3D display control is performed on the image corresponding to the portion so that the virtual image portion is connected to the virtual image portion of the object closer to the user than the distance indicated by the threshold value with a sense of perspective. The head-up display device according to any one of claims 1 to 4, wherein the display is controlled. A display control device as the depth display control unit, which is mounted on the head-up display device according to any one of claims 1 to 5 and realized by using a computer. A display control program that operates a computer as the display control device according to claim 6.

Images