DE102004031311A1 - Information representing device for e.g. aircraft, has optical system representing pupil of user of image sensor, and common optical system over which image is projected on projection surface and pupil of user is imageable - Google Patents

Abstract

The device has an image sensor, and an optical system for representing a pupil (15) of the user of the image sensor. A common optical system is provided over which an image is projected on a projection surface and the pupil of the user of the image sensor is imageable. The image sensor consists of several silicon light detectors. An image source comprises of a TFT-display, transmissive display and an image provider. An independent claim is also included for a method for controlling the position of representation of information.

Description

The The present invention relates to a device for display of information on a projection screen, especially on the windshield a motor vehicle, with an optical system, via the an image producible from an image source at changeable positions on the image display area is projectable, wherein the direction of view-dependent positioning of the image a device for viewing direction recognition of a user provided which is an image sensor and an optical system for imaging the pupil of a user on the image sensor includes.

such Devices for the projection of information are in particular in aircraft and in motor vehicles as so-called head-up displays well known. In addition, although they are in any application, for example at watercraft or at different tax booths for Use can be, the present invention and the her underlying problem in the following example of a head-up display for motor vehicles described.

at a head-up display for Motor vehicles are any information generated by an image source, For example, the display of a driven speed or Driving directions of a navigation system on the front of the Driver lying and serving as a screen windshield projected. As a result, the outside of the vehicle landscape in front of the windshield a virtual Image of the image source visually overlaid. The head-up display device includes a projector that supports the light emanating from the image source directly or usually via a optical system deflects against the windshield. In general are used as image sources TFT displays. The windshield serves as a combiner that reflects the projected light and thus one for the driver visible virtual image in front of the windshield provides.

This mirrored information can be displayed in different positions. For example, from the DE 198 13 300 A1 a display device is known in which there is a dynamic change and adjustment of the position of the virtual image of a head-up display display. In this case, the virtual images can be positioned depending on driving state parameters such as driving speed or steering angle at various locations of the windshield suitable for a driver.

While the insertion takes place here at positions that depend solely on the driving condition of the vehicle and not the driver, devices of the type mentioned are also known in which the position of the virtual image depending on the direction of the driver or from the position of his pupil , and thus is variable depending on the driver (eye-tacking). The DE 199 51 001 A1 discloses for this purpose, for example, a head-up display device, are provided in the means for detecting the direction of the driver's direction, in order to be able to tune the information supply to the driver's activity. The direction of the driver's direction determines where the information to be displayed is displayed. The driver therefore no longer needs to focus his attention on specially arranged display means to receive the information, but the information can be displayed where the driver is currently looking, thereby significantly increasing the safety of the driver and other road users.

From The disadvantage here is that the eye tracking for tracking the virtual image with a considerable constructive and control engineering Effort is connected. So requires the detection of the pupil position the user next to an image sensor additional optical systems, over the the respective positions of the pupil on the image sensor or on a camera will be displayed. This is also additional Space requirement as well as additional Weight connected, which is a decisive factor in the automotive sector Disadvantage is. The evaluation of the pupil position recorded Signals conditional as well an elaborate control, which as well as the previously mentioned additionally required Components disadvantageously leads to very high costs.

Advantages of invention

The inventive device according to claim 1 faces the known embodiments the advantage on that is no longer two different from each other optical systems needed be to the projection of the image to be displayed and the picture the pupil for to accomplish the viewing direction recognition. As a result, fall Costs in the manufacture and assembly of the device according to the invention considerably lower. It is also advantageous that through the saving of an optical system space requirement and weight be significantly reduced.

The The idea underlying the present invention is that that a common optical system is provided, which at the same time for the Projection of the virtual image as well as for the image of the pupil the user is used to determine his line of sight.

advantageous Further developments and improvements of the display device according to the invention result from the dependent ones Claims.

So It is particularly advantageous if the common optical system Means for magnifying picture of the image generated by the image source. This will The use of relatively small-sized image sources possible, which is a considerable Cost saving means. The means for enlargement can be known per se Way in particular by concave mirrors and / or formed by lenses be. When using suitable optics, a microdisplay with very small dimensions serve as a high-resolution image source whose Picture according to the magnifying glass principle shown enlarged accordingly becomes.

By the adaptation of the position of the virtual image to the viewing direction or to the position of the pupil of the user via the common optical Systems can also the generally existing when viewing microdisplays on magnifying glasses Problem that with increasing magnification of the possible Bewegungsbe rich the eyes increasingly restricted will be solved become. The reduction of the restriction of the possible range of motion of the Eyes (eye ellipse) provides another significant advantage of the present invention.

According to one particularly preferred embodiment The invention further provides for the image source to comprise a silicon imager includes. A silicon imager can be used as a light emitting device with a little extra Lighting or even without a separate additional light source used come. Leave it With a silicon-based imager, the entire light spectrum from ultraviolet to infrared. By using a Silicon chips can so particularly inexpensive and very small-sized image sources can be realized.

Especially It is advantageous if the silicon imager as light-emitting Image matrix with several groupwise or individually controllable silicon light emitters is executed. In the simplest arrangement, the image matrix can only be one-dimensional executed as a line be. There are both monochrome and multi-colored arrangements a high-resolution Microdisplays possible. Preferably is for a multicolor matrix the combination of emitters of the three primary colors red, green and blue on a silicon chip suggested. The generation of different Colors of each light emitter (dots) can either by a corresponding doping of the individual elements take place, so that the silicon chip directly emits light of the desired wavelength, or by a radiation emission in a different wavelength, for example ultraviolet, and subsequent Conversion to visible light of the desired for each dot wavelength by a suitable converter, for example in an analogous manner to lamp phosphor in a fluorescent lamp. A silicon chip with such a matrix thus constitutes a microdisplay, the for virtual or for Projection displays particularly suitable in motor vehicles is. Preferably, the drive circuit of the individual silicon dots to be integrated in the same silicon chip, analogous to displays based on organic light emitting diodes (active matrix OLED display), but with the difference that the light generation in the embodiment according to the invention takes place directly in the doped silicon semiconductor.

According to one Another particularly preferred embodiment of the invention provided that the image sensor has multiple silicon light detectors includes, which are integrated as a sensor matrix in the image matrix. The insertion of light-detecting silicon elements between the light-emitting silicon elements So provides a combined display sensor chip, the display functionality and the Camera functionality for eye tracking united in one and the same semiconductor. This can be advantageous Way a particularly small-sized and with few components easy to install device can be achieved. Preferably can also be the circuit for the evaluation of the detected signals be integrated into the combined silicon chip. The evaluation can be particularly simple with such a display sensor chip and thus cost-effective be realized because at a mechanical adjustment of the combined Chips for adaptation to the respective viewing direction of the user Illustration of the eye pupil only in the same central position of the combined chip needs to be kept.

According to an alternative embodiment of the invention, the image source may comprise a TFT display or a backlit transmissive display, in particular a liquid crystal display (LC display), the common optical system comprising a beam splitter, preferably a polarization beam splitter, through which the beams emanating from the image source to the display surface and the user's pupil imaging beams are steerable on the image sensor. The image sensor can be formed, for example, by a CMOS image sensor or by a CCD image sensor or a photodiode array. It is placed in the imaging plane of the magnifying optic such that the image of the user's eye area appears on the image sensor. As a beam splitter, which is preferably arranged between the magnifying optics and the image source, in particular a so-called "polarizing beam splitter" are used, which allows the light emitted from the display almost completely pass through and yet reflects the incident light from outside to about 50% laterally away.

When Another alternative, the image source can also be a laser scanner display comprising a reflective or transmissive scattering surface, wherein the common optical system also in this case a beam splitter, preferably comprises a polarization beam splitter through which the rays emanating from the image source to the projection surface and the rays reflecting the pupil of the user on the image sensor are steerable. In this embodiment is on the reflective or transmissive scattering surface of the Displays the projected image of a moving laser beam generated.

advantageously, the user's eye area is illuminated with infrared light, so that in particular at night a sufficient image signal to get the image sensor. It is particularly advantageous if a pulsed infrared light source to illuminate an eye the user is provided, with the infrared light source with half the sampling frequency of the image sensor is pulsed. To this Way, the picture sharpness for eye tracking be significantly improved since the evaluation of the image data respectively for the Difference of received images with or without infrared illumination takes place, whereby the amount of extraneous light and thus also of the visible Light generated blurred image of the user's eye is suppressed.

alternative or additionally to such a pulsed or clocked infrared light source can for increase the picture sharpness also an infrared illumination of the user's eyes and a masking the silicon light detectors with a filter that is only permeable to infrared light (VIS blocking filter) are provided. Here is the VIS blocking filter only on the sensor dots and not on the light emitting dots to arrange.

Especially It is also advantageous if the common optical system has a curved mirror with a dichroic mirrored front surface that covers infrared light has a different focal length than for Light with one wavelength in the visible range. This can be achieved that the common optical system the user's eyes on the combined Sensor display chip maps, i. that the chip on the focal length of the mirror for Infrared light lies while at the same time the same chip still within the focal length for the visible Light is located and thus enlarged according to the principle of magnifying glass or becomes visible. In this way, the device according to the invention operates especially reliable.

A especially for monochrome image sources applicable, particularly simple possibility To produce different focal lengths is in use a lens made of transparent material, such as PMMA or glass, which has a very high dispersion. However also in the visible range for different colors to be painted a uniform effective Focal length is preferably proposed, a curved mirror to use, which consists of transparent material and whose back in conventional Way is provided with a metallic reflection layer. The Front of the mirror comes with a dichroic coating provided, preferably still of a transparent coating mechanically protected is. In this case, the front dichroic mirror surface has a from the curvature the back deviating curvature and thus one of the focal length of the back reflection layer different focal length. Depending on the version of the dichroic mirror surface is either the infrared light on the front surface and the visible light on the back surface or correspondingly reversed the visible light on the front surface and the infrared light reflects on the back surface.

by virtue of the restricted Eye ellipse at large Magnification of the Magnifying optics can be stronger Eye or head movements of the user adjusting the position the projection surface required (eye-tracking). For this purpose, according to a preferred embodiment the invention mechanical adjusting means for translational and / or rotational adjustment of the position of elements of the common optical system and / or to adjust the position of the image source, in particular in connection with an adjustment of the position of the Image sensor, be provided. For example, the display may be together with the image sensor as the adjustable elements by means of appropriate Actuators are shifted so that the user is still at a head movement sees the same picture information. This adjustment options allow the use of small-scale microdisplays.

alternative or additionally to such a mechanical adjustment can also be provided that by means of the control of the image source, the image information be moved electronically on the image source. It can be up mechanical adjustment are dispensed with, but is a display required, whose format is larger, as it requires the image to be displayed.

A particularly beneficial and easy A method for controlling the positioning of the display of information with a device of the type described above provides that the combined image sensor matrix is first positioned in such a way that the user's pupil is centered within the combined image sensor matrix, preferably in a central area of the combined image sensor matrix. In a subsequent change in the viewing direction of the user and an associated shift of the position of the imaged pupil on the combined image sensor matrix at least one element of the common optical system and / or the combined image sensor matrix is adjusted such that the position the imaged pupil is at least approximately back in the original area of the combined image sensor matrix. In this way, the control engineering effort compared to the previously known control method in eye tracking can be significantly reduced.

drawings

In The drawings are exemplary embodiments of the invention shown in the following description be explained in more detail.

It demonstrate:

1 a schematic representation of a display device according to the invention arranged in a motor vehicle;

2 a schematic representation of a first embodiment of the display device according to the invention;

3 a schematic representation of a second embodiment of the display device according to the invention;

4 : a schematic representation of a silicon image source according to the invention;

5 : A schematic representation of a combined invention according to the invention silicon sensor image source of the device 3 ,

description the embodiments

In the 1 shown device 1 to display information is as a head-up display in a motor vehicle 2 built-in. A display 3 serves as an image source of the information to be displayed, for example on current driving conditions or possible warnings, via an optical system 4 on the windshield 5 of the vehicle 2 be projected. The windscreen designed here as a wedge disk 5 serves as a projection surface of the device 1 , the display 3 and the optical system 4 are here in a projection box 6 arranged.

The driver 7 takes as a user of the device 1 the projected image of the display 3 did not generate graphical information on the glass surface of the windshield 5 but as outside in front of the windshield 5 floating virtual picture 8th true, which is superimposed on the landscape in front of it. Compared to conventional display devices in the cockpit of the vehicle 2 This reduces the difference between the distance of the displayed information to the landscape and thus also the time that the human eye needs to see after a change of the observed object, the respective objects at different distances again sharply.

The information projected in this way can be displayed at different positions by means of adjusting means not shown in greater detail. Depending on the direction of the driver 7 takes place within certain limits according to the principle of eye-tracking a dynamic adjustment of the position of the virtual image 8th , in one of the determined direction of the driver 7 corresponding job is projected.

At the in 2 illustrated embodiment of the device according to the invention 1 becomes the transmissive LC display 3 from an additional light source 9 with an associated reflector 10 backlit. The from the display 3 outgoing light rays 11a . 11b . 11c be from a so-called polarizing beam splitter 12 reflected and onto a concave mirror 13 diverted. To perform a magnifying function is the concave mirror 13 curved in accordance with an ellipsoid surface and thus causes a greatly enlarged projection of the display 3 generated image on the windshield 5 that from the eye 14 the driver 7 is recognized as a virtual image.

At the same time, an image of the eye is taken to perform the eye-tracking function 14 or the pupil 15 over the windshield 5 and the concave mirror 13 as well as straight through the Polarizing Beam Splitter 12 through an image sensor arranged behind it and formed by a CCD matrix 16 displayed. The mirror 13 is thus an essential part of the common optical system according to the invention 4 , about which both the image of the display 3 on the windshield 5 projected as well as the pupil 15 the driver 7 on the image sensor 16 is shown. The concave mirror 13 thus exerts at the same time a magnifying glass function and a mapping function.

At the in 3 illustrated embodiment variant of the device 1 becomes a light-emitting silicon display 17 used as image source. An additional light source for illuminating the image source 17 is not required. The silicon display 17 is designed here as a combined display sensor chip. So will from a single chip 17 On the silicon semiconductor basis, both the display functionality and the camera functionality required for the eye tracking were perceived. A beam splitter or polarizing beam splitter is also not required here.

The of the silicon display 17 outgoing light rays 11a . 11b . 11c are here from the front surface of an optical concave mirror 18 redirected and as a greatly magnified image on the windshield 5 projected where they turn from the eye 14 the driver 7 be perceived as a virtual image. At the same time is over the windshield 5 and the back surface of the optical concave mirror 18 an image to perform the eye-tracking function 19 of the eye 14 or the pupil 15 on the combined silicon chip 17 displayed. The mirror 18 is here also an essential part of the common optical system 4 to project the image of the display 17 on the windshield 5 and to image the pupil 15 of the eye 14 on the silicon chip 17 ,

To improve the imaging accuracy of the eye 14 on the combined silicon chip 17 will be the eye area of the driver 7 illuminated here with infrared light. Through the training of the mirror 18 As a dichroic concave mirror thereby different focal lengths for the infrared light for imaging the eye 14 and for the visible light to project the information to be displayed. This ensures that the combined silicon chip 17 in terms of its sensor functionality for the eye tracking exactly in the focal length of the mirror 18 for the infrared light, while the same silicon chip 17 in terms of its display functionality within the focal length of the mirror 18 for the visible light and therefore magnified by the magnifying glass principle is visible.

The concave mirror 18 has a curved body made of PMMA, the back with a metallic reflection layer 20 and its front with a dichroic mirror coating 21 is provided. Since the back has a deviating from the front curvature, also have the two reflective coatings 20 and 21 different focal lengths. Here is the dichroic mirror coating 21 the front of the mirror 18 executed so that they see the visible rays of light 11a . 11b . 11c with a wavelength of up to 650 nm, whereas the infrared rays 22a . 22b . 22c with a wavelength above 650 nm through the dichroic mirror coating 21 pass. They are only from the metallic reflection layer 20 the back of the mirror 18 reflected, then again through the dichroic mirror coating 21 out of the mirror 18 exit and in the infrared focal length of the mirror 18 an image 19 the pupil 15 on the silicon chip 17 to create.

To adjust the position of the projection on the windshield 5 to nodding head movements of the driver 7 can be the combined silicon display sensor chip 17 by an actuator not shown in a vertical adjustment direction 23 be moved up and down. In a similar way, the silicon chip 17 to compensate for lateral pivoting movements of the driver's head 7 via a likewise not shown actuator displaceable in a direction perpendicular to the drawing plane horizontal adjustment direction.

In 4 is a subregion of a silicon imager according to the invention 24 shown. The section shown here comprises a 12 × 4 matrix. With individually controllable, light-emitting red dots R, green dots G and blue dots B the silicon imager allows 24 a variable image generation in any colors. Despite a high resolution is the silicon imager 24 while a particularly small-sized image source.

At the in 5 illustrated advantageous development of silicon-based sensor dots S are also integrated into the matrix. In this way, the in 3 used combined silicon chip 17 , which combines the display functionality and the camera functionality for eye tracking in one and the same silicon semiconductor. Especially in combination with the common optical system according to the invention, the advantages of a compact design of the device with fewer individual components, a simpler installation and thus lower costs can be particularly effective.

Even though the present invention only by means of preferred embodiments It is not limited to this, but in many ways modifiable. In particular, the shape and layout of the Matrix is not limited to the examples shown, but they can be arbitrary be designed.

Although in the illustrated embodiments, the common optical system comprises only a concave mirror or a concave mirror and a beam splitter, depending on the application, other or additional optical elements such as mirrors, lenses or prisms can be used. Furthermore, in addition to the common optical system and optical elements are arranged, which are needed only for the display functionality or only for the eye-tracking functionality.

Finally is the use of the device according to the invention not necessarily tied to a motor vehicle, though it is is a preferred application.

1

contraption

2

motor vehicle

3

display

4

common optical system

5

Windshield

6

Projection Box

7

driver

8th

virtual image

9

additional light source

10

reflector

11a, 11b, 11c

light rays

12

Polarizing Beam splitter

13

optical concave mirror

14

eye

15

pupil

16

image sensor

17

combined Silicon Display sensor chip

18

optical concave mirror

19

image the pupil

20

metallic reflective layer

21

dichroic mirror coating

22a, 22b, 22c

infrared rays

23

vertical adjustment

24

Silicon imager

R

red dot

G

green dot

B

blauern dot

S

Sensor Dot

Claims (12)

Contraption ( 1 ) for displaying information on a projection surface ( 5 ), in particular on the windscreen ( 5 ) of a motor vehicle ( 2 ), with an optical system via which one of an image source ( 3 . 17 . 24 ) producible image at variable positions on the projection surface ( 5 ) is projectable (head-up display), wherein the direction of view-dependent positioning of the image means for detecting the direction of a user ( 7 ), which is an image sensor ( 16 . 17 ) and an optical system for imaging the pupil ( 15 ) of the user ( 7 ) on the image sensor ( 16 . 17 ), characterized in that a common optical system ( 4 ) is provided, via which both the image on the projection surface ( 5 ) as well as the pupil ( 15 ) of a user ( 7 ) on the image sensor ( 16 . 17 ) is mapped. Apparatus according to claim 1, characterized in that the common optical system means ( 13 . 18 ) to magnify the image from the image source ( 3 . 17 . 24 ). Apparatus according to claim 1 or 2, characterized in that the image source ( 17 . 24 ) comprises a light emitting silicon imager, which is preferably designed as an image matrix with a plurality of groupwise or individually controllable silicon light emitters (R, G, B). Apparatus according to claim 3, characterized in that the image sensor ( 17 ) comprises a plurality of silicon light detectors (S), which are integrated as a sensor matrix in an image matrix of silicon light emitters (R, G, B). Apparatus according to claim 1 or 2, characterized in that the image source ( 3 ) comprises a TFT display or a backlit transmissive display, and that the common optical system ( 4 ) a beam splitter ( 12 ), preferably a polarization beam splitter, through which the image source ( 3 ) outgoing beams ( 11a . 11b . 11c ) to the projection surface ( 5 ) and the pupil ( 15 ) of the user ( 7 ) imaging rays on the image sensor ( 16 ) are steerable. Apparatus according to claim 1 or 2, characterized in that the image source ( 3 ) comprises a laser scanner display with a reflective or transmissive scattering surface, and that the common optical system ( 4 ) a beam splitter ( 12 ), preferably a polarization beam splitter, through which the image source ( 3 ) outgoing beams ( 11a . 11b . 11c ) to the projection surface ( 5 ) and the pupil ( 15 ) of the user ( 7 ) imaging rays on the image sensor ( 16 ) are steerable. Device according to one of the preceding claims, characterized in that a pulsed infrared light source for illuminating an eye ( 14 ) of the user ( 7 ), wherein the infrared light source is preferably at half the sampling frequency of the image sensor ( 16 . 17 ) is pulsed. Apparatus according to claim 4, in particular in combination with claim 7, characterized in that an infrared light source for illuminating an eye ( 14 ) of the user ( 7 ), wherein the silicon light detectors (S) with only one infrared light ( 22a . 22b . 22c ) are provided with permeable filter. Apparatus according to claim 7 or 8, characterized characterized in that the common optical system ( 4 ) a curved mirror ( 13 . 18 ) with a dichroic mirrored front surface ( 21 ), which is suitable for infrared light ( 22a . 22b . 22c ) has a different focal length than for light ( 11a . 11b . 11c ) with a wavelength in the visible range. Device according to one of the preceding claims, characterized in that mechanical adjusting means for adjusting the position of at least one element of the common optical system ( 4 ) and / or for adjusting ( 23 ) the position of the image source ( 3 . 17 . 24 ) and in particular of the image sensor ( 16 . 17 ) are provided. Device according to one of the preceding claims, characterized in that by means of the control of the image source ( 3 . 17 . 24 ) the image information on the image source ( 3 . 17 . 24 ) are electronically displaceable. Method for controlling the positioning of the representation of information with a device ( 1 ) according to claim 4 in combination with claim 10, characterized by the following method steps: - the combined image sensor matrix ( 17 ) is first positioned so that the pupil ( 15 ) of the user ( 7 ) in a centered viewing direction within, preferably in a central region of the combined image sensor matrix ( 17 ) is displayed, - when changing the viewing direction of the user ( 7 ) and an associated displacement of the position of the imaged pupil ( 19 ) on the combined image sensor matrix ( 17 ) at least one element of the common optical system ( 4 ) and / or the combined image sensor matrix ( 17 ) such that the position of the imaged pupil ( 19 ) at least approximately in the original area of the combined image sensor matrix ( 17 ) is located.