DE10360176A1 - Optical monitoring system observing vehicle drivers eyes e.g. for signs of tiredness, is positioned to avoid obstruction to beam path during driving - Google Patents

Abstract

Sensor positioning and orientation ensure that the beam path from sensor to driver's face is unobstructed, whether by parts of the vehicle (10) or by the driver (11), provided that a normal posture is adopted, when driving. In a particular implementation, the screen is used to reflect light, at the same time satisfying the foregoing criterion.

Description

The The invention relates to a motor vehicle with a sensor for monitoring a driver of the motor vehicle (driver monitoring). The driver monitoring takes place optically, the face, in particular the eyes of the driver are captured. By evaluation of each recorded Image, in particular by evaluating the movements of the eyes and responsiveness the pupils, the eyelid reflex and the like can on a possibly tiredness and / or the responsiveness of the driver to be closed and in the case of or falling below predetermined or specifiable relevant Limits a safety measure, such. the triggering of a Alarm message, triggered become.

From the US 5,231,674 is a way known to determine the line of sight of the human eye, which is trying to increase the quality of the results obtained and thus to determine the direction of view even more accurately.

From the DE 197 31 303 A1 For example, one way to determine the duration of viewing and the viewing order of different objects appearing on a screen is known. This is done on the basis of a contactless, helmet-free measurement of the line of sight of eyes in larger and faster head and eye movements, in which the eye pulsating or pulsating with infrared light, imaged by an optical system and at least one image sensor in the form of a CCD camera is recorded. The camera, screen and viewer are approximately on a line with the camera in the immediate vicinity of the screen and aligned with the viewer.

In the US 5,573,006 a possibility for monitoring a driver of a motor vehicle is described. The monitoring relates to the physiological and psychological condition of the driver, ie it is the attention and vigilance and a possible tension of the driver observed. For this purpose, a camera and an infrared light source are arranged in the interior of the dashboard of the vehicle such that through the steering wheel, so for example between individual spokes of the steering wheel, a detection of the driver's eyes is possible.

Disadvantageous in this monitoring the driver, however, is that monitoring at least temporarily not possible or more difficult, if that is Parts of the steering wheel or body parts of the driver, such as hands or arms that obstruct or obstruct direct detection of the driver's face.

Of the The invention is therefore based on the object of specifying a motor vehicle, into which a sensor for driver monitoring, So an optical sensor, such as a camera, with an image evaluation system and possibly a light source, in particular an infrared light source, integrated so that a permanent observation of the driver becomes possible.

These Task is according to the invention with the Characteristics of claim 1 solved. For this purpose it is provided that the sensor, that is the optical sensor, namely e.g. the camera, especially in a version as an infrared camera, as well optionally a light source, in particular also in an embodiment as Infrared light source, is positioned and oriented so that a beam from the sensor to the driver's face neither by parts of the motor vehicle nor by the driver himself, if this in a usual when driving the motor vehicle attitude is locked.

Of the Advantage of the invention is that a permanent monitoring the driver is possible and that to the for the preparation and evaluation of each recorded Pictures required processing equipment lower requirements are because of the need to identify foreign objects not given in the picture or at least considerably reduced.

advantageous Embodiments of the invention are the subject of the dependent claims.

According to one first embodiment According to the invention, the sensor is behind one seen from the driver Instrument panel of the vehicle arranged and perpendicular to the top aligned, so that the blast passage using the windshield as a mirror to the driver's face. When using of infrared light, ie a camera operating in the infrared range and possibly a corresponding light source, is a reflection that does not disturb the driver of the picture into the camera possible.

Prefers is the windscreen on the inside of the vehicle turned Inner side provided with an infrared-reflective layer, so that possible the total amount of light emitted by the light source or From the face of the driver emanating infrared light to the face of the Driver or to the optical sensor arrives.

Particularly preferably, the windshield is provided with an infrared filter, the esp special on a remote from the vehicle interior outside of the windshield as infrared absorbing or infrared light reflecting layer is executed. In this way it is ensured that as little infrared light as ambient light falls into the camera.

According to one another embodiment The invention relates to the sensor in a steering wheel of the motor vehicle arranged. By the arrangement in the steering wheel, in contrast to a known arrangement behind the steering wheel (seen from the driver), is a cover of the camera by parts of the steering wheel excluded. The driver stays for the camera independently can be detected by a special position of the steering wheel.

Prefers is a rotation of the sensor, so e.g. the camera and if necessary the light source, due to rotation of the steering wheel by detection a rotational angle of the steering wheel determined and detected by the sensor and possibly rotated image by mathematical operation under consideration the detected angle of rotation correctable. In this way it is ensured that the evaluation of the captured image, if necessary, after a corresponding Correction always due to the same direction, ie horizontally or at least essentially horizontally oriented images can take place.

According to one yet another embodiment the invention, the sensor is right or left of the steering wheel, in particular near of ventilation openings, arranged in a dashboard of the motor vehicle.

According to one another, alternative embodiment The invention is the sensor in an A-pillar of the motor vehicle, in particular in a lower or middle Area of the A-pillar, arranged. An arrangement in the lower or middle area of the A column is cheap, so as to easily catch the driver's eyes from below can.

According to one yet another embodiment The invention relates to the sensor in an interior mirror of the motor vehicle integrated. Integration in the interior mirror has the advantage that a blockade of the beam passage through parts of the motor vehicle ruled out and a blockade of the beam passage by the driver, So by body parts of the Driver, in particular hands and arms, maximum is reduced.

Prefers is a mirror surface the interior mirror or a portion of this mirror surface for visible light reflective and for Infrared light permeable accomplished and the sensor is disposed behind the mirror surface or part of the mirror surface. In this way, the sensor is visually inconspicuous in the rearview mirror integrated.

According to one yet another embodiment the invention is the sensor above a dashboard of the motor vehicle arranged and aligned so that the beam path in a straight Line to the driver's face.

Prefers is the position of the sensor above the dashboard so selected that the beam path is not or only at maximum steering wheel height adjustment slight is locked.

For all embodiments the invention or its configuration can be provided that the sensor behind a for Infrared light permeable and one for opaque visible light Aperture is arranged.

Separate or more embodiments of Invention can can also be combined, giving the driver of at least two sensors at the same time is recorded to even when the driver moves as possible Complete monitoring too guarantee.

following becomes one of the embodiments the invention explained in more detail with reference to the drawing.

In this the sole figure shows a schematically simplified vehicle with a driver whose face in the area of the eyes by means of a Camera is detected.

1 shows in a stylized and highly simplified representation of a motor vehicle 10 by a driver 11 is controlled. In the area of a dashboard, not shown, so above or from the driver 11 seen from behind a steering wheel 12 is a camera as an example of an optical sensor for driver monitoring 13 arranged so on a windshield 14 of the motor vehicle 10 is directed that due to the mirror effect of the windshield 14 the eyes of the driver 11 but at least on his face from the camera 13 be recorded. For clarification is a beam path 15 of the driver's face or eyes 11 Outgoing and captured by the camera light drawn in the form of dotted lines. The camera 13 forms either alone or in combination with a light source, not shown, the sensor for driver monitoring. The light source is preferred, but not necessary in the range of the camera 13 arranged so that the beam path 15 from the camera 13 detected light with a beam path out of the light source sent light collapses.

That from the camera 13 captured image is sent to an image processing unit 16 transmitted. The image processing unit 16 is for processing, analysis and evaluation of the camera 13 taken pictures with regard to details on the basis of which a possible fatigue of the driver 11 or an attention level of the driver 11 by known methods (evaluation of pupil reflex, eyelid reflex, frequency of eye movements, etc.) can be seen provided. The data obtained is sent to one of the image processing unit 16 downstream processing unit 17 transmitted, for example, when exceeding or falling below predetermined or predefinable thresholds for the determined fatigue or responsiveness of the driver 11 Issues warning or alarm messages to the driver 11 in particular optically (warning light or the like), acoustically (warning sound or the like) or haptically (movement of steering wheel or driver's seat or the like) are perceptible.

To optimize the driver monitoring is provided that the windshield 14 on the inside, so the vehicle interior facing side has a coating for a particularly good reflection of the camera 13 or one of the camera 13 associated, not shown light source used light, in particular of infrared light, provides. The use of infrared light ensures that is up to the driver 11 no disturbing reflections in the windshield during the driving task 14 results. Due to the particularly good reflection properties of the additional layer on the windshield 14 it is ensured that a maximum possible proportion of the respective amounts of light can be utilized.

To further optimize the driver monitoring is provided that the windshield 14 on the outside a light used for driver monitoring, in particular for infrared light, particularly well reflective or absorbing layer, so that a possible influence of the camera 13 captured image is minimized by ambient light.

According to further, not shown embodiments of the invention is the camera 13 and possibly the associated light source in the steering wheel 12 , in or on an interior mirror, in or on an A pillar of the motor vehicle 10 or left or right of a dashboard of the vehicle, in particular in the area often provided there anyway ventilation openings arranged.

• – Hinter der Armaturentafel senkrecht nach oben gerichtet: Die Kamera 13 ist von unten gegen die Windschutzscheibe 14 gerichtet. Die innere Seite der Windschutzscheibe 14 dient als Spiegel. Hierdurch ist ein direkter Blick in das Gesicht des Fahrers 11 möglich. Damit eine den Fahrer 11 nicht störende Spiegelung des Bildes in die Kamera 13 ermöglicht wird, arbeitet die Kamera 13 bevorzugt im Infrarotbereich und die Windschutzscheibe 14 ist auf der Innenseite mit einer Infrarotlicht sehr gut reflektierenden Schicht versehen. Die Windschutzscheibe 14 kann ferner mit einem Infrarotfilter versehen sein, so dass möglichst wenig Infrarotanteile des Umgebungslichts durch die Windschutzscheibe 14 zur Kamera 13 gelangen.
• – Befestigung im Lenkrad 12: Die Kamera 13 kann ebenfalls ins Lenkrad 12 integriert werden. Aus dieser Perspektive ist eine gute Sicht auf das Gesicht des Fahrers 11 möglich. Die Drehung der Kamera 13 durch die Lenkradbewegung kann sensiert und die Kameraposition auf Nullstellung umgerechnet werden.
• – Links oder rechts vom Lenkrad 12 in der Armaturentafel in der Nahe der Lüftungsöffnungen
• – Befestigung an der A-Säule im mittleren oder unteren Bereich, um leicht von unten das Auge des Fahrers 11 zu erfassen. Eine Korrektur des Beobachtungswinkels von der Seite kann über eine Rückrechnung zwischen Einbauposition der Kamera 13 und Kopfposition des Fahrers 11 erfolgen.
• – Integration im Innenspiegel: Der Innenspiegel kann so ausgelegt werden, dass er sichtbares Licht reflektiert, Infrarotlicht jedoch durchlässt. So könnte die Kamera 13 sowie ggf. eine zusätzliche Infrarotbeleuchtung hinter der Spiegelfläche des Innenspiegel angeordnet werden.
• – Befestigung auf der Armaturentafel in einer Position, in der eine möglichst geringe Abdeckung durch die maximale Lenkradhöheneinstellung oder die jeweilige Griffposition am Lenkrad 12 erreicht wird.

In summary, the invention as well as individual specific aspects thereof may be briefly illustrated as follows:
To the attention, fatigue or the current position of a driver 11 To detect, a sensor is required, which the driver 11 supervised. This is usually a camera 13 used. For the possible position of the camera 13 as well as possible lighting equipment for the system, the following installation locations are proposed:

• - Behind the dashboard directed vertically upwards: The camera 13 is from below against the windshield 14 directed. The inner side of the windshield 14 serves as a mirror. This gives a direct view of the driver's face 11 possible. So that one the driver 11 not disturbing reflection of the image into the camera 13 is enabled, the camera works 13 preferably in the infrared range and the windshield 14 is provided on the inside with an infrared light very well reflective layer. The windshield 14 can also be provided with an infrared filter, so that as little infrared components of the ambient light through the windshield 14 to the camera 13 reach.
• - Attachment in the steering wheel 12 : The camera 13 can also turn the steering wheel 12 to get integrated. From this perspective, a good view of the driver's face 11 possible. The rotation of the camera 13 The steering wheel movement can be sensed and the camera position converted to zero position.
• - Left or right of the steering wheel 12 in the dashboard near the vents
• - Attachment to the A-pillar in the middle or lower area to lightly from the bottom the driver's eye 11 capture. A correction of the viewing angle from the side can be done by recalculating between the installation position of the camera 13 and head position of the driver 11 respectively.
• - Integration in the interior mirror: The interior mirror can be designed so that it reflects visible light, but lets infrared light through. So could the camera 13 and possibly an additional infrared illumination behind the mirror surface of the interior mirror can be arranged.
• - Mounted on the dashboard in a position where the smallest possible coverage by the maximum steering wheel height adjustment or the respective grip position on the steering wheel 12 is reached.

In all installation locations, the camera 13 and the or each light source are mounted behind infrared transparent panels. If these apertures do not transmit visible light, an integration that is invisible to the user is possible.

10

motor vehicle

11

driver

12

steering wheel

13

camera

14

Windshield

15

beam path

16

Image processing unit

17

processing unit

Claims (14)

Motor vehicle with a sensor for monitoring a driver of the motor vehicle, the sensor being positioned in this way and is oriented, that a beam path from the sensor to to the driver's face neither by parts of the motor vehicle nor by the driver himself, provided that in one while driving of the motor vehicle usual Attitude is located, is locked. Motor vehicle according to claim 1, wherein the sensor has a optical sensor, in particular a camera, and a light source and wherein the optical sensor and the light source in the infrared range work. Motor vehicle according to claim 1 or 2, wherein the sensor Seen from the driver behind a dashboard of the vehicle arranged and oriented vertically upwards, so that the Shine using the windshield as a mirror to the face the driver arrives. Motor vehicle according to claim 3, wherein the windshield on the interior of the vehicle facing inside with an infrared light reflective layer is provided. Motor vehicle according to claim 4, wherein the windshield is provided with an infrared filter, in particular on a remote from the vehicle interior outside of the windshield than Infrared light absorbing or infrared light reflecting layer is applied. Motor vehicle according to claim 1 or 2, wherein the sensor is arranged in a steering wheel of the motor vehicle. A motor vehicle according to claim 6, wherein a rotation the sensor due to rotation of the steering wheel by detection a rotation angle of the steering wheel can be determined and wherein the from Sensor captured and possibly rotated image through mathematical operation considering the detected angle of rotation is correctable. Motor vehicle according to claim 1 or 2, wherein the sensor right or left of the steering wheel, especially near ventilation openings, is arranged in a dashboard of the motor vehicle. Motor vehicle according to claim 1 or 2, wherein the sensor in an A-pillar of the motor vehicle, in particular in a lower or middle Area of the A-pillar, is arranged. Motor vehicle according to claim 1 or 2, wherein the Sensor is integrated in an interior mirror of the motor vehicle. Motor vehicle according to claim 10, wherein a mirror surface of the Inner mirror or part of this mirror surface for visible light reflective and for Infrared light permeable accomplished and wherein the sensor is arranged behind the mirror surface or the part of the mirror surface is. Motor vehicle according to claim 1 or 2, wherein the Sensor arranged above a dashboard of the motor vehicle and is oriented such that the beam path in a straight line to the driver's face. Motor vehicle according to claim 12, wherein the position of the sensor above the instrument panel is chosen so that the beam path even with maximum steering wheel height adjustment not or only slightly blocked is. Motor vehicle according to one or more of the preceding Claims, the sensor behind a for Infrared light permeable and one for visible Light impermeable Aperture is arranged.