DE102004036119B4 - Driver assistance system for fatigue detection or attention evaluation of a driver - Google Patents

Abstract

Driver assistance system (1) for detecting fatigue and / or attention of the driver (2), in particular for detecting the imminent and / or onset of microsleep, consisting next to at least one evaluation unit (3)
a sensor (4) and / or a sensor arrangement (4), suitable for detecting the pulse frequency (11) of the vehicle driver (2),
an activatable warning device (5) and / or a warning device (5) available for activation, and
a storage device (6) and / or a storage device (6) available for storing information,
wherein the sensor (4) and / or the sensor arrangement (4) on the vehicle side is fixedly connected to the vehicle, or is an integrated part of the vehicle or a vehicle part, the pulse frequency (11) of the driver (2) is continuously monitored, so that at a sudden change (17) of the pulse rate by a predetermined value, the warning device (5) can be activated, and at least in an exceptional vehicle event, which is associated with the period of change (17) of the pulse rate, a documentation in the storage device ...

Description

The The invention relates to a driver assistance system for detecting fatigue or attention assessment of a vehicle driver, in particular for detection the impending or onset of microsleep, according to the preamble of claim 1.

Of the Development trend in the automotive sector, with this the security at the top Position shows that driver assistance systems are becoming increasingly important gain. One of the main tasks of these driver assistance systems, the future Increased use is the task of fatigue monitoring / fatigue detection or attention evaluation of the driver, so this example can be warned in case of imminent or incipient microsleep, so a danger of the driver as well other road users prevented or at least mitigated can.

It Many systems are already known, in these by means of a variety of Methods and equipment is attempted, this task satisfactory or to solve with a corresponding reliability.

From the DE 196 42 830 A1 For example, there is known a method and apparatus for inhibiting sleep and response control of individuals which is controlled based on the positional displacement and / or size change of the human eye. For this purpose, according to the proposed method, by means of sensors, the reaction values of the eye, in particular the iris, pupil and eyelid movements, the brain waves, the blood pressure, the pulse rate, the temperature change on the eye and the skin reaction, in particular the electrical skin resistance, are detected and Actual comparison under application of fuzzy logic and / or artificial neural networks. In the event of a deviation from the stored standard values (limit values), a warning signal and an emergency stop signal are triggered. The device according to the invention for implementing the proposed method comprises a carrying device (glasses) with an eye-related positioning device on or on which the sensors for monitoring the eye reactions and / or the physiological changes are placed without limiting the field of vision of the wearer. According to the document, the carrying device may be a helmet with or without a visor, a cap, a headband, a pair of glasses or a spectacle-like frame on or on which the positioning device with the signal transmitters and the receiver are fastened.

From the DE 198 03 158 C1 is a device suitable for timely warning of the driver before falling asleep, known in this invention, the vigilance condition of a vehicle driver is continuously monitored. For this purpose, the area of at least one eye is recorded by means of an image sensor system and analyzed by a downstream image evaluation system.

From the DE 30 13 140 For example, a device for preventing the driver from falling asleep in a vehicle is known, which is controlled by the head tilt of the driver. The device is adapted in shape to the outer ear and triggers a head tilt by means of a tilt contactor from an acoustic tone or vibration signal acting on the mastoid bone behind the ear of the wearer or in which the sound introduced via a tube into the external auditory canal becomes.

From the DE 102 23 210 A1 a method and a device for alarming a driver when a so-called microsleep sleep is known, in this invention by means of a detector suitable for monitoring the duration of Lidschlusses the driver, the duration of the eyelid closure is monitored and when exceeding a predetermined duration of the lid closure a warning signal is triggered.

All these writings, especially the Scriptures DE 196 42 830 A1 However, or the devices disclosed therein have drawbacks, which are to be seen in the fact that these devices are in part "mobile active devices", which the vehicle user on the one hand constantly carry with him and also aware (active) and on the other hand, this device must be tailored / adapted to each individual driver (eg glasses) and each "active" must be connected to the vehicle, so that a data transfer to the vehicle can take place. Another disadvantage is to be seen in the optical based devices in that in each case an exact alignment to the field of vision of the driver must be present, which due to the different seating positions of the driver using the vehicle, as well as the different proportions of the vehicle driver using the vehicle, often Vehicle driver to driver very deviations are possible, as well as by "obstacles", especially dirty optics (smoke and dusty optics), in the detection area, can be severely impaired.

Further are from the prior art additionally following fonts known, in addition cited be, by means of the devices disclosed therein, a "driver condition monitoring" is possible.

From the DE 100 18 669 A1 For example, there is known a driver condition monitoring apparatus comprising a pulse sensor disposed in a steering wheel of a transport device for sensing a pulse signal from the palm or fingers of the left or right hands or both hands of a driver.

From the Scriptures DE 196 43 593 A1 is an apparatus and method for early detection and prevention of undue concentration weaknesses and falling asleep (microsleep) in motorists and other activities requiring high concentration, known to be monitored by means of sensors and other devices during a defined period of time Person, physical, chemical, biological and other individual quantities (which are characteristic of the state of full concentration such as waking state) can be recorded, analyzed, and stored as OK reference values by a specific human being during actual monitoring in the event of a deviation from them iO reference value data to infer an inadmissible lack of concentration of the corresponding person.

From the Scriptures DE 44 00 207 A1 For example, an apparatus and a method for improving the alertness of a driver of a motor vehicle, in which the pre-sleep warning device outputs a precautionary warning of falling asleep when driving in response to alertness, wherein the heartbeat processing means is a reference Set the heart rate of the driver in response to a driver's heartbeat rate calculated by heartbeat processing means.

When Disadvantage of this additional Fonts can be considered that, although all the subject "driver condition monitoring device" or equivalent Devices for the evaluation and if necessary avoidance / prevention unacceptable lack of concentration and falling asleep (microsleep) in motorists reveal however, none of these writings beyond disclosed the possibility that if the device does not reach your destination and the motorist as a result of tiredness An accident caused that to the reconstruction of the cause of the accident the determined data of the "driver condition monitoring device" for supplementary Accident analysis are held for evaluation, or included with can be so as to be able to make an analysis whether the accident on a fatigue of the driver is due.

The The object of the present invention is therefore a driver assistance system for fatigue detection or to present an attention evaluation of the vehicle driver, by means of this, without the driver do something "active" to do this, or a device on its own, or an optical system must focus on himself, or his field of view an optical system an assessment of the state of tiredness or attentional state of the driver allows So, because of this information, in the case of an extraordinary Vehicle event, especially an accident, a slight reconstruction about that possible is that the extraordinary Vehicle event is due to a microsleep or onset of instantaneous sleep.

These The object is achieved by a device having the features according to claim 1 solved. Advantageous developments of the invention will become apparent from the Dependent claims, including combinations and developments of individual features are possible with each other.

One essential idea of the invention is that the pulse frequency or a sudden change the pulse rate of the driver, which as a safe assessment criterion for fatigue detection or attention evaluation of a vehicle driver can be used, by means of a "passive" ("passive": the driver must to do this no conscious "active" act) functioning Detection device is detected and monitored in order to sudden change the pulse rate to trigger an action that the safety of Driver, and / or preventing or reducing accidents Accident severity and documentation of the accident, serves.

For detecting and monitoring the pulse frequency of the driver, the driver assistance system for fatigue detection and / or attention of the driver, in addition to an evaluation unit for evaluating the detected pulse rate, at least one sensor and / or a sensor array, an activatable warning device and / or one available for activation Warning device, and a memory device and / or a memory device for storing information available. The driver assistance system for fatigue detection and / or attention evaluation of the driver is characterized by the sensor and / or the sensor arrangement on the vehicle side is fixedly connected to the vehicle, or is an integral part of the vehicle / a vehicle part. By means of the sensor and / or the sensor arrangement, which is arranged on the steering wheel on the vehicle side or integrated in the steering wheel, and / or arranged on the driver's seat on the vehicle side, or integrated in the driver's seat, located, and / or arranged on the gear lever, or integrated in the gear selector lever, the pulse rate of the driver is continuously monitored so that in a sudden change in the pulse rate by a predetermined value, the warning device can be activated, and at least in the case of an extraordinary vehicle event, which is to be associated with the period of the change of the pulse rate, a documentation can be made in the memory device. To record the pulse rate, it is sufficient if the driver occupies the driver's seat / occupied or with one hand to the steering wheel or the gear selector lever engages.

at the warning device, about which has the driver assistance system or the driver assistance system available for activation is, it is an acoustic and / or optical and / or haptic warning device, wherein the haptic warning device preferably acts on the steering wheel.

at the storage device, it is analogous to the warning device, to a driver assistance system own storage device, or a storage device available to the driver assistance system. The memory device is required in particular for the driver assistance system is capable, in the event of an exceptional vehicle event, of in particular an accident, as a kind of aid to the reconstruction of the extraordinary Vehicle event all relevant data (e.g., driver's tiredness condition, vehicle speed), which in the period of the extraordinary Vehicle event prevailed, or with the period of the change the pulse rate are to be associated to be able to record. On that way later easily reconstruct, or provide evidence of whether the extraordinary Vehicle event to a microsleep or onset of microsleep is due or not.

at the predetermined value, and / or predetermined values, for evaluation a state of tiredness and / or an exceptional situation, or to activate an or more of the warning devices and / or initiation of an information storage process and / or formation of the alert information signal or trigger time for one associated with the driver assistance system further unit, in particular Occupant protection system or accident recording system, provided the pulse rate of the driver If one of these values is reached, it can vary depending on the application version of the Driver assistance system, by a fixed value or fixed limit or to a variable value or variable limit, where the fixed value or fixed limit value, preferably the respective one recognized driver is assigned.

at the variable values or the variable limit values / n are concerned depending on a value or limit, which / r by a difference value deviating from the typical previous average Pulse frequency value, wherein the variable value or variable limit (similar the fixed value), for detecting a microsleep or incipient Microsleep (in a sudden Drop in pulse rate) to a difference value lower, lower the typical previous average pulse rate value, is, and the variable value or variable limit (similar to the fixed Limit value), to form an alert information signal or trigger time for accident data recording systems, or systems suitable for accident data recording, and / or for Formation of a pre-crash information or alert signal for an occupant protection system (at a sudden Increase in pulse rate) to a difference higher, from the typical previous average pulse rate value is.

at the not connected to the driver assistance system not shown Occupant protection system, is preferably a restraint system, in particular airbag and belt tensioner system, and / or a rollover system, and / or an anti-skid system, and / or accident avoidance / accident mitigation System, in particular a braking and / or steering angle influencing, by means of this when detecting a dangerous situation, for example an automatic accident avoidance / accident reducing reaction, as an activation of the brakes or braking readiness and / or Speed reduction and / or steering angle control for Avoiding an obstacle and / or adjusting the tripping thresholds in restraint systems, can be initiated.

Further Advantages and applications The present invention will become apparent from the following description in connection with the embodiment shown in the figures on a motor vehicle / passenger car.

In the description, in the claims, in the abstract and in the accompanying drawings the in the list below the reference numbers used terms and associated reference numerals used.

The invention will now be described below with reference to an embodiment with the aid of 1 to 4 explained in more detail. Hereinafter, for functionally identical and / or identical elements may be denoted by the same reference numerals.

It demonstrate

1 : A representation of a passenger car with driver and sensors for fatigue detection / attention monitoring.

2 : A representation of the driver assistance system with its sensors and possible warning devices.

3 & 4 : A representation of the possible progressions of the pulse frequencies, and the associated limit values.

1 shows a representation of a passenger car with driver and sensors ( 4 ) for fatigue detection / attention monitoring.

The driver ( 2 ) occupies / sits on the vehicle seat ( 8th ) which with corresponding sensors ( 4 ), suitable for detecting the pulse frequency of the driver ( 2 ), Is provided. As well as the vehicle seat ( 8th ) are also the steering wheel ( 7 ) as well as the gear selector lever ( 9 ) with corresponding sensors ( 4 ), suitable for detecting the pulse frequency of the driver ( 2 ), so that the driver assistance system ( 1 ) the pulse frequency of the driver ( 2 ) can automatically detect it after it has assumed the position for guiding the vehicle without the driver ( 2 ) must perform an additional "active" action.

2 shows a representation of the driver assistance system ( 1 ) with its sensors ( 4 ) or sensor arrangements ( 4 ) and the possible warning devices ( 5 ).

The evaluation unit ( 3 ) of the driver assistance system, which preferably contains a μP, is connected to the individual sensors ( 4 ) of the individual devices ( 7 . 8th . 9 ), or contains the corresponding sensor signals of the sensors ( 4 ), which are like in 1 shown in / on the steering wheel ( 3 ), in / on the seat / driver's seat ( 8th ), and / or on the gear selector lever ( 9 ) are located.

The driver assistance system ( 1 ) have different warning devices ( 5 ) or is to activate the corresponding warning devices ( 5 ) connected to these, this is an acoustic warning device ( 5.1 ), and / or an optical warning device ( 5.2 ), and / or a haptic warning device ( 5.3 ), which preferably in the steering wheel ( 7 ) is.

Furthermore, the driver assistance system ( 1 ), as shown, via a driver assistance system memory device ( 6 ), or at least with a memory device available to the driver assistance system ( 6 ), so that the driver assistance system can perform or cause corresponding documentation operations.

As can be further seen from the figure, the driver assistance system ( 1 ) or its evaluation unit ( 3 ) alternatively / optionally with a further system, in particular an occupant protection system ( 10 ), because the driver assistance system ( 1 ), as a result of the early possibility of intervention, is ideally suited to trigger other systems or to inform these systems early with a corresponding information signal / alert signal regarding an imminent danger situation / to prepare / prepare (before the driver can consciously initiate an action ) to take appropriate action.

3 shows a representation of the course of the pulse rate with a sudden drop in the pulse rate, and the associated limits.

As can be seen from the illustration, the pulse rate ( 11 ) or pulse rate characteristic ( 11 ) by an average pulse rate value ( 12 ), which is the mean value of the present pulse rate profile ( 11 ).

The sudden change in the pulse rate ( 17 ) or the pulse rate progression ( 17 ), in the direction of decreasing pulse rate ( 17.1 ), or the resulting / resulting pulse rate is with a fixed predetermined limit ( 13 ), or with a variable limit ( 14 ), which is a difference value ( 15 ) / Delta value ( 15 ) below the previously determined average pulse rate value ( 12 ), so that upon reaching or falling below one of these limits ( 13 . 14 ) at the time ( 16 ) a trigger signal / alert signal or a warning signal can be generated.

4 shows a representation of the course of the pulse rate with a sudden increase in the pulse rate, and the associated limits.

As can be seen from the illustration, the pulse rate ( 11 ) or pulse rate characteristic ( 11 ), similar to 3 to obtain an average pulse rate value ( 12 ), which is the mean value of the present pulse rate profile ( 11 ).

The sudden change in the pulse rate ( 17 ) or the pulse rate progression ( 17 ), in the direction of increasing pulse frequency ( 17.2 ), or the resulting / resulting pulse rate is with a fixed predetermined limit ( 13 ), or with a variable limit ( 14 ), which is a difference value ( 15 ) / Delta value ( 15 ) above the previously determined average pulse rate value ( 12 ), in order to reach (or exceed) one of these limits ( 13 . 14 ) at the time ( 16 ) a trigger signal / alert signal or a warning signal can be generated.

1

Driver assistance system

2

driver

3

evaluation

4

Sensor / sensor arrangement

5

warning device

5.1

acoustic warning device

5.2

optical warning device

5.3

Haptic warning device (on / in the steering wheel 7 )

6

storage device

7

steering wheel

8th

Seat / driver seat / driver's seat

9

Gear selector

10

Occupant protection system / occupant protection device

11

Heart rate / pulse rate history

12

average Pulse Rate / Average Pulse Rate Value

13

Fester predetermined limit value / fixed preset value

14

variable Limit value / variable value

15

Difference value / delta value

16

Trigger time / Alert time / alarm time

17

modification the pulse rate

17.1

waste the pulse rate

17.2

rise the pulse rate

Claims (15)

Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ), in particular for detecting the imminent and / or onset of microsleep, in addition to an evaluation unit ( 3 ) from at least one sensor ( 4 ) and / or a sensor arrangement ( 4 ), suitable for detecting the pulse rate ( 11 ) of the driver ( 2 ), an activatable warning device ( 5 ) and / or a warning device available for activation ( 5 ), and a storage device ( 6 ) and / or a storage device available for storing information ( 6 ), whereby the sensor ( 4 ) and / or the sensor arrangement ( 4 ) is fixedly connected to the vehicle on the vehicle side, or is an integrated part of the vehicle or of a vehicle part, the pulse frequency ( 11 ) of the driver ( 2 ) is continuously monitored so that in the event of a sudden change ( 17 ) the pulse rate by a predetermined value, the warning device ( 5 ) and at least in the case of an exceptional vehicle event coinciding with the period of the change ( 17 ) of the pulse rate, a documentation in the memory device ( 6 ), characterized in that the driver assistance system ( 1 ), in the event of an exceptional vehicle event, in particular an accident, can be used as a means of reconstructing the exceptional vehicle event, with the assistance of the driver assistance system ( 1 ) a statement can be made as to whether the extraordinary vehicle event is due to a microsleep or onset of instantaneous sleep. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 1, characterized in that the driver assistance system ( 1 ), in case of a sudden increase ( 17.2 ) the pulse rate ( 11 ) by a predetermined value, as a trigger function or alert signal for accident data recording systems, or systems suitable for accident data recording, serves and / or can be used. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 1, characterized in that the driver assistance system, in a sudden increase ( 17.2 ) the pulse rate ( 11 ) by a predetermined value, as pre-crash information or alert signal for an occupant protection system ( 10 ) can be used and / or used. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to one of claims 1 to 3, characterized in that it is at the predetermined value by a fixed value ( 13 ) or fixed limit ( 13 ) or by a variable value ( 14 ) or variable limit ( 14 ). Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 4, characterized in that the fixed value ( 13 ) or fixed limit ( 13 ) is a value assigned to the respective recognized driver ( 2 ) assigned. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 4, characterized in that it is at the variable value ( 14 ) or variable limit ( 14 ) is a value or limit which is offset by a difference value ( 15 ) deviating from the typical preceding average pulse rate value ( 12 ) lies. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claims 2 and 3, characterized in that the variable value ( 14 ) or variable limit ( 14 ), to form the trigger signal ( 16 ) or alert signal ( 16 ) for an accident data recording system or systems suitable for accident data recording, or formation of a pre-crash information ( 16 ) or Alersignals ( 16 ) for an occupant protection system ( 10 ) to obtain a difference value ( 15 ) higher, from the typical previous average pulse rate value ( 12 ), lies. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 1, characterized in that the sensor ( 4 ) and / or the sensor arrangement ( 4 ) on the vehicle side on the steering wheel ( 7 ), or in the steering wheel ( 7 ) is integrated. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 1, characterized in that the sensor ( 4 ) and / or the sensor arrangement ( 4 ) on the vehicle side on the driver's seat ( 8th ), or in the driver's seat ( 8th ), is located, and / or on the gear selector lever ( 9 ), or in the gear selector lever ( 9 ) is integrated. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to claim 6, characterized in that the variable value ( 14 ) or variable limit ( 14 ), to detect a microsleep or onset of microsleep, by a difference value ( 15 ) lower, from the typical previous average pulse rate value ( 12 ), lies. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to one of claims 1 to 10, characterized in that it is in the warning device ( 5 ) by an acoustic ( 5.1 ) and / or optical ( 5.2 ) and / or haptic ( 5.3 ) Warning device ( 5 ). Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to one of claims 1 to 11, characterized in that it is in the warning device ( 5 . 5.1 . 5.2 . 5.3 ) to a driver assistance system own warning device, or to the driver assistance system ( 1 ) available for activation warning device acts. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to one of claims 1 to 12, characterized in that it is in the memory device ( 6 ) to a driver assistance system own memory device, or to the driver assistance system ( 1 ) available storage device, acts. Driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to one of claims 1 to 16, characterized in that it is in the occupant protection system ( 10 ), a restraint system, in particular airbag and belt tensioner system, and / or a rollover system, and / or an anti-skid system, and / or an accident-avoiding / accident-reducing system, in particular a braking and / or steering angle influencing acts. Vehicle, in particular passenger or truck, characterized by a driver assistance system ( 1 ) for fatigue detection and / or attention of the driver ( 2 ) according to one or more of claims 1 to 14.