[go: up one dir, main page]

WO2002050792A1 - The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions - Google Patents

The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions Download PDF

Info

Publication number
WO2002050792A1
WO2002050792A1 PCT/YU2000/000024 YU0000024W WO0250792A1 WO 2002050792 A1 WO2002050792 A1 WO 2002050792A1 YU 0000024 W YU0000024 W YU 0000024W WO 0250792 A1 WO0250792 A1 WO 0250792A1
Authority
WO
WIPO (PCT)
Prior art keywords
drowsiness
driver
procedure
vehicle
executive
Prior art date
Application number
PCT/YU2000/000024
Other languages
French (fr)
Inventor
Todor Stankovic
Original Assignee
Todor Stankovic
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Todor Stankovic filed Critical Todor Stankovic
Priority to AU2001229788A priority Critical patent/AU2001229788A1/en
Priority to PCT/YU2000/000024 priority patent/WO2002050792A1/en
Publication of WO2002050792A1 publication Critical patent/WO2002050792A1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms

Definitions

  • the invention belongs to a technical group of safety systems and refers to the procedure and device intended for the technical-technological man-machine systems security preservation under the driver control conditions.
  • the Invention Technical Problem resolves the development procedure and device design problem, intended for early detection and prevention of the crisis factor occurring in the man-machine system due to the driver drowsiness, so as to increase the degree of security in preserving the system security to the maximum level (100%) with reference to the solutions of the well-known inventions the guarantees of which to preserve the system security are minimum and of some almost none.
  • the invention DE OS 3447536 reacts based on the 60 sec active state holding time constant input electronic circuit (variable parameter) activated by the "trigger button". If the handler fails to push the button upon 60 sec, the invention records his absence and automatically activates the breaking system - stopping the machine.
  • the invention is an interesting solution of narrow possibilities of application and has a greater number of defects.
  • the invention basic defects are as follows: causes the handler's repulsion during the operation procedure, the invention button is often pushed by a simple auxiliary device (mechanical phantom) while the handler meditates or dozes (what was the reason for a greater number of accidents in the railway traffic of the most European countries) and the 60-sec time interval is a too long period to control the locomotive in a drowsy state (the late drowsiness phase) which offers a possibility in one of five to six "secunde situaten” sequences in 5 sec to pass the signal for "stopping the drive” unobserved, upon which regular handling of the invention (its button) goes on and the locomotive is driven into an inevitable accident.
  • the measuring data quality is such that drowsiness detection moment can only maximally reach the threshold (start) of phase 5 - late phase of drowsiness (see classification in the detailed description, point 2.1) which, from the chances point of view to succeed in preventing drowsiness, is a delayed (unfavourable) moment.
  • start the threshold
  • point 2.1 the threshold
  • sudden breaking is used as a forced and most frequently counterproducitve procedure for the purpose of preventing an accident.
  • the driver- vehicle system security under the driver control is safely (100%) and timely, practically in still awake state of the driver, maintained and the driver timely disqualified from the driving process for a certain time.
  • the operating capability range of a man that is, the operating incapability threshold under the drowsiness conditions is a variable parameter in the invention and can be adjusted depending upon the invention application and requirements for accomplishing the level of security.
  • Fig. la. Shown in Fig. la. is an iris H-segment map representing the first indirect bioemitter of information on the brain functional state and which is innervated by the sympathetic and parasymphatetic nerves. Shown in Fig. lb. is the brain bioenergetic field of radiation of a man (aura) used as a direct bioemitter of information on the brain functional state. Shown in Fig. lc. is a schematic diagram of innervation and motor function of the system of muscles to activate the upper eyelid in the function of the bioemitter of information on the CNS functional state. Shown in Fig. Id.
  • Fig. 3 is a block diagram of a sensor and the executive units within the driver-vehicle system as well as their connection to the processing computer for the purpose of accomplishing the invention task.
  • Fig. 4 represents a constructive solution of the measuring-executive bridge (1) intended for data acquisition on a man's drowsiness and its prevention.
  • the invention task is to develop a high-performance device and adequate procedures which will, in the function of a safety system, accomplish a high degree of guarantee in preserving the man-machine system under the driver control conditions.
  • the invention structure and functions should be implemented so that with slight changes in the basic solution a wide spectrum of applications can be covered such as: traffic (road and railway, river, coastal), air-traffic flight control service, industrial applications, supervision services (dams, power plant, nuclear power plants, other nuclear plants, oil plants, gas plants and other), medicine, army and police.
  • the invention development first of all, means development of a new method for monitoring awareness, detection of a drowsiness process establishment and continuous monitoring of the trend (increase/decrease) of drowsiness during the action of the whole interval.
  • the functions of preventing the crisis factors which endanger the system security should be based upon: the procedure for adaptable system control (principal procedure) and the procedure for preventing drowsiness (auxiliary procedure) to be realized in real time with the drowsiness detected and according to a special timing schedule of internal activities.
  • the procedure for adaptable system control principal procedure
  • auxiliary procedure procedure for preventing drowsiness
  • the device should be simple in design, easy to handle, not to burden the user in exploitation, attractive in appearance and shall not limit the user field of view during use. Also, it is important that the device should be protected of any attempt of misuse by the user as well as to possess an additional memory unit with a backup battery to memorize and store selected data intended for event course reconstruction.
  • the invention solutions adequate to the hereinbefore set tasks are contained in the patent requirements 1 - 9.
  • the invention constructive solution consists of three wholes such as: 1.1 processing computer design (14) for the image graphical processing and the executive units operation control, 1.2 device design (1) - measuring-executive bridge for early detection and prevention of drowsiness (biological crisis factor) and 1.3 sensors and executive units located in the controlled object (vehicle) in the function of data acquisition from the vehicle and realization of the speed accommodating procedure to the driver drowsiness state found out (adaptable control procedure).
  • connection between the constrictive wholes (1) and (14) is implemented by means of the wired beam (13), while the connection between (14) and the sensor (S 3 ) and the executive units in the vehicle is implemented by the wired connections according to Fig. 3.
  • the connection between (1) and (14) may be implemented by the remote transfer as well, which represents an option of the invention.
  • the processing computer design (14) is based upon the graphic processor for the standard configuration image processing, expanded with: 1. replaceable memory card (15) intended to memorize and store data on the driver and vehicle conditions during the drowsiness, and 2. battery backup card (16).
  • the processing computer (14) block diagram and the wiring diagram with sensors and executive units of the driver- vehicle system are given in Fig. 3.
  • the number of input/output units (I/O interfaces) is variable and mainly depends upon the man-machine system type in which the invention is applied. In the concrete case of application the processing computer has four input interfaces and ten output interfaces.
  • Input interfaces 1 and 2 provide reception of measuring biosignals from the corresponding bioemitters on the driver head, acquired during the operation process by the measuring-executive bridge (1) by means of sensors (S ⁇ /S' ⁇ and S 2 /S' 2 ), while the input interface 3 provides reception of the speed of the vehicle acquired by the sensor (S 3 ).
  • the input interface 4 is intended for connecting the console (17) for data reprogramming and memory (15) contents readout.
  • the processing computer (14) through its output interfaces 2, 3 and 4, supports all output units intended to excite the driver (10/10', 11/11' and 12/12') for the purpose of preventing biological crisis factors (drowsiness), while, through interfaces 7 and 8, supports output units (18 and 19) in the parallel implementation for step-by-step annulling the speed of the vehicle in the adaptable process control procedure.
  • the processing computer (14) based on the image contrast reduced, automatically activates and supports, through the output interface 1, the infrared light source (9/9'), which from the flank of the eye lights the outside eye sockets for the purpose of obtaining a high quality shot of the eyelid blink and the iris H-segment of map.
  • the output interface 6 to support operation of the light displays (20/20') on the vehicle for the purpose of warning other participants in the traffic on the driver drowsy state.
  • the output interface 9 is intended to activate the release valve on the bottle (22) containing a strong (unpleasant) gas (pyridine or hydrogen sulphide H 2 S) for the needs of preventing drowsiness (option III).
  • the output interface 10 is intended to activate the alarm device horn (23) for the purpose of creating excitement "ZNUK (SOUND) III" with f 3 according to. Table 2.
  • the processing computer may be housed in its own casing of a special design ("black box"); it can also be integrated with the existing processing computer of the system for other purposes. Both in one and the other implementation cases, constructive solution for building-in the memory card (15) is such that it prevents the driver to directly and of his own access the data during the traffic.
  • the device constructive solution (1), the measuring-executive bridge is given in Fig. 4. It consists of an anatomically shaped supporting construction along which sensors (Si/S , S 2 /S 2 '), infrared light sources (9/9') and executive units (10/10', 11/11' and 12/12') for excitement creation (light, sound and painful, respectively) are integrated by the corresponding constructive solutions.
  • the device (1) supporting construction anatomically follows the shape of the driver head at the height of the eyebrow - temple - ear, so that along the ridge (2) it mildly leans on the ridge of the driver eyebrows resting with holders (3/3') on the ears of the person, like eyeglasses.
  • the saddle of the ridge (4) which follows the anatomical form of the nose root and serves the device (1) to rest and be positioned to the nose root.
  • the device (1) enables the frame (6) to be slightly upgraded with replaceable plastic lenses (with or without diopters) (7/7'), which is by the inserting (putting in) procedure into the holes (5/5') simply built-in and replaced.
  • replaceable plastic lenses with or without diopters
  • 7/7' replaceable plastic lenses
  • the ridge (2) or, to put it more precisely, at the vertexes of the right angles, which in the operating mode closes the ridge (2) with the holders (3/3'), vertical cylinders are attached which, first of all, serve CCD microcameras (Si/Si') and inductive probes (S 2 /S 2 ') to be built-in and accommodation to the corresponding bioemitters of information on drowsiness.
  • the upper part of the cylinder (8/8') serves a LED (10/10') to be built-in as a light source to excite the driver within the programme intended to prevent drowsiness, while the lower part serves infrared diode (9/9') to be built-in to laterally light the eye sockets with infrared rays under the night operating conditions.
  • Constructive implementation of the cylinder (8/8') is such that enables it to be finely moved up and down and to rotate, which enables the sensors (Si/S ⁇ and S 2 /S 2 ') and the light sources (9/9' and 10/10') to be adjusted to the optimum position with reference to the intralids hole (rima palpebra), that is, to the path (x) the upper eyelid passes when one blink is realized.
  • the most favourable angle is chosen, depending on the anatomic construction of the outside part of the driver eye, for the purpose of realizing a high quality shot.
  • the holders (3/3') are attached to the ridge (2) by a standard joint, like with eyeglasses, and in a free position they are folded in the ridge (2) and cylinder (8/8') plane. They are anatomically shaped and possess technological holes for the buzzers (11/11 ') to be built-in - the executive unit to excite the driver by sound and micromagnet needles (12/12') - executive units intended to excite the driver by pain.
  • a technological channel extends used for the wiring of all the sensors, light sources and executive units to be built-in, which at the support end is formed into an output cable (13/13') used to connect the device (1) to the processing computer (14).
  • the measuring-executive bridge design is, for safety reasons, implemented in a redundant implementation, which to a certain degree makes the invention more expensive.
  • MTBF mean time between failures
  • S 2 technical availability of the CCD chip and inductive probes
  • technical reliability of the measuring-executive bridge (1) may also be obtained by a standard implementation, a transition to which is easy and simple.
  • the device (1) standard implementation has also been realized within the invention and represents an option to the redundant solution.
  • the device (1) in a full symmetry records, measures and excites the left and the right sides of the driver head in the area of the principal senses, so it is why the device (1) name is a MEASURING- EXECUTIVE BRIDGE.
  • the processing computer In the part of sensors (Si/Si', S 2 /S 2 ' and 9) and the processing computer (14), it represents a secondary (technical) measuring circuit to detect and measure drowsiness, while in the part of the executive units (10/10', 11/11' and 12/12') and the processing computer (14) it represents an executive circuit of the invention used to prevent the crisis (drowsiness) biological factor.
  • the infrared diode When considering adverse effects of the infrared radiation on the driver eye, it should be born in mind that, during the night drive when the driver is awake, the infrared diode operates sequentially in sequences of 3 minutes off and 3 sec on. After detecting the moment the drowsiness commenced, the infrared diode changes its mode of operation and during the subsequent couple of minutes operates actively until the driver is awake again or the vehicle stopped - then the diode switches off (see: the procedure for early detection of drowsiness, the process course monitoring and classification).
  • the executive unit which generates excitement by sound (buzzer) is located in position (11) of the support (3) and can generate tones of middle frequency (f ) and tones of high frequency (f 2 ) (according to Table 2).
  • the support (3/3') ends are slightly folded towards the inner side of the device (1), so that they follow the anatomic shape of the mastoid bone on the driver head and provide good adherence of the executive units (11/11') - the micromagnet needle to generate excitement - pain.
  • the needle sting in two levels of depth (300 ⁇ m and 600 ⁇ m) generates PAIN I (the first pain level) and PAIN II (the second pain level) as shown in the excitement matrix, Table 2.
  • the sensors (S 3 /S 3 ') and the executive units (18, 19, 20/20', 21, 22 and 23) represent a component parts of the invention design disregarding the fact that some of the executive units (18 and 23) are built-into the vehicle for the purpose of accomplishing other important functions of the vehicle.
  • Structural arrangement of the sensors and executive units within the vehicle is shown in Fig. 3.
  • the sensor S 3 /S 3 ' - inductive speed meter, coupled with (14), continuously measures the vehicle speed permanently levelled by the processor with the measured values of the drowsiness function SB f(t).
  • the executive unit (19) represents an automatic electromechanical or electronic select switch (reductor) intended to limit the vehicle speed. Since the adaptable system control procedure is performed in cascades in line with the impending new phases of drowsiness, sudden breaking the vehicle causes that in each step of breaking the driver body is by inertia (unwillingly) moved forward- backward. Therefore, one can say that generation of excitement with the driver by changing his balance as well as generation of fear, according to Table 3, at the beginning of phase 3, is another function of the executive unit (18). Awareness of the driver in PHASES 1 and 2 is considered to be high enough that fear cannot be generated with the driver due to the inertial body movement under the sudden breaking conditions.
  • the executive unit (22) - the bottle containing sharp and unpleasant gas - coupled with (14) gives off, as needed, a compressed sharp gas into the vehicle cabin, which creates extremely unpleasant excitement and forces the driver to stop drowsiness and step outside the cabin/vehicle, what was the goal. For fear not to panic the driver, this form of excitement and breaking the drowsiness is offered by authors as option III.
  • the executive unit (23), the howling siren (vehicle antitheft alarm), is also in the function of preventing drowsiness and serves to generate excitement ZNUK (SOUND) III of variable frequency (see: the excitement matrix in Table 2). The alarm is switched on in phase 3 of drowsiness and cannot be switched off until the vehicle stops and the driver steps outside to deactivate it.
  • the executive unit (21) - the driver intended to generate "stop” lights, operates synchronously with (18), so that simultaneously with breaking the vehicle the "stop” lights are activated as well which is in line with the traffic regulations.
  • the executive units (20/20') - separate lighting displays they are arranged in the upper left corners of the front and back windscreens and, coupled with (14), are activated at the moment PHASE 2 of drowsiness commences. PHASE 2 of drowsiness is accompanied by a red colour. Entering PHASE 3, the display alternately flashes red and green.
  • the executive units (20/20') inform other participants in the traffic and the police on the actual drowsiness phase of the driver participating in the traffic.
  • the total invention procedure consists of three main procedures, which in the functional point of view treat three different problems upon which the invention functioning is based. Those are: 2.1. the procedure of early drowsiness detection, 2.2. the procedure for adaptable man- vehicle system control and 2.3. the procedure to prevent biological crisis (drowsiness) factors. In addition to the main procedures, there exists within the total invention procedure a certain number of accompanying procedures the number and functions of which change from the application to application and only some of them will be described under 2.4.
  • procedure 2.2. through its basic function, systematically accommodates the vehicle speed to the driver drowsy state found out, but at the same time, by means of its contribution services another line of action (procedure 2.3.).
  • any attempt to prevent the driver drowsiness is carried out under the conditions of considerably reduced vehicle speed, which greatly decreases the possibility the accident to occur due to the effect of noncontrolled reflex movements of hands and legs which, as by-products of the drowsiness broken, inevitably accompany an attempt to prevent drowsiness.
  • the invention procedures activities timing schedule defines that at each step of realization of these two procedures, the task of procedure 2.2. is to be carried out first and then that of procedure 2.3.
  • the early detection and measuring of one's drowsiness is a key procedure of the invention by means of which, supported by the measuring-executive bridge (1) and the processing computer (14), precise measurements and the drowsiness process analysis are carried out.
  • One's drowsiness process is best reflected through the awareness degree (SB) changes under different drowsiness phases, so that herefrom the drowsiness function defining can be drawn which reads:
  • Drowsiness is a transitional psychophysical state of variable awareness which most frequently moves a human organism from the state of awareness into the state of sleeping.
  • definition II would read as follows: Drowsiness is a transitional process in which, under the drowsiness factors, there occurs a phenomenon of interferences both in the reception and recognition of excitements and in emission of the controlling pulses for the performance of effectors (muscles and glands) functions, which CNS recognizes and automatically introduces corresponding functional changes (into CNS and the organism on the whole) for the purpose of accommodating neuro-physiological functions to the newly created state.
  • Drowsiness factors are divide into: natural drowsiness factors (fatigue, type of job, working environment and other) and artificial drowsiness factors (drugs, alcohol, medicaments, and other soporifics).
  • natural drowsiness factors fatigue, type of job, working environment and other
  • artificial drowsiness factors drugs, alcohol, medicaments, and other soporifics.
  • CNS internal mechanisms taking part in the procedure of changes of its operation mode due to drowsiness, those are mainly: a) reticular activation systems (RAS), b) relay cores of the brain tree (new gray matters), c) SAN (SLEEP)- neuroformation and d) HRONO-neuroformation (biological clock).
  • Reticular activation systems is more a functional system of CNS responsible for: waking up, maintaining awareness, activating and holding one's attention, perceiving associations and directed introspection, and consists of the centrocephalic part of the brain tree and circuitous parts of the reticular formation belonging to which are subthalamus, hypothalamus and middle part of thalamus [1,2].
  • Relay cores of the brain tree are specialized CNS neuroformations of higher functional purpose, which fundamentally represent bistable switches intended to direct neurotransmitter paths (reflexive arc path selection), thus intended to determine the CNS operation mode.
  • the relay cores play a role of active elements as well within which integration of various functions is performed when neurotransmitters from different brain centres flow into them [1,3].
  • the relay cores switch off more neuronic networks from functioning, so that further functioning of CNS under the drowsiness conditions is carried out through the lower neuronic networks, which establishes a series of high quality new neurophysiologic functions on the CNS level and the level of the whole body.
  • Relay cores as an RAS instrument, react depending on the RAS findings and the result of its action on the internal selfregulation of the generated interferences (action of the immunological system - CNS).
  • SAN-neuroformation belongs to lower neuronic networks (reticular formation [1,2]), which are phyllogenetically older, and being unknown so far, we think that it was structurally appended to the relay cores of the brain tree and to the gray cores of RAS. It is activated by RAS through which it also receives time commands on the blocking intervals of neurons responsible for functioning in the awake state. Through RAS (otherwise responsible for waking up), it also receives a controlling pulse for instantaneous deblocking of all neurons at the moment of waking up.
  • HRONO- neuroformation functions within the reticular activation system (RAS) by means of which it impresses (modulates) the basic biotact (ty o ) into the neurons network, indispensable for creation and performance of a great number of activities.
  • RAS reticular activation system
  • Neurotransmitters oscillation from neuron to neuron along the strictly defined path and at constant movement speed could surely meet requirements of the basic functional unit for biological time generation.
  • the awareness function course of a man is variable and mainly depends upon: drowsiness type and intensity factors, ambient in which the process is carried out and upon the mental frame of a personality.
  • drowsiness type and intensity factors two recognizable ranges can be noticed: the range of establishing the drowsiness transitional mode and that of the drowsiness stable mode.
  • the drowsiness factors effect start on the nervous system there occurs a slight (partial) dysfunction of neurons in the sensitive and motoring centres of CNS, where all the sensitive and motoring centres of CNS are not equally affected by the dysfunction process.
  • the awareness transitional mode establishment range duration varies and its outcome (annulled effect and return to the lively awake state or development into the stable drowsiness process) mainly depends upon the drowsiness factor intensity, mental frame of the personality and slightly upon training.
  • a crucial moment in the drowsiness process development which at the same time limits the hereinbefore named ranges of drowsiness, occurs at the moment when the above mentioned interferences grow to a critical value, which starts to seriously endanger the natural balance of neuro/physiological activities of the awake state.
  • PIA DYNAMICS Computer Analysis of DYNAMICS of the eyelid (Palpebrae), of the Iris H-segment map and the bioenergetic brain field (Aura) was developed.
  • the choice of bioemitters of information on the brain functional state over the drowsiness process is a result of a long-range investigations of the authors and expert collaborators and is fully adequate to the complex problems considered - "the twilight zone" or "the consciousness blackout” state.
  • bioemitters choice have been adopted as the only possible solution to accomplish the basic invention task - early detection of drowsiness, that is, detection of drowsiness at the moment of its commencement.
  • selected as high quality bioemitters were: 1. iris H-segment map (Fig. la); 2. brain bioenergetic field of radiation (aura) (Fig. lb); 3. system of muscles to move eyelids (palpebrae) with the eyelid as an operating element (Fig. lc), resulting in an optimum solution to realize the above set goal.
  • bioemitters automatically determined were the magnitudes (phenomena) for drowsiness quantification and measurement such as: for iris H-segment - amount of Q-field area, for aura - the flux value ⁇ at the moment of measurement and for the muscles system to move the eyelid - eyelid blink dynamic parameters value according to Fig. Id.
  • magnitudes for iris H-segment - amount of Q-field area, for aura - the flux value ⁇ at the moment of measurement and for the muscles system to move the eyelid - eyelid blink dynamic parameters value according to Fig. Id.
  • normal values of these magnitudes are recorded and stored in the processing computer (14) within the "zero initialization" procedure and invention personalization.
  • Position of CCD microcameras is, by means of the measuring-executive bridge (1), so determined that it, in addition to high quality recording of the eyelids blinks, provides a high quality shot of the iris H-segment in both cameras when the position of eyeballs is normal, and only in one (left or right) when the position of eyeballs is shifted to the left or to the right.
  • the senor (S 2 /S 2 ') position As for the sensor (S 2 /S 2 ') position, - special inductive probes, it accidentally coincides with the optimum sensor (Si/Si') position and was experimentally determined as the optimum distance both relative to the brain crust central motoring system position and the reticular activation system position.
  • the selected position of the sensor (S 2 /S ') accomplishes satisfactory efficacy of flux recording in both operating modes of the brain (through higher neuronic networks and through lower neuronic networks).
  • Measuring tact of all measuring values and parameters in the invention has been harmonized with the natural tact of the eyelid blink repetition, so that practically with repetition of each subsequent blink a new (fresh) data pack on the actual psychophysical state of the driver and dynamic state of the vehicle is entered into the processing computer.
  • Fig. Id For detailed analysis and computation of the driver drowsiness function instantaneous values, only the upper eyelid blink will be used (Fig. Id), in view of the fact that its movement radius is considerably higher than that of the lower eyelid, which makes the image graphical processing procedure shorter without affecting the quality of measurement.
  • the measurement procedure is carried out so that the shot of the eyelid blink and the iris H-segment, after recording by means of the sensor (S t /Si') - CCD microcamera, is led via cable (13) of the measuring-executive bridge (1) to the processing computer (14), where image graphical processing and numerical data processing is performed.
  • UMF modulation transfer function
  • the drowsiness process start (the drowsiness transitional mode establishment range) feature frequent function values change over a narrow range (tolerant awareness phase), which imparts slightly decreasing waveform to the curve.
  • the requirement to bring the moment of finding out drowsiness into the moment of its occurrence is an imperative of the invention, so it is why the measuring method has been devised so that by measurements it involves as greater number of sensitive and motoring brain centres as possible.
  • the curve shows variable course, mainly descending, with the distinct occurrence of the function course break (t pr ) at each reflex operation measurement sequence - the eyelid blink.
  • the drowsiness process is classified in six phases as follows: 1. for 100% > SB > 90%, we would have PHASE 1 - tolerant awareness phase; 2.
  • the procedure for adaptable driver-vehicle system control represents the principle invention procedure to maintain the system security under the driver drowsiness conditions the task of which is to accommodate the vehicle speed to the driver awareness degree fall found out and according to need to timely stop the vehicle. This procedure is carried out in parallel with procedure 2.3 intended to prevent the crisis (drowsiness) biological factor, and in real time with procedure 2.1 for early driver drowsiness detection. Shown in Table 1 are the values of permissible speeds for corresponding drowsiness phases accomplished by the invention by the adaptable control procedure.
  • Attributed to it can be a "shadow procedure" epithet, because all the time during the driver drowsiness it precisely performs its principal task, making at the same time great favours to the parallel procedure 2.3. and giving it precedence in solving the crisis up to the moment of commencement of the critical moment (driver operating incapability threshold).
  • the procedure itself is carried out so that at the moment of finding out the actual fall of the awareness degree according to the table, the processing computer (14) activates the sensor (S 3 /S 3 ') - inductive emitter to measure the vehicle speed, at which moment it computes the vehicle speed.
  • the procedure intended to prevent drowsiness is another procedure of the invention to preserve the driver-vehicle system security under the driver's drowsiness conditions. Based on the medical investigations results in this field: "that there is no absolute guarantee to succeed in preventing one's drowsiness", this procedure has the auxiliary procedure status in the invention - the procedure of insufficient reliability.
  • Light excitements are produced by LEDs (10/10'), which in PHASE 1 - tolerant .awareness phase, are blinking at frequency f l5 while in PHASE 2 their blinking frequency is tripled to f 2 .
  • the sound excitements of the first level They are generated by small buzzers (11/11') located at the measuring-executive bridge (1), the sound frequency of which automatically changes at the transition from the drowsiness PHASE 1 to PHASE 2.
  • the sound excitement of the third level, f 3 is generated by the sound device of the standard alarm system (23) built-into the external part of the vehicle body and which can be blocked only by stopping the vehicle and stepping outside, which is quite enough to break down the actual drowsiness moment.
  • Excitement by PAIN I and II levels is generated by the executive units (12/12') - microelectromagnetic needles with automatically changed sting depth of 300 ⁇ , at the first excitement level, and 600 ⁇ at the second excitement level. Changing the sting depth at the transition from the phase to phase of drowsiness, there is a situation that the pain felt at the pain centre is multiply increased with reference to the needle sting shift (difference).
  • These executive units (11/11') are also located on the measuring-executive bridge (1) supports (3/3'), so that the sting is generated at the skin nearby the mastoid bone (behind the ear).
  • Excitements caused by the BALANCE CHANGE and FEAR are mutually connected excitements generated due to the effect of procedure 2.2.
  • Excitement of the sense of smell of the driver is exceptionally strong excitement under the influence of strong (unpleasant) gas (pyridine or hydrogen sulphide H 2 S) held in a small bottle with an automatic gas release valve.
  • the bottle filled with gas (22) is housed in the front bonnet of the vehicle, so that, through an extension hose, the gas is led into the interior of the vehicle to the left of the steering wheel.
  • the gas dosage must be strictly controlled, because the excitement is so strong that the driver cannot stand more than 2 ⁇ 3 sec in the ambient containing the gas, which overcomes any instinct (need) for drowsiness and forces the driver to seek salvation in stopping the vehicle and stepping outside.
  • the inconvenience of this excitement is in that it can panic the driver and assistant driver, which may affect the traffic security.
  • the executive units (10/10', 11/11' and 12/12') are housed on the measuring-executive bridge (1) (see Fig. 4), so that positioning the measuring-executive bridge (1) on the driver head, each of them occupies its optimum position with reference to the sense organ it excites.
  • LEDs (10/10') are housed in the cylinders (8/8') of the measuring-executive bridge (1) together with infrared diodes (9/9') and sensors (Si/Si'and S 2 /S 2 ').
  • each step of the driver drowsiness prevention procedure is performed thanks to the step-by-step (cascade) reduction of the vehicle speed based on the effect of procedure 2.2. in the ambient of the vehicle speed accommodated to the actual psychophysical moment of the driver state, which is a significant contribution to the security. Further, under the vehicle reduced speed conditions a risk of danger is also reduced from the impact of the uncontrolled reflex movements of the driver legs and hands which occur during excitements. At high vehicle speeds, these reflex movements may additionally endanger the already endangered driver- vehicle system security.
  • the invention fails to prevent the driver drowsiness process in early drowsiness phases, including the first half of PHASE 4 as well, its is certain that a hard form drowsiness is in question (great fatigue or impact of drug and/or alcohol) which, by further repetition of the procedure, is ever harder to prevent.
  • the procedure to realize the function of informing other participants in the traffic on the actual driver drowsiness state is in that the processing computer (14), after having detected the first signs of drowsiness with the driver, activates displays 20/20' located in the upper left corners of the vehicle windscreens, which begin blinking in red colour. With the advanced drowsiness and entering PHASE 3 of drowsiness, additional green colour in displays is activated, so that from that moment and on red/green colours are alternately blinking, signalling other participants in the traffic that the driver of the marked vehicle is in a dangerous phase of drowsiness.
  • the procedure to realize "the end of drive” function in cases of forced stopping the vehicle feature the situation in which the vehicle, having been stopped by procedure 2.2., remains under the blockade for 3-5 minutes. Upon expiration of this time, the processing computer (14) deblocks the vehicle for the next 10 minutes, during which time the vehicle has to be removed from the road and properly parked, after which it is again blocked for 2 hours, needed for the driver to take a nap.
  • the procedure to select, memorize and store information on the traffic course for reconstruction of events and subsequent analysis is a fully automatic process within the processing computer (14) according to specific software solution.
  • the selected data on the vehicle and driver states are memorized on a special memory card (15) supplied from a battery backup unit (16), which guarantees data to be saved even under the faulty or deliberately removed battery.
  • the driver cannot access the memory card (15) and the data stored on it, but only an authorized person using secret code.
  • the procedure to prevent the invention misuse by the driver during the drive will not be dealt with in details, because it is evident that an intelligent device is in question which carries out the self-test function during each pause between two blinks, so that it is practically impossible to make complex "mechanical phantoms" by means of which the stated bioemitters would be simulated.
  • the "self-test" procedure is used, at the beginning of each use, to perform detailed test of technical correctness of all components of the invention, the test results being communicated through the corresponding signals of the executive units (10/10') and (11/11').

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The invention represents a high reliable safety system intended for preventing catastrophes (accidents) of technic-technological system man-machine that would be caused due to drowsiness of a man.The highest degree of reliability (100%) with reference to the system security preservation has been founded upon the development of a new method for early detection and monitoring of a drowsiness process course of a man (Com. A. PIA DYNAMICS), by means of which the drowsiness process is detected at the moment of its commencement and continuously monitored up to the moment of the sleeping process occurrence.Early detection of drowsiness of a man creates real prerequisites for timely performance of procedures for the system security preservation such as: the procedure for adaptable system control with the purpose of permanently accommodating the speed of the vehicle to the driver awareness degree fall found out and the procedure for preventing the driver drowsiness (crisis biological factor) at the early drowsiness phase when the chances for success are maximum. The invention is controlled by the processing computer (14), so that both procedures for the crisis factors prevention are carried out in real time with finding out certain drowsiness process phases (out of six in total) simultaneously or in the 'step-by-step' procedure.Failure of the driver drowsiness process prevention procedure in the third step of repetition (maximum dose of excitement) automatically is a sign that a hard form of drowsiness, that is, high degree of the system endangerment is in question, in which case the problem of further system security preservation is resolved by the invention by means of the adaptable system control procedure. Based on the results obtained from the vehicle speed decreased over the previous steps of action to the value of v = 20 km/h, the vehicle is timely stopped through the last step of action (v = 0 km/h) at the road length 1 = l m, practically while the driver is still in the state of consciousness (SB = 45%, 10-2 sec < tp.r.< 10-1 sec, t V.B. = 0).

Description

THE PROCEDURE AND DEVICE INTENDED
FOR THE MAN-MACHINE SYSTEM SECURITY PRESERVATION
UNDER A MAN'S DROWSINESS CONDITIONS
The Field of Technique the Invention Refers to:
The invention belongs to a technical group of safety systems and refers to the procedure and device intended for the technical-technological man-machine systems security preservation under the driver control conditions.
According to the international classification of patents (ICP) it belongs to : B60 K28/00.
The Invention Technical Problem The inventions resolves the development procedure and device design problem, intended for early detection and prevention of the crisis factor occurring in the man-machine system due to the driver drowsiness, so as to increase the degree of security in preserving the system security to the maximum level (100%) with reference to the solutions of the well-known inventions the guarantees of which to preserve the system security are minimum and of some almost none.
The Technique State-of-the-Art
Studying the invention solution in the field of detecting and preventing drowsiness of a man in the function of preserving the security of the man-machine system, a conclusion can be drawn that the level of the results obtained is in disproportion with the volume of investigation. Namely, the volume of investigation is great and the results of detecting the moment of drowsiness of a man have not made significant progress from the drowsiness threshold and they mainly range within the late phases of drowsiness (see detailed description of phases 5 and 6). Three inventions of somewhat earlier date (Patent No. DE-OS 3447536, Patent No. DE-OS 42006421 and Patent No. DE-OS 3013140) and one of recent date (1979) protected under No. WO 97/15033 at the International Patents Office will be covered in more details by this analysis. The invention DE OS 3447536 reacts based on the 60 sec active state holding time constant input electronic circuit (variable parameter) activated by the "trigger button". If the handler fails to push the button upon 60 sec, the invention records his absence and automatically activates the breaking system - stopping the machine. The invention is an interesting solution of narrow possibilities of application and has a greater number of defects. The invention basic defects are as follows: causes the handler's repulsion during the operation procedure, the invention button is often pushed by a simple auxiliary device (mechanical phantom) while the handler meditates or dozes (what was the reason for a greater number of accidents in the railway traffic of the most European countries) and the 60-sec time interval is a too long period to control the locomotive in a drowsy state (the late drowsiness phase) which offers a possibility in one of five to six "secundeschlafen" sequences in 5 sec to pass the signal for "stopping the drive" unobserved, upon which regular handling of the invention (its button) goes on and the locomotive is driven into an inevitable accident. Featuring other inventions is a common characteristic, a poor quality of measured data based on which a moment of drowsiness is detected. This was the reason that drowsiness with these inventions was detected only at the end of the drowsiness function course (at the late - risky phase) when chances to succeed in preventing drowsiness are minimal (almost none) and the vehicle most frequently driving at the speed of 80-100 km/h. Described rather hidden in these inventions is the following: (quote) "upon termination of the response interval (2-3 sec) during which the effect of the attempt to prevent drowsiness is noticed and if the attempt to prevent driver drowsiness fails, the invention activates the signal to stop the vehicle" (unquote). One gets the impression that the authors of these inventions have forgotten physics and biology when they think that it is possible to safely stop the vehicle moving at the speed of v = 80 km/h, when the driver is already asleep for 3-4 sec, if the automatic breaking system is activated. Somewhat more favourable results in detecting drowsiness have been declared, without more precise indices, with the patent no. WO 97/15033 of a more recent date than the hereinbefore named ones. Carefully analyzing the used measuring procedures, bioemitter quality, measuring sensors (quality and capabilities) and the data quality on the whole, an impression is gained that a step forward has been made with reference to detecting drowsiness, but that no progress has been made from the range of the late - risky phase of drowsiness. The measuring data quality is such that drowsiness detection moment can only maximally reach the threshold (start) of phase 5 - late phase of drowsiness (see classification in the detailed description, point 2.1) which, from the chances point of view to succeed in preventing drowsiness, is a delayed (unfavourable) moment. As with previous inventions, if the attempt to prevent drowsiness fails, here, too, upon the termination of 2 sec, sudden breaking is used as a forced and most frequently counterproducitve procedure for the purpose of preventing an accident. The Invention Essence
The invention essence is to accomplish a dynamic model of a safety system to preserve the man-vehicle system security under the driver control conditions, which in real time with occurrence detects and keeps track of the control process development trend, measures the driver and vehicle crisis factor values, affects correction/prevention of the crisis factors measured by adequately (strictly controlled) measures and maintains possible awake state. If the driver crisis factor (driver drowsiness) measured value is not prevented neither after the third prevention attempt, the invention activates the final step of the procedure for adaptable system control and at the preset term safely stops the vehicle at the length of / = lm, automatically breaking the vehicle from v = 20 km/h to 0 km/h. Thus, the driver- vehicle system security under the driver control is safely (100%) and timely, practically in still awake state of the driver, maintained and the driver timely disqualified from the driving process for a certain time. The operating capability range of a man, that is, the operating incapability threshold under the drowsiness conditions is a variable parameter in the invention and can be adjusted depending upon the invention application and requirements for accomplishing the level of security.
The Plan Short Description Shown in Fig. la. is an iris H-segment map representing the first indirect bioemitter of information on the brain functional state and which is innervated by the sympathetic and parasymphatetic nerves. Shown in Fig. lb. is the brain bioenergetic field of radiation of a man (aura) used as a direct bioemitter of information on the brain functional state. Shown in Fig. lc. is a schematic diagram of innervation and motor function of the system of muscles to activate the upper eyelid in the function of the bioemitter of information on the CNS functional state. Shown in Fig. Id. is a graphical representation of the upper eyelid blink, resulting from the graphical processing of the bioemitter dynamic behaviour image from Fig. lc. Fig. 2 represents the drowsiness function course SB = f(t). Shown in Fig. 3 is a block diagram of a sensor and the executive units within the driver-vehicle system as well as their connection to the processing computer for the purpose of accomplishing the invention task. Fig. 4 represents a constructive solution of the measuring-executive bridge (1) intended for data acquisition on a man's drowsiness and its prevention.
The Invention Detailed Description
The invention task is to develop a high-performance device and adequate procedures which will, in the function of a safety system, accomplish a high degree of guarantee in preserving the man-machine system under the driver control conditions. The invention structure and functions should be implemented so that with slight changes in the basic solution a wide spectrum of applications can be covered such as: traffic (road and railway, river, coastal), air-traffic flight control service, industrial applications, supervision services (dams, power plant, nuclear power plants, other nuclear plants, oil plants, gas plants and other), medicine, army and police. The invention development, first of all, means development of a new method for monitoring awareness, detection of a drowsiness process establishment and continuous monitoring of the trend (increase/decrease) of drowsiness during the action of the whole interval. Based on the results of early detection of drowsiness, the functions of preventing the crisis factors which endanger the system security should be based upon: the procedure for adaptable system control (principal procedure) and the procedure for preventing drowsiness (auxiliary procedure) to be realized in real time with the drowsiness detected and according to a special timing schedule of internal activities. For the driver drowsiness process detection needs, changes should be used that occur on the high quality bioemitters of information on the manner of the nervous system functioning such as: iris H-segment map, aurodynamics of the nervous system and neuroanatomic mechanism for the eyelid blink generation. The device should be simple in design, easy to handle, not to burden the user in exploitation, attractive in appearance and shall not limit the user field of view during use. Also, it is important that the device should be protected of any attempt of misuse by the user as well as to possess an additional memory unit with a backup battery to memorize and store selected data intended for event course reconstruction. The invention solutions adequate to the hereinbefore set tasks are contained in the patent requirements 1 - 9.
The invention detailed description covers: 1. the invention design description and 2. the invention procedures description. The invention description will be based upon the invention solution example intended for the needs of preserving the mobile driver- vehicle systems security in the road traffic. 1. Viewed in details, the invention constructive solution consists of three wholes such as: 1.1 processing computer design (14) for the image graphical processing and the executive units operation control, 1.2 device design (1) - measuring-executive bridge for early detection and prevention of drowsiness (biological crisis factor) and 1.3 sensors and executive units located in the controlled object (vehicle) in the function of data acquisition from the vehicle and realization of the speed accommodating procedure to the driver drowsiness state found out (adaptable control procedure). The connection between the constrictive wholes (1) and (14) is implemented by means of the wired beam (13), while the connection between (14) and the sensor (S3) and the executive units in the vehicle is implemented by the wired connections according to Fig. 3. The connection between (1) and (14) may be implemented by the remote transfer as well, which represents an option of the invention.
1.1. The processing computer design (14) is based upon the graphic processor for the standard configuration image processing, expanded with: 1. replaceable memory card (15) intended to memorize and store data on the driver and vehicle conditions during the drowsiness, and 2. battery backup card (16). The processing computer (14) block diagram and the wiring diagram with sensors and executive units of the driver- vehicle system are given in Fig. 3. The number of input/output units (I/O interfaces) is variable and mainly depends upon the man-machine system type in which the invention is applied. In the concrete case of application the processing computer has four input interfaces and ten output interfaces. Input interfaces 1 and 2 provide reception of measuring biosignals from the corresponding bioemitters on the driver head, acquired during the operation process by the measuring-executive bridge (1) by means of sensors (Sι/S'ι and S2/S' 2), while the input interface 3 provides reception of the speed of the vehicle acquired by the sensor (S3). The input interface 4 is intended for connecting the console (17) for data reprogramming and memory (15) contents readout. On the other hand, the processing computer (14), through its output interfaces 2, 3 and 4, supports all output units intended to excite the driver (10/10', 11/11' and 12/12') for the purpose of preventing biological crisis factors (drowsiness), while, through interfaces 7 and 8, supports output units (18 and 19) in the parallel implementation for step-by-step annulling the speed of the vehicle in the adaptable process control procedure. For the invention operation needs under poor light conditions (night guard, night drive or when passing through the unlighted tunnel), the processing computer (14), based on the image contrast reduced, automatically activates and supports, through the output interface 1, the infrared light source (9/9'), which from the flank of the eye lights the outside eye sockets for the purpose of obtaining a high quality shot of the eyelid blink and the iris H-segment of map. As option II, there is a possibility, by means of the output interface 6, to support operation of the light displays (20/20') on the vehicle for the purpose of warning other participants in the traffic on the driver drowsy state. The output interface 9 is intended to activate the release valve on the bottle (22) containing a strong (unpleasant) gas (pyridine or hydrogen sulphide H2S) for the needs of preventing drowsiness (option III). The output interface 10 is intended to activate the alarm device horn (23) for the purpose of creating excitement "ZNUK (SOUND) III" with f3 according to. Table 2. As for the manner of implementation, the processing computer may be housed in its own casing of a special design ("black box"); it can also be integrated with the existing processing computer of the system for other purposes. Both in one and the other implementation cases, constructive solution for building-in the memory card (15) is such that it prevents the driver to directly and of his own access the data during the traffic. Taking over the data on the accomplished course of traffic and its subsequent analysis can be done only by the authorized person using a special code. The central processing unit (CPU) of the processing computer is of parallel implementation, which increases the invention reliability to the maximum level, so that technical availability (a) of the processing computer has the value of a = 0.9999. 1.2 The device constructive solution (1), the measuring-executive bridge is given in Fig. 4. It consists of an anatomically shaped supporting construction along which sensors (Si/S , S2/S2'), infrared light sources (9/9') and executive units (10/10', 11/11' and 12/12') for excitement creation (light, sound and painful, respectively) are integrated by the corresponding constructive solutions. The device (1) supporting construction anatomically follows the shape of the driver head at the height of the eyebrow - temple - ear, so that along the ridge (2) it mildly leans on the ridge of the driver eyebrows resting with holders (3/3') on the ears of the person, like eyeglasses. At the middle part of the ridge (2), at the lower side, constructively performed is the saddle of the ridge (4) which follows the anatomical form of the nose root and serves the device (1) to rest and be positioned to the nose root. For the imperfect eyesight persons needs or protection against the sun, the device (1) enables the frame (6) to be slightly upgraded with replaceable plastic lenses (with or without diopters) (7/7'), which is by the inserting (putting in) procedure into the holes (5/5') simply built-in and replaced. At the ends of the ridge (2) or, to put it more precisely, at the vertexes of the right angles, which in the operating mode closes the ridge (2) with the holders (3/3'), vertical cylinders are attached which, first of all, serve CCD microcameras (Si/Si') and inductive probes (S2/S2') to be built-in and accommodation to the corresponding bioemitters of information on drowsiness. The upper part of the cylinder (8/8') serves a LED (10/10') to be built-in as a light source to excite the driver within the programme intended to prevent drowsiness, while the lower part serves infrared diode (9/9') to be built-in to laterally light the eye sockets with infrared rays under the night operating conditions. Constructive implementation of the cylinder (8/8') is such that enables it to be finely moved up and down and to rotate, which enables the sensors (Si/S^ and S2/S2') and the light sources (9/9' and 10/10') to be adjusted to the optimum position with reference to the intralids hole (rima palpebra), that is, to the path (x) the upper eyelid passes when one blink is realized. Thus, the most favourable angle is chosen, depending on the anatomic construction of the outside part of the driver eye, for the purpose of realizing a high quality shot. The holders (3/3') are attached to the ridge (2) by a standard joint, like with eyeglasses, and in a free position they are folded in the ridge (2) and cylinder (8/8') plane. They are anatomically shaped and possess technological holes for the buzzers (11/11 ') to be built-in - the executive unit to excite the driver by sound and micromagnet needles (12/12') - executive units intended to excite the driver by pain. Along the support (3/3'), a technological channel extends used for the wiring of all the sensors, light sources and executive units to be built-in, which at the support end is formed into an output cable (13/13') used to connect the device (1) to the processing computer (14). The measuring-executive bridge design is, for safety reasons, implemented in a redundant implementation, which to a certain degree makes the invention more expensive. However, since the mean time between failures (MTBF) and technical availability of the CCD chip and inductive probes (S2) are at a high technical level, it is that technical reliability of the measuring-executive bridge (1) may also be obtained by a standard implementation, a transition to which is easy and simple. The device (1) standard implementation has also been realized within the invention and represents an option to the redundant solution. In the case of a redundant solution, the device (1) in a full symmetry records, measures and excites the left and the right sides of the driver head in the area of the principal senses, so it is why the device (1) name is a MEASURING- EXECUTIVE BRIDGE. In the part of sensors (Si/Si', S2/S2' and 9) and the processing computer (14), it represents a secondary (technical) measuring circuit to detect and measure drowsiness, while in the part of the executive units (10/10', 11/11' and 12/12') and the processing computer (14) it represents an executive circuit of the invention used to prevent the crisis (drowsiness) biological factor. By the described device (1) design shown in Fig. 4, a high degree of coupling between the sensors (Si/S^ and S2/S2') - secondary (technical) measuring circuit and bioemitters - corresponding primary measuring circuits (neuroanatomic mechanisms intended to generate measuring values) is accomplished, without reducing the driver field of view. LEDs (10/10') and infrared diode (9/9') are positioned so that LEDs blinking is distinctly noticeable for the eye, and the infrared diodes light up the outside part of the eye (eyelids and the front part of the eyeball) at a sharp angle α = 45°) which means a high quality solution as regards the protection of the eye against the infrared radiation. When considering adverse effects of the infrared radiation on the driver eye, it should be born in mind that, during the night drive when the driver is awake, the infrared diode operates sequentially in sequences of 3 minutes off and 3 sec on. After detecting the moment the drowsiness commenced, the infrared diode changes its mode of operation and during the subsequent couple of minutes operates actively until the driver is awake again or the vehicle stopped - then the diode switches off (see: the procedure for early detection of drowsiness, the process course monitoring and classification). The executive unit which generates excitement by sound (buzzer) is located in position (11) of the support (3) and can generate tones of middle frequency (f ) and tones of high frequency (f2) (according to Table 2). The support (3/3') ends are slightly folded towards the inner side of the device (1), so that they follow the anatomic shape of the mastoid bone on the driver head and provide good adherence of the executive units (11/11') - the micromagnet needle to generate excitement - pain. The needle sting in two levels of depth (300μm and 600μm) generates PAIN I (the first pain level) and PAIN II (the second pain level) as shown in the excitement matrix, Table 2. A conclusion can be drawn that the described device (1) design resulted in a device solution which in its standard and redundant implementations (with or without options I, II and II) meets all high requirements regarding functionality and ergonomics of the device set in the invention project task. 1.3 The sensors (S3/S3') and the executive units (18, 19, 20/20', 21, 22 and 23) represent a component parts of the invention design disregarding the fact that some of the executive units (18 and 23) are built-into the vehicle for the purpose of accomplishing other important functions of the vehicle. Structural arrangement of the sensors and executive units within the vehicle is shown in Fig. 3. The sensor S3/S3' - inductive speed meter, coupled with (14), continuously measures the vehicle speed permanently levelled by the processor with the measured values of the drowsiness function SB = f(t). Thus, a prerequisite to realize the procedure of adaptable system control is achieved, which accommodates the vehicle speed to the driver awareness degree fall found out, which is the responsibility of the executive units (18 and 19). The executive unit (19) represents an automatic electromechanical or electronic select switch (reductor) intended to limit the vehicle speed. Since the adaptable system control procedure is performed in cascades in line with the impending new phases of drowsiness, sudden breaking the vehicle causes that in each step of breaking the driver body is by inertia (unwillingly) moved forward- backward. Therefore, one can say that generation of excitement with the driver by changing his balance as well as generation of fear, according to Table 3, at the beginning of phase 3, is another function of the executive unit (18). Awareness of the driver in PHASES 1 and 2 is considered to be high enough that fear cannot be generated with the driver due to the inertial body movement under the sudden breaking conditions. The executive unit (22) - the bottle containing sharp and unpleasant gas - coupled with (14) gives off, as needed, a compressed sharp gas into the vehicle cabin, which creates extremely unpleasant excitement and forces the driver to stop drowsiness and step outside the cabin/vehicle, what was the goal. For fear not to panic the driver, this form of excitement and breaking the drowsiness is offered by authors as option III. The executive unit (23), the howling siren (vehicle antitheft alarm), is also in the function of preventing drowsiness and serves to generate excitement ZNUK (SOUND) III of variable frequency (see: the excitement matrix in Table 2). The alarm is switched on in phase 3 of drowsiness and cannot be switched off until the vehicle stops and the driver steps outside to deactivate it. The executive unit (21) - the driver intended to generate "stop" lights, operates synchronously with (18), so that simultaneously with breaking the vehicle the "stop" lights are activated as well which is in line with the traffic regulations. As for the executive units (20/20') - separate lighting displays, they are arranged in the upper left corners of the front and back windscreens and, coupled with (14), are activated at the moment PHASE 2 of drowsiness commences. PHASE 2 of drowsiness is accompanied by a red colour. Entering PHASE 3, the display alternately flashes red and green. Thus, the executive units (20/20') inform other participants in the traffic and the police on the actual drowsiness phase of the driver participating in the traffic. They represents an option as well (option II), because of the need to be harmonized with the traffic regulations and introducing this function into exploitation. 2. Viewed in details, the total invention procedure consists of three main procedures, which in the functional point of view treat three different problems upon which the invention functioning is based. Those are: 2.1. the procedure of early drowsiness detection, 2.2. the procedure for adaptable man- vehicle system control and 2.3. the procedure to prevent biological crisis (drowsiness) factors. In addition to the main procedures, there exists within the total invention procedure a certain number of accompanying procedures the number and functions of which change from the application to application and only some of them will be described under 2.4. In the invention application as a safety system intended to preserve awareness in the traffic, the following procedures, as more essential ones, can be singled out: data storage on drowsiness from the moment the safety crisis commences to its successful elimination, the procedure of informing other participants in the traffic on the actual driver drowsy state, the procedure of protecting the invention against any attempt by the driver to misuse it and the procedure to realize "end of drive" in the cases when the invention prevents accidents by the forced vehicle breaking, after having found out that it is impossible to prevent the already commenced drowsiness process of the driver. The procedure to preserve the driver- vehicle system security (2.2. and 2.3.) act in the invention as a system of parallel procedures under the unique action algorithm, when, in addition to the distinctly expressed individual (direct) contributions in preserving the system security, indirect contributions are also accomplished, which are reflected in the mutual support (help). So, for example, procedure 2.2., through its basic function, systematically accommodates the vehicle speed to the driver drowsy state found out, but at the same time, by means of its contribution services another line of action (procedure 2.3.). Thus, any attempt to prevent the driver drowsiness is carried out under the conditions of considerably reduced vehicle speed, which greatly decreases the possibility the accident to occur due to the effect of noncontrolled reflex movements of hands and legs which, as by-products of the drowsiness broken, inevitably accompany an attempt to prevent drowsiness. On the other hand, it is much easier for the drowsy driver and more safe for the traffic as well when the driver steers the vehicle steering wheel if the vehicle moves at a speed much lower that that when the driver was awake. In that sense, the invention procedures activities timing schedule defines that at each step of realization of these two procedures, the task of procedure 2.2. is to be carried out first and then that of procedure 2.3. Thanks to the processing computer (14), both procedures intended to preserve the driver- vehicle system security are carried out in real time with procedure 2.1. for early drowsiness detection. In the description text to follow, the hereinabove named principal invention procedures will be separately described. The accompanying procedures, which belong more in the domain of routine procedures, will be described in short because they are component parts of the invention, by means of which the accompanying procedures are accomplished, detailed description of which is contained in the design description (1.1., 1.2. and 1.3.).
2.1 The early detection and measuring of one's drowsiness is a key procedure of the invention by means of which, supported by the measuring-executive bridge (1) and the processing computer (14), precise measurements and the drowsiness process analysis are carried out. One's drowsiness process is best reflected through the awareness degree (SB) changes under different drowsiness phases, so that herefrom the drowsiness function defining can be drawn which reads: The drowsiness function is represented by the awareness degree (SB) changes of a man over the drowsiness interval (t) under the effect of the drowsiness factor (SB = f(t)). By means of this measurement procedure the drowsiness function (SB = f(t)) is determined in all important elements of the function (the function value in each measurement moment, function course, measurable points of the break, measurable intervals of the break (reactions blackout or sekundeschlafen or break of the reaction), virtual awareness interval ("stiff glance") and other). To more easily understand these complex problems and for the purpose of more clear procedure description for early detection and measurement of drowsiness, defined will be, first of all: drowsiness, drowsiness factors and neuroanatomical mechanisms of CNS which mainly take part in the realization of this complex transitional process. As for the drowsiness, it can be defined in several ways, depending on the viewing point. Thus, for example, viewed from the psychophysical state point of a man, it can be defined as follows: Drowsiness is a transitional psychophysical state of variable awareness which most frequently moves a human organism from the state of awareness into the state of sleeping. In the functional view of CNS and the human organism in general, definition II would read as follows: Drowsiness is a transitional process in which, under the drowsiness factors, there occurs a phenomenon of interferences both in the reception and recognition of excitements and in emission of the controlling pulses for the performance of effectors (muscles and glands) functions, which CNS recognizes and automatically introduces corresponding functional changes (into CNS and the organism on the whole) for the purpose of accommodating neuro-physiological functions to the newly created state. Drowsiness factors are divide into: natural drowsiness factors (fatigue, type of job, working environment and other) and artificial drowsiness factors (drugs, alcohol, medicaments, and other soporifics). As for the CNS internal mechanisms taking part in the procedure of changes of its operation mode due to drowsiness, those are mainly: a) reticular activation systems (RAS), b) relay cores of the brain tree (new gray matters), c) SAN (SLEEP)- neuroformation and d) HRONO-neuroformation (biological clock). Neuroformations under c) and d) are unknown in the medicine literature available to the authors during the investigation, so that discovery of SAN-neuroformations and setting forth a scientific hypothesis on HRONO-neuroformations represents a scientific contribution of the authors in favour of clearing up the secret of the nervous system mode of functioning under the conditions of drowsiness. a. Reticular activation systems (RAS) is more a functional system of CNS responsible for: waking up, maintaining awareness, activating and holding one's attention, perceiving associations and directed introspection, and consists of the centrocephalic part of the brain tree and circuitous parts of the reticular formation belonging to which are subthalamus, hypothalamus and middle part of thalamus [1,2]. Hypnotic means selectively block transmission of pulses in it, and the same can well be stimulated by exciting all the peripheral sense organs. b. Relay cores of the brain tree (new gray matters) are specialized CNS neuroformations of higher functional purpose, which fundamentally represent bistable switches intended to direct neurotransmitter paths (reflexive arc path selection), thus intended to determine the CNS operation mode. In addition to redirecting the neurotransmitter path (passive role), the relay cores play a role of active elements as well within which integration of various functions is performed when neurotransmitters from different brain centres flow into them [1,3]. In a specified drowsiness process phase, the relay cores switch off more neuronic networks from functioning, so that further functioning of CNS under the drowsiness conditions is carried out through the lower neuronic networks, which establishes a series of high quality new neurophysiologic functions on the CNS level and the level of the whole body. Relay cores, as an RAS instrument, react depending on the RAS findings and the result of its action on the internal selfregulation of the generated interferences (action of the immunological system - CNS). c. SAN-neuroformation belongs to lower neuronic networks (reticular formation [1,2]), which are phyllogenetically older, and being unknown so far, we think that it was structurally appended to the relay cores of the brain tree and to the gray cores of RAS. It is activated by RAS through which it also receives time commands on the blocking intervals of neurons responsible for functioning in the awake state. Through RAS (otherwise responsible for waking up), it also receives a controlling pulse for instantaneous deblocking of all neurons at the moment of waking up. Its task is, under the RAS changed operation mode conditions due to the drowsiness factors impact, to systematically perform sequential blocking of neurons responsible for functioning in the awake state with the tendency of total blocking of the same and introducing CNS and the organism on the whole into the sleeping state. The lowest blocking sequence (interval) of neurons (tp.r.min.) represents the biological time unit (tp.r.min = tbio) and it is multiplied from sequence to sequence, so that already in the early drowsiness phase its value is of the order of 10"3 sec. These neurons blocking intervals, explained in different ways by many authors, appear in the literature under different names such as: reactions blackout, "sekundeschlafen" (German) or prekid reakcije (Serbian). These conclusions have been drawn by the authors based on the analysis and numerical processing of the measurement results of the drowsiness function SB = f(t), particularly in the part of the arithmetic series of the function break intervals (at which the function has the value zero). Studying these problems, the literature [1, 2, 3, 4, 5 and 6] was used, while many scientific problems were solved by the personal correspondence of the authors with eminent experts in these fields [7, 8, 9, 10 and 11]. d. In the part of HRONO-neuroformation, the authors only set a hypothesis which for the moment being, in contrast to others on this topic, is founded on the discovery of the existence and the manner of action of SAN-neuroformation. Incorrectness of the hypothesis set is possible only in the part of its structure (anatomical structure), while other items of the hypothesis cannot be denied. It is essential to point out that, should the hypothesis on the existence and function of HRONO-neuroformation be rejected, the results of the procedure application for early drowsiness detection and measurement shall not change. Arithmetic sequence of the awareness break intervals with arbitrary and seemingly indefinite awareness break time gain Δtp can precisely be observed by the detailed measurement results analysis of the drowsiness function SB = f(t) in Fig. 2. This becomes understandable when the curve SB = f(t) is considered to represent the approximation curve which connects the function values at the measurement moments including corresponding awareness break intervals as well, since the eyelid blink is measured and analyzed as a reflex operation of indefinite period of repetition (t5) (Fig Id). Selecting 2÷3 ranges on the time axis SB = f(t) over which the eyelid blinks periodically repeat and comparing the values of the blocking interval/awareness interval, then upon integration and numerical processing of data on the series, strictly ordered arithmetic series of the awareness break intervals results contained in which are both measured (included) and nonmeasured (not included) but existing intervals of the awareness function breaks. Also, it may be noticed that pauses between two break intervals show slight rise and are proportional to the slowdown of almost all activities at the organism level and that the awareness break interval gain Δtp.r. increases for a constant value k tbi0 from interval to interval. Based on the results obtained, it can be concluded that such precisely ordered series of breaks of the drowsiness function SB = f(t) can result only as a consequence of the SAN-neurons genetic code or existence of and impact of HRONO-neuroformation. We think, therefore the hypothesis: dl. The ordered series of break intervals SB = f(t) is a consequence of the existence and effect of SAN-neuroformations in coaction with NEURO-neuroformations. d2. HRONO- neuroformation functions within the reticular activation system (RAS) by means of which it impresses (modulates) the basic biotact (tyo) into the neurons network, indispensable for creation and performance of a great number of activities. d3. Location: reticular formation and d4. Possible structure: two cores of the reticular formation with a completely identical neurons, where axons and dendrites of the coupled neurons are mutually connected so as to form suitable formation of neuron pairs with strictly symmetric circles. Neurotransmitters oscillation from neuron to neuron along the strictly defined path and at constant movement speed could surely meet requirements of the basic functional unit for biological time generation. The awareness function course of a man is variable and mainly depends upon: drowsiness type and intensity factors, ambient in which the process is carried out and upon the mental frame of a personality. Realizing the course of a typical drowsiness function, two recognizable ranges can be noticed: the range of establishing the drowsiness transitional mode and that of the drowsiness stable mode. At the drowsiness factors effect start on the nervous system there occurs a slight (partial) dysfunction of neurons in the sensitive and motoring centres of CNS, where all the sensitive and motoring centres of CNS are not equally affected by the dysfunction process. This causes interferences to occur both in transmission and recognition of external excitements and in execution of effectors (muscles and glands) functions, so that starting shadows ("spots") are created in the sensitive brain centres and different percentage of nominal power loss with certain muscles; which on the whole points to the first signs of the organism activities slowdown and decrease in lively awake state. It is obvious that establishment of the drowsiness transitional mode is in question, which the reticular activation system of CNS finds out and activates internal defensive mechanisms to maintain awareness. It is not a rare case in practice that RAS successfully annuls (neutralizes) the awareness factor directed effect and maintains awake state in spite of the already expressed instinct (need) to sleep. The awareness transitional mode establishment range duration varies and its outcome (annulled effect and return to the lively awake state or development into the stable drowsiness process) mainly depends upon the drowsiness factor intensity, mental frame of the personality and slightly upon training. A crucial moment in the drowsiness process development, which at the same time limits the hereinbefore named ranges of drowsiness, occurs at the moment when the above mentioned interferences grow to a critical value, which starts to seriously endanger the natural balance of neuro/physiological activities of the awake state. At that moment, faced with the impossibility to prevent the drowsiness factors effect by the internal mechanisms, RAS, almost simultaneously, activates relay cores of the brain tree (new gray matters) and SAN-neuroformation (described under b. and c. in this chapter), by means of which a high quality new mode of operation is automatically introduced in CNS (functioning by means of lower neuronic networks and sequential blocking of neurons responsible for functioning in the awake state with variable intensity). The new CNS operation mode automatically causes changes in the organism metabolism as well as more distinct slowdown in all the activities resulting in a gradual accommodation of the neurophysiological functions balance to enter the sleeping state. It is obvious that the drowsiness process, with these changes introduced, has entered the range of stable drowsiness mode, which seriously endangers one's awareness from which it is difficult for him, without additional excitements, to come back to the awareness state. It is clear, from the above stated that, for the needs of precise measurement of all elements of the drowsiness function SB = f(x) over the whole effect interval, this measurement procedure must analyze three different functional states of CNS such as: 1. the functional state in the awareness lively state ; 2. the functional state over the drowsiness transitional mode establishment range and 3. the functional state over the drowsiness stable mode range, which, first of all, means selection of adequate bioemitters capable of detecting the slightest functional change in CNS and transmitting it to the measuring equipment technical sensors.
For the needs of a unique measurement procedure, a complex method named COM. A. PIA DYNAMICS (Computer Analysis of DYNAMICS of the eyelid (Palpebrae), of the Iris H-segment map and the bioenergetic brain field (Aura) was developed. The choice of bioemitters of information on the brain functional state over the drowsiness process is a result of a long-range investigations of the authors and expert collaborators and is fully adequate to the complex problems considered - "the twilight zone" or "the consciousness blackout" state. Every effort has been made the functional systems or organism subsystems from the immediate vicinity of CNS, including CNS itself, to be selected as bioemitters, which, under the normal functioning conditions (in awake state), show high sensitivity in operation, so that they, over the drowsiness process, when otherwise there occurs slowdown in the corresponding activities, can more easily and precisely measure changes in their parameters. Also, viewed on the whole, every effort has been made the number of bioemitters and their structure to be such that their innervation and control subsystems include as much as possible greater number of brain centres and corresponding cores from different parts of the brain structure. Such criteria for the bioemitters choice have been adopted as the only possible solution to accomplish the basic invention task - early detection of drowsiness, that is, detection of drowsiness at the moment of its commencement. In that sense, selected as high quality bioemitters were: 1. iris H-segment map (Fig. la); 2. brain bioenergetic field of radiation (aura) (Fig. lb); 3. system of muscles to move eyelids (palpebrae) with the eyelid as an operating element (Fig. lc), resulting in an optimum solution to realize the above set goal. Through the suggested choice of bioemitters automatically determined were the magnitudes (phenomena) for drowsiness quantification and measurement such as: for iris H-segment - amount of Q-field area, for aura - the flux value ψ at the moment of measurement and for the muscles system to move the eyelid - eyelid blink dynamic parameters value according to Fig. Id. When buying the invention, normal values of these magnitudes (awake state values) are recorded and stored in the processing computer (14) within the "zero initialization" procedure and invention personalization. Position of CCD microcameras is, by means of the measuring-executive bridge (1), so determined that it, in addition to high quality recording of the eyelids blinks, provides a high quality shot of the iris H-segment in both cameras when the position of eyeballs is normal, and only in one (left or right) when the position of eyeballs is shifted to the left or to the right. The selected cylinder (8) position in which, in addition to (Si/Si' and S2/S2'), the infrared light source (9-9') is housed as well, represents the most favourable (the most safe) angle of the eyeball radiated by the infrared rays, so that infrared rays neither penetrate the eye nor reach the retina. As for the sensor (S2/S2') position, - special inductive probes, it accidentally coincides with the optimum sensor (Si/Si') position and was experimentally determined as the optimum distance both relative to the brain crust central motoring system position and the reticular activation system position. The selected position of the sensor (S2/S ') accomplishes satisfactory efficacy of flux recording in both operating modes of the brain (through higher neuronic networks and through lower neuronic networks). Measuring tact of all measuring values and parameters in the invention has been harmonized with the natural tact of the eyelid blink repetition, so that practically with repetition of each subsequent blink a new (fresh) data pack on the actual psychophysical state of the driver and dynamic state of the vehicle is entered into the processing computer. For detailed analysis and computation of the driver drowsiness function instantaneous values, only the upper eyelid blink will be used (Fig. Id), in view of the fact that its movement radius is considerably higher than that of the lower eyelid, which makes the image graphical processing procedure shorter without affecting the quality of measurement. The measurement procedure is carried out so that the shot of the eyelid blink and the iris H-segment, after recording by means of the sensor (St/Si') - CCD microcamera, is led via cable (13) of the measuring-executive bridge (1) to the processing computer (14), where image graphical processing and numerical data processing is performed. As a result of data processing, the values of the following data are computed: XM - a distance traversed by the eyelid, tιM - eyelid closing time, t2M - blink break time, t3M - reaction break time (sekundeschlafen) in the reflex operation, t4M - eyelid lift time, t5M - blink repetition time, SI = dxiu/dti - slope of the blink feling path, S2M= dx2/dt4M - slope of the blink rising path and PQ.M - amount of the measured area and Q-field in the iris H- in the iris H-segment. Also, based on the induction in the measuring probes S2/S2', the value of the measuring flux ΨM is computed in the computer. Comparing the values measured with those normal (awake state values), relations of different parameters are obtained, expressed by the constant Kx (x = 1, 2, 3,...), based upon which, using other derived parameters, precise computation of all elements of the drowsiness function over its complete existence is performed in the computer. Complete determining the drowsiness function SB = f(t) is performed by the computer based on the following computations: 1. instantaneous function values during measurement over the complete drowsiness interval; 2. function break interval series values (t3n - reaction break time); 3. occurrence and duration time of the virtual awareness ("stiff glance"). Instantaneous values of the awareness degree (SB) are calculated by the computer from relation SB:BN = From the above relation follows that SB = SΪM/SI X B , that is, SB = K] x BN (%), where BN = 100%. If the measured slope of the descending path (SIM) equals the slope (SIN) of the blink descending slope in awake state Ki = 1 and SB = BN = 100%. To determine the instantaneous value of the function (SB) in early drowsiness phases (over the drowsiness transitional mode establishment), as a value of constant Kx , the most favourable relation of the hereinbefore determined values (SIM/SΓN, S2M S2N, PQM PQN, ΨM/ΨN) automatically selected by the computer is used, all with the aim that the moment of finding out drowsiness should maximally approach the moment the drowsiness commences. Entering the range of stable drowsiness mode, the value of constant Kx is calculated only from relation Ki = SIM SIN- The reaction break time value (t3) is measured from the blink graphics (Fig. Id) so as that t2N = const, is subtracted from t(2+3)M- In the awake state of a man, as well as in the field of the drowsiness transitional mode establishment, the blink break time is constant t2 = cta and harmonized with the modulation transfer function (UMF) of retina, so that the eyelid blink, with its duration time, does not introduce interferences into transmission and conversion of the optical image to the image (event) reconstruction centre. As for finding out and computation of the virtual awareness time value (ty.B.), its monitoring process commences only at the beginning of PHASE 5 - late drowsiness phase. This anomaly occurs with few people (mainly with professional drivers), so that awareness is simulated (open eyelid) in the sleeping state at three or more seconds. It is determined so that the computer already in the second half of PHASE 4 - middle phase of drowsiness commences to maintain statistics on each blink repetition time (t5) and at the moment when I5M ≥ t5sR + 10% the computer records the "stiff glance" phenomenon (t5M - tγ.A.); (t5SR - mean vaute t5). It is important to point out that monitoring and measurement of instantaneous values SB = f(t) at the awake state are carried out sequentially in sequences of 3 -minutes pause and 18- sec recording, where, during the pause, the infrared radiation source (9/9') is automatically switched off. Thus, radiation of the eye socket external cavity by the infrared rays, when using the invention during the night drive, is drastically reduced (for 90%) without affecting the measurement quality. With the occurrence of the first drowsiness signals, the invention automatically shifts to the standard mode of operation (continuous recording and measurement). Repeating measurement in the rhythm (tact) of the eyelid blink repetition (around 15 blinks/min.) and calculating the function values in all the above described elements, a dense dotted graph of the function (SB) values at the corresponding moments of measurement (tx) is obtained as well as the function break intervals values over the drowsiness stable mode range. Connecting the measured points of the function both at the intervals of positive values and at the intervals where the function value is zero, a complex drowsiness curve SB = f(t) is obtained according to classified as a discrete function with descending course. The measured drowsiness curve reflects with high precision changes of the CNS functional system practically from the moment in which drowsiness commences up to the moment of entering sleeping state, which offers wide possibilities for precise classification of drowsiness based on a greater number of criteria. Analyzing the SB = f(t) curve course, two, above described, drowsiness ranges can clearly be noticed. The drowsiness process start (the drowsiness transitional mode establishment range) feature frequent function values change over a narrow range (tolerant awareness phase), which imparts slightly decreasing waveform to the curve. The curve waveform occurs as a consequence of uneven seizure of all brain centres by the drowsiness factor and, when computing the function value (SB = Kx x B (%)), the processing computer selects the most favourable value of constant Kx. The requirement to bring the moment of finding out drowsiness into the moment of its occurrence is an imperative of the invention, so it is why the measuring method has been devised so that by measurements it involves as greater number of sensitive and motoring brain centres as possible. In the second part of the course (the drowsiness stable mode range), the curve shows variable course, mainly descending, with the distinct occurrence of the function course break (tpr) at each reflex operation measurement sequence - the eyelid blink. These function breaks reflect by the measurements included blocking intervals of neurons responsible for operation in awake state, which occur due to the SAN-neuroformation effect, as it has earlier been explained. At the end of the function course, the curve shows sudden fall, and the moment of entering the seeping state greatly depends, in addition to the drowsiness factor, upon the personality mental frame as well, so that certain persons enter sleeping at tp.r. = t3 = 0.5 sec, while the other do that at tp.r. = t3 = 2 sec and more. In these late drowsiness phases there also occurs, but not so frequently, the virtual awareness as an acquired anomaly of professional drivers, which is discovered in a way earlier described. Classification of drowsiness in a greater number of phases is done by the processing computer (14) in real time with measurement, according to the prespecified and stored table of values. Criteria for determining actual phase of drowsiness are: drowsiness function value at the moment of measurement (SB), function break interval value at the moment of measurement (tp = t3) and virtual awareness interval value (ty.B.), the third criterion being applied only with the drowsiness late phase start. In order to use the invention in the road traffic, the drowsiness process is classified in six phases as follows: 1. for 100% > SB > 90%, we would have PHASE 1 - tolerant awareness phase; 2. for 90% > SB >75%, we would have PHASE 2 - temporary drowsiness phase; 3. for 75% > SB > 65% or t3min < t3 < 10"2, we would have PHASE 3 - early drowsiness phase; 4. for 65% > SB > 50% or 10"2sec < t3 < 10_1sec, we would have PHASE 4 - middle drowsiness phase; 5. for 50% > SB > 25% or 10_1sec < t3 < lsec, we would have PHASE 5 - late drowsiness phase (risk phase) and 6. for 25% > SB > 0 or t3 > lSek or ty.B. ≥ t5sr + 10%), we would have PHASE 6 - deep late drowsiness phase (high risk phase). 2.2. The procedure for adaptable driver-vehicle system control represents the principle invention procedure to maintain the system security under the driver drowsiness conditions the task of which is to accommodate the vehicle speed to the driver awareness degree fall found out and according to need to timely stop the vehicle. This procedure is carried out in parallel with procedure 2.3 intended to prevent the crisis (drowsiness) biological factor, and in real time with procedure 2.1 for early driver drowsiness detection. Shown in Table 1 are the values of permissible speeds for corresponding drowsiness phases accomplished by the invention by the adaptable control procedure.
Table 1
Figure imgf000016_0001
Considering the data shown in Table 1, one can notice that due to the adaptable system control procedure impact on the vehicle the vehicle speed is reduced and limited in cascades in the first four phases, so that at the end of PHASE 4, that is, at the beginning of PHASE 5, it is v = 20km/h. This speed limit (v = 20km/h) has been selected as an acceptable vehicle speed value at which the vehicle can be, by sudden breaking, stopped at the shortest possible distance (1 = lm). Forced vehicle stopping, if needed, is done in the middle part of the drowsiness process course (SB = 50%, 10"2sec < t3 < 10"1 sec) when the driver, from the driver operating capability point of view (RSV) under the drowsiness conditions, is still considered to be in a good operating condition (first of all to control the vehicle steering wheel). The forced vehicle stopping by the adaptable control procedure is performed as a final invention activity intended to preserve the system security only even if the third attempt to prevent the driver not to fall asleep, using procedure 2.3., does not prevent him to fall asleep. Attributed to it can be a "shadow procedure" epithet, because all the time during the driver drowsiness it precisely performs its principal task, making at the same time great favours to the parallel procedure 2.3. and giving it precedence in solving the crisis up to the moment of commencement of the critical moment (driver operating incapability threshold). The procedure itself is carried out so that at the moment of finding out the actual fall of the awareness degree according to the table, the processing computer (14) activates the sensor (S3/S3') - inductive emitter to measure the vehicle speed, at which moment it computes the vehicle speed. In the case of prohibited speed, the processing computer activates the existing systems on the vehicle intended for automatic breaking (18) and the speed limit system (19), still monitoring the vehicle speed through the sensor (S3/S3'). Activities of this procedure are carried out through maximum five steps, while all introduced limitations can be interrupted and deblocked after any step has been accomplished, if the drowsiness process has been stopped and the drowsiness function course SB = f(t) trend measured. At the same time, activating the automatic breaking system (18), the driver (21), the task of which is to switch on "stop" lights on the vehicle, is activated. 2.3. The procedure intended to prevent drowsiness (crisis biological factor) is another procedure of the invention to preserve the driver-vehicle system security under the driver's drowsiness conditions. Based on the medical investigations results in this field: "that there is no absolute guarantee to succeed in preventing one's drowsiness", this procedure has the auxiliary procedure status in the invention - the procedure of insufficient reliability. Respecting another finding of the medical investigations, which reads: "chances to succeed in preventing drowsiness are minimum if the preventing procedure is performed in the late drowsiness phase and vice versa, chances to succeed are maximum if the drowsiness preventing procedure is carried out in early phases", maximum efforts (see procedure 2.1.) have been made during the measuring procedure development to accomplish early drowsiness detection, so that chances for success could be raised to the maximum possible level. On the other hand, in view of the fact that the drowsiness process is a very complex neurologic (psychic) process with a greater number of levels of blockade of the CNS functional mechanisms, a series of excitements different both by nature and intensity have been prepared within the preventing procedure that they could, due to their composite effects and through a greater number of repetitions, find "Achilles heel" of CNS and perform deblockade of the commenced drowsiness process. Shown in Table 2 is the excitements matrix for drowsiness prevention, which is, in the form of a pack of excitements, selectively used depending on the actual drowsiness phase.
Figure imgf000017_0001
Light excitements are produced by LEDs (10/10'), which in PHASE 1 - tolerant .awareness phase, are blinking at frequency fl5 while in PHASE 2 their blinking frequency is tripled to f2. Also, similar situation is with the sound excitements of the first level. They are generated by small buzzers (11/11') located at the measuring-executive bridge (1), the sound frequency of which automatically changes at the transition from the drowsiness PHASE 1 to PHASE 2. The sound excitement of the third level, f3, is generated by the sound device of the standard alarm system (23) built-into the external part of the vehicle body and which can be blocked only by stopping the vehicle and stepping outside, which is quite enough to break down the actual drowsiness moment. Excitement by PAIN I and II levels is generated by the executive units (12/12') - microelectromagnetic needles with automatically changed sting depth of 300μ, at the first excitement level, and 600μ at the second excitement level. Changing the sting depth at the transition from the phase to phase of drowsiness, there is a situation that the pain felt at the pain centre is multiply increased with reference to the needle sting shift (difference). These executive units (11/11') are also located on the measuring-executive bridge (1) supports (3/3'), so that the sting is generated at the skin nearby the mastoid bone (behind the ear). Excitements caused by the BALANCE CHANGE and FEAR are mutually connected excitements generated due to the effect of procedure 2.2. for the adaptable system control. Namely, sudden slowdown of the vehicle when entering every new drowsiness phase results in unwilling movements of the driver body forward- backward (law of inertia), which, on the one hand, causes excitement due to the balance change and, on the other hand, arouses fear of the driver from possible consequences. These two excitements are not so intense at the initial drowsiness phases (PHASES 1 and 2), since awareness in these phases is still at the acceptable level. However, already at the third drowsiness phase and particularly at the fourth phase, the relation "clear consciousness" and "consciousness blackout" is such that these excitements occupy a significant place at the excitements scale for drowsiness prevention. Excitement of the sense of smell of the driver is exceptionally strong excitement under the influence of strong (unpleasant) gas (pyridine or hydrogen sulphide H2S) held in a small bottle with an automatic gas release valve. The bottle filled with gas (22) is housed in the front bonnet of the vehicle, so that, through an extension hose, the gas is led into the interior of the vehicle to the left of the steering wheel. The gas dosage must be strictly controlled, because the excitement is so strong that the driver cannot stand more than 2÷3 sec in the ambient containing the gas, which overcomes any instinct (need) for drowsiness and forces the driver to seek salvation in stopping the vehicle and stepping outside. The inconvenience of this excitement is in that it can panic the driver and assistant driver, which may affect the traffic security. It is because of that this type of excitement is treated in the product as "option at user's request". The executive units (10/10', 11/11' and 12/12') are housed on the measuring-executive bridge (1) (see Fig. 4), so that positioning the measuring-executive bridge (1) on the driver head, each of them occupies its optimum position with reference to the sense organ it excites. To block the driver filed of view as less as possible, LEDs (10/10') are housed in the cylinders (8/8') of the measuring-executive bridge (1) together with infrared diodes (9/9') and sensors (Si/Si'and S2/S2'). The drowsiness procedure is carried out as follows: all executive units (10/10', 11/11', 12/12', 22 and 23) are driven and controlled by the processing computer (14), which, according to the previously grouping of excitements (according to Table 2), activates a certain set (pack) of excitements in real time along with finding out (measuring) the actual drowsiness phases. If the used pack of excitements has achieved to prevent the drowsiness process, sensors (Si/Si' and S2/S2') find out the rise trend of the curve SB = f(t) (return to awake state) and the processing computer starts to successively deblock the speed limits as it has entered them. Thus, the rhythm is being gradually brought back both with the driver and with the vehicle up to the full synergy actions occurring in the awake state. On the other hand, if the used set of excitements fails to prevent the actual moment of drowsiness, sensors (Si/Si'and S2/S2') in coaction with the processing computer (14) find out that state and according to the prescribed activities timing schedule wait for the next term to activate a new set of excitements that should resolve the problem. The driver excitement process is limited in each drowsiness phase and its total excitement time amounts to tUk = 90 sec, within which a suitable internal timing to continuous excitement (30 sec) and to discontinuous excitement (60 sec) with the aim of maintaining tension is made from application to application. It is essential to point out that each step of the driver drowsiness prevention procedure is performed thanks to the step-by-step (cascade) reduction of the vehicle speed based on the effect of procedure 2.2. in the ambient of the vehicle speed accommodated to the actual psychophysical moment of the driver state, which is a significant contribution to the security. Further, under the vehicle reduced speed conditions a risk of danger is also reduced from the impact of the uncontrolled reflex movements of the driver legs and hands which occur during excitements. At high vehicle speeds, these reflex movements may additionally endanger the already endangered driver- vehicle system security. If the invention fails to prevent the driver drowsiness process in early drowsiness phases, including the first half of PHASE 4 as well, its is certain that a hard form drowsiness is in question (great fatigue or impact of drug and/or alcohol) which, by further repetition of the procedure, is ever harder to prevent. Repetition of the uncertain procedure in critical phases of drowsiness (PHASES 5 and 6) would only be a loss valuable time, under the conditions when the possibility (P) the accident to occur is hastily approaching the unit "one" (P = 1 ; unavoidable accident). Because of that the usage of this procedure is always limited in time and in this application of the invention the procedure must not be used upon expiration of 2/3 of the middle drowsiness phase (PHASE 4). 2.4. The accompanying procedures: In the part of the accompanying procedures presented under 2. of this description, short descriptions will be given only of those most important. The procedure to realize the function of informing other participants in the traffic on the actual driver drowsiness state is in that the processing computer (14), after having detected the first signs of drowsiness with the driver, activates displays 20/20' located in the upper left corners of the vehicle windscreens, which begin blinking in red colour. With the advanced drowsiness and entering PHASE 3 of drowsiness, additional green colour in displays is activated, so that from that moment and on red/green colours are alternately blinking, signalling other participants in the traffic that the driver of the marked vehicle is in a dangerous phase of drowsiness. The procedure to realize "the end of drive" function in cases of forced stopping the vehicle feature the situation in which the vehicle, having been stopped by procedure 2.2., remains under the blockade for 3-5 minutes. Upon expiration of this time, the processing computer (14) deblocks the vehicle for the next 10 minutes, during which time the vehicle has to be removed from the road and properly parked, after which it is again blocked for 2 hours, needed for the driver to take a nap. The procedure to select, memorize and store information on the traffic course for reconstruction of events and subsequent analysis is a fully automatic process within the processing computer (14) according to specific software solution. The selected data on the vehicle and driver states are memorized on a special memory card (15) supplied from a battery backup unit (16), which guarantees data to be saved even under the faulty or deliberately removed battery. The driver cannot access the memory card (15) and the data stored on it, but only an authorized person using secret code. The procedure to prevent the invention misuse by the driver during the drive will not be dealt with in details, because it is evident that an intelligent device is in question which carries out the self-test function during each pause between two blinks, so that it is practically impossible to make complex "mechanical phantoms" by means of which the stated bioemitters would be simulated. The "self-test" procedure is used, at the beginning of each use, to perform detailed test of technical correctness of all components of the invention, the test results being communicated through the corresponding signals of the executive units (10/10') and (11/11'). In the case of correct system state, LEDs (10/10') are activated, so that they are lit on 10 times in pauses of 0.5 sec. In the case when the system is technically out of order, sound sources (buzzers) (11/11 ') are activated emitting continuous sound the frequency of which is (f2). As we have said earlier, this procedure is permanently carried out, in a somewhat abridged form, in the procedure of use, so that it is impossible that any component fails during the drive without being detected. The ZERO INITIALIZATION procedure is a procedure by means of which information on the driver and vehicle as well as normal parameter value of the bioemitters (awake state value) is entered into the processing computer (14). Practically, this is the invention personalization procedure to one or more of persons (not more than three) carried out by the authorized seller trained for those jobs.
5 References:
1. Funkcionalna anatomija nervnog sistema, Z. Dordevic, Univerzitet - Nis, 1994. 2. Korelativna neuroanatomija i funkcionalna neurologija, J. de Groot & J. Chusid, San Francisco/New York City, Savremena adminsitracija, Beograd, 1990. 103. Anatomija coveka, M. Boskovic, Medicinska knjiga, Beograd, XX prestampano izdanje.
4. Fiziologija oka, K Cupak, Medicinska knjiga, Zagreb, 1991.
5. Medicinska fiziologija, A. Gayton, Medicinska knjiga, Beograd, 1989.
6. Klinicka neurooftalmologija, B. Stefanovic, Zavod za udzbenike i nastavna sredstva, Beograd, 1986.
157. Bolesti nervnog sistema, B. Radojicic, Medicinska knjiga, Beograd, 1989.
8. Anesteziologija, P. Lalevic, Medicinska knjiga, Zagreb, 1979.
9. Personal correspondence with Prof. Dr. Zvonimir Dordevic, Chief of the Department for Anatomy of the University of Podgorica.
10. Personal correspondence with Prof. Dr. Obrad Kostic, Chief of the Department for 0 Physiology of the University of Nis .
11. Personal correspondence with research assistant Dr. Ljiljana Otasevic, ophthalmologist, Department for Opthalmology of the University of Nis.
12. Personal correspondence with reserach assistant Ivana Mladenovic, neurologist, Department for Sports Medicine University of Nis.
25
30
35
0
45
50 LIST OF ABBREVIATIONS USED Aufstellung der benutzten Bezugszeichen
CNS central nervous system
ANS autonomous nervous system RAS reticular activation system
SAN sleep
HRONO time
SB awareness degree
PIA palpebra-Iris-Aura RSN driver operating capability
Si/S CCD microcamera
S2/S ' special inductive probe
S3/S3' inductive sensor
IC dioda infrared diode 1 measuring-executive bridge
2 bridge ridge
3 holders
4 ridge saddle
5 technological hole for frame (6) insertion 6 frame
7 transparent lens with or without diopter
8 cylinder sensors building-in
9 infrared diode
10 LED 11 microelectromagnetic needle
12 buzzer
13 wired beam
14 processing computer
15 memory card 16 battery backup card
17 reprogramming console
18 breaking system driver
19 speed limitation system
20 traffic participants information display 21 "stop" light driver
22 bottle with strong gas under pressure
23 howling siren

Claims

PATENT CLAIMS
1. The procedure to preserve the man-machine system security under the control of a man is intended for the needs of traffic, industry, air-traffic flight control service, buildings supervision and guarding services, army, police and medical investigations, as indicated, so that, based upon the data on the eyelid blink dynamic parameters changes, IRIS H- segment Q-field area and AURA flux change Δψ recorded by means of sensors (Si/Si' and S2/S2') the least functional changes of CNS from the earliest moments of drowsiness are computed and continuously monitored, on the basis of which automatically and in real time are timely activated two parallel procedures in the invention microcomputer (14) for the driver- vehicle system preservation such as: the procedure for adaptable system control (with the purpose of accommodating the vehicle speed in cascades to the awareness fall degree found out) and the procedure to prevent the crisis biological factor (drowsiness), so that, if the second procedure does not eliminate the crisis biological factor until the driver drowsiness critical moment occurrence, the invention safely (100%) succeeds in preserving the system security by timely implementing the final adaptable system control step, which slows the vehicle down from v = 20km/h to v = 0 km/h, the data on the event course being stored in the internal memory (15).
2. The procedure according to requirement 1, as indicated, that early drowsiness detection and monitoring the process course is accomplished by sensors (Sι/Sχ' and S2/S ') recording, in the repetition rhythm reflex operations - eyelid blink, values needed for drowsiness quantification: brain bioenergetic radiation field flux (ΨM), iris H-segment Q-field P(QM) and eyelid blink dynamic parameters (XM, tiM, t2M, t3M, t4M, t5M, SIM = dxi/dti and S2M = dx2/dt4), which synchronously reflect functional changes in CNS under the drowsiness factors impact, which the processing computer (14) acquires and performs graphic processing of data in real time, compares the measured values with the normal values of the same (awake state values) and, based upon the relations and/or differences obtained, by means of the corresponding mathematical relations, precisely computes all elements of the drowsiness function SB = f(t), both in the field of the drowsiness transitional mode establishment (PHASES 1 and 2) and in the field of the drowsiness stable mode.
3. The procedure according to requirements 1 and 2, as indicated, that the adaptable system control for the purpose of the vehicle speed accommodation in cascades to the drowsiness phase found out shall be accomplished under the monitoring and control function of the processing computer (14) in real time finding out possible drowsiness phases so as that at the moment the actual drowsiness phase is detected the processing computer (14) activate sensors (S3/S3') to measure the vehicle speed and, should the value of the speed measured exceed that permissible (preset in Table 1 and memorized), it activates the executive units (18, 19 and 20) intended for automatic breaking and limiting the speed by means of which it successively adapts (harmonizes) the vehicle and the drive states, creating an ambient and prerequisitions that in the prescribed crisis moment of the driver drowsiness, by means of the final step of its action, effectively and safely stop the vehicle at the shortest possible length of the road (1 = 1÷2 m).
4. The procedure according to requirements 1 and 2, as indicated, that the driver drowsiness prevention shall be accomplished under the monitoring and control function of the processing computer (14) in real time accomplishing the procedure for finding out and classification of the driver drowsiness, so as that at the moment the actual drowsiness phase is detected the processing computer (14) selectively activates the invention executive units (10/10', 11/11', 12/12', 22 and 23) creating sets (packs) of direct excitements of different intensities and types joining to which are also the excitements FEAR and BALANCE CHANGE due to the simultaneous action of the adaptable control procedure with the aim that exciting the driver they should interrupt the commenced drowsiness process, bring back the driver to the awake state and in the most favourable manner resolve the problem of the driver- vehicle system preservation, this procedure being, as needed, repeated until the moment of occurrence of PHASE 4 - middle drowsiness phase, by the value of which the end of the driver operating capability interval under the drowsiness conditions is predefined and upon which the use of this procedure can only be counterproductive.
5. The procedure according to requirements 1 and 2, as indicated, that informing the other participants in the traffic on the driver actual state is carried out under the monitoring and control function of the processing computer (14) in real time with procedures under requirements 2 and 4, so as that finding out the first drowsiness signs (PHASES 1 and 2) the processing computer activates only one (orange) colour on the light displays (20/20'), while the driver entering advanced phases of drowsiness (PHASES 3 and 4) activates one colour (green) more in the alternate switch on/off mode, giving thus the other participants (form both directions) in the traffic to understand that the marked vehicle driver is in the advanced drowsiness phase and that the accident is possible at any moment, which is at the same time a warning for a careful drive.
6. The device intended to realize the procedure according to requirement 1, consisting of the device (1) - the measuring-executive bridge with sensors (Si/Si', S2/S2') and the executive units (9/9', 10/10', 11/11', 12/12'), frame (6) with plastic lenses (7/7') with or without diopters (as an option), processing computer (14) as a monitoring-control unit with accompany accessories (15, 16 and 17) and the corresponding number of I/O interfaces and the measuring-executive units on the vehicle (S3/S3', 18, 19, 20/20', 22 and 23), the connection between the measuring-executive bridge (10) and the processing computer (14) being realized through a wire beam (13) (option: data remote transfer), as indicated, that, in the supporting construction of the measuring-executive bridge, consisting of: anatomically shaped ridge (2) in the form of the eyebrows with the saddle (4) in the form of the nose root, cylinder (8/8'), technological holes (5/5') for frame (6) insertion and side holders (3/3') by means of which the ridge (2) is maintained in the desirous (measuring) position, all sensors (S1/S1', S2/S2') are built-in and the executive units (9/9', 10/10', 11/11' and 12/12') oriented towards the driver so that the constructive whole represents a redundant measuring-executive bridge (1), which, in the functional and ergonomic point of view offers a maximum, by not decreasing the driver field of view and not creating psychological disturbances in the process of use, and at the same time functionally positions and accommodates the sensors to the bioemitters and the executive units to the senses of the driver creating ideal conditions for high quality implementation of the procedure according to requirements 2, 3 and 4.
7. The device according to requirements 1, 2, 4 and 6, as indicated, that the constructive subassemblies (8/8') of the form of cylinders include sensors
Figure imgf000025_0001
- CCD microcameras and (S /S2') - special inductive probes, as well as infrared light sources (9/9') and LEDs (10/10') and which, due to their positions within the measuring- executive bridge (1), position the same into the most favourable position for recording PIA-bioemitters (Palpebra-Iris-Aura) as well as for lighting eye sockets with infrared rays (9/9') under the night conditions at the angle which maximally protects the eye retina from damage and for intermittent lighting of the eye by LEDs (10/10') for the purpose of generating light excitement for the driver.
8. The device according to requirements 1, 2 and 4, as indicated, that the constructive assembly (8) in the special application of the invention is constructively built-in at the middle of the ridge (2) and the saddle (4), so that recording of PIA-bioemitters is being done from the inner angle of the between-the-eyelids hole (PALPEBRARUM).
9. The device according to requirements 1, 2 ,4 and 6, as indicated, that supports (3/3') of the measuring-executive bridge (1) into which the executive units: (11/11 ') - two- level tone microbuzzers (fi and f2) and (12/12') - two-level sting microelectromagnetic needles (330μ and 600μ deep) are built-in, should, in the measuring-executive bridge operating position, automatically bring the microbuzzers in front of the holes of the concha and the microelectromagnetic needles into the area of the mastoid bone (of the ear), where they mildly lean (press) the skin of the driver.
PCT/YU2000/000024 2000-12-21 2000-12-21 The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions WO2002050792A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2001229788A AU2001229788A1 (en) 2000-12-21 2000-12-21 The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions
PCT/YU2000/000024 WO2002050792A1 (en) 2000-12-21 2000-12-21 The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/YU2000/000024 WO2002050792A1 (en) 2000-12-21 2000-12-21 The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions

Publications (1)

Publication Number Publication Date
WO2002050792A1 true WO2002050792A1 (en) 2002-06-27

Family

ID=25559695

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/YU2000/000024 WO2002050792A1 (en) 2000-12-21 2000-12-21 The procedure and device intended for the man-machine system security preservation under a man's drowsiness conditions

Country Status (2)

Country Link
AU (1) AU2001229788A1 (en)
WO (1) WO2002050792A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1394756A1 (en) * 2002-08-29 2004-03-03 Uwe Peter Dipl.-Ing. Braun System to watch over and influence the wakefullness of a driver
WO2006123365A1 (en) * 2005-03-24 2006-11-23 Tengshe Vishwas V A drowsy driving alarm system
EP2237237A1 (en) * 2009-03-30 2010-10-06 Tobii Technology AB Eye closure detection using structured illumination
WO2012078996A2 (en) 2010-12-10 2012-06-14 Tk Holdings Inc. System for monitoring a vehicle driver
WO2014031042A1 (en) * 2012-08-20 2014-02-27 Autoliv Development Ab Eyelid movement processing for detection of drowsiness
US10752252B2 (en) 2013-03-15 2020-08-25 Honda Motor Co., Ltd. System and method for responding to driver state
CN117555217A (en) * 2024-01-09 2024-02-13 华侨大学 Design method and device of safety brake control system oriented to redundant structure

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3803916A1 (en) * 1988-02-09 1989-08-17 Messerschmitt Boelkow Blohm METHOD AND DEVICE FOR DETERMINING THE DRIVABILITY OF A DRIVER
GB2292242A (en) * 1994-08-05 1996-02-14 Rover Group Monitoring and warning of a reduction in vehicle driver alertness
WO1997015033A2 (en) * 1995-10-21 1997-04-24 Paetz Joachim Method and device for preventing drivers, etc. from falling asleep and for monitoring people's reactions
US5786765A (en) * 1996-04-12 1998-07-28 Mitsubishi Jidosha Kogyo Kabushiki Kaisha Apparatus for estimating the drowsiness level of a vehicle driver
US5795306A (en) * 1994-03-10 1998-08-18 Mitsubishi Denki Kabushiki Kaisha Bodily state detection apparatus
FR2784887A1 (en) * 1998-10-22 2000-04-28 Renault SYSTEM FOR MONITORING EYES TO DETECT AND PREVENT LOW VIGILANCE OF A VEHICLE DRIVER

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3803916A1 (en) * 1988-02-09 1989-08-17 Messerschmitt Boelkow Blohm METHOD AND DEVICE FOR DETERMINING THE DRIVABILITY OF A DRIVER
US5795306A (en) * 1994-03-10 1998-08-18 Mitsubishi Denki Kabushiki Kaisha Bodily state detection apparatus
GB2292242A (en) * 1994-08-05 1996-02-14 Rover Group Monitoring and warning of a reduction in vehicle driver alertness
WO1997015033A2 (en) * 1995-10-21 1997-04-24 Paetz Joachim Method and device for preventing drivers, etc. from falling asleep and for monitoring people's reactions
US5786765A (en) * 1996-04-12 1998-07-28 Mitsubishi Jidosha Kogyo Kabushiki Kaisha Apparatus for estimating the drowsiness level of a vehicle driver
FR2784887A1 (en) * 1998-10-22 2000-04-28 Renault SYSTEM FOR MONITORING EYES TO DETECT AND PREVENT LOW VIGILANCE OF A VEHICLE DRIVER

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1394756A1 (en) * 2002-08-29 2004-03-03 Uwe Peter Dipl.-Ing. Braun System to watch over and influence the wakefullness of a driver
WO2006123365A1 (en) * 2005-03-24 2006-11-23 Tengshe Vishwas V A drowsy driving alarm system
GB2438564A (en) * 2005-03-24 2007-11-28 Vishwas V Tengshe A drowsy driving alarm system
GB2438564B (en) * 2005-03-24 2008-09-17 Vishwas V Tengshe A drowsy driving alarm system
EP2237237A1 (en) * 2009-03-30 2010-10-06 Tobii Technology AB Eye closure detection using structured illumination
US8314707B2 (en) 2009-03-30 2012-11-20 Tobii Technology Ab Eye closure detection using structured illumination
US9955903B2 (en) 2009-03-30 2018-05-01 Tobii Ab Eye closure detection using structured illumination
US8902070B2 (en) 2009-03-30 2014-12-02 Tobii Technology Ab Eye closure detection using structured illumination
WO2012078996A2 (en) 2010-12-10 2012-06-14 Tk Holdings Inc. System for monitoring a vehicle driver
EP2648618A4 (en) * 2010-12-10 2014-05-21 Tk Holdings Inc SYSTEM FOR MONITORING A VEHICLE DRIVER
JP2015529512A (en) * 2012-08-20 2015-10-08 オートリブ ディベロップメント エービー Processing related to eyelid movement to detect drowsiness
US9220454B2 (en) 2012-08-20 2015-12-29 Autoliv Development Ab Device and method for detecting drowsiness using eyelid movement
WO2014031042A1 (en) * 2012-08-20 2014-02-27 Autoliv Development Ab Eyelid movement processing for detection of drowsiness
US10752252B2 (en) 2013-03-15 2020-08-25 Honda Motor Co., Ltd. System and method for responding to driver state
US10759438B2 (en) 2013-03-15 2020-09-01 Honda Motor Co., Ltd. System and method for responding to driver state
US10759437B2 (en) 2013-03-15 2020-09-01 Honda Motor Co., Ltd. System and method for responding to driver state
US10759436B2 (en) 2013-03-15 2020-09-01 Honda Motor Co., Ltd. System and method for responding to driver state
US10780891B2 (en) 2013-03-15 2020-09-22 Honda Motor Co., Ltd. System and method for responding to driver state
US11383721B2 (en) 2013-03-15 2022-07-12 Honda Motor Co., Ltd. System and method for responding to driver state
CN117555217A (en) * 2024-01-09 2024-02-13 华侨大学 Design method and device of safety brake control system oriented to redundant structure
CN117555217B (en) * 2024-01-09 2024-04-12 华侨大学 Design method and device for redundant structure-oriented safety brake control system

Also Published As

Publication number Publication date
AU2001229788A1 (en) 2002-07-01

Similar Documents

Publication Publication Date Title
Proctor et al. Sensation and perception
US10962789B1 (en) Digital eyewear system and method for the treatment and prevention of migraines and photophobia
US6163281A (en) System and method for communication using eye movement
US7202793B2 (en) Apparatus and method of monitoring a subject and providing feedback thereto
US10055964B2 (en) Methods and apparatus for monitoring alertness of an individual utilizing a wearable device and providing notification
US7367671B2 (en) Process and device for the training of human vision
US4723625A (en) Sobriety tester
US6836751B2 (en) Optical controller
WO2005098777A1 (en) Method and system for perceptual suitability test of a driver
WO2003061460A3 (en) Device and method for optical imaging of retinal function
WO1997023160A3 (en) Bio-feedback process and device for affecting the human psyche
Wolford et al. Practice effects in backward masking.
WO2002050792A1 (en) The procedure and device intended for the man-machine system security preservation under a man&#39;s drowsiness conditions
US20140088667A1 (en) Anti-sleep glasses
CN115578835B (en) Driver fatigue detection method and device based on steering wheel
GB2375645A (en) Drowsiness monitor having a means for detecting a metabolic function of a user
TWM561291U (en) Fatigue alarm apparatus
WO2002025615A1 (en) Alerting device
Bhaskar EyeAwake: A cost effective drowsy driver alert and vehicle correction system
KR20130058007A (en) System for the early detection of life-threatening conditions of persons
Proctor et al. Sensation and perception
McDonnell et al. Behavioural issues and supports
KR20190104725A (en) Apparatus and method for preventing drowsy driving using multi-sensory stimulation
Weliky Recording and manipulating the in vivo correlational structure of neuronal activity during visual cortical development
Krüger et al. Dependence of surround effects on receptive field center illumination in cat retinal ganglion cells

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP