[go: up one dir, main page]

WO1997021165A1 - Procede et dispositif de commutation et/ou de commande au moyen d'un ordinateur - Google Patents

Procede et dispositif de commutation et/ou de commande au moyen d'un ordinateur Download PDF

Info

Publication number
WO1997021165A1
WO1997021165A1 PCT/EP1996/005464 EP9605464W WO9721165A1 WO 1997021165 A1 WO1997021165 A1 WO 1997021165A1 EP 9605464 W EP9605464 W EP 9605464W WO 9721165 A1 WO9721165 A1 WO 9721165A1
Authority
WO
WIPO (PCT)
Prior art keywords
brain
signal
computer
signal curve
switching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP1996/005464
Other languages
German (de)
English (en)
Inventor
Johanna Lorenz
Gabriele Scheugenpflug-Leibig
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to AU11775/97A priority Critical patent/AU1177597A/en
Publication of WO1997021165A1 publication Critical patent/WO1997021165A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/377Electroencephalography [EEG] using evoked responses
    • A61B5/378Visual stimuli

Definitions

  • the invention relates to a method and a device for switching and / or controlling using a computer, wherein the brain waves of a person are detected, which are converted into digital switching and / or control commands.
  • the object of the invention is to improve a method and a device for switching and / or controlling using a computer with regard to accuracy and safety of the output signal.
  • the signal curve of the brain waves is compared with a defined pattern signal curve.
  • This defined pattern signal curve can be stored on a person-specific or individual basis in the evaluation computer and / or can preferably be formed by the input signal or source signal itself that is generated in a targeted manner and recorded by the human senses.
  • an input signal picked up via the ear such as e.g. B. a Morse signal in the brain wave signal sequence has essentially the same course (frequency, amplitude).
  • the source signal being able to be picked up by any human sense, preferably via the ear or the eye.
  • the capture of the Source signal through the eye has the advantage that light sources and thus certain light pulse sequences can be recorded over a long distance. This means that even complex systems can be controlled, for example hall cranes or vehicles.
  • FIG. 1 shows a schematic overall representation of the system
  • 2 shows a two-channel embodiment with a flow chart
  • FIG. 3 shows a single-channel embodiment with a flow chart.
  • the five functions ON, OFF, LIFT, LOWER and ROTATE are available on a control unit 3 in a crane (not shown in more detail).
  • a light pulse sequence a, b each with a different frequency and / or amplitude, is preferably emitted in the direct working area of the hall crane, for example by a respective light source as a signal generator 4 with a frequency of the emitted light pulse of, B. 20, 22, 24, 26 and 28 vibrations per minute.
  • a respective light source as a signal generator 4 with a frequency of the emitted light pulse of, B. 20, 22, 24, 26 and 28 vibrations per minute.
  • this control command is consciously taken over and subsequently generated with the essentially same pattern in the brain stream.
  • a corresponding sensor preferably a headband as head holder 1 with an EEG electrode 2 at the visual center, thus detects the signal curve c, d, so that in an evaluation computer 5 this brain wave signal sequence c, d with the defined pattern signal curve a, b of the source signal (e.g. lamp 4 with 24 vibrations) can be compared. If the evaluation computer 5 then detects an at least qualitatively matching signal sequence, the corresponding control command e, here LIFT, is sent to the control unit 3 by cable or radio and executed. This results in remote control for a large number of machines and systems which are controlled by the digital control device 3.
  • the source signals a, b can also be formed by certain sound sequences when recorded by the sense of hearing, for example by known morse signals. So that users of such digital control devices 3 no more input keyboards or control levers are required, so that the proposed switching and / or control device is particularly suitable for the disabled or for work in which the hands are not free or are otherwise required, such as . B. Surgeon or pilot activities.
  • acoustic or optical stimuli are suitable as source signals a, b, but source signals via the olfactory or sensing organs are also possible, since each of the human senses (seeing, hearing, smelling, feeling, touching) with a corresponding specific stimulus Brain generates a defined brain current as a measurable electrical quantity.
  • These electrical signals can be measured at various locations on the outside of the human head, which are known from medical technology. For example, certain points on the outside of the head are known for the visual center and optical stimuli, as are used in particular in the EEG measurement.
  • the measured brain current signals c, d can serve to trigger or control switching processes, as will be explained below for the human sense "seeing".
  • a light source 4 as a signal transmitter, controlled with appropriate software, as represented by the pulse train a ', b' between control unit 3 and evaluation computer 5, sends light pulses of a certain frequency, which is coded, for example, in a type of morse code with changing peaks, and a certain minimum light intensity, which depends on the respective environment.
  • Both eyes of an observer or an operator record the light pulses a, b from this light source 4. This is passed on via the optic nerves
  • Suitable electronics in an amplifier 7 can additionally amplify these signals c, d of each visual center to a higher level.
  • the signals of each visual center amplified in this way are then forwarded to the evaluation computer 5, which can also contain the program mentioned at the outset for controlling the light source 4 with the pulse sequence a ', b'.
  • This control program for the light source 4 and the amplifier 7 for evaluating the brain current signal sequence c, d can be components of the evaluation computer 5.
  • control signals a ', b' corresponding to the source signals a, b ' are sent by the control unit 3 to the evaluation computer 5 by cable or radio in order to form the basis of comparison there.
  • the evaluation computer 5 first carries out a comparison as to whether the signals c, d from the two halves of the brain of the human being (visual center) are the same in intensity (amplitude) and frequency within an adjustable tolerance quality. If this is the case, it follows that the human being deliberately looks with both eyes at the respective pulsating light source, for example at the light for the control command LIFT.
  • a certain time period of, for example, one second can be defined in the evaluation computer 5 as a further condition, so that in order to trigger the switching and / or control command, the respective light source 4 must be consciously considered for about one second so that the brain current Signal sequence c, d in correlation with the input signal sequences a, b or a ', b' is present over a time range of approximately one second.
  • the evaluation computer 5 triggers an action assigned to the corresponding light pulse. In the example above, this is the LIFT switching command.
  • the evaluation computer 5 can also use the stronger of the two signals for evaluation. 3 is therefore also suitable for the visually impaired who have poor visual performance in one eye. In order to increase the switching and / or control security, however, the checking period should be selected to be longer in order to exclude interfering influences, such as accidental viewing of the respective light source.
  • the source signals a, b (in the example described the light pulses) can be formed by arranging a plurality of lights 4 with a certain spatial separation. Each of these lights 4 sends a different coding or flashes, for example, in a different frequency or in a special color.
  • This source signal sequence can be transmitted from control unit 3 to the evaluation computer (arrow a ', b' upwards) or the control of the light source 4 can take place from the latter.
  • the driver puts on a headband, a cap or a modified pair of glasses as head holder 1 for the electrode (s) 2, the arms of which, for example, are longer and extend to the photostimulation points on the back of the head in order to receive the measurement signals c, d on the right and left vision center.
  • the evaluation computer 5 can be adjusted or calibrated to the brain wave intensity of the respective driver by input on the on-board computer of the vehicle. This is particularly necessary because, depending on the driver's condition, the intensity of the brain waves c, d can be different.
  • the on-board computer of the vehicle flashes a light source or a light-emitting diode 4 at short intervals in the driver's field of vision.
  • the evaluation computer 5 is adjusted with regard to its definition of the limit values to the respective driver and his brain waves.
  • the brain current signal sequence c, d induced thereby is recorded via the electrodes 2 at the visual centers.
  • the evaluation computer 5 in the on-board computer evaluates the signal obtained in this way from the at least one, preferably both vision centers. If the driver has closed his eyes due to tiredness or the beginning of sleep, the output signal c, d is missing or is correspondingly lower than when he is awake.
  • the on-board computer sends a further sequence of flashes of light to determine whether the driver has only briefly looked in the rear view mirror or has actually fallen asleep.
  • certain brain current signal sequences (wave patterns) of the individual driver can also be set during the calibration process.
  • the driver looks attentively through the windshield or the other extreme case that the driver has closed his eyes.
  • the driver detects the threshold value that occurs in each case in the on-board computer and stores it in a memory module 6. With these stored signals, the evaluation computer 5 is thus adjusted to the respective driver and his brain waves.
  • the threshold values of the two brain wave patterns c, d are extremely different, so that reliable statements about the respective condition of the driver can be obtained therefrom.
  • the visual center (or both visual centers) continuously records a large number of light pulses.
  • the evaluation computer 5 this multitude of different light pulses can measure over the electrodes 2 on the driver's head, it is assumed that the driver has opened his eyes and is awake.
  • Suitable alerting measures are only initiated when the evaluation computer 5 detects a reduction in the signals or even the received signals c, d correspond to the "eyes closed" state determined during calibration. It is also essential here that appropriate countermeasures can be initiated even when the brain current activities are reduced in the direction of the brain wave pattern for the “eyes closed” state.
  • the on-board computer can increase the number of pulses of the light pulses a, b emitted by the light source 4 by modifying the control signals a ', b'.
  • the comparison base is adjusted in the evaluation computer 5 in accordance with the change in the control signals a ', b' emitted to the light source 4.
  • a contactless switching and / or control arrangement can thus be created by this embodiment.
  • This can serve as a replacement for the so-called "dead man's switch" for train drivers, for example.
  • the brain current signal sequences c, d in the above sense, it can be checked whether the driver is still awake. It is advantageous here that the train driver does not have to operate any actuating elements periodically as before, so that he does not have to take his hands off the operating elements, such as brakes, etc.
  • the proposed switching and / or control device is particularly advantageous even when working in closed test chambers, with gloves that make the operation of switches extremely difficult.
  • the optical version of the switching device is also particularly suitable here.
  • the arrangement of the sensors can, as described above, be provided on glasses, but also on a headband, a hat or a helmet, which is usually prescribed in such work areas anyway. Thus there is no impairment of the individual's freedom of movement, being for disabled people z. B. arm amputees also implanting such an electrode, e.g. B. is conceivable behind the auricle.
  • contactless cursor or keyboard control is possible in that the respective key or cursor arrow points to a specific signal pattern (e.g. frequency, ie specific color, symbolism or oscillation curve) Monitor is assigned.
  • a specific signal pattern e.g. frequency, ie specific color, symbolism or oscillation curve
  • Monitor is assigned.
  • the operator considers z. B. a certain cursor arrow (e.g. upwards) on the monitor, which corresponds here to the light source 4, this results in a certain output signal pattern in brain current, which can then be assigned to this cursor key, because its light frequency (e.g. color red ) is known, in particular is at least qualitatively defined in the memory 6.
  • the evaluation computer 5 can thus detect the specific signal curve c, d of the brain waves, assign it to a specific (cursor) key by using the memory 6, and compare it over a specific period of z. B. perform half a second and trigger a corresponding switching command (here: e.g. cursor up) if they match.
  • This non-contact system is therefore particularly suitable for controlling the so-called window technology on a computer screen.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Dermatology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Psychology (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Psychiatry (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un procédé et un dispositif de commutation et/ou de commande au moyen d'un ordinateur, dans lesquels les ondes cérébrales d'une personne sont détectées et converties en instruction numérique de commutation et/ou de commande. Selon l'invention, dans le but de permettre la reproduction des signaux de sortie de manière plus précise et plus fiable dans un procédé et un dispositif de ce type, la configuration des signaux des ondes cérébrales (c, d) est comparée avec une configuration de signaux type prédéterminée (a, b). De préférence, des électrodes (2) fixées sur un support de tête (1), notamment un bandeau, sont utilisées à cet effet. La comparaison s'effectue dans un ordinateur d'évaluation (5) pourvu d'un amplificateur (7) en amont et d'un transducteur (4) couplé.
PCT/EP1996/005464 1995-12-06 1996-12-06 Procede et dispositif de commutation et/ou de commande au moyen d'un ordinateur Ceased WO1997021165A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU11775/97A AU1177597A (en) 1995-12-06 1996-12-06 Switching and/or control method and device which use a computer

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE19545392A DE19545392B4 (de) 1995-12-06 1995-12-06 Verfahren und Vorrichtung zum Schalten und/oder Steuern, insbesondere eines Rechners
DE19545392.1 1995-12-06

Publications (1)

Publication Number Publication Date
WO1997021165A1 true WO1997021165A1 (fr) 1997-06-12

Family

ID=7779265

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP1996/005464 Ceased WO1997021165A1 (fr) 1995-12-06 1996-12-06 Procede et dispositif de commutation et/ou de commande au moyen d'un ordinateur

Country Status (3)

Country Link
AU (1) AU1177597A (fr)
DE (1) DE19545392B4 (fr)
WO (1) WO1997021165A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001032078A1 (fr) * 1999-10-29 2001-05-10 Tsinghua University Procede et systeme de commande faisant appel a des reponses cerebrales electriques provoquees en mode statique, et procede et systeme de detection par les organes sensoriels
CN103845137A (zh) * 2014-03-19 2014-06-11 北京工业大学 基于稳态视觉诱发脑机接口的机器人控制方法

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10211946C1 (de) 2002-03-18 2003-07-31 Siemens Ag Steuer- oder Schaltelement für Fahrzeuge
US20100090835A1 (en) * 2008-10-15 2010-04-15 Charles Liu System and method for taking responsive action to human biosignals
US20100094097A1 (en) * 2008-10-15 2010-04-15 Charles Liu System and method for taking responsive action to human biosignals
DE102012102710A1 (de) * 2012-03-29 2013-10-02 Jürgen Gross Vorrichtung und Verfahren zur Messung elektrischer Potentiale eines Lebewesens
DE102012212030A1 (de) * 2012-07-10 2013-10-02 E.G.O. Elektro-Gerätebau GmbH Verfahren zur Bedienung eines Haushaltsgerätes und Haushaltsgerät

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4201224A (en) * 1978-12-29 1980-05-06 Roy John E Electroencephalographic method and system for the quantitative description of patient brain states
US4651145A (en) * 1984-05-31 1987-03-17 Medical Research Institute Communication system for the disabled in which a display target is selected by encephalogram response
GB2220089A (en) * 1988-06-17 1989-12-28 Brian Edwards Brain-wave-controlled computer interface
US5402797A (en) * 1993-03-11 1995-04-04 Pioneer Electronic Corporation Apparatus for leading brain wave frequency
WO1995018565A1 (fr) * 1991-09-26 1995-07-13 Sam Technology, Inc. Procede et systeme d'evaluation neurocognitive non invasifs

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2642302A1 (fr) * 1989-01-31 1990-08-03 Basset Regis Dispositif pour engendrer un signal electrique pulse de commande en reponse a un commandement d'un etre vivant

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4201224A (en) * 1978-12-29 1980-05-06 Roy John E Electroencephalographic method and system for the quantitative description of patient brain states
US4651145A (en) * 1984-05-31 1987-03-17 Medical Research Institute Communication system for the disabled in which a display target is selected by encephalogram response
GB2220089A (en) * 1988-06-17 1989-12-28 Brian Edwards Brain-wave-controlled computer interface
WO1995018565A1 (fr) * 1991-09-26 1995-07-13 Sam Technology, Inc. Procede et systeme d'evaluation neurocognitive non invasifs
US5402797A (en) * 1993-03-11 1995-04-04 Pioneer Electronic Corporation Apparatus for leading brain wave frequency

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001032078A1 (fr) * 1999-10-29 2001-05-10 Tsinghua University Procede et systeme de commande faisant appel a des reponses cerebrales electriques provoquees en mode statique, et procede et systeme de detection par les organes sensoriels
CN100366215C (zh) * 1999-10-29 2008-02-06 清华大学 基于脑电稳态诱发响应的控制方法及系统和感官测试方法及系统
CN103845137A (zh) * 2014-03-19 2014-06-11 北京工业大学 基于稳态视觉诱发脑机接口的机器人控制方法
CN103845137B (zh) * 2014-03-19 2016-03-02 北京工业大学 基于稳态视觉诱发脑机接口的机器人控制方法

Also Published As

Publication number Publication date
DE19545392B4 (de) 2006-04-13
AU1177597A (en) 1997-06-27
DE19545392A1 (de) 1997-06-12

Similar Documents

Publication Publication Date Title
DE19983911B4 (de) Wachsamkeitsüberwachungssystem
DE102016211021B4 (de) Verfahren und Vorrichtung zur Absicherung einer vollautomatischen Bewegung eines Fahrzeuges
DE69805955T2 (de) Schläfrigkeitsdetektion für kraftfahrzeugführer
EP3289836B1 (fr) Procédé et système d'amélioration d'une commande d'éclairage et procédé et système de commande d'un dispositif d'éclairage
DE602005003214T2 (de) Verfahren und system zur perzeptuellen eignungsprüfung eines fahrers
DE102014004395B3 (de) Verfahren zum Betrieb eines Fahrerassistenzsystems und Kraftfahrzeug
DE102016123159A1 (de) Vorrichtung und Verfahren zum Detektieren eines Fahrerzustands basierend auf biometrischen Signalen des Fahrers
DE102015001686B4 (de) Verfahren und Vorrichtung zur Erkennung einer Reaktionsfähigkeit eines Fahrers beim automatisierten Fahren
WO1997021165A1 (fr) Procede et dispositif de commutation et/ou de commande au moyen d'un ordinateur
DE102019215691A1 (de) Verfahren und Vorrichtung zur Zustandserkennung eines Fahrzeuginsassen
DE102019003557A1 (de) Verfahren zum Betrieb eines Fahrzeugs
EP1498069A1 (fr) Contrôle de performance et de tolérance à la contrainte pour les conducteurs d'automobiles
DE102018206237A1 (de) Verfahren und Vorrichtung zur Müdigkeitserkennung einer Person
DE10319281B4 (de) Vorrichtung und Verfahren zur Lebenderkennung eines Körperteils bei einem biometrischen Prüfverfahren
DE102017209793A1 (de) Verfahren zum Betreiben eines Kraftfahrzeugs, Fahrerassistenzsystem
DE102015224889A1 (de) Verfahren zur Müdigkeitsermittlung
AT523641A4 (de) System zum Testen eines Fahrerassistenzsystems eines Fahrzeugs
WO2010142409A1 (fr) Méthode et dispositif de surveillance de l'activité cérébrale d'une personne
DE4303933A1 (de) Verfahren und Vorrichtung zur Betätigung einer Weckeinrichtung
DE102015216623A1 (de) Situative Neuromodulation eines Insassen eines Kraftfahrzeugs
DE102016011016A1 (de) Verfahren zum Betrieb eines Assistenzsystems
DE102018219769A1 (de) Verfahren zum Betreiben eines Aktuators eines Kraftfahrzeugs, Trainingseinrichtung, Kraftfahrzeug, System mit einem Kraftfahrzeug und einem tragbaren Gerät
EP3349178A1 (fr) Procédé et dispositif de modification d'informations visuelles affectives dans le champ visuel d'un utilisateur
DE102004060279A1 (de) Operationsmikroskop
DE102024003086A1 (de) Sehstärkenabhängige Anpassung einer Anzeigeeinheit

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU BR CA CN CZ HU JP KR NO NZ SI SK US AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase