WO2001032078A1 - The control method and system and the sense organs test method and system based on electrical steady state induced response - Google Patents
The control method and system and the sense organs test method and system based on electrical steady state induced response Download PDFInfo
- Publication number
- WO2001032078A1 WO2001032078A1 PCT/CN2000/000410 CN0000410W WO0132078A1 WO 2001032078 A1 WO2001032078 A1 WO 2001032078A1 CN 0000410 W CN0000410 W CN 0000410W WO 0132078 A1 WO0132078 A1 WO 0132078A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- frequency
- stimulus signal
- sensory test
- eeg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/377—Electroencephalography [EEG] using evoked responses
- A61B5/383—Somatosensory stimuli, e.g. electric stimulation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/377—Electroencephalography [EEG] using evoked responses
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/377—Electroencephalography [EEG] using evoked responses
- A61B5/378—Visual stimuli
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/377—Electroencephalography [EEG] using evoked responses
- A61B5/38—Acoustic or auditory stimuli
Definitions
- the invention relates to a method and a device for controlling a computer and other equipment based on a brain electrical signal, and in particular, to a method and a device for controlling a computer and other equipment based on an EEG steady state evoked response, and a method based on EEG stabilization.
- the brain-computer interface is a direct communication and control channel established between the human brain and a computer or other electronic device. Through this channel, people can express ideas or manipulate devices directly through the human brain, without the need for language or body movements.
- the main difference between a brain-computer interface and ordinary human-machine interfaces is that the former does not require any kind of muscle response, but only needs to detect signals that reflect the responsiveness or purposeful activity of the brain
- the control device based on the brain-machine interface can achieve the control purpose without any language or body movement.
- the main difference between objective sensory test systems based on the brain-machine interface and those subjective sensory test systems is that the former does not require the expression of subjective consciousness or behavior such as language or body movements. It only needs to detect the response or purpose of the human brain The signals of sexual activity are therefore objective and fair.
- the EEG signal used for classification is the action preparation stage after the target appears and before the cursor appears.
- Figure 1 shows a schematic diagram of a prior art system that performs some control based on evoked EEG signals. This method is to give the subject a certain stimulus, record the EEG signals induced under different stimuli, identify them, and then use the identified signals to achieve some control.
- P300 is a type of event related potential (ERP), and a peak of 300 mg of EEG will be called P300 after a related event occurs.
- ERP event related potential
- Farwel l and Doncin designed a virtual printer using ERP.
- a 6 X 6 character matrix blinks randomly in rows or columns, then "the row or column containing the character that the user wants to enter blinks" becomes a related event. Find the row and column that cause the largest amplitude of P300, then the characters to be printed at the intersection of the row and the column.
- Sutter's BCI system uses the visual evoked potential (VEP) method.
- the 8 ⁇ 8 symbol matrix on the display is red / green alternated according to a pseudo-random binary sequence.
- the user looks at the symbol to be selected and compares the measured EEG signal with a previously recorded template. The goal. Learning a stable template beforehand is a key step (see "The Brain Response interface: Communicat ion through Visual ly-induced Electrical Brain Response ", J Microcomput Appl, 1992, 15: 31-45).
- the above system uses the transient evoked response of the EEG. Since the test is based on P300, the time interval between two stimuli is required to be greater than 1 second to ensure that the subject responds to the previous stimulus before the new stimulus arrives. The response has ended or disappeared. Therefore, the above system cannot be used for real-time control, and the reliability of its test cannot meet the practical requirements
- Another major shortcoming of the current brain-machine interface method as a detection technology is that sensory stimulation methods with or without spatial information can not be given at the same time, so the detection results do not have the spatial resolution information of the sensory system, and the application range is greatly limited.
- An object of the present invention is to provide a reliable control method and system based on the EEG steady state evoked response, which can not only achieve a high judgment accuracy rate, but also ensure real-time performance in use.
- Another object of the present invention is to provide a sensory test method and system based on EEG steady state induced response, which can objectively evaluate the state of the senses.
- the basis of the present invention is the steady state induced response to EEG.
- the so-called steady-state EEG response means that when the stimulation frequency is greater than a certain value, the subject's EEG response will be aliased back and forth, resulting in a periodic change in the EEG evoked potential.
- the frequency of the periodic change is consistent with the stimulus frequency.
- visual evoked response as an example, if the stimulation frequency is more than 6 times per second, the subject's visual evoked potential will have a periodic change in the corresponding frequency.
- EEG steady state evoked response to test the brain activity of the subject, the accuracy rate and test speed have reached a level that can be used for real-time control.
- a control method based on an EEG steady state response including: a. Generate one or more stimulus signals that change at different frequencies and can be sensed by the human senses;
- the control signal based on the stimulation fe a particular controlled device performs a signal corresponding to a predetermined operation, ie.
- a sensory test method based on EEG steady state response including:
- a control system based on an EEG-induced steady state response including:
- a stimulator for generating one or more stimulus signals that change at different frequencies and can be sensed by human senses
- EEG signal detector which is used to detect the EEG signal of the stimulated human body
- a signal processor configured to analyze the detected EEG signal, and extract a characteristic physical quantity corresponding to a certain stimulation signal frequency as a control signal
- the control device controls a specific controlled device corresponding to the stimulation signal to perform a predetermined operation based on the control signal.
- a sensory test system based on an EEG-induced steady state response including: a. a stimulator for generating one or more stimulus signals that change at different frequencies and can be sensed by human senses;
- an electroencephalogram signal detector for detecting an electroencephalogram signal of a human body stimulated by the stimulus signal
- a signal processor configured to analyze the detected EEG signal, and extract a characteristic physical quantity relative to the frequency of the stimulation signal from the signal processor;
- An evaluation device is configured to evaluate the response ability of the measured sensor to the stimulus signal based on the obtained physical quantity corresponding to the frequency of the stimulus signal and the spatial distribution characteristics of the stimulus signal, so as to obtain an objective evaluation of the sense organ.
- the stimulation signal is a visual stimulation signal
- the human sense organ is a visual organ
- the stimulation signal is an auditory stimulus signal
- the human senses are auditory organs.
- the stimulation signal is a tactile stimulation signal
- the human senses are tactile organs.
- the analysis includes performing spectrum analysis on the EEG signal, and the characteristic physical quantity is a spectral component in the EEG signal spectrum corresponding to the frequency of each stimulus signal.
- the stimulus signal is of a single frequency.
- the one stimulus signal is a combination of multiple frequency signals.
- FIG. 1 is a schematic diagram of a prior art test system based on evoked EEG signals.
- Fig. 2 is a schematic diagram showing the actual configuration of a control system based on the steady-state EEG response of the present invention.
- Fig. 3 is a circuit block diagram of a control system based on a steady-state EEG response of the present invention.
- FIG. 4 is a schematic diagram showing the actual configuration of a sensory test system based on a steady-state EEG response of the present invention.
- FIG. 5 is a circuit block diagram of a sensory test system based on a steady-state EEG response of the present invention. Preferred embodiment of the invention
- Figures 2 and 3 show a control system based on the steady-state EEG response of the present invention.
- the system is mainly composed of the following four parts:
- the role of the stimulator is to generate stimulation signals to the human sense organs.
- the stimulation signal may be a visual stimulation signal, an auditory stimulation signal, or a tactile stimulation signal.
- the stimulator is composed of some stimulation points, and the stimulation points are light sources that flicker at a certain frequency.
- Stimulate The point can be a flash, other light source with a certain brightness, or a flickering light spot on the computer screen.
- the flicker mentioned here means that the brightness, shape, color, size, spatial position, duration, or combination of these physical quantities of the optical signal changes at a certain frequency.
- the frequency of change of the visual stimulus signal is generally in the range of 1 to 50 Hz, and preferably in the range of 4 to 25 Hz.
- a stimulus point can flash at a single frequency, or it can contain multiple signals that flash at different frequencies.
- the advantage of a stimulus point containing multiple signals of different frequencies is that the characteristics of the stimulus point in the subject's EEG are reflected as the combined frequency spectrum of the multiple frequencies, which allows more stimulus points to be set within a certain frequency range .
- the stimulator may include a stimulus controller for controlling the characteristics of the stimulus point.
- the characteristics of the stimulation points are: 1. According to different requirements of the visual system measurement, the pre-stimulation before light stimulation is given. 2. Set the background of the light stimulus. 3. Set the parameters of the light stimulation points (such as spatial position, intensity, area size, and duration) for different flicker frequencies.
- EEG extraction, amplification and transmission The function of EEG extraction, amplification and transmission is to amplify the weak EEG signal to a sufficiently large amplitude, and convert it from analog to digital, and finally input it to a computer or other signal processing device. It includes the following sections.
- Electrode An electrode is a metal sheet that is closely attached to the scalp. It can detect potential changes on the scalp surface (this change reflects electrical activity in the brain). The potential change on the electrodes is the input signal to the EEG amplifier. Its signal amplitude is l ⁇ 10uV.
- EEG signal amplifier The function of the EEG amplifier is to amplify the weak EEG signal to a sufficiently large magnitude so that it can be converted from analog to digital. EEG amplifiers generally require an electrophysiological signal amplifier with a gain of 3000 to 10,000 times and a frequency passband of 1 to 30 Hz.
- the signal transmission device refers to transmitting the digitalized EEG signal to a computer or other signal processing device.
- the transmission process can be wired or So wireless transmission.
- the transmission delay of the signal should be less than 10 ms.
- Electrophysiological experiments have proven that when the sensory organs of the human body are stimulated to a certain extent, as long as the subject's sensory system is healthy, the subject's occipital scalp can be recorded with distinctively induced EEG signals.
- the characteristics of the recorded signal appear in the time, space, and frequency domains.
- the function of the EEG signal processor is to analyze the characteristics of the EEG signal and identify these characteristics for control and other purposes.
- EEG signal preprocessing Because the recorded EEG signal is very weak, interference is usually introduced during the extraction process. Therefore, pre-processing such as noise reduction must be performed before analysis.
- the noise to be removed is mainly the common frequency interference, baseline drift and so on.
- the method used is digital filtering.
- EEG signal spectrum analyzer Take steady-state visual induction as an example, the stimulus point flashes a light source at a certain frequency, and the induced EEG includes the stimulus frequency and its harmonic components. In order to obtain these frequency components, the signal must be processed Spectrum analysis, this is the function of the frequency analyzer.
- the stimulus points can be designed to flicker at different frequencies or frequency combinations.
- the induced electroencephalogram should include the flicker frequency of the stimulus point and its harmonic components.
- the frequency of the flicker of the stimulus point is a combination of multiple frequencies, and the induced EEG should also include non-linear components (such as sum and difference frequencies) of the frequency combination of the flicker of the stimulus point. From the frequency The different frequency components are distinguished in the analyzer, and the stimulus point or multiple stimulus points that the subject is watching can be realized.
- the frequency characteristic analysis needs to solve the two problems of spectral peak resolution accuracy and spectral peak discrimination threshold.
- Our solution is (1) In order to improve the resolution of spectral peaks, the length of the FFT data should be a certain length, usually 1 second. (2) In the FFT result, if a peak occurs at a certain stimulus frequency, and the ratio of the peak amplitude to the maximum value of the FFT result at 4 to 35 Hz exceeds 0.8, the subject is considered to be watching If there is more than two stimulation frequencies that meet the conditions, the frequency with the highest ratio is used.
- EEG signals with certain characteristics can be used to achieve certain control purposes after being identified.
- a typical application of the brain-machine interface is for the disabled to control the surrounding environment, for example, turning on / off the lights, turning on / off the TV, turning on / off the fans, and so on. From the output of the EEG signal processor, we can know which blinking light the subject is watching, and then we know what control we want to accomplish. As long as this information is transmitted to the environmental controller and the corresponding circuit is connected, the control of the surrounding electrical appliances can be realized.
- FIG. 2 An example of the control system based on the EEG steady-state response of the present invention is shown in FIG. 2.
- the stimulator is a screen with four light spots on it, corresponding to the four pieces of electrical equipment to be controlled.
- the four light spots flicker at different frequencies.
- the EEG signal processor can detect the frequency peak corresponding to the light spot in the EEG signal and output a corresponding signal to the controller.
- the controller controls the corresponding appliances to perform predetermined operations, such as on / off operation, based on the signal.
- FIG. 3 is a circuit block diagram of the system shown in FIG. 2.
- 1 is a frequency-mode flicker stimulator, and flicker frequencies of different stimulation points are different.
- 2 is the visual system of the test subject.
- 3 is an EEG extraction, amplification and transmission device, which is used to obtain the subject's EEG signals and The signal is amplified and subjected to analog-to-digital conversion, and then the obtained signal is sent to the signal pre-processing device 4.
- the signal pre-processing device 4 performs pre-processing such as noise reduction on the signal.
- the electroencephalogram signal analyzer 5 analyzes the signals mainly by spectrum analysis, and finds out the frequency components in the subject's brain electricity corresponding to the frequency of a certain stimulation point in the scintillation stimulator, thereby determining the flicker that the subject is concerned about. Point, and output the corresponding signal to the controller 6.
- the controller 6 instructs the corresponding equipment to perform corresponding operations according to the preset program according to the signal.
- the working principle of the EEG signal analyzer 6 has been described in the foregoing, and is not repeated here.
- FIGs 4 and 5 show a sensory test system based on steady state EEG evoked responses according to the present invention. This system is basically the same as the control system shown in Figs. 2 and 3, except that the control device 6 is replaced with an evaluation device 7 and a stimulation controller 8 is added.
- the detection steps are:
- step (e) If you need to design new conditions (such as background and light stimulation point parameters), return to step (b), otherwise step (f).
- the EEG extraction and amplification used in the experiment is a ready-made EEG machine.
- the amplified EEG signal is sent to an EEG signal processor composed of a computer.
- the computer completes the EEG signal preprocessing and spectrum analysis to obtain the corresponding frequency components.
- the subject's vision level is then determined by a predetermined computer program.
- the experiment was a success.
- the above objective visual acuity test accurately gives the visual acuity of different vision subjects.
- the stimulator of the present invention may be a sound stimulator, a tactile stimulator, and the like, and the subject's brain electrical steady state response also includes a frequency component corresponding to the frequency of the stimulation signal. Based on this feature, the EEG control and objective evaluation of the corresponding senses can be achieved by analyzing the EEG response of sound stimulation, tactile stimulation, and so on.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Psychiatry (AREA)
- Heart & Thoracic Surgery (AREA)
- Psychology (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Acoustics & Sound (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
Description
基于脑电稳态诱发响应的控制方 Controller based on EEG steady state evoked response
法及系统和感官测试方法及系统 本发明的领域 Method and system and sensory test method and system Field of the invention
本发明涉及一种基工脑电信号对计算机等设备进行控制的方法及 装置, 特别涉及一种基于脑电稳态诱发响应对计算机等设备进行控制 的方法及装置, 以及一种基于脑电稳态诱发响应对感官进行客观测试 的方法及装置。 背景技术 The invention relates to a method and a device for controlling a computer and other equipment based on a brain electrical signal, and in particular, to a method and a device for controlling a computer and other equipment based on an EEG steady state evoked response, and a method based on EEG stabilization. Method and device for objectively testing sensory responses of state-induced responses. Background technique
脑一机接口是在人脑与计算机或其它电子设备之间建立的直接的 交流和控制通道。 通过这种通道, 人就可以直接通过人脑来表达想法 或操纵设备, 而不需要通过语言或肢体的动作。 The brain-computer interface is a direct communication and control channel established between the human brain and a computer or other electronic device. Through this channel, people can express ideas or manipulate devices directly through the human brain, without the need for language or body movements.
脑一机接口和那些普通的人机接口的主要差别在于, 前者不需要 任何种类的肌肉响应, 只需要检测反映脑的响应性或目的性活动的信 号 The main difference between a brain-computer interface and ordinary human-machine interfaces is that the former does not require any kind of muscle response, but only needs to detect signals that reflect the responsiveness or purposeful activity of the brain
基于脑一机接口的控制装置可以不需要任何语言或肢体的动作达 到控制目的。 The control device based on the brain-machine interface can achieve the control purpose without any language or body movement.
基于脑一机接口的客观感官测试系统和那些主观的感官测试系统 的主要差别在于, 前者不需要通过语言或肢体的动作等主观意识或行 为的表达, 只需要检测反映人脑的响应性或目的性活动的信号, 因而 具有客观性和公正性。 The main difference between objective sensory test systems based on the brain-machine interface and those subjective sensory test systems is that the former does not require the expression of subjective consciousness or behavior such as language or body movements. It only needs to detect the response or purpose of the human brain The signals of sexual activity are therefore objective and fair.
已有的实现脑电控制的比较直接的方法有: The more direct methods to achieve EEG control are:
( 1 ) 基于事件相关脑电信号的方法 (1) Method based on event-related EEG signals
例如, 在人的自主运动发生之前, 脑电中存在与该运动关联的称 为事件相关去同步的成分, 它本质上是一种诱发脑电信号。 人们可在 For example, before a person's autonomous movement occurs, there is an event-related desynchronization component associated with the movement in the EEG, which is essentially an induced EEG signal. People can
1 1
确 认本 记录的脑电信号中识别事件相关信号, 并利用它去实现某种控制。Confirm this Event-related signals are identified in the recorded EEG signals and used to achieve some control.
Pfurtschel ler等人进行了一系列基于此生理现象的 BCI研究, 受试者面对显示器上的右侧或左侧显示的一个目标, 受试者根据目标 的位置准备用左手食指或右手食指去按一个开关, 大约一秒钟后, 显 示器中央出现一个十字形光标, 受试者按动开关。 用于分类的脑电信 号是目标出现后和光标出现前的动作准备阶段, 通过学习得到模板从 而预测是右手还是左手的运动(参见 " Brain- computer Int erface - A New Communication Device for Handicapped Persons " , J Microcomput Appl, 1993, 16 : 293-299 ; "Prediction of the Side of Hand Movements from Single Trial Multichannel EEG Data Using Neural Networks", Electroenceph Cl in Neurophs iol, 1992, 82 : 313-315)。 Pfurtschel ler and others conducted a series of BCI studies based on this physiological phenomenon. The subjects faced a target displayed on the right or left side of the display. The subject prepared to press with the left or right index finger according to the position of the target A switch, after about a second, a cross-shaped cursor appears in the center of the display, and the subject pressed the switch. The EEG signal used for classification is the action preparation stage after the target appears and before the cursor appears. Learning is used to obtain a template to predict whether it is right-hand or left-hand movement (see "Brain- computer Int erface-A New Communication Device for Handicapped Persons" J Microcomput Appl, 1993, 16: 293-299; "Prediction of the Side of Hand Movements from Single Trial Multichannel EEG Data Using Neural Networks", Electroenceph Cl in Neurophs iol, 1992, 82: 313-315).
( 2 ) 基于诱发脑电信号的方法 (2) Method based on inducing EEG signals
图 1示出了已有技术的基于诱发脑电信号进行某种控制的系统的 示意图。 这种方法是给受试者以某种刺激, 记录不同刺激下诱发的脑 电信号, 加以识别, 然后用识别出的信号实现某种控制。 Figure 1 shows a schematic diagram of a prior art system that performs some control based on evoked EEG signals. This method is to give the subject a certain stimulus, record the EEG signals induced under different stimuli, identify them, and then use the identified signals to achieve some control.
P300 是事件相关电位(event related potential, ERP)的一种, 在相关事件发生后的 300ms脑电会出现一个峰值称为 P300。 Farwel l 和 Doncin利用 ERP设计了一种虚拟打印机。 一个 6 X 6的字符矩阵按 行或按列随机闪烁,则 "包含使用者想要输入字符的行或列发生闪烁" 就成为相关事件。 求出引起 P300 幅度最大的行和列, 则是该行和该 列交点上的字符要打印的字符。 P300 is a type of event related potential (ERP), and a peak of 300 mg of EEG will be called P300 after a related event occurs. Farwel l and Doncin designed a virtual printer using ERP. A 6 X 6 character matrix blinks randomly in rows or columns, then "the row or column containing the character that the user wants to enter blinks" becomes a related event. Find the row and column that cause the largest amplitude of P300, then the characters to be printed at the intersection of the row and the column.
Sutter的 BCI系统是利用视觉诱发电位(VEP)方法。 显示器上 8 X 8 的符号矩阵按一种伪随机二进制序列进行红 /绿交替, 使用者注 视想要选择的符号, 将测得的脑电信号与事先记录的模板比较, 就可 以确定使用者注视的目标。 事先学习得到稳定的模板是一个关键步骤 (参见 " The Brain Response interface: Communicat ion through Visual ly-induced Electrical Brain Response ", J Microcomput Appl, 1992, 15 : 31-45 ) . Sutter's BCI system uses the visual evoked potential (VEP) method. The 8 × 8 symbol matrix on the display is red / green alternated according to a pseudo-random binary sequence. The user looks at the symbol to be selected and compares the measured EEG signal with a previously recorded template. The goal. Learning a stable template beforehand is a key step (see "The Brain Response interface: Communicat ion through Visual ly-induced Electrical Brain Response ", J Microcomput Appl, 1992, 15: 31-45).
上述的系统利用的是脑电的瞬态诱发响应, 由于其测试的依据是 P300 , 所以要求两次刺激的时间间隔大于 1秒, 以保证在新的刺激到 来前, 受试者对上一次刺激的响应已经结束或消失。 因此上述系统无 法用于实时控制, 并且其测试的可靠性也不能达到实用的要求 The above system uses the transient evoked response of the EEG. Since the test is based on P300, the time interval between two stimuli is required to be greater than 1 second to ensure that the subject responds to the previous stimulus before the new stimulus arrives. The response has ended or disappeared. Therefore, the above system cannot be used for real-time control, and the reliability of its test cannot meet the practical requirements
目前作为检测技术的脑一机接口方法的另一主要缺点是没有或不 能同时给予具有空间信息的感官刺激方式, 因而检测结果没有感官系 统的空间分辨率信息, 应用范围受到很大限制。 本发明的目的 Another major shortcoming of the current brain-machine interface method as a detection technology is that sensory stimulation methods with or without spatial information can not be given at the same time, so the detection results do not have the spatial resolution information of the sensory system, and the application range is greatly limited. Object of the invention
本发明的一个目的是提供一种可靠的基于脑电稳态诱发响应的控 制方法及系统, 它不仅能达到很高的判断正确率, 而且能保证在使用 中的实时性。 An object of the present invention is to provide a reliable control method and system based on the EEG steady state evoked response, which can not only achieve a high judgment accuracy rate, but also ensure real-time performance in use.
本发明的另一个目的是提供一种基于脑电稳态诱发响应的感官测 试方法及系统, 其能够客观地对感官的状态作出评价。 本发明的概述 Another object of the present invention is to provide a sensory test method and system based on EEG steady state induced response, which can objectively evaluate the state of the senses. Summary of the invention
本发明的基础是脑电稳态诱发响应。 所谓的脑电稳态诱发响应是 指当刺激频率大于某一值时, 受试者的脑电响应就会前后混迭, 结果 导致其脑电诱发电位呈现出周期性变化的特征。 周期变化的频率与刺 激频率一致。 以视觉诱发响应为例, 如果刺激频率大于每秒 6次, 则 受试者的视觉诱发电位中即出现相应频率的周期性变化。 利用脑电稳 态诱发响应来测试受试者的脑活动, 正确率及测试速度达到了可用于 实时控制的水平。 The basis of the present invention is the steady state induced response to EEG. The so-called steady-state EEG response means that when the stimulation frequency is greater than a certain value, the subject's EEG response will be aliased back and forth, resulting in a periodic change in the EEG evoked potential. The frequency of the periodic change is consistent with the stimulus frequency. Taking visual evoked response as an example, if the stimulation frequency is more than 6 times per second, the subject's visual evoked potential will have a periodic change in the corresponding frequency. Using EEG steady state evoked response to test the brain activity of the subject, the accuracy rate and test speed have reached a level that can be used for real-time control.
根据本发明的一个方面, 提供了一种基于脑电稳态诱发响应的控 制方法, 包括: a、 生成以不同频率变化的、 能被人体感官感受的一或多个刺激 信号; According to an aspect of the present invention, a control method based on an EEG steady state response is provided, including: a. Generate one or more stimulus signals that change at different frequencies and can be sensed by the human senses;
b、 检测受激人体的脑电信号; b. Detecting EEG signals of the stimulated human body;
c、 对检测得到的脑电信号进行分析, 从中提取与某一刺激信号 频率相对应的特征物理量作为控制信号; c. Analyze the detected EEG signals, and extract a characteristic physical quantity corresponding to the frequency of a certain stimulus signal as a control signal;
d、 基于所述的控制信号控制 fe该剌激信号相对应的一特定的受 控装置执行一即定的操作。 d, the control signal based on the stimulation fe a particular controlled device performs a signal corresponding to a predetermined operation, ie.
根据本发明的另一个方面, 提供了一种基于脑电稳态诱发响应的 感官测试方法, 包括: According to another aspect of the present invention, a sensory test method based on EEG steady state response is provided, including:
a、 用以不同频率变化的、 能被人体感官感受的一或多个刺激信 号对受测人的感官进行刺激; a. Stimulate the subject's senses with one or more stimulation signals that can be sensed by the human senses at different frequencies;
b、 检测受激人体的脑电信号; b. Detecting EEG signals of the stimulated human body;
c 对检测得到的脑电信号进行分析, 检测其中与刺激信号频率 相对应的特征物理量; c Analyze the detected EEG signals and detect the characteristic physical quantity corresponding to the frequency of the stimulus signal;
d、 基于所检测到的与剌激信号频率相对应的特征物理量及剌激 信号强度、 空间分布等特征对受测感官作出评价。 d. Evaluate the sensed sensor based on the detected physical quantities corresponding to the frequency of the stimulus signal, and the stimulus signal strength and spatial distribution.
根据本发明的再一个方面, 提供了一种基于脑电稳态诱发响应的 控制系统, 包括: According to still another aspect of the present invention, a control system based on an EEG-induced steady state response is provided, including:
a、 刺激器, 用于生成以不同频率变化的、 能被人体感官感受的 一或多个刺激信号; a. a stimulator for generating one or more stimulus signals that change at different frequencies and can be sensed by human senses;
b、 脑电信号检测器, 用于检测受激人体的脑电信号; b. EEG signal detector, which is used to detect the EEG signal of the stimulated human body;
c 信号处理器, 用于对检测得到的脑电信号进行分析, 从中提 取与某一刺激信号频率相对应的特征物理量作为控制信号; c a signal processor, configured to analyze the detected EEG signal, and extract a characteristic physical quantity corresponding to a certain stimulation signal frequency as a control signal;
d、 控制装置, 基于所述的控制信号控制与该刺激信号相对应的 一特定的受控装置执行一即定的操作。 d. The control device controls a specific controlled device corresponding to the stimulation signal to perform a predetermined operation based on the control signal.
根据本发明的又一个方面, 提供了一种基于脑电稳态诱发响应的 感官测试系统, 包括: a、 刺激器, 用于生成以不同频率变化的、 能被人体感官感受的 一或多个刺激信号; According to yet another aspect of the present invention, a sensory test system based on an EEG-induced steady state response is provided, including: a. a stimulator for generating one or more stimulus signals that change at different frequencies and can be sensed by human senses;
b、 脑电信号检测器, 用于检测受所述刺激信号刺激的人体的脑 电信号; b. an electroencephalogram signal detector for detecting an electroencephalogram signal of a human body stimulated by the stimulus signal;
c、 信号处理器, 用于对检测得到的脑电信号进行分析, 从中提 取与刺激信号频率相对. ^的特征物理量; c. A signal processor, configured to analyze the detected EEG signal, and extract a characteristic physical quantity relative to the frequency of the stimulation signal from the signal processor;
d、 评价装置, 用于根据所得到的与刺激信号频率相对应的特征 物理量及刺激信号的空间分布特征, 评定受测感官对刺激信号的反映 能力, 从而得出对该感官的客观评价。 d. An evaluation device is configured to evaluate the response ability of the measured sensor to the stimulus signal based on the obtained physical quantity corresponding to the frequency of the stimulus signal and the spatial distribution characteristics of the stimulus signal, so as to obtain an objective evaluation of the sense organ.
在一个实施例中, 所述的刺激信号为视觉刺激信号, 而所述的人 体感官为视觉器官。 In one embodiment, the stimulation signal is a visual stimulation signal, and the human sense organ is a visual organ.
在另一个实施例中, 所述的剌激信号为听觉刺激信号, 而所述的 人体感官为听觉器官。 In another embodiment, the stimulation signal is an auditory stimulus signal, and the human senses are auditory organs.
在又另一个实施例中, 所述的刺激信号为触觉刺激信号, 而所述 的人体感官为触觉器官。 In yet another embodiment, the stimulation signal is a tactile stimulation signal, and the human senses are tactile organs.
最好, 所述的分析包括对脑电信号进行频谱分析, 而所述的特征 物理量为所述脑电信号频谱中与各刺激信号频率相应的频谱成分。 Preferably, the analysis includes performing spectrum analysis on the EEG signal, and the characteristic physical quantity is a spectral component in the EEG signal spectrum corresponding to the frequency of each stimulus signal.
在一个实施例中, 所述的一个刺激信号是单一频率的。 In one embodiment, the stimulus signal is of a single frequency.
在另一个实施例中, 所述的一个刺激信号是多种频率信号的一个 组合。 In another embodiment, the one stimulus signal is a combination of multiple frequency signals.
本发明的潜在应用有: Potential applications of the invention are:
( 1 ) 为思维正常但有运动功能障碍的人提供一种对外界环境进 行交流和控制的途径。 例如, 他们可以通过脑一机接口来控制自己的 轮椅、 功能性电刺激系统或计算机。 (1) Provide a way for people with normal thinking and motor dysfunction to communicate and control the external environment. For example, they can control their wheelchair, functional electrical stimulation system, or computer through a brain-computer interface.
( 2 ) 为人们提供一种在特殊环境下附加的控制外界设备的途径。 如高加速度下的飞行员等; (2) Provide a way for people to control external devices in special circumstances. Such as pilots under high acceleration;
( 3 ) 为人们提供一种全新的娱乐方式。 如用思维玩电子游戏, 合成音乐等。 (3) Provide a new way of entertainment for people. If you play video games with your mind, Synthetic music, etc.
( 4 ) 提供一种客观视力或听力等的检测方法, 不需要通过语言 或肢体的动作等主观意识行为的表达。 它的客观性和公正性克服了传 统视力或听力等的测量中人为的随意性。 (4) Provide an objective vision or hearing detection method, without the need to express subjective conscious behaviors such as language or body movements. Its objectivity and impartiality overcome the artificial randomness in the measurement of traditional vision or hearing.
( 5 ) 为人们提供一种在特殊环境下的视觉意识状态分析。 如高 ¾度下的飞行员、 疲劳或酗酒驾驶员等。 附图的简单说明 (5) To provide people with an analysis of visual consciousness under special circumstances. Such as pilots at high degrees, tired or alcoholic drivers, etc. Brief description of the drawings
图 1所示是已有技术的基于诱发脑电信号的测试系统的示意图。 图 2所示是本发明的基于稳态脑电诱发响应的控制系统的实际构 成的示意图。 FIG. 1 is a schematic diagram of a prior art test system based on evoked EEG signals. Fig. 2 is a schematic diagram showing the actual configuration of a control system based on the steady-state EEG response of the present invention.
图 3所示是本发明的基于稳态脑电诱发响应的控制系统的电路方 框图。 Fig. 3 is a circuit block diagram of a control system based on a steady-state EEG response of the present invention.
图 4所示是本发明的基于稳态脑电诱发响应的感官测试系统的实 际构成的示意图。 FIG. 4 is a schematic diagram showing the actual configuration of a sensory test system based on a steady-state EEG response of the present invention.
图 5所示是本发明的基于稳态脑电诱发响应的感官测试系统的电 路方框图。 本发明的优选实施例 FIG. 5 is a circuit block diagram of a sensory test system based on a steady-state EEG response of the present invention. Preferred embodiment of the invention
以下结合附图详细说明本发明当前的优选实施例。 Hereinafter, the presently preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
图 2和图 3示出了本发明的基于稳态脑电诱发响应的控制系统。 该系统主要由以下四部分组成: Figures 2 and 3 show a control system based on the steady-state EEG response of the present invention. The system is mainly composed of the following four parts:
( 1 ) 刺激器 (1) Stimulator
刺激器的作用是产生对人体感觉器官的刺激信号。 刺激信号可以 是视觉刺激信号、 听觉刺激信号或触觉刺激信号。 以视觉刺激为例, 刺激器是由一些刺激点组成, 刺激点是按一定频率闪烁的光源。 刺激 点可以是闪光灯、 其他有一定亮度的光源、 或者是计算机屏幕上闪烁 的光斑。 这里所说的闪烁是指光信号的亮度、 形状、 色彩、 大小、 空 间位置、 持续时间或这些物理量的组合以一定的频率变化。 视觉刺激 信号的变化频率一般在 1一 50Hz的范围内,最好在 4一 25Hz的范围内。 The role of the stimulator is to generate stimulation signals to the human sense organs. The stimulation signal may be a visual stimulation signal, an auditory stimulation signal, or a tactile stimulation signal. Taking visual stimulation as an example, the stimulator is composed of some stimulation points, and the stimulation points are light sources that flicker at a certain frequency. Stimulate The point can be a flash, other light source with a certain brightness, or a flickering light spot on the computer screen. The flicker mentioned here means that the brightness, shape, color, size, spatial position, duration, or combination of these physical quantities of the optical signal changes at a certain frequency. The frequency of change of the visual stimulus signal is generally in the range of 1 to 50 Hz, and preferably in the range of 4 to 25 Hz.
一个刺激点可以是以单一频率闪烁的, 也可以包含多个以不同频 闪烁的信号。 一个刺激点包含多个不同频率的信号的好处是该刺激 点在受试者脑电中的特征反映为该多个频率的组合频谱, 这使得在一 定的频率范围内可设置更多的刺激点。 A stimulus point can flash at a single frequency, or it can contain multiple signals that flash at different frequencies. The advantage of a stimulus point containing multiple signals of different frequencies is that the characteristics of the stimulus point in the subject's EEG are reflected as the combined frequency spectrum of the multiple frequencies, which allows more stimulus points to be set within a certain frequency range .
刺激器可以包括一个刺激控制器, 用于对刺激点的特征进行控 制。 以视觉刺激为例, 刺激点的特征是: 1、 根据视觉系统测量的不 同要求, 给出光刺激前的预刺激。 2、 设定光刺激的背景。 3、 设定不 同闪烁频率的光刺激点参数 (如空间位置、 强度、 区域大小和持续时 间)。 The stimulator may include a stimulus controller for controlling the characteristics of the stimulus point. Taking visual stimulation as an example, the characteristics of the stimulation points are: 1. According to different requirements of the visual system measurement, the pre-stimulation before light stimulation is given. 2. Set the background of the light stimulus. 3. Set the parameters of the light stimulation points (such as spatial position, intensity, area size, and duration) for different flicker frequencies.
( 2 ) 脑电提取、 放大与传输 (2) EEG extraction, amplification and transmission
脑电提取、 放大与传输的作用是将微弱的脑电信号放大到足够大 的幅度, 并对其进行模拟到数字的转换, 最终输入到计算机或其他信 号处理装置。 包括以下几部分。 The function of EEG extraction, amplification and transmission is to amplify the weak EEG signal to a sufficiently large amplitude, and convert it from analog to digital, and finally input it to a computer or other signal processing device. It includes the following sections.
a.电极: 电极是指紧贴在头皮上的金属片, 它能检测出头皮表面 的电位变化 (这种变化反映了脑内的电活动)。 电极上的电位变化是 脑电放大器的输入信号。 其信号幅度 l〜10uV。 a. Electrode: An electrode is a metal sheet that is closely attached to the scalp. It can detect potential changes on the scalp surface (this change reflects electrical activity in the brain). The potential change on the electrodes is the input signal to the EEG amplifier. Its signal amplitude is l ~ 10uV.
b.脑电信号放大器: 脑电放大器的作用是将微弱的脑电信号放大 到足够大的幅度, 以便对其进行模拟到数字的转换。 脑电放大器的一 般要求为增益 3000〜10000倍、 频率通带 l〜30Hz的电生理信号放大 器。 b. EEG signal amplifier: The function of the EEG amplifier is to amplify the weak EEG signal to a sufficiently large magnitude so that it can be converted from analog to digital. EEG amplifiers generally require an electrophysiological signal amplifier with a gain of 3000 to 10,000 times and a frequency passband of 1 to 30 Hz.
c信号传送装置: 信号传送装置是指将已经数字化的脑电信号传 送给计算机或其他信号处理装置。 传送过程可以是有线的传送, 也可 以是无线的传送。 信号的传输延时应小于 10毫秒。 ( 3 ) 脑电信号处理器 c. Signal transmission device: The signal transmission device refers to transmitting the digitalized EEG signal to a computer or other signal processing device. The transmission process can be wired or So wireless transmission. The transmission delay of the signal should be less than 10 ms. (3) EEG signal processor
电生理实验证明, 当给人体的感觉器官一定的刺激时, 只要受试 者的感觉系统是健康的, 就可以在受试者的枕部头皮上记录到特征明 显的诱发脑电信号。 记录信号的特征表现在时间、 空间和频率域中。 脑电信号处理器的作用是分析脑电信号的特征, 并将这些特征识别出 来用于控制等目的。 Electrophysiological experiments have proven that when the sensory organs of the human body are stimulated to a certain extent, as long as the subject's sensory system is healthy, the subject's occipital scalp can be recorded with distinctively induced EEG signals. The characteristics of the recorded signal appear in the time, space, and frequency domains. The function of the EEG signal processor is to analyze the characteristics of the EEG signal and identify these characteristics for control and other purposes.
以稳态视觉刺激为例, 脑电信号分析器中的主要功能模块有: a.脑电信号预处理: 因为记录到的脑电信号非常微弱通常在提取 过程中会引入干扰。 因此在进行分析前必需对其进行降噪声等预处 理。 需去处的噪声主要是公频干扰、 基线漂移等。 采用的方法是数字 滤波。 Taking steady-state visual stimulation as an example, the main functional modules in the EEG signal analyzer are: a. EEG signal preprocessing: Because the recorded EEG signal is very weak, interference is usually introduced during the extraction process. Therefore, pre-processing such as noise reduction must be performed before analysis. The noise to be removed is mainly the common frequency interference, baseline drift and so on. The method used is digital filtering.
b.脑电信号频谱分析器: 以稳态视觉诱发为例, 刺激点按一定频 率闪烁的光源, 诱发脑电中包含刺激频率及其谐波成分, 为了要得到 这些频率成分就必需对信号做频谱分析, 这就是频率分析器的功能。 b. EEG signal spectrum analyzer: Take steady-state visual induction as an example, the stimulus point flashes a light source at a certain frequency, and the induced EEG includes the stimulus frequency and its harmonic components. In order to obtain these frequency components, the signal must be processed Spectrum analysis, this is the function of the frequency analyzer.
频谱分析通常是由计算机或其他数字信号处理器完成的。 因此, 这是一个数字信号处理的过程。 常用的用于完成频谱分析的算法是快 速傅里叶变换法 (FFT), 它的计算公式是 上式中 x (n)是数字化的脑电信号, η=0〜Ν-1 ; X籠是 x (n)的 离散傅里叶变换, k=0〜N-l。 Spectrum analysis is usually performed by a computer or other digital signal processor. Therefore, this is a digital signal processing process. The commonly used algorithm to complete the spectrum analysis is the fast Fourier transform (FFT). Its calculation formula is In the above formula, x (n) is a digital EEG signal, η = 0 ~ N-1; X cage is a discrete Fourier transform of x (n), k = 0 ~ Nl.
c.频率特征分析: 为了实现不同要求的控制, 可以设计刺激点以 不同的频率或频率组合闪烁。 当受试者根据需要注视某一个刺激点 时, 其诱发脑电中就应该包含该刺激点闪烁的频率及其谐波成分。 如 刺激点闪烁的频率是多种频率组合, 其诱发脑电中就还应该包含该刺 激点闪烁的频率组合的非线性成分 (如和与差频率)。 只要能从频率 分析器中分辩出不同的频率成分, 就可以实现得知受试者注视的刺激 点或多个刺激点。 如何有效从频率分析结果中分辩刺激频率成分是否 存在, 频率特征分析需要解决好谱峰分辩精度和谱峰的判别阈值两个 问题。 我们的解决方案是 (1 ) 为了提高谱峰的分辩精度, FFT 数据 长度应有一定长度, 通常为 1秒。 (2 ) 在 FFT结果中, 如果某一刺激 频率处出现了峰值, 且峰值幅度与该次 FFT结果在 4一 35Hz的最大值 的比超过了 0. 8, 则认为受试者在注视以该频率闪烁的剌激点, 若满 足条件的刺激频率超过二个, 则取上述比值最大的频率。 c. Frequency characteristic analysis: In order to achieve different control requirements, the stimulus points can be designed to flicker at different frequencies or frequency combinations. When the subject looks at a certain stimulus point as required, the induced electroencephalogram should include the flicker frequency of the stimulus point and its harmonic components. For example, the frequency of the flicker of the stimulus point is a combination of multiple frequencies, and the induced EEG should also include non-linear components (such as sum and difference frequencies) of the frequency combination of the flicker of the stimulus point. From the frequency The different frequency components are distinguished in the analyzer, and the stimulus point or multiple stimulus points that the subject is watching can be realized. How to effectively distinguish the existence of stimulus frequency components from the frequency analysis results, the frequency characteristic analysis needs to solve the two problems of spectral peak resolution accuracy and spectral peak discrimination threshold. Our solution is (1) In order to improve the resolution of spectral peaks, the length of the FFT data should be a certain length, usually 1 second. (2) In the FFT result, if a peak occurs at a certain stimulus frequency, and the ratio of the peak amplitude to the maximum value of the FFT result at 4 to 35 Hz exceeds 0.8, the subject is considered to be watching If there is more than two stimulation frequencies that meet the conditions, the frequency with the highest ratio is used.
( 4 ) 控制器 (4) Controller
具有一定特征的脑电信号被识别后可以用来实现某种控制的目 的。 EEG signals with certain characteristics can be used to achieve certain control purposes after being identified.
脑一机接口的一个典型应用是供残疾人实现对周围环境的控制, 例如, 开 /关灯、 开 /关电视、 开 /关风扇等。 由脑电信号处理器的输 出, 我们能得知受试者注视哪一个闪烁灯, 于是也就知道想完成的控 制。 只要把这一信息传给环境控制器, 接通相应的电路, 就可以实现 对周围电器的控制。 A typical application of the brain-machine interface is for the disabled to control the surrounding environment, for example, turning on / off the lights, turning on / off the TV, turning on / off the fans, and so on. From the output of the EEG signal processor, we can know which blinking light the subject is watching, and then we know what control we want to accomplish. As long as this information is transmitted to the environmental controller and the corresponding circuit is connected, the control of the surrounding electrical appliances can be realized.
图 2 中示出了本发明的基于脑电稳态响应的控制系统的一个实 例。 其中的刺激器为一个屏幕, 其上设置有四个光斑, 分别对应于希 望控制的四件电器设备。 该四个光斑分别以不同的频率闪烁。 当使用 者注视与想要控制的电器相对应的光斑时, 脑电信号处理器即可在其 脑电信号中探测出与该光斑相对应的频率峰, 并输出相应信号给控制 器。 控制器则根据该信号控制相应的电器进行预定的操作, 如开 /关 操作等。 An example of the control system based on the EEG steady-state response of the present invention is shown in FIG. 2. The stimulator is a screen with four light spots on it, corresponding to the four pieces of electrical equipment to be controlled. The four light spots flicker at different frequencies. When the user looks at the light spot corresponding to the electric appliance to be controlled, the EEG signal processor can detect the frequency peak corresponding to the light spot in the EEG signal and output a corresponding signal to the controller. The controller controls the corresponding appliances to perform predetermined operations, such as on / off operation, based on the signal.
图 3为图 2所示的系统的电路方框图。 其中, 1为频率模式闪烁 刺激器, 它的不同的刺激点的闪烁频率不同。 2为受试人的视觉系统。 3 为脑电提取、 放大与传输装置, 用于获取受试者的脑电信号, 对其 进行放大并进行模 /数转换, 之后将所得到的信号输送到信号预处理 装置 4。 信号预处理装置 4对信号进行降噪等预处理。 脑电信号分析 器 5对信号进行以频谱分析为主的分析, 找出受试者脑电中与闪烁刺 激器中某一刺激点的频率相应的频率成分, 从而确定受试者所关注的 闪烁点, 并输出相应的信号给控制器 6。 控制器 6则按照该信号, 根 据预先设置的程序指令相应的设备进行相应的操作。 脑电信号分析器 6的工作原理已在前面介绍, 这里不在赘述。 FIG. 3 is a circuit block diagram of the system shown in FIG. 2. Among them, 1 is a frequency-mode flicker stimulator, and flicker frequencies of different stimulation points are different. 2 is the visual system of the test subject. 3 is an EEG extraction, amplification and transmission device, which is used to obtain the subject's EEG signals and The signal is amplified and subjected to analog-to-digital conversion, and then the obtained signal is sent to the signal pre-processing device 4. The signal pre-processing device 4 performs pre-processing such as noise reduction on the signal. The electroencephalogram signal analyzer 5 analyzes the signals mainly by spectrum analysis, and finds out the frequency components in the subject's brain electricity corresponding to the frequency of a certain stimulation point in the scintillation stimulator, thereby determining the flicker that the subject is concerned about. Point, and output the corresponding signal to the controller 6. The controller 6 instructs the corresponding equipment to perform corresponding operations according to the preset program according to the signal. The working principle of the EEG signal analyzer 6 has been described in the foregoing, and is not repeated here.
具有一定特征的脑电信号被识别后可以用来作为一人体各感官系 统客观评价的指标。 图 4和图 5示出了本发明的基于稳态脑电诱发响 应的一个感官测试系统。 该系统与图 2和图 3示出的控制系统基本相 同, 只是将控制装置 6以一个评价装置 7替代, 并增加了一个刺激控 制器 8。 After the EEG signals with certain characteristics are identified, they can be used as indicators for objective evaluation of each human sensory system. Figures 4 and 5 show a sensory test system based on steady state EEG evoked responses according to the present invention. This system is basically the same as the control system shown in Figs. 2 and 3, except that the control device 6 is replaced with an evaluation device 7 and a stimulation controller 8 is added.
以视觉客观检测为例, 检测的步骤是: Taking visual objective detection as an example, the detection steps are:
(a)根据视觉系统测量的不同要求, 给出光刺激前的预刺激。 (a) According to the different requirements of the visual system measurement, the pre-stimulus before light stimulation is given.
(b)设定本次光刺激的背景。 (b) Set the background of this light stimulation.
(c)设定不同闪烁频率的光刺激点参数 (如空间位置、 光强度、 光斑大小和持续时间)。 以上步骤是通过刺激控制器 8实现的。 (c) Set parameters of light stimulation points (such as spatial position, light intensity, spot size, and duration) for different flicker frequencies. The above steps are implemented by the stimulation controller 8.
(d)根据受试者的脑电诱发响应, 分析受试者对不同的光刺激点 的反应, 结合光刺激点的参数 (空间位置、 光强度、 光斑大小和持续 时间等) 以及人体视觉系统结构, 得出本次刺激的客观视觉评价。 (d) Analysis of the subject's response to different light stimulation points based on the subject's EEG response, combined with the parameters of the light stimulation points (spatial position, light intensity, spot size and duration, etc.) and the human visual system Structure to obtain an objective visual evaluation of this stimulus.
(e)如需要设计新的条件 (如背景和光刺激点参数), 返回步骤 (b), 否则步骤 (f)。 (e) If you need to design new conditions (such as background and light stimulation point parameters), return to step (b), otherwise step (f).
(f)根据各种条件下的客观视觉评价, 得出总的人体视觉系统客 观评价的指标。 (f) According to the objective visual evaluation under various conditions, the total objective evaluation index of the human visual system is obtained.
作为一个实施测试的例子, 我们在实验室完成了利用稳态视觉诱 发电位对受试者进行视力检测的实验。 实验系统的构成见图 4。 As an example of the implementation of the test, we have performed experiments in the laboratory to test the visual acuity of subjects using steady-state visual evoked potentials. The composition of the experimental system is shown in Figure 4.
我们在计算机屏幕上设计了五个闪烁的方块区域, 每个分别以不 同的一种或多种的频率闪烁, 其中一个在中间其它四个分别位于其上 下左右。 实验的过程中只要受试者注视特定的中间方块区域, 他的脑 电信号中就会出现该区域特定频率的特征的频率成分。 随着五个闪烁 方块区域的减小, 他的脑电信号中就会出现其它特定频率的特征。 由 脑电信号分析器采集受试者的诱发脑电信号, 并进行分析就可以检测 出 试者的视力。 We designed five flashing square areas on the computer screen, each of which One or more of the same frequency flickers, one of which is in the middle and the other four are located above and below it. During the experiment, as long as the subject looks at a specific middle square region, a frequency component of a specific frequency characteristic of the region will appear in his EEG signal. As the area of the five blinking squares decreases, other specific frequency features appear in his EEG signals. The subject's evoked EEG signal is collected by the EEG signal analyzer and analyzed to detect the tester's vision.
实验中所用的脑电提取与放大是一台现成的脑电图机。 经过放大 后的脑电信号被送入由计算机构成的脑电信号处理器, 计算机完成脑 电信号预处理和频谱分析, 得到相应的频率成分。 再通过预定的计算 机程序确定受试者的视力水平。 The EEG extraction and amplification used in the experiment is a ready-made EEG machine. The amplified EEG signal is sent to an EEG signal processor composed of a computer. The computer completes the EEG signal preprocessing and spectrum analysis to obtain the corresponding frequency components. The subject's vision level is then determined by a predetermined computer program.
实验获得了成功。 上述的客观视力检测准确给出了不同的视力受 试者的视力能力。 The experiment was a success. The above objective visual acuity test accurately gives the visual acuity of different vision subjects.
虽然以上以视觉刺激和响应为例详细说明了本发明, 但本发明并 不局限于视觉刺激和响应。 本发明的刺激器可以是声音刺激器、 触觉 刺激器等, 而受试者的脑电稳态诱发响应中也都会包含与刺激信号的 频率相应的频率成分。 基于这一特征, 可以通过对声音刺激、 触觉刺 激等的脑电响应的分析而实现脑电控制及对相应感官的客观评价。 Although the present invention has been described in detail by taking visual stimuli and responses as examples, the present invention is not limited to visual stimuli and responses. The stimulator of the present invention may be a sound stimulator, a tactile stimulator, and the like, and the subject's brain electrical steady state response also includes a frequency component corresponding to the frequency of the stimulation signal. Based on this feature, the EEG control and objective evaluation of the corresponding senses can be achieved by analyzing the EEG response of sound stimulation, tactile stimulation, and so on.
以上结合附图的详细说明并非用来限制本发明的范围。 本发明的 范围仅由后面的权利要求书所限定。 不脱离本发明的理念和范围, 本 领域的技术人员能够容易地联想出其它的实施方式和应用。 这些方式 或应用也应该属于本发明的范围。 The above detailed description in conjunction with the accompanying drawings is not intended to limit the scope of the present invention. The scope of the invention is only limited by the claims that follow. Without departing from the concept and scope of the present invention, those skilled in the art can easily think of other implementations and applications. These modes or applications should also belong to the scope of the present invention.
Claims
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/111,801 US7123955B1 (en) | 1999-10-29 | 2000-10-30 | Control method and system and the sense organs test method and system based on electrical steady state induced response |
| CNB008151342A CN100366215C (en) | 1999-10-29 | 2000-10-30 | Control method and system based on EEG homeostasis evoked response and sensory testing method and system |
| AU11272/01A AU1127201A (en) | 1999-10-29 | 2000-10-30 | The control method and system and the sense organs test method and system based on electrical steady state induced response |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN99122161A CN1248426A (en) | 1999-10-29 | 1999-10-29 | Controller based on brain electricity steady-state induced response |
| CN99122161.3 | 1999-10-29 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2001032078A1 true WO2001032078A1 (en) | 2001-05-10 |
Family
ID=5282326
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2000/000410 Ceased WO2001032078A1 (en) | 1999-10-29 | 2000-10-30 | The control method and system and the sense organs test method and system based on electrical steady state induced response |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US7123955B1 (en) |
| CN (2) | CN1248426A (en) |
| AU (1) | AU1127201A (en) |
| WO (1) | WO2001032078A1 (en) |
Families Citing this family (50)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7546158B2 (en) * | 2003-06-05 | 2009-06-09 | The Regents Of The University Of California | Communication methods based on brain computer interfaces |
| CN100345086C (en) * | 2003-06-27 | 2007-10-24 | 松下电器产业株式会社 | Service providing device, expectation-shattering judging device, and expectation-shattering judging method |
| CN1331080C (en) * | 2003-10-21 | 2007-08-08 | 东北大学 | Virtual keyboard and robot control system by brain electric signal |
| CN1317624C (en) * | 2003-12-31 | 2007-05-23 | 中国人民解放军第三军医大学野战外科研究所 | Method of extracting brain machine interface control signa based on instantaneous vision sense induced electric potential |
| US20070070999A1 (en) * | 2005-08-02 | 2007-03-29 | Black Jeffrey T | Synchronization of historical data without retransmission |
| CN101159086B (en) * | 2007-11-22 | 2010-05-19 | 中国人民解放军国防科学技术大学 | Calling device based on EEG information detection |
| US8952888B2 (en) * | 2008-05-09 | 2015-02-10 | Koninklijke Philips N.V. | Method and system for conveying an emotion |
| US8391966B2 (en) * | 2009-03-16 | 2013-03-05 | Neurosky, Inc. | Sensory-evoked potential (SEP) classification/detection in the time domain |
| US8155736B2 (en) * | 2009-03-16 | 2012-04-10 | Neurosky, Inc. | EEG control of devices using sensory evoked potentials |
| WO2010141764A2 (en) * | 2009-06-03 | 2010-12-09 | University Of Pittsburgh - Of The Commonwealth System Of Higher Education | Steady state measurement and analysis approach to profiling auditory evoked potentials from short-latency to long-latency |
| CN101711908B (en) * | 2009-11-30 | 2013-04-03 | 上海交通大学 | Hierarchical functional electrical stimulation recovery system for lower limbs |
| US8579812B2 (en) | 2009-12-15 | 2013-11-12 | Brainscope Company, Inc. | System and methods for management of disease over time |
| US8577451B2 (en) * | 2009-12-16 | 2013-11-05 | Brainscope Company, Inc. | System and methods for neurologic monitoring and improving classification and treatment of neurologic states |
| SG192045A1 (en) * | 2011-01-20 | 2013-08-30 | Widex As | Personal eeg monitoring device with electrode validation |
| CN102309380A (en) * | 2011-09-13 | 2012-01-11 | 华南理工大学 | Intelligent wheelchair based on multimode brain-machine interface |
| CN102697506B (en) * | 2012-05-29 | 2014-11-26 | 广州乾华生物科技有限公司 | Method and system for monitoring action response condition |
| US10155121B2 (en) | 2012-08-25 | 2018-12-18 | National Chiao Tung University | Stimuli generating methods, devices and control systems to induce visual evoked potentials using imperceptible flickering multi-color lights |
| CN103083014B (en) * | 2013-01-08 | 2015-04-29 | 北京理工大学 | Method controlling vehicle by electroencephalogram and intelligent vehicle using method |
| CN103405230B (en) * | 2013-08-07 | 2015-04-15 | 清华大学 | System and method for detecting color perception based on electroencephalogram evoked potential |
| CN104224128B (en) * | 2013-09-26 | 2016-08-24 | 中国科学院生物物理研究所 | A kind of birds visual stimulus monitors and light analysis record system in real time |
| CN103654773B (en) * | 2013-12-20 | 2016-02-03 | 北京飞宇星电子科技有限公司 | Electroencephalo experimental teaching unit |
| CN104545895B (en) * | 2014-09-22 | 2017-02-01 | 中国科学院昆明动物研究所 | Method for quickly screening out drug addicts by electroencephalogram characteristics |
| DK3197351T3 (en) * | 2014-09-24 | 2025-06-16 | Vivosonic Inc | SYSTEM, METHOD AND DEVICE FOR DETECTING AN INDUCED RESPONSE SIGNAL |
| KR101585150B1 (en) * | 2014-09-25 | 2016-01-14 | 서울대학교산학협력단 | multi-mode brain-computer interface system based on brain connectivity |
| CN104503592A (en) * | 2015-01-23 | 2015-04-08 | 北京智谷睿拓技术服务有限公司 | Method and device for determining head gestures |
| CN104503593A (en) * | 2015-01-23 | 2015-04-08 | 北京智谷睿拓技术服务有限公司 | Control information determination method and device |
| CN104688222B (en) * | 2015-04-03 | 2017-04-26 | 清华大学 | EEG-based (electroencephalogram-based) tone synthesizer |
| CN106249846B (en) * | 2015-06-29 | 2020-03-17 | 北京智谷睿拓技术服务有限公司 | Light intensity adjusting method and device |
| CN106293049A (en) * | 2015-08-19 | 2017-01-04 | 北京智谷睿拓技术服务有限公司 | Input information determines method and apparatus |
| CN105193410A (en) * | 2015-09-14 | 2015-12-30 | 武汉智普天创科技有限公司 | EEG (electroencephalogram) signal amplifying system |
| CN106793728B (en) * | 2016-12-13 | 2019-03-01 | 清华大学 | Screening arrangement for Mobile biological electric signal amplifier |
| EP3684463B1 (en) | 2017-09-19 | 2025-05-14 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement |
| US11717686B2 (en) | 2017-12-04 | 2023-08-08 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement to facilitate learning and performance |
| CN108153414B (en) * | 2017-12-19 | 2021-06-15 | 同济大学 | Method, system and device for identifying steady-state visual evoked potential signals |
| JP7069716B2 (en) * | 2017-12-28 | 2022-05-18 | 株式会社リコー | Biological function measurement and analysis system, biological function measurement and analysis program, and biological function measurement and analysis method |
| US11478603B2 (en) | 2017-12-31 | 2022-10-25 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement to enhance emotional response |
| US12280219B2 (en) | 2017-12-31 | 2025-04-22 | NeuroLight, Inc. | Method and apparatus for neuroenhancement to enhance emotional response |
| US11364361B2 (en) | 2018-04-20 | 2022-06-21 | Neuroenhancement Lab, LLC | System and method for inducing sleep by transplanting mental states |
| EP3849410A4 (en) | 2018-09-14 | 2022-11-02 | Neuroenhancement Lab, LLC | SLEEP ENHANCEMENT SYSTEM AND METHOD |
| CN109875583B (en) * | 2019-02-19 | 2021-01-29 | 京东方科技集团股份有限公司 | A system and method for fatigue driving detection based on AR technology |
| KR102791246B1 (en) * | 2019-05-08 | 2025-04-08 | 현대자동차주식회사 | Apparatus for controlling convenience device of vehicle and method thereof |
| US11786694B2 (en) | 2019-05-24 | 2023-10-17 | NeuroLight, Inc. | Device, method, and app for facilitating sleep |
| CN110251064A (en) * | 2019-07-17 | 2019-09-20 | 西安交通大学 | Visual acuity detection method based on motor visual evoked potentials |
| CN110811613B (en) * | 2019-11-22 | 2022-09-27 | 河北工业大学 | Method for improving event-related potential signal-to-noise ratio based on European Debao and DMST paradigm fusion |
| CN111639608B (en) * | 2020-06-02 | 2023-09-01 | 郑州大学 | Automatic labeling method, automatic labeling device, computer readable medium and electronic equipment |
| CN111728608A (en) * | 2020-06-29 | 2020-10-02 | 中国科学院上海高等研究院 | EEG signal analysis method, device, medium and equipment based on augmented reality |
| CN111743538A (en) * | 2020-07-06 | 2020-10-09 | 江苏集萃脑机融合智能技术研究所有限公司 | Brain-computer interface alarm method and system |
| CN111939469A (en) * | 2020-08-05 | 2020-11-17 | 深圳扶林科技发展有限公司 | Multi-mode electroencephalogram stimulation device and finger bending and stretching stimulation rehabilitation device |
| CN114557708B (en) * | 2022-02-21 | 2024-08-20 | 天津大学 | Somatosensory stimulation consciousness detection device and method based on brain electricity dual-feature fusion |
| CN115282431B (en) * | 2022-07-06 | 2023-06-30 | 电子科技大学 | An EEG-based light-regulating intelligent lamp stimulation method and device thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4493539A (en) * | 1982-06-30 | 1985-01-15 | The United States Of America As Represented By The Secretary Of The Air Force | Method and apparatus for objective determination of visual contrast sensitivity functions |
| US4651145A (en) * | 1984-05-31 | 1987-03-17 | Medical Research Institute | Communication system for the disabled in which a display target is selected by encephalogram response |
| US4832480A (en) * | 1986-06-24 | 1989-05-23 | Quintron, Inc. | Differential diagnosis of sensory abnormalities using a normalized, ratiometric analysis of steady state evoked potentials |
| US5331969A (en) * | 1985-07-30 | 1994-07-26 | Swinburne Limited | Equipment for testing or measuring brain activity |
| WO1997021165A1 (en) * | 1995-12-06 | 1997-06-12 | Johanna Lorenz | Switching and/or control method and device which use a computer |
| US5638825A (en) * | 1994-04-21 | 1997-06-17 | Nec Corporation | Evoked potential measuring apparatus |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4244376A (en) * | 1980-02-08 | 1981-01-13 | Fisher Charles B | Measurement of evoked nervous system potentials |
| US4676611A (en) * | 1984-11-14 | 1987-06-30 | New York University | Method and apparatus for visual-evoked responses |
| US4861154A (en) * | 1986-08-06 | 1989-08-29 | Westinghouse Electric Corp. | Automated visual assessment system with steady state visual evoked potential stimulator and product detector |
| NZ226959A (en) * | 1987-11-11 | 1990-07-26 | Univ Melbourne | Evoked response audiometer: determining locking of brain signals to audio stimulus |
| US4926969A (en) * | 1988-11-18 | 1990-05-22 | Neurosonics, Inc. | Sensory-driven controller |
| CN1228290A (en) * | 1998-03-09 | 1999-09-15 | 北京驰名科技开发公司 | newborn physiological parameter monitor |
| AUPP313798A0 (en) * | 1998-04-22 | 1998-05-14 | University Of Melbourne, The | Improved evoked response audiometer |
-
1999
- 1999-10-29 CN CN99122161A patent/CN1248426A/en active Pending
-
2000
- 2000-10-30 AU AU11272/01A patent/AU1127201A/en not_active Abandoned
- 2000-10-30 WO PCT/CN2000/000410 patent/WO2001032078A1/en not_active Ceased
- 2000-10-30 CN CNB008151342A patent/CN100366215C/en not_active Expired - Fee Related
- 2000-10-30 US US10/111,801 patent/US7123955B1/en not_active Expired - Lifetime
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4493539A (en) * | 1982-06-30 | 1985-01-15 | The United States Of America As Represented By The Secretary Of The Air Force | Method and apparatus for objective determination of visual contrast sensitivity functions |
| US4651145A (en) * | 1984-05-31 | 1987-03-17 | Medical Research Institute | Communication system for the disabled in which a display target is selected by encephalogram response |
| US5331969A (en) * | 1985-07-30 | 1994-07-26 | Swinburne Limited | Equipment for testing or measuring brain activity |
| US4832480A (en) * | 1986-06-24 | 1989-05-23 | Quintron, Inc. | Differential diagnosis of sensory abnormalities using a normalized, ratiometric analysis of steady state evoked potentials |
| US5638825A (en) * | 1994-04-21 | 1997-06-17 | Nec Corporation | Evoked potential measuring apparatus |
| WO1997021165A1 (en) * | 1995-12-06 | 1997-06-12 | Johanna Lorenz | Switching and/or control method and device which use a computer |
Also Published As
| Publication number | Publication date |
|---|---|
| AU1127201A (en) | 2001-05-14 |
| CN100366215C (en) | 2008-02-06 |
| CN1248426A (en) | 2000-03-29 |
| CN1420745A (en) | 2003-05-28 |
| US7123955B1 (en) | 2006-10-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2001032078A1 (en) | The control method and system and the sense organs test method and system based on electrical steady state induced response | |
| Gao et al. | A BCI-based environmental controller for the motion-disabled | |
| CN101339455B (en) | Brain-computer interface system based on the N170 component of the specific wave for face recognition | |
| Horki et al. | Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb | |
| Takano et al. | Visual stimuli for the P300 brain–computer interface: a comparison of white/gray and green/blue flicker matrices | |
| Pfurtscheller et al. | 15 years of BCI research at Graz University of Technology: current projects | |
| Middendorf et al. | Brain-computer interfaces based on the steady-state visual-evoked response | |
| Edlinger et al. | A hybrid brain-computer interface for smart home control | |
| CN101477405B (en) | Steady state visually evoked brain-computer interface method based on two frequency stimuli in the left and right visual fields | |
| US5840040A (en) | Encephalolexianalyzer | |
| CN101391129B (en) | Brain-machine interface intelligentized upper-limb recovery training device based on P300 signal and signal processing method | |
| CN102200833B (en) | A Speller BCI system and its control method | |
| CN102799267B (en) | Multi-brain-computer interface method for three characteristics of SSVEP (Steady State Visual Evoked Potential), blocking and P300 | |
| CN105938397A (en) | Hybrid brain-computer interface method based on steady state motion visual evoked potential and default stimulation response | |
| Kanoh et al. | A brain-computer interface (BCI) system based on auditory stream segregation | |
| CN108958486A (en) | Mood brain machine interface system based on recognition of face brain electricity N170 ingredient | |
| Ko et al. | Enhancing the hybrid BCI performance with the common frequency pattern in dual-channel EEG | |
| Yao et al. | Performance variation of a somatosensory BCI based on imagined sensation: a large population study | |
| Narayana et al. | Mind your thoughts: BCI using single EEG electrode | |
| Yao et al. | Performance of brain–computer interfacing based on tactile selective sensation and motor imagery | |
| CN101339413B (en) | Switching control method based on brain electric activity human face recognition specific wave | |
| CN109567936B (en) | A brain-computer interface system and implementation method based on auditory attention and multifocal electrophysiology | |
| Ortner et al. | State of the art in sensors, signals and signal processing | |
| Zhao et al. | A virtual smart home based on EEG control | |
| Al-Negheimish et al. | Brainwave typing: Comparative study of p300 and motor imagery for typing using dry-electrode EEG devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 008151342 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 10111801 Country of ref document: US |
|
| REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
| 122 | Ep: pct application non-entry in european phase | ||
| DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) |