WO2018147407A1 - 体内装置からの通信データ量を変更可能なブレインマシンインターフェースシステム、およびその制御方法 - Google Patents
体内装置からの通信データ量を変更可能なブレインマシンインターフェースシステム、およびその制御方法 Download PDFInfo
- Publication number
- WO2018147407A1 WO2018147407A1 PCT/JP2018/004561 JP2018004561W WO2018147407A1 WO 2018147407 A1 WO2018147407 A1 WO 2018147407A1 JP 2018004561 W JP2018004561 W JP 2018004561W WO 2018147407 A1 WO2018147407 A1 WO 2018147407A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- living body
- communication unit
- electrode groups
- extracorporeal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
- A61B5/6867—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive specially adapted to be attached or implanted in a specific body part
- A61B5/6868—Brain
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0004—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
- A61B5/0006—ECG or EEG signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/002—Monitoring the patient using a local or closed circuit, e.g. in a room or building
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0031—Implanted circuitry
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/25—Bioelectric electrodes therefor
- A61B5/279—Bioelectric electrodes therefor specially adapted for particular uses
- A61B5/291—Bioelectric electrodes therefor specially adapted for particular uses for electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/30—Input circuits therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/30—Input circuits therefor
- A61B5/307—Input circuits therefor specially adapted for particular uses
- A61B5/31—Input circuits therefor specially adapted for particular uses for electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
- A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
- A61B5/686—Permanently implanted devices, e.g. pacemakers, other stimulators, biochips
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/50—Prostheses not implantable in the body
- A61F2/68—Operating or control means
- A61F2/70—Operating or control means electrical
- A61F2/72—Bioelectric control, e.g. myoelectric
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7225—Details of analogue processing, e.g. isolation amplifier, gain or sensitivity adjustment, filtering, baseline or drift compensation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
Definitions
- the present disclosure relates to a brain machine interface (BMI) system including an in-vivo device implanted in a living body and an in-vivo device disposed outside the living body.
- BMI brain machine interface
- the in-vivo device detects brain activity by acquiring a brain wave as a signal source, and transmits a signal corresponding to the brain activity and a signal obtained by processing the signal to the extra-corporeal device.
- the extracorporeal device performs an operation according to the signal received from the intracorporeal device.
- the in-vivo device described in Patent Document 1 includes a plurality of electrodes that are embedded in a living body and detect brain waves.
- a first aspect for satisfying the above requirements is an internal device of a brain machine interface system implanted in a living body, A communication unit that performs wireless communication with the extracorporeal device; A control unit for controlling the communication unit; With The controller is Data corresponding to the electroencephalogram signal of the living body detected through N (N is 2 or more) electrode groups, the communication unit to be transmitted to the extracorporeal device, When the communication unit receives a designation signal designating M electrode groups fewer than N after the transmission is performed, it corresponds to the brain wave signal of the living body detected through the M electrode groups. Data is transmitted to the extracorporeal device in real time by the communication unit.
- a second aspect for satisfying the above requirements is a method for controlling an internal device of a brain machine interface system embedded in a living body, Wirelessly transmitting data corresponding to the electroencephalogram signal of the living body detected through N (N is 2 or more) electrode groups to the extracorporeal device; After the wireless transmission is performed, a designation signal designating M electrode groups smaller than the N pieces is wirelessly received; Data corresponding to the electroencephalogram signal of the living body detected through the M electrode groups is wirelessly transmitted to the extracorporeal device in real time.
- first, data acquired through the N electrode groups is transmitted to the extracorporeal device.
- the timing at which the transmission is performed is, for example, a time when real-time BMI control of the extracorporeal device is not requested. That is, it is given priority over the data transmission speed to reliably deliver as much data as possible to the extracorporeal device. Therefore, the communication unit does not need to have a high data transmission capability.
- M electrode groups that are prioritized for performing desired BMI control can be accurately specified. Further, the M electrode groups fewer than N are specified so as to match the data transmission capability of the communication unit. Therefore, at the stage where BMI control is actually performed, data corresponding to the electroencephalogram signals acquired through the M electrode groups is transmitted to the extracorporeal device in real time. Thereby, desired BMI control can be executed without increasing the communication rate.
- a third aspect for satisfying the above requirement is an internal device of a brain machine interface system implanted in a living body, A data acquisition unit; A communication unit that performs wireless communication with the extracorporeal device; A control unit for controlling the communication unit; With The controller is First data having a first data amount corresponding to the electroencephalogram signal of the living body detected through N (N is 2 or more) electrodes is acquired by the data acquisition unit, Causing the communication unit to transmit the first data to the extracorporeal device; When the communication unit receives a designation signal designating a second data amount smaller than the first data amount after the transmission is performed, the communication unit corresponds to the electroencephalogram signal of the living body detected through the N electrodes. Causing the data acquisition unit to acquire second data having a second data amount; The communication unit transmits the second data to the extracorporeal device in real time.
- a fourth aspect for satisfying the above requirements is a method for controlling an internal device of a brain machine interface system implanted in a living body, Obtaining first data having a first data amount corresponding to the electroencephalogram signals of the living body detected through N (N is 2 or more) electrode groups, and wirelessly transmitting the first data to an extracorporeal device; After the wireless transmission is performed, a designation signal designating a second data amount rather than the first data amount is wirelessly received, Second data having the second data amount corresponding to the electroencephalogram signals of the living body detected through the N electrode groups is acquired, and the second data is wirelessly transmitted to the extracorporeal device in real time.
- a relatively large amount of the first data amount acquired through the N electrode groups is transmitted to the extracorporeal device.
- the timing at which the transmission is performed is, for example, a time when real-time BMI control of the extracorporeal device is not requested. That is, it is given priority over the data transmission speed to reliably deliver as much data as possible to the extracorporeal device. Therefore, the communication unit does not need to have a high data transmission capability.
- the second data amount necessary for performing the desired BMI control can be accurately specified.
- the second data amount smaller than the first data amount is specified so as to match the data transmission capability of the communication unit. Therefore, in the stage where BMI control is actually performed, the data of the second data amount acquired through the N electrode groups is transmitted to the extracorporeal device in real time. Thereby, desired BMI control can be executed without increasing the communication rate.
- FIG. 1 shows a functional configuration of the BMI system 100 according to the first embodiment.
- the BMI system 100 includes an internal device 1 and an external device 200.
- the intracorporeal device 1 is configured to be used by being embedded in the living body 300 (specifically, the head).
- the extracorporeal device 200 is configured to be used outside the living body 300.
- the intracorporeal device 1 includes N electrode groups 2.
- N is an integer of 2 or more.
- Each of the N electrode groups 2 is attached to a predetermined location in the brain of the living body 300 and configured to acquire an electroencephalogram signal at the location.
- the intracorporeal device 1 includes a data acquisition unit 3.
- the data acquisition unit 3 includes an A / D converter.
- Each electroencephalogram signal acquired through the N electrode groups 2 is an analog signal.
- the A / D converter is configured to convert the analog signal into digital data at a predetermined sampling rate and a predetermined resolution.
- Sampling rate corresponds to the frequency at which digital signals are acquired. If the frequency is 1 kHz, 1000 pieces of digital data are acquired from an analog signal for one second.
- the resolution corresponds to the number of values that the digital data can take. If the resolution is 16 bits, the range of values that the amplitude of the input analog signal can take is divided into 16 bits, and one of 2 16 power values is assigned to the amplitude of the input analog signal.
- the intracorporeal device 1 includes a communication unit 5.
- the communication unit 5 is communicably connected to the data acquisition unit 3 and the storage unit 4.
- the communication unit 5 is configured to be able to perform wireless communication with the extracorporeal device 200.
- the communication rate of the communication unit 5 is set lower than the communication rate necessary for transmitting digital data acquired through the N electrode groups 2 in real time.
- the intracorporeal device 1 includes a control unit 6.
- the control unit 6 is connected to the data acquisition unit 3 and the communication unit 5 in a communicable manner.
- the control unit 6 is configured to be able to control operations of the data acquisition unit 3 and the communication unit 5.
- the control unit 6 corresponds to the brain wave signal of the living body 300 detected through the N electrode groups 2, and causes the communication unit 5 to wirelessly transmit all of the digital data acquired by the data acquisition unit 3 to the extracorporeal device 200. It is configured.
- the control unit 6 corresponds to the electroencephalogram signal of the living body 300 detected through the M electrode groups 2a.
- the digital data acquired by the data acquisition unit 3 is configured to cause the communication unit 5 to wirelessly transmit to the extracorporeal device 200 in real time.
- the function of the control unit 6 is realized by software (computer program) executed by the cooperation of a processor and a memory that are communicably connected.
- the processor include a CPU, MPU, GPU and the like.
- the memory include ROM and RAM.
- the function of the control unit 6 can be realized by hardware resources such as an ASIC and FPGA, or by a combination of hardware resources and software.
- the learning phase (S1) is performed.
- the living body 300 is caused to perform a learning operation. Specifically, it causes the living body 300 to perform an operation of actually grasping a hand or to recall an operation of grasping a hand.
- an electroencephalogram corresponding to the learning operation is generated in the brain of the living body 300.
- the electroencephalogram is detected as N electroencephalogram signals by the N electrode groups 2.
- the data acquisition unit 3 acquires digital data corresponding to the N brain wave signals (S2). For example, when the learning operation is for 1 second, digital data corresponding to an electroencephalogram signal for a total of 3 seconds including 1 second before and after that is acquired.
- the control unit 6 causes the communication unit 5 to transmit all the acquired digital data to the extracorporeal device 200 (S4).
- the timing at which transmission is performed includes, for example, a predetermined time and a predetermined time interval when a transmission instruction is input from the user.
- the timing at which transmission is performed may be selected as a timing that does not require real-time monitoring of an electroencephalogram signal.
- the extracorporeal device 200 receives the data transmitted from the intracorporeal device 1 (S5).
- the communication rate of the communication unit 5 is 0.5 Mbps
- the extracorporeal device 200 may be the same as or different from the device that receives the signal transmitted from the intracorporeal device 1 and performs an operation based on the signal.
- the extracorporeal device 200 may be a device that receives a signal transmitted from the intracorporeal device 1 and transmits a control signal that causes another external device to execute an operation based on the signal.
- the extracorporeal device 200 may be a dedicated device for performing analysis described later.
- the data received by the extracorporeal device 200 is subjected to analysis for reducing the amount of transmission data.
- the N electrode groups 2 are arranged at a relatively narrow interval, and there are electrode groups that have a strong correlation and other electrodes that are not involved in BMI control at all.
- M electrode groups 2a (see FIG. 1) having higher priority in the actual BMI control are specified (S6).
- M is an integer smaller than N. The value of M is appropriately selected as the number of channels corresponding to the data amount necessary for BMI control.
- the operation phase (S8) is implemented in the second period after the first period.
- the extracorporeal device 200 is actually subjected to BMI control by the living body 300.
- a predetermined operation corresponding to the operation is executed by the extracorporeal device 200.
- a signal designating the M electrode groups 2a selected based on the above analysis is transmitted from the extracorporeal device 200.
- the signal is received by the communication unit 5 of the in-vivo device 1 (S7).
- the control unit 6 sets so that the data acquisition unit 3 acquires only digital data corresponding to the M brain wave signals acquired through the M electrode groups 2a.
- Change S9.
- the data acquisition unit 3 acquires digital data corresponding to the electroencephalogram signal based on the above settings (S9).
- the control unit 6 causes the communication unit 5 to transmit the digital data acquired by the data acquisition unit 3 to the extracorporeal device 200 in real time (S10). While repeating the operations of S9 and S10 (S12), the extracorporeal device 200 executes a predetermined operation in real time based on the data transmitted from the communication unit 5 (S11).
- the M electrode groups 2a are selected so as to perform desired BMI control. Further, the M electrode groups 2a are selected so that the communication unit 5 can transmit data corresponding to the electroencephalogram signals acquired through them in real time. Therefore, real-time BMI control of the extracorporeal device 200 according to the operation of the living body 300 is realized.
- the operation method using the in-vivo device 1 having the above-described configuration a relatively large amount of data acquired through the N electrode groups 2 is transmitted to the extracorporeal device 200 in the learning phase.
- the delivery of as much data as possible to the extracorporeal device 200 is prioritized over the data transmission rate. That is, the communication unit 5 does not need to have a high data transmission capability.
- M electrode groups 2a that are prioritized for performing desired BMI control can be accurately specified. Further, the M electrode groups 2 a fewer than N are specified so as to match the data transmission capability of the communication unit 5. Therefore, in the operation phase, data corresponding to the electroencephalogram signals acquired through the M electrode groups 2a is transmitted to the extracorporeal device 200 in real time. Thereby, desired BMI control can be executed without increasing the communication rate.
- a storage unit 4 is provided as shown in FIG.
- the storage unit 4 is communicably connected to the data acquisition unit 3.
- the storage unit 4 is configured to be able to store digital data acquired by the data acquisition unit 3.
- the control unit 6 is communicably connected to the storage unit 4. As shown in FIG. 2, the control unit 6 stores the digital data acquired by the data acquisition unit 3 in the storage unit 4 prior to the transmission (S4) (S3).
- the control unit 6 can repeat the steps from S2 through S3 to S4 as necessary (S13). That is, until the desired electroencephalogram signal data necessary for analysis in the learning phase is accumulated, learning operation by the living body 300, acquisition of digital data corresponding to the N electroencephalogram signals acquired through the N electrode groups 2 (S2) ), Storage (S3), and transmission of the digital data to the extracorporeal device 200 (S4) are repeated. According to such a configuration, although the communication frequency between the communication unit 5 and the extracorporeal device 200 increases, the necessity of securing a large capacity for the storage unit 4 is reduced.
- the communication unit Since the digital data can be transmitted at an arbitrary timing by providing the storage unit, the communication unit does not need to have a high data transmission capability not only in the operation phase but also in the learning phase. Therefore, in the learning phase, the effect of reducing power consumption and suppressing heat generation can be expected. Furthermore, since the area of the communication unit tends to increase according to the height of the data transmission capability, the area of the communication unit can be reduced by keeping the data transmission capability low in both the learning and operation phases.
- control unit 6 can repeat the steps S2 and S3 as necessary prior to the transmission (S4) (S14). That is, until the desired electroencephalogram signal data necessary for the analysis in the learning phase is accumulated, the learning operation by the living body 300 and the acquisition of digital data corresponding to the N electroencephalogram signals acquired through the N electrode groups 2 ( S2) and storage (S3) are repeated. Thereafter, the data stored in the storage unit 4 is transmitted to the extracorporeal device 200 in a lump (S4). According to such a configuration, the communication frequency between the communication unit 5 and the extracorporeal device 200 can be reduced. Even in this operation method, by providing the storage unit, the communication unit does not need to have a high data transmission capability even in the learning phase, so that it is possible to reduce power consumption, suppress heat generation, and reduce the size of the communication unit.
- data of an arbitrary electrode group fewer than N may be transmitted to the extracorporeal device 200 in real time.
- the learning operation by the living body 300 is performed until desired electroencephalogram signal data necessary for analysis in the learning phase for one electrode is accumulated.
- the digital data acquisition (S2) corresponding to one electroencephalogram signal acquired through one electrode and the real-time transmission (S4) of the digital data to the extracorporeal device 200 are repeated. If it repeats about an electrode, N pieces of electroencephalogram signal data required for analysis can be acquired (S5). According to such a configuration, the same learning operation needs to be repeated many times, but the storage unit 4 in FIG. 1 and the step S3 in FIG. 2 are not necessary. If the number of electrode data to be transmitted at a time is increased in accordance with the transmission capability of the communication unit 5, the learning phase time can be shortened.
- the communication unit 5 may be capable of transmitting data of all N electrode groups 2 to the extracorporeal device 200 in real time. Also in this case, the process of the memory
- control unit 6 can cause the communication unit 5 to transmit a part of the data stored in the storage unit 4 to the extracorporeal device 200 (S15). Such processing can be performed to confirm whether the intracorporeal device 1 is operating normally. Such processing can be performed when the communication unit 5 receives a command from the extracorporeal device 200.
- control unit 6 transmits all of the data corresponding to the N brain wave signals acquired by the data acquisition unit 3 in the learning phase to the extracorporeal device 200.
- the in-vivo device 1A includes a control unit 6A.
- 6 A of control parts are connected with the data acquisition part 3 and the communication part 5 so that communication is possible.
- the control unit 6A is configured to be able to control operations of the data acquisition unit 3 and the communication unit 5.
- the control unit 6A corresponds to the brain wave signal of the living body 300 detected through the N electrode groups 2, and causes the communication unit 5 to wirelessly transmit all of the digital data acquired by the data acquisition unit 3 to the extracorporeal device 200. It is configured. That is, the first amount of digital data is transmitted to the extracorporeal device 200.
- the control unit 6A corresponds to the brain wave signal of the living body 300 detected through the N electrode groups 2, and
- the data acquisition unit 3 is configured to acquire digital data having two data amounts.
- control unit 6A reduces the data amount of the acquired digital data by reducing the data sampling rate.
- 6A of control parts reduce the data amount of the digital data acquired by reducing the resolution of data.
- the control unit 6A can both reduce the sampling rate and the resolution.
- An example of a decrease in resolution is a decrease from 16 bits to 8 bits.
- the sampling rate and resolution may be reduced through hardware processing or software processing.
- the control unit 6A is configured to cause the communication unit 5 to wirelessly transmit the digital data acquired as described above to the extracorporeal device 200 in real time.
- control unit 6A is realized by software executed by the cooperation of a communicably connected processor and memory.
- processor include a CPU and an MPU.
- memory is a RAM.
- the function of the control unit 6 can be realized by hardware such as ASIC or FPGA, or by a combination of hardware and software.
- the learning phase (S1) is implemented in the first period.
- an electroencephalogram corresponding to the learning operation is generated in the brain of the living body 300.
- the electroencephalogram is detected as N electroencephalogram signals by the N electrode groups 2.
- the data acquisition unit 3 acquires digital data of the first data amount corresponding to the N electroencephalogram signals (S2). For example, when the learning operation is for 1 second, digital data corresponding to an electroencephalogram signal for a total of 3 seconds including 1 second before and after that is acquired.
- the control unit 6A stores the digital data in the storage unit 4 (S3).
- control unit 6A causes the communication unit 5 to transmit all the acquired digital data to the extracorporeal device 200 (S4).
- Data transmission from the communication unit 5 to the extracorporeal device 200 is lower than a value necessary for transmitting the data acquired through the communication unit 5 to the extracorporeal device 200 in real time, that is, data acquired through the N electrode groups 2. This is done at the communication rate.
- the extracorporeal device 200 receives the data transmitted from the intracorporeal device 1 (S5).
- the data received by the extracorporeal device 200 is subjected to analysis for reducing the amount of transmission data.
- the second data amount capable of performing realistic BMI control without exceeding the real-time data transmission capability of the communication unit 5 is specified (S16).
- the operation phase (S8) is implemented in the second period after the first period.
- a signal specifying the second data amount selected based on the above analysis is transmitted from the extracorporeal device 200.
- the signal is received by the communication unit 5 of the in-vivo device 1A (S17).
- the control unit 6A changes the setting so that digital data of the second data amount can be transmitted.
- the control unit 6A reduces at least one of the data sampling rate and resolution.
- the communication rate required for transmitting digital data of the first data amount acquired at the first sampling rate and the first resolution through the N electrode groups 2 to the extracorporeal device 200 in real time is 2 Mbps
- the communication unit 5 is 0.5 Mbps
- the control unit 6A can reduce the digital data acquired as follows to the second data amount. Change the first sampling rate to a quarter second sampling rate. • Change the first resolution to a quarter of the second resolution. -Change the first sampling rate to a second sampling rate of 1/2, and change the first resolution to a second resolution of 1/2 (if the amount of data to be transmitted is 1/4, sampling The combination of rate reduction and resolution reduction can be determined as appropriate).
- data acquired at the first resolution through hardware processing may be converted to the second resolution through subsequent software processing. Further, the resolution and sampling rate may be changed for each electrode.
- the data acquisition unit 3 acquires digital data of the second data amount through the N electrode groups 2 (S18).
- the control unit 6A causes the communication unit 5 to transmit the digital data acquired by the data acquisition unit 3 to the extracorporeal device 200 in real time (S19). While repeating the operations of S18 and S19 (S12), the extracorporeal device 200 executes a predetermined operation in real time based on the data transmitted from the communication unit 5 (S11).
- the second data amount is selected so that the desired BMI control can be performed.
- the second data amount is selected so that the communication unit 5 can transmit the acquired digital data in real time. Therefore, real-time BMI control of the extracorporeal device 200 according to the operation of the living body 300 is realized.
- the learning phase a relatively large amount of first data amount acquired through the N electrode groups 2 is stored in the storage unit 4. Once memorized. The stored data is then transmitted to the extracorporeal device 200. In this phase, the delivery of as much data as possible to the extracorporeal device 200 is prioritized over the data transmission rate. That is, the communication unit 5 does not need to have a high data transmission capability.
- the operation method that does not require the storage unit 4 in the learning phase of the first embodiment can be applied to the second embodiment.
- the second data amount necessary for performing the desired BMI control can be accurately specified. Further, the second data amount is specified so as to match the data transmission capability of the communication unit 5. Therefore, in the operation phase, data corresponding to the electroencephalogram signal acquired through the N electrode groups 2 as it is is transmitted to the extracorporeal device 200 in real time. Thereby, desired BMI control can be executed without increasing the communication rate.
- control unit 6A transmits all the digital data of the first data amount acquired by the data acquisition unit 3 in the learning phase to the extracorporeal device 200. However, it is not always necessary to transmit all the digital data of the first data amount. The amount of data transmitted in the learning phase only needs to exceed the amount of data transmitted in the operation phase.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Neurology (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physiology (AREA)
- Neurosurgery (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Dermatology (AREA)
- Cardiology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Transplantation (AREA)
- Vascular Medicine (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
体外装置と無線通信を行なう通信部と、
前記通信部を制御する制御部と、
を備えており、
前記制御部は、
N個(Nは2以上)の電極群を通じて検出された前記生体の脳波信号に対応するデータを、前記通信部に前記体外装置へ送信させ、
前記送信が行なわれた後で前記通信部が前記N個よりも少ないM個の電極群を指定する指定信号を受信すると、当該M個の電極群を通じて検出された前記生体の脳波信号に対応するデータを、前記通信部にリアルタイムで前記体外装置へ送信させる。
N個(Nは2以上)の電極群を通じて検出された前記生体の脳波信号に対応するデータを体外装置へ無線送信し、
前記無線送信が行なわれた後、前記N個よりも少ないM個の電極群を指定する指定信号を無線受信し、
前記M個の電極群を通じて検出された前記生体の脳波信号に対応するデータをリアルタイムで前記体外装置へ無線送信する。
データ取得部と、
体外装置と無線通信を行なう通信部と、
前記通信部を制御する制御部と、
を備えており、
前記制御部は、
N個(Nは2以上)の電極を通じて検出された前記生体の脳波信号に対応し第一データ量を有する第一データを前記データ取得部に取得させ、
前記通信部に前記第一データを前記体外装置へ送信させ、
前記送信が行なわれた後で前記通信部が前記第一データ量より少ない第二データ量を指定する指定信号を受信すると、前記N個の電極を通じて検出された前記生体の脳波信号に対応し前記第二データ量を有する第二データを前記データ取得部に取得させ、
前記通信部に前記第二データをリアルタイムで前記体外装置へ送信させる。
N個(Nは2以上)の電極群を通じて検出された前記生体の脳波信号に対応し第一データ量を有する第一データを取得し、前記第一データを体外装置へ無線送信し、
前記無線送信が行なわれた後、前記第一データ量よりも第二データ量を指定する指定信号を無線受信し、
前記N個の電極群を通じて検出された前記生体の脳波信号に対応し前記第二データ量を有する第二データを取得し、前記第二データをリアルタイムで前記体外装置へ無線送信する。
・第一サンプリングレートを4分の1の第二サンプリングレートに変更する。
・第一分解能を4分の1の第二分解能に変更する。
・第一サンプリングレートを2分の1の第二サンプリングレートに変更し、第一分解能を2分の1の第二分解能に変更する(送信されるデータ量が4分の1になれば、サンプリングレートの低下量と分解能の低下量の組合せは適宜に定められうる)。
Claims (12)
- 生体内に埋め込まれるブレインマシンインターフェースシステムの体内装置であって、
体外装置と無線通信を行なう通信部と、
前記通信部を制御する制御部と、
を備えており、
前記制御部は、
N個(Nは2以上)の電極群を通じて検出された前記生体の脳波信号に対応するデータを、前記通信部に前記体外装置へ送信させ、
前記送信が行なわれた後で前記通信部が前記N個よりも少ないM個の電極群を指定する指定信号を受信すると、当該M個の電極群を通じて検出された前記生体の脳波信号に対応するデータを、前記通信部にリアルタイムで前記体外装置へ送信させる、
体内装置。 - 記憶部をさらに備えており、
前記制御部は、前記N個の電極群を通じて検出された前記生体の脳波信号に対応するデータの送信に先立ち、前記N個の電極群を通じて検出された前記生体の脳波信号に対応するデータを繰り返し前記記憶部に記憶させる、
請求項1に記載の体内装置。 - 前記制御部は、前記N個の電極群を通じて検出された前記生体の脳波信号に対応するデータの送信に先立って、前記データの一部を、前記通信部に前記体外装置へ送信させる、
請求項1または2に記載の体内装置。 - 生体内に埋め込まれたブレインマシンインターフェースシステムの体内装置の制御方法であって、
N個(Nは2以上)の電極群を通じて検出された前記生体の脳波信号に対応するデータを体外装置へ無線送信し、
前記無線送信が行なわれた後、前記N個よりも少ないM個の電極群を指定する指定信号を無線受信し、
前記M個の電極群を通じて検出された前記生体の脳波信号に対応するデータをリアルタイムで前記体外装置へ無線送信する、
制御方法。 - 記憶部をさらに備えており、
前記記憶部への記憶は、前記N個の電極群を通じて検出された前記生体の脳波信号に対応するデータの送信に先立って繰り返し行なわれる、
請求項4に記載の制御方法。 - 前記データの一部を前記N個の電極群を通じて検出された前記生体の脳波信号に対応するデータの送信に先立って前記体外装置へ無線送信する、
請求項4または5に記載の制御方法。 - 生体内に埋め込まれるブレインマシンインターフェースシステムの体内装置であって、
データ取得部と、
体外装置と無線通信を行なう通信部と、
前記通信部を制御する制御部と、
を備えており、
前記制御部は、
N個(Nは2以上)の電極を通じて検出された前記生体の脳波信号に対応し第一データ量を有する第一データを前記データ取得部に取得させ、
前記通信部に前記第一データを前記体外装置へ送信させ、
前記送信が行なわれた後で前記通信部が前記第一データ量より少ない第二データ量を指定する指定信号を受信すると、前記N個の電極を通じて検出された前記生体の脳波信号に対応し前記第二データ量を有する第二データを前記データ取得部に取得させ、
前記通信部に前記第二データをリアルタイムで前記体外装置へ送信させる、
体内装置。 - 前記データ取得部は、第一サンプリングレートで前記脳波信号をサンプリングすることにより前記第一データを取得し、当該第一サンプリングレートよりも低い第二サンプリングレートで前記脳波信号をサンプリングすることにより前記第二データを取得する、
請求項7に記載の体内装置。 - 前記データ取得部は、第一分解能で前記脳波信号をA/D変換することにより前記第一データを取得し、当該第一分解能より低い第二分解能で前記脳波信号をA/D変換することにより前記第二データを取得する、
請求項7または8に記載の体内装置。 - 生体内に埋め込まれたブレインマシンインターフェースシステムの体内装置の制御方法であって、
N個(Nは2以上)の電極群を通じて検出された前記生体の脳波信号に対応し第一データ量を有する第一データを取得し、
前記第一データを体外装置へ無線送信し、
前記無線送信が行なわれた後、前記第一データ量よりも第二データ量を指定する指定信号を無線受信し、
前記N個の電極群を通じて検出された前記生体の脳波信号に対応し前記第二データ量を有する第二データを取得し、
前記第二データをリアルタイムで前記体外装置へ無線送信する、
制御方法。 - 第一サンプリングレートで前記脳波信号をサンプリングすることにより前記第一データを取得し、当該第一サンプリングレートよりも低い第二サンプリングレートで前記脳波信号をサンプリングすることにより前記第二データを取得する、
請求項10に記載の制御方法。 - 第一分解能で前記脳波信号をA/D変換することにより前記第一データを取得し、当該第一分解能より低い第二分解能で前記脳波信号をA/D変換することにより前記第二データを取得する、
請求項10または11に記載の制御方法。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2018567508A JP7186947B2 (ja) | 2017-02-10 | 2018-02-09 | 体内装置からの通信データ量を変更可能なブレインマシンインターフェースシステム、およびその制御方法 |
| US16/484,922 US11779278B2 (en) | 2017-02-10 | 2018-02-09 | Brain-machine interface system capable of changing amount of communication data from internal device, and control method therefor |
| EP18751161.3A EP3582069B1 (en) | 2017-02-10 | 2018-02-09 | Brain-machine interface system capable of changing amount of communication data from internal device, and control method therefor |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2017023413 | 2017-02-10 | ||
| JP2017-023413 | 2017-02-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018147407A1 true WO2018147407A1 (ja) | 2018-08-16 |
Family
ID=63107546
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2018/004561 Ceased WO2018147407A1 (ja) | 2017-02-10 | 2018-02-09 | 体内装置からの通信データ量を変更可能なブレインマシンインターフェースシステム、およびその制御方法 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11779278B2 (ja) |
| EP (1) | EP3582069B1 (ja) |
| JP (1) | JP7186947B2 (ja) |
| WO (1) | WO2018147407A1 (ja) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021132084A1 (ja) * | 2019-12-26 | 2021-07-01 | 国立大学法人大阪大学 | 抵抗デバイス、集積回路装置、体内埋込装置、及び、補正係数決定方法 |
| WO2022224808A1 (ja) | 2021-04-21 | 2022-10-27 | 株式会社メルティンMmi | 複数の導線から電気信号を取得するための方法、システム、および電極構造、ならびにその電極構造の製造方法 |
| JP2023519968A (ja) * | 2020-04-01 | 2023-05-15 | シンクロン オーストラリア ピーティーワイ リミテッド | 神経関連信号の検知された変化を使用してデバイスを制御するためのシステムおよび方法 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113115474B (zh) * | 2021-03-19 | 2022-07-19 | 苏州景昱医疗器械有限公司 | 在充电同时传输脑电信号的方法及设备 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006020794A2 (en) * | 2004-08-13 | 2006-02-23 | Cyberkinetics Neurotechnology Systems, Inc. | Biological interface systems with controlled device selector and related methods |
| WO2012063377A1 (ja) * | 2010-11-09 | 2012-05-18 | 国立大学法人大阪大学 | 体内埋込装置のケーシングと体内埋込装置、体内埋込装置のケーシングの製造方法、および体内埋込装置を用いた治療支援方法 |
| JP2014036862A (ja) * | 2012-08-17 | 2014-02-27 | Nielsen Co (Us) Llc | 脳波データを収集し解析するためのシステム及び方法 |
| WO2015114347A1 (en) * | 2014-01-30 | 2015-08-06 | University Of Leicester | System for a brain-computer interface |
| WO2015164477A1 (en) * | 2014-04-25 | 2015-10-29 | The General Hospital Corporation | Hybrid system for treating mental and emotional disorders with responsive brain stimulation |
| JP2017023413A (ja) | 2015-07-22 | 2017-02-02 | ファミリーイナダ株式会社 | マッサージ機 |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6230049B1 (en) * | 1999-08-13 | 2001-05-08 | Neuro Pace, Inc. | Integrated system for EEG monitoring and electrical stimulation with a multiplicity of electrodes |
| US8560041B2 (en) * | 2004-10-04 | 2013-10-15 | Braingate Co., Llc | Biological interface system |
| US8073545B2 (en) | 2006-07-21 | 2011-12-06 | Neuropace, Inc. | Treatment and warning of recurring therapy and other events using an implantable device |
| WO2008057365A2 (en) * | 2006-11-02 | 2008-05-15 | Caplan Abraham H | Epileptic event detection systems |
| WO2009025863A1 (en) * | 2007-08-23 | 2009-02-26 | Massachusetts Institute Of Technology | Method and apparatus for reducing the number of channels in an eeg-based epileptic seizure detector |
| US20100280403A1 (en) | 2008-01-11 | 2010-11-04 | Oregon Health & Science University | Rapid serial presentation communication systems and methods |
| US10617361B2 (en) | 2010-11-09 | 2020-04-14 | Osaka University | Casing of implantable device and implantable device, method for manufacturing casing of implantable device, and method for supporting treatment using implantable device |
-
2018
- 2018-02-09 JP JP2018567508A patent/JP7186947B2/ja active Active
- 2018-02-09 EP EP18751161.3A patent/EP3582069B1/en active Active
- 2018-02-09 WO PCT/JP2018/004561 patent/WO2018147407A1/ja not_active Ceased
- 2018-02-09 US US16/484,922 patent/US11779278B2/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006020794A2 (en) * | 2004-08-13 | 2006-02-23 | Cyberkinetics Neurotechnology Systems, Inc. | Biological interface systems with controlled device selector and related methods |
| US20060049957A1 (en) | 2004-08-13 | 2006-03-09 | Surgenor Timothy R | Biological interface systems with controlled device selector and related methods |
| WO2012063377A1 (ja) * | 2010-11-09 | 2012-05-18 | 国立大学法人大阪大学 | 体内埋込装置のケーシングと体内埋込装置、体内埋込装置のケーシングの製造方法、および体内埋込装置を用いた治療支援方法 |
| JP2014036862A (ja) * | 2012-08-17 | 2014-02-27 | Nielsen Co (Us) Llc | 脳波データを収集し解析するためのシステム及び方法 |
| WO2015114347A1 (en) * | 2014-01-30 | 2015-08-06 | University Of Leicester | System for a brain-computer interface |
| WO2015164477A1 (en) * | 2014-04-25 | 2015-10-29 | The General Hospital Corporation | Hybrid system for treating mental and emotional disorders with responsive brain stimulation |
| JP2017023413A (ja) | 2015-07-22 | 2017-02-02 | ファミリーイナダ株式会社 | マッサージ機 |
Non-Patent Citations (3)
| Title |
|---|
| MATSUSHITA, KOJIRO ET AL.: "Development of an Implantable Wireless ECoG Recording Device", JSME ANNUAL CONFERENCE ON ROBOTICS AND MECHATRONICS, 27 May 2012 (2012-05-27), pages 1 - 4, XP032489360 * |
| MATSUSHITA, KOJIRO ET AL.: "Development of an Implantable Wireless ECoG Recording Device", THE 30TH ANNUAL CONFERENCE OF THE ROBOTICS SOCIETY OF JAPAN DVD -ROM 2012, vol. 30, 17 September 2012 (2012-09-17), pages 1 - 3, XP009515583 * |
| TAKIZAWA, KENICHI ET AL.: "Ultra wideband communications for wireless brain-machine interface with an ultra multi-channel neural recording system", IEICE TECHNICAL REPORT, vol. 113, no. 117, 2 July 2013 (2013-07-02), pages 1 - 4, XP055614096 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021132084A1 (ja) * | 2019-12-26 | 2021-07-01 | 国立大学法人大阪大学 | 抵抗デバイス、集積回路装置、体内埋込装置、及び、補正係数決定方法 |
| JPWO2021132084A1 (ja) * | 2019-12-26 | 2021-07-01 | ||
| JP7054967B2 (ja) | 2019-12-26 | 2022-04-15 | 国立大学法人大阪大学 | 抵抗デバイス、集積回路装置、体内埋込装置、及び、補正係数決定方法 |
| US12285600B2 (en) | 2019-12-26 | 2025-04-29 | Osaka University | Resistance device, integrated circuit device, implantable device, and correction factor determining method |
| JP2023519968A (ja) * | 2020-04-01 | 2023-05-15 | シンクロン オーストラリア ピーティーワイ リミテッド | 神経関連信号の検知された変化を使用してデバイスを制御するためのシステムおよび方法 |
| WO2022224808A1 (ja) | 2021-04-21 | 2022-10-27 | 株式会社メルティンMmi | 複数の導線から電気信号を取得するための方法、システム、および電極構造、ならびにその電極構造の製造方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP7186947B2 (ja) | 2022-12-12 |
| US20200054284A1 (en) | 2020-02-20 |
| US11779278B2 (en) | 2023-10-10 |
| EP3582069B1 (en) | 2025-10-22 |
| EP3582069A1 (en) | 2019-12-18 |
| JPWO2018147407A1 (ja) | 2020-02-13 |
| EP3582069A4 (en) | 2020-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018147407A1 (ja) | 体内装置からの通信データ量を変更可能なブレインマシンインターフェースシステム、およびその制御方法 | |
| JP6529263B2 (ja) | 並列生体信号プロセッサ及びその制御方法並びにそれを含む統合生体信号プロセッサ及びそのためのアプリケーションプロセッサ | |
| EP3178379A1 (en) | Method and device for bioelectric physiological signal acquisition and processing | |
| Brunelli et al. | Design considerations for wireless acquisition of multichannel sEMG signals in prosthetic hand control | |
| EP3405256B1 (en) | Apparatus facilitating data buffering and removal | |
| JP6859453B2 (ja) | 複数のデータストリームの表示を管理するデバイス | |
| CN114795243B (zh) | 具有多通道脑电采集与脑电刺激功能的便携式脑机装置 | |
| EP4250069B1 (en) | System for using imagined direction to perform at least one action | |
| CN112843467B (zh) | 视觉假体装置、系统及其控制方法、存储介质 | |
| JP2017079807A (ja) | 生体センサ、生体データ収集端末、生体データ収集システム、及び生体データ収集方法 | |
| KR20230108891A (ko) | 생체 삽입형 기기 및 외부 기기 및 이들의 동작 방법 | |
| CN104644216A (zh) | 肌肉群运动信息的超声检测系统及其方法 | |
| CN103784125A (zh) | 用于生理参数监测的一对多无线数据采集通讯方法 | |
| Badr et al. | 12-lead ecg platform for real-time monitoring and early anomaly detection | |
| CN209019068U (zh) | 振动臂环及触觉检测系统 | |
| Yassin et al. | Rehabilitation biofeedback using EMG signal based on android platform | |
| US10777318B2 (en) | Physician related selective data compression | |
| Navarro et al. | SoC Architecture for Acquisition and Processing of EMG Signals | |
| CN113115474B (zh) | 在充电同时传输脑电信号的方法及设备 | |
| CN117101001A (zh) | 一种基于体外能控器的手势控制方法及装置 | |
| KR102033146B1 (ko) | 전디지털 뇌파 취득 장치 | |
| KR101916418B1 (ko) | 수신 장치의 소비 전력 저감 방법 및 소비 전력 저감 장치 | |
| KR101647944B1 (ko) | 혈당 및 심전도 통합 모니터링 장치 및 방법 | |
| US20210271324A1 (en) | Method, Human Machine Interface, Machine Computing Unit and Computer Programs to Control at Least One Actuator to Carry Out at Least One Task | |
| US7974686B2 (en) | Multi-channel bio-med electric signals capturing device based on a sound signal generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18751161 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2018567508 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2018751161 Country of ref document: EP Effective date: 20190910 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2018751161 Country of ref document: EP |