TWI544365B - Control system of electronic device and method thereof - Google Patents
Control system of electronic device and method thereof Download PDFInfo
- Publication number
- TWI544365B TWI544365B TW103132701A TW103132701A TWI544365B TW I544365 B TWI544365 B TW I544365B TW 103132701 A TW103132701 A TW 103132701A TW 103132701 A TW103132701 A TW 103132701A TW I544365 B TWI544365 B TW I544365B
- Authority
- TW
- Taiwan
- Prior art keywords
- electronic device
- brain wave
- wave
- characteristic
- brain
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 24
- 210000004556 brain Anatomy 0.000 claims description 128
- 238000004458 analytical method Methods 0.000 claims description 15
- 230000004397 blinking Effects 0.000 claims description 5
- 230000009467 reduction Effects 0.000 claims description 4
- 238000000537 electroencephalography Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 5
- 230000018109 developmental process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000003334 potential effect Effects 0.000 description 4
- 241000282414 Homo sapiens Species 0.000 description 3
- 210000004027 cell Anatomy 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 210000003710 cerebral cortex Anatomy 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006266 hibernation Effects 0.000 description 2
- 230000006996 mental state Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000007958 sleep Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 206010062519 Poor quality sleep Diseases 0.000 description 1
- 206010038743 Restlessness Diseases 0.000 description 1
- 206010041235 Snoring Diseases 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000004958 brain cell Anatomy 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 210000000624 ear auricle Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 210000000744 eyelid Anatomy 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 210000002442 prefrontal cortex Anatomy 0.000 description 1
- 230000002360 prefrontal effect Effects 0.000 description 1
- 230000000272 proprioceptive effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 235000015096 spirit Nutrition 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Description
本發明係有關於一種電子裝置的控制系統及其方法，且特別是有關於一種利用腦波對於電子裝置進行控制之系統及其方法。 The present invention relates to a control system for an electronic device and a method thereof, and more particularly to a system and method for controlling an electronic device using brain waves.
科技的發展往往源自於人類的需求，在電子產品上的發展也不例外，電子產品的開發除了朝向體積越小，重量越輕，功能越多，效能越高的方向發展之外，在使用者的介面上，近年來也有諸多的發展。早期電子產品的輸入方式，都是以鍵盤，指向器(pointer)，比如滑鼠，數位板，觸控筆等為主，都需要一個周邊的輸入裝置來達成。近年來為了便利使用者操作，許多新的輸入介面陸續被廣泛的使用。舉例來說，電容式的觸控面板，可以直接利用手指進行輸入；語音輸入裝置，利用聲音進行輸入；體感控制輸入，利用身體的動作或手勢進行輸入，等等。這些廣泛地應用於我們日常生活的電子產品中，諸如智慧型手機，智慧型電視，電視遊樂器等等。 The development of science and technology often originates from the needs of human beings. The development of electronic products is no exception. The development of electronic products is not only the smaller the volume, the lighter the weight, the more functions, the higher the efficiency, the use of In the interface of the people, there have been many developments in recent years. The input methods of early electronic products were mainly keyboards, pointers, such as mouse, tablet, stylus, etc., all of which required a peripheral input device to achieve. In recent years, in order to facilitate user operations, many new input interfaces have been widely used. For example, a capacitive touch panel can be directly input using a finger; a voice input device that inputs using sound; a somatosensory control input, input using a body motion or gesture, and the like. These are widely used in the electronic products of our daily life, such as smart phones, smart TVs, video games and so on.
因此，如何提供更便利的使用者介面，可以方便使用者對於電子裝置進行輸入及控制，一直都是此技術領域持續研發的重要課題。 Therefore, how to provide a more convenient user interface, which is convenient for the user to input and control the electronic device, has always been an important subject for continuous research and development in this technical field.
本發明的觀點之一就是提供一種電子裝置的控制系統及其 方法，可以利用腦波對於電子裝置進行輸入或控制。 One of the viewpoints of the present invention is to provide a control system for an electronic device and The method can use brain waves to input or control an electronic device.
根據本發明上述及其他觀點，提供一種電子裝置的控制方法，應用於一電子裝置中，該電子裝置至少包括一顯示模組、一作業系統與一應用程式。本發明電子裝置的控制方法包括：接收一腦波訊號；運算該腦波訊號以產生一特徵腦波，當該特徵腦波超過一預定臨界值，產生一控制訊號；以及根據該控制訊號，控制該電子裝置的一操作，其中該操作係選自於由該顯示模組的影像捲動、該顯示模組的影像放大/縮小、該作業系統的鎖定/解鎖、該應用程式的選擇及其組合所組成組群的一種操作。 According to the above and other aspects of the present invention, a method for controlling an electronic device is provided for use in an electronic device, the electronic device including at least a display module, an operating system, and an application. The control method of the electronic device of the present invention comprises: receiving a brain wave signal; calculating the brain wave signal to generate a characteristic brain wave, generating a control signal when the characteristic brain wave exceeds a predetermined threshold; and controlling according to the control signal An operation of the electronic device, wherein the operation is selected from an image scrolling by the display module, an image enlargement/reduction of the display module, locking/unlocking of the operating system, selection of the application, and combinations thereof An operation of the group.
在本發明的一個或多個實施例中，特徵腦波係由α波，β波，γ波，δ波及θ波至少其中之一所組成。電子裝置包括電腦，智慧型行動電話，智慧型電視等。 In one or more embodiments of the present invention, the characteristic brain wave system is composed of at least one of an alpha wave, a beta wave, a gamma wave, a delta wave, and a theta wave. Electronic devices include computers, smart mobile phones, and smart TVs.
根據本發明上述及其他觀點，提供一種電子裝置控制系統，用以控制一電子裝置，該電子裝置至少包含一顯示模組、一儲存媒體以及一控制模組，該儲存媒體儲存一作業系統與一應用程式，該控制模組電性連接該顯示模組與該儲存媒體。本發明電子裝置控制系統包含一腦波接收模組以及一腦波分析模組。腦波接收模組接收一使用者之一腦波訊號。腦波分析模組電性連接該腦波接收模組，自該腦波接收模組接收該腦波訊號，運算該腦波訊號以產生一特徵腦波，當該特徵腦波超過一預定臨界值，輸出一控制訊號至該控制模組，使該控制模組依據該控制訊號，操作該作業系統、該應用程式或該顯示模組。 According to the above and other aspects of the present invention, an electronic device control system is provided for controlling an electronic device. The electronic device includes at least a display module, a storage medium, and a control module. The storage medium stores an operating system and a The control module is electrically connected to the display module and the storage medium. The electronic device control system of the present invention comprises a brain wave receiving module and an brain wave analyzing module. The brain wave receiving module receives a brain wave signal of one of the users. The brain wave analysis module is electrically connected to the brain wave receiving module, and receives the brain wave signal from the brain wave receiving module, and calculates the brain wave signal to generate a characteristic brain wave, when the characteristic brain wave exceeds a predetermined threshold And outputting a control signal to the control module, so that the control module operates the operating system, the application or the display module according to the control signal.
在本發明的一個或多個實施例中，特徵腦波包括專注度特徵腦波、穩定度特徵腦波、眨眼特徵腦波及其組合。腦波訊號包括：α波，β 波，γ波，δ波，θ波或其組合。 In one or more embodiments of the invention, the characteristic brain waves include a concentration feature brain wave, a stability feature brain wave, a blink feature brain wave, and combinations thereof. Brain wave signals include: alpha wave, beta Wave, gamma wave, delta wave, theta wave or a combination thereof.
在本發明的一個或多個實施例中，腦波分析模組可以整合於電子裝置中或與腦波接收模組整合。操作作業系統包括鎖定/解鎖作業系統。操作顯示模組包括捲動顯示模組的一影像，或放大/縮小顯示模組的一影像。操作應用程式包括致動/關閉應用程式的其中之一。 In one or more embodiments of the present invention, the brain wave analysis module can be integrated into the electronic device or integrated with the brain wave receiving module. Operating the operating system includes locking/unlocking the operating system. The operation display module includes an image of the scroll display module or an image of the display module that is enlarged/reduced. Operating the application includes one of the actuating/closing applications.
藉由本發明的電子裝置的控制系統及其方法，可以利用專注度特徵腦波、穩定度特徵腦波、眨眼特徵腦波對於電子裝置進行輸入或操作，而無須透過任何動作，手勢或語音，可以更方便使用者進行輸入或操控。 The control system and the method of the electronic device of the present invention can utilize the concentration characteristic brain wave, the stability characteristic brain wave, the blink characteristic brain wave to input or operate the electronic device without any action, gesture or voice. It is more convenient for the user to input or manipulate.
100‧‧‧電子裝置的控制方法 100‧‧‧Electronic device control method
110、111、112、114、116、118、120、122‧‧‧步驟 110, 111, 112, 114, 116, 118, 120, 122‧‧‧ steps
200、300‧‧‧電子裝置控制系統 200, 300‧‧‧ Electronic device control system
210‧‧‧腦波接收模組 210‧‧‧ brain wave receiving module
212‧‧‧腦波分析模組 212‧‧‧Earth Wave Analysis Module
214、314‧‧‧電子裝置 214, 314‧‧‧ electronic devices
216‧‧‧電子裝置 216‧‧‧Electronic devices
218‧‧‧顯示模組 218‧‧‧ display module
220‧‧‧儲存媒體 220‧‧‧Storage media
222‧‧‧作業系統 222‧‧‧ operating system
224‧‧‧應用程式 224‧‧‧Application
圖一繪示依照本發明一實施例的一種電子裝置的控制方法的流程圖。 FIG. 1 is a flow chart of a method for controlling an electronic device according to an embodiment of the invention.
圖二繪示依照本發明一實施例的一種電子裝置控制系統之方塊圖。 2 is a block diagram of an electronic device control system in accordance with an embodiment of the invention.
圖三繪示依照本發明另一實施例的一種電子裝置控制系統之方塊圖。 3 is a block diagram of an electronic device control system in accordance with another embodiment of the present invention.
關於本發明的優點，精神與特徵，將以實施例並參照所附圖式，進行詳細說明與討論。值得注意的是，為了讓本發明能更容易理解，後附的圖式僅為示意圖，相關尺寸並非以實際比例繪示。 The advantages, spirits and features of the present invention will be described and discussed in detail by reference to the accompanying drawings. It is to be noted that, in order to make the invention more comprehensible, the appended drawings are only schematic representations, and the related dimensions are not shown in actual scale.
為了讓本發明的優點，精神與特徵可以更容易且明確地了解，後續將以實施例並參照所附圖式進行詳述與討論。值得注意的是，這 些實施例僅為本發明代表性的實施例，其中所舉例的特定方法，裝置，條件，材質等並非用以限定本發明或對應的實施例。 For the sake of the advantages and spirit of the invention, the spirit and the features may be more easily and clearly understood, and the detailed description and discussion will be made by way of example and with reference to the accompanying drawings. It is worth noting that this The embodiments are merely representative of the present invention, and the specific methods, devices, conditions, materials, and the like are not intended to limit the invention or the corresponding embodiments.
大腦的電位活動反映著人的生心理狀態，可藉由量測大腦皮層上的電位活動來觀察記錄，大腦皮質的電流是發生在細胞外的電流，是由細胞群與其他細胞群之間的電位差所形成。然而這些電位活動的變化非常微弱，所以需藉由放大器處理後，在以波形呈現，上述之電位變化即為腦電波，又稱為腦電圖(Electroencephalography，簡稱EEG)，是大腦重要的生理參數。許多研究證實，可透過腦部各電極點的電位活動測量來檢驗其生心理運作的歷程，包括思想、情緒、慾望等，皆為腦細胞之電位差反應所呈現出來，透過腦電圖(EEG)具有高度的時間解析度，且能夠立即紀錄與直接呈現腦部運作歷程，是一種常見且非侵入式的專注力(attention)或穩定度(mediation)的檢測方式。依據腦電圖儀與臨床生理學會國際聯盟的分類將腦波的頻率由低至高細分為：δ波(0.5~4Hz)、θ波(4~7Hz)、α波(8~13Hz)、β波(14~30Hz)，γ波(30Hz~100+Hz)，α波代表一個人最清醒、安靜、穩定且專注的狀態；β波代表情緒涉入工作狀態，是處於緊張、焦慮或興奮、不安等高度思維時的腦波；θ波(4~7Hz)代表人在一種輕眠、打盹的狀態，正常成人在覺醒狀態下很少出現θ波；δ波代表人的睡眠狀態，正常成人在清醒狀態下沒有δ波；γ波則與意識感知有關。 The potential activity of the brain reflects the state of human psychology. It can be observed by measuring the potential activity on the cerebral cortex. The current in the cerebral cortex is the current that occurs outside the cell, and is between the cell population and other cell populations. A potential difference is formed. However, the change of these potential activities is very weak, so it needs to be represented by a waveform after being processed by an amplifier. The above potential change is brain wave, also known as electroencephalography (EEG), which is an important physiological parameter of the brain. . Many studies have confirmed that the course of the psychological operation of the brain can be tested through the measurement of potential activity at various electrode points in the brain, including thoughts, emotions, desires, etc., which are presented by the potential difference reaction of brain cells through the electroencephalogram (EEG). It has a high degree of time resolution and is capable of immediately recording and directly presenting the brain's operational history. It is a common and non-invasive method of detecting attention or mediation. According to the classification of the EEG and the International Union of Clinical Physiology, the frequency of brain waves is subdivided from low to high: δ wave (0.5~4Hz), θ wave (4~7Hz), α wave (8~13Hz), β wave (14~30Hz), γ wave (30Hz~100+Hz), α wave represents the most awake, quiet, stable and focused state of a person; β wave represents emotion involved in working state, is nervous, anxious or excited, restless, etc. The brain wave in high thinking; θ wave (4~7Hz) represents a state of light sleep and snoring. Normal adults rarely appear θ wave in awakening state; δ wave represents human sleep state, normal adult is awake state There is no delta wave; gamma waves are related to consciousness perception.
許多研究發現腦波特徵的變化與專注力集中程度息息相關，α波、β波、θ波的振幅、頻率的變化都可直接呈現不同的專注力程度。Prinzel et al.(2001)發現α波減少及θ波的增加對工作負荷及專心有明顯的相關；其它研究指出當受測者專心於心算的測驗時，其α波的振 幅比平時較為減少，且當θ波及低頻β波的增加，對於專注力集中、記憶力增加有明顯的提升效果(Mecklinger et al.1992；Kilmesch et al.1993)。Sauseng et al.2007提到θ波除了與專注、情緒經驗、維持及內化的注意力有關外，也與持續性注意力及資源的分配、本體感覺訊息處理過程、任務複雜性有所關聯。α波振幅會因感官刺激、自主動作及認知活動而降低，而α波振幅的降低且頻率提升則表示腦部處於激發(專注)狀態(Pfurtscheller & Klimesch 1992)。 Many studies have found that the changes in brain wave characteristics are closely related to the concentration of concentration. The amplitudes and frequency changes of α wave, β wave and θ wave can directly show different degrees of concentration. Prinzel et al. (2001) found that alpha wave reduction and θ wave increase have a significant correlation between workload and concentration; other studies have shown that when the subject is focused on mental arithmetic, the amplitude of the alpha wave is less than usual. Moreover, when the θ wave and the low-frequency β wave increase, there is a significant improvement effect on concentration of concentration and memory increase (Mecklinger et al. 1992; Kilmesch et al. 1993). Sauseng et al. 2007 mentions that θ waves are related to attention, emotional experience, maintenance, and internalization, as well as to persistent attention and resource allocation, proprioceptive message processing, and task complexity. The alpha wave amplitude is reduced by sensory stimulation, autonomous motion, and cognitive activity, while a decrease in alpha wave amplitude and an increase in frequency indicate that the brain is in an excited (focused) state (Pfurtscheller & Klimesch 1992).
目前市面上已有一些產品可以進行腦波的偵測與採集。舉例來說，NeuroSky近年來致力於發展輕量化的腦機介面(Brain Computer Interface；BCI)裝置，MindWave為其發展之腦波耳機，藉由單一乾式電極傳感器，置於前額葉處，採集大腦產生之生物訊號，其參考電極和電路接地系統連接於左耳垂，採樣頻率為512Hz。其獨家技術ThinkGearTM晶片整合了對原始腦電訊號進行採集、濾波、放大、轉換、分析等數位訊號處理功能，通過eSenseTM演算法將個人之心理狀態以數字化作一個呈現的方式，並且可區分為專注度(Attention)與穩定度(Mediation)，該精神狀態以0到100表示。 There are currently some products on the market that can detect and collect brain waves. For example, NeuroSky has been working on the development of a lightweight Brain Computer Interface (BCI) device in recent years. MindWave developed its brainwave headphones, which are placed in the prefrontal cortex by a single dry electrode sensor. The generated biological signal has a reference electrode and a circuit grounding system connected to the left earlobe at a sampling frequency of 512 Hz. Its exclusive technology, ThinkGearTM chip, integrates digital signal processing functions such as acquisition, filtering, amplification, conversion, and analysis of original EEG signals. The eSenseTM algorithm digitizes the individual's mental state into a presentation and can be differentiated into focus. Attention and Mediation, the mental state is represented by 0 to 100.
此外，由於偵測腦波的方法都是在前額葉處，而眼睛十分靠近偵測點，且角膜或眼皮肌肉運動時會帶微量電荷，所以往往在腦波採集中，會同時採集到因為眨眼所造成的波形。目前業界是將其視為一種腦波之干擾波，但已經可以用一些方法將其擷取出來，或是過濾出來。然而，目前並沒有針對這部分的波形進行應用。 In addition, since the methods of detecting brain waves are in the prefrontal lobe, and the eyes are very close to the detection point, and the cornea or eyelid muscles move with a small amount of electric charge, they are often collected in the brain wave collection. The waveform caused by blinking. At present, the industry regards it as a kind of interference wave of brain waves, but it can be taken out by some methods or filtered out. However, there is currently no application for this part of the waveform.
請先參照圖一，其繪示依照本發明一實施例的一種電子裝置 的控制方法的流程圖。本發明的電子裝置的控制方法100包括下列步驟：首先步驟110為接收一腦波訊號，可以透過腦電圖(EEG)的裝置偵測使用者的腦波訊號，例如上述的腦波耳機。而腦電圖中的腦波訊號包括δ波(0.5~4Hz)、θ波(4~7Hz)、α波(8~13Hz)、β波(14~30Hz)，γ波(30Hz~100+Hz)。步驟111，將這些腦波訊號經過特定的分析與運算，可以取得一特徵腦波，如上所述，比如是專注度特徵腦波、穩定度特徵腦波、眨眼特徵腦波或其組合。然而本發明不限於上述的特徵腦波，任何可以偵測獲得，且可以經由學習或訓練強化的特徵腦波，都可以應用於本發明的控制系統中。步驟112，在本發明的某些實施例中，會預設這些特徵腦波分別的臨界值，當所測得的特徵腦波超過預定臨界值，即會產生特定的控制訊號(步驟114)。也就是說，當使用者專注度超過一定的程度，穩定度超過一定程度或是以特定方式眨眼時，會使得所測得之特徵腦波超過預定臨界值，即產生控制訊號(如步驟114)，而這些特徵腦波超過預定臨界值時，可以分別產生對應不同的控制訊號。 Please refer to FIG. 1 , which is a flow chart of a method for controlling an electronic device according to an embodiment of the invention. The control method 100 of the electronic device of the present invention comprises the following steps: First, in step 110, a brain wave signal is received, and an electroencephalogram (EEG) device can be used to detect a user's brain wave signal, such as the above-mentioned brain wave earphone. The brain wave signals in the EEG include δ wave (0.5~4Hz), θ wave (4~7Hz), α wave (8~13Hz), β wave (14~30Hz), γ wave (30Hz~100+Hz). ). Step 111: After a specific analysis and operation of the brain wave signals, a characteristic brain wave can be obtained, as described above, for example, a concentration characteristic brain wave, a stability characteristic brain wave, a blink characteristic brain wave, or a combination thereof. However, the present invention is not limited to the above-described characteristic brain waves, and any characteristic brain wave that can be detected and can be enhanced by learning or training can be applied to the control system of the present invention. Step 112, in some embodiments of the present invention, preset threshold values of the characteristic brain waves, and when the measured characteristic brain waves exceed a predetermined threshold, a specific control signal is generated (step 114). That is to say, when the user's concentration exceeds a certain degree, the stability exceeds a certain degree or blinks in a specific manner, the measured characteristic brain wave exceeds a predetermined threshold, that is, a control signal is generated (step 114). When the characteristic brain waves exceed a predetermined threshold, different control signals may be generated respectively.
如步驟116所示，控制訊號傳輸至電子裝置，並依據控制訊號，控制電子裝置。舉例而言，當專注度特徵腦波超過預定臨界值時，可以產生對應顯示模組的控制訊號，而當眨眼特徵腦波超過預定臨界值時，可以產生對應應用程式的控制訊號。電子裝置的種類包括電腦(包含個人電腦，筆記型電腦，平板電腦等)，智慧型行動電話，智慧型電視等。電子裝置至少包括一處理器，一顯示模組，一儲存媒體，及一輸入/輸出模組等，而儲存媒體，比如是硬碟，固態硬碟，光碟，或記憶體等，可以用來儲存作業系統，及各種應用程式或檔案。電子裝置可以依據控制訊號內容，對 於其硬體或軟體進行操作。舉例而言，如步驟118所示，可以根據控制訊號操作顯示模組，比如顯示模組中影像的捲動(scrolling)，或者顯示模組中影像的放大/縮小(scaling)等。如步驟120所示，也可以根據控制訊號操作作業系統，比如作業系統的鎖定/解鎖，作業系統休眠/關機等等。如步驟122所示，更可以根據控制訊號操作應用程式或檔案，比如應用程式或檔案的選擇/開啟/關閉等等。然而，本發明並不限於上述電子裝置的操作，電子裝置的各種硬體，韌體，軟體的操作，都可以利用本發明的方法進行控制。 As shown in step 116, the control signal is transmitted to the electronic device, and the electronic device is controlled according to the control signal. For example, when the concentration characteristic brain wave exceeds a predetermined threshold, a control signal corresponding to the display module may be generated, and when the blink characteristic brain wave exceeds a predetermined threshold, a control signal corresponding to the application may be generated. The types of electronic devices include computers (including personal computers, notebook computers, tablet computers, etc.), smart mobile phones, and smart TVs. The electronic device includes at least a processor, a display module, a storage medium, and an input/output module, and the storage medium, such as a hard disk, a solid state hard disk, a compact disk, or a memory, can be used for storing Operating system, and various applications or files. The electronic device can be based on the content of the control signal, Operate on its hardware or software. For example, as shown in step 118, the display module can be operated according to the control signal, such as scrolling of the image in the display module, or scaling/scaling of the image in the display module. As shown in step 120, the operating system can also be operated according to the control signal, such as locking/unlocking of the operating system, operating system sleep/shutdown, and the like. As shown in step 122, the application or file can be operated according to the control signal, such as selection/on/off of the application or file, and the like. However, the present invention is not limited to the operation of the above electronic device, and the operation of various hardware, firmware, and software of the electronic device can be controlled by the method of the present invention.
值得一提的是，本發明的電子裝置控制方法，可以將特徵腦波與電子裝置的操作做任意的對應或組合。舉例而言，當使用者專注電子裝置到達一定程度，使得專注度特徵腦波超過預定臨界值時，可以產生控制訊號，以進行顯示模組的影像捲動。而當使用者在一特定時間內連續眨眼特定次數，使得眨眼特徵腦波超過預定臨界值時，可以產生另一控制訊號，以進行應用程式之選擇。或者，當使用者冥想達到一定程度使得穩定度特徵腦波超過預定臨界值，且同時在一特定時間內連續眨眼特定次數，使得眨眼特徵腦波超過預定臨界值時，可以產生另一控制訊號，以進行作業系統的鎖定。然而本發明電子裝置控制方法，並不限於上述的控制對應及組合方式，熟習此技藝者可以依照需求，將特徵腦波與電子裝置的控制作適當的對應與組合。 It is worth mentioning that the electronic device control method of the present invention can arbitrarily correspond or combine the characteristic brain waves with the operation of the electronic device. For example, when the user concentrates on the electronic device to a certain extent, so that the concentration characteristic brain wave exceeds a predetermined threshold, a control signal can be generated to perform image scrolling of the display module. When the user blinks a certain number of times in a specific time so that the blinking brainwave exceeds a predetermined threshold, another control signal can be generated for the application selection. Alternatively, when the user meditation reaches a certain level such that the stability characteristic brain wave exceeds a predetermined threshold and simultaneously blinks a certain number of times in a specific time, so that the blink characteristic brain wave exceeds a predetermined threshold, another control signal may be generated. To lock the operating system. However, the electronic device control method of the present invention is not limited to the above-described control correspondence and combination manner, and those skilled in the art can appropriately associate and combine the characteristic brain waves with the control of the electronic device according to requirements.
接著，請參照圖二，圖二繪示依照本發明一實施例的一種電子裝置控制系統之方塊圖。本發明電子裝置控制系統200，用以控制一電子裝置214，本發明電子裝置控制系統200包括：一腦波接收模組210以及一腦波分析模組212。腦波接收模組210適於配戴於使用者之頭部，用以接收使 用者之腦波訊號，諸如δ波(0.5~4Hz)、θ波(4~7Hz)、α波(8~13Hz)、β波(14~30Hz)，γ波(30Hz~100+Hz)。腦波分析模組212電性連接腦波接收模組210，自腦波接收模組210接收腦波訊號，運算腦波訊號以產生一特徵腦波，諸如專注度特徵腦波、穩定度特徵腦波、眨眼特徵腦波或其組合。當特徵腦波超過一預定臨界值，輸出一控制訊號。電子裝置214至少包括一控制模組216、一顯示模組以及一儲存媒體220。儲存媒體220比如是硬碟，固態硬碟，光碟，或記憶體等，用來儲存至少一作業系統222以及至少一應用程式224或檔案。控制模組216例如是處理器(processor)，電性連接腦波分析模組212，並接收控制訊號，且電性連接顯示模組218與儲存媒體220，並依據控制訊號，操作作業系統222，操作應用程式224，或操作顯示模組218。如上所述，這些操作包括：顯示模組中影像的捲動(scrolling)，或者顯示模組中影像的放大/縮小(scaling)，作業系統的鎖定/解鎖，作業系統休眠/關機，應用程式或檔案的選擇/開啟/關閉等等。然而，本發明並不限於上述電子裝置的操作，電子裝置的各種硬體，韌體，軟體的操作，都可以利用本發明的系統進行控制。 Next, please refer to FIG. 2. FIG. 2 is a block diagram of an electronic device control system according to an embodiment of the invention. The electronic device control system 200 of the present invention is used to control an electronic device 214. The electronic device control system 200 of the present invention comprises: a brain wave receiving module 210 and an brain wave analyzing module 212. The brain wave receiving module 210 is adapted to be worn on the head of the user for receiving brain waves of the user, such as δ wave (0.5~4Hz), θ wave (4~7Hz), and α wave (8~13Hz). ), β wave (14~30Hz), γ wave (30Hz~100+Hz). The brain wave analysis module 212 is electrically connected to the brain wave receiving module 210, receives the brain wave signal from the brain wave receiving module 210, and calculates the brain wave signal to generate a characteristic brain wave, such as a concentration characteristic brain wave, a stability characteristic brain. Wave, blinking brain waves or a combination thereof. When the characteristic brain wave exceeds a predetermined threshold, a control signal is output. The electronic device 214 includes at least a control module 216, a display module, and a storage medium 220. The storage medium 220 is, for example, a hard disk, a solid state hard disk, a compact disk, or a memory, for storing at least one operating system 222 and at least one application 224 or file. The control module 216 is, for example, a processor, is electrically connected to the brain wave analysis module 212, and receives the control signal, and is electrically connected to the display module 218 and the storage medium 220, and operates the operating system 222 according to the control signal. The application 224 is operated, or the display module 218 is operated. As described above, these operations include: scrolling of images in the display module, or scaling of images in the display module, locking/unlocking of the operating system, hibernation/shutdown of the operating system, application or File selection / on / off and more. However, the present invention is not limited to the operation of the above electronic device, and the operation of various hardware, firmware, and software of the electronic device can be controlled by the system of the present invention.
在本發明的一個或多個實施例中，特徵腦波包括專注度特徵腦波、穩定度特徵腦波、眨眼特徵腦波及其組合。而特徵腦波與電子裝置操作的控制，可以做任意的對應與組合，如上所述。在本實施例中，腦波接收模組210與腦波分析模組212可以整合於一裝置中，比如NeuroSky所發展輕量化的腦機介面(Brain Computer Interface；BCI)裝置，MindWave腦波耳機。 In one or more embodiments of the invention, the characteristic brain waves include a concentration feature brain wave, a stability feature brain wave, a blink feature brain wave, and combinations thereof. The control of the characteristic brain wave and the operation of the electronic device can be arbitrarily matched and combined as described above. In this embodiment, the brain wave receiving module 210 and the brain wave analysis module 212 can be integrated into a device, such as a lightweight Brain Interface Interface (BCI) device developed by NeuroSky, and a MindWave brain wave earphone.
請參照圖三，圖三繪示依照本發明另一實施例的一種電子裝 置控制系統之方塊圖。圖三中與圖二相同標號表示相同或類似的元件，可參照圖二之說明，在此不再贅述。圖三與圖二的主要不同在於，本實施例的電子裝置控制系統300中，腦波分析模組212整合於電子裝置314中。在實務上，腦波分析模組212對於腦波訊號需要較多較複雜的運算，以產生特徵腦波，如果就耗電量或運算效能的考量，可以將腦波分析模組212整合於電子裝置314，而由控制模組216(處理器)進行運算。值得一提的是，圖二中腦波分析模組212與控制模組216間的連接，或者圖三中腦波接收模組210與腦波分析模組212的連接，可以是有線或者是無線的電性連接，其中無線的方式，可以包括藍芽，射頻傳輸，WiFi,3G或LTE。 Please refer to FIG. 3 , which illustrates an electronic device according to another embodiment of the present invention. Set the block diagram of the control system. The same reference numerals in FIG. 3 as those in FIG. 2 denote the same or similar elements, and the description of FIG. 2 can be referred to, and details are not described herein again. The main difference between FIG. 3 and FIG. 2 is that the brain wave analysis module 212 is integrated in the electronic device 314 in the electronic device control system 300 of the embodiment. In practice, the brain wave analysis module 212 requires more complicated operations for the brain wave signal to generate characteristic brain waves. If the power consumption or computational efficiency is considered, the brain wave analysis module 212 can be integrated into the electron. The device 314 is operated by the control module 216 (processor). It is worth mentioning that the connection between the brain wave analysis module 212 and the control module 216 in FIG. 2 or the connection between the brain wave receiving module 210 and the brain wave analysis module 212 in FIG. 3 may be wired or wireless. The electrical connection, which wireless way, can include Bluetooth, RF transmission, WiFi, 3G or LTE.
綜上所述，藉由本發明的電子裝置的控制系統及其方法，可以利用專注度特徵腦波、穩定度特徵腦波、眨眼特徵腦波及其任意組合等特徵腦波，對於電子裝置進行輸入或操作，包括顯示模組中影像的捲動，或者顯示模組中影像的放大/縮小，作業系統的鎖定/解鎖，作業系統休眠/關機，應用程式或檔案的選擇/開啟/關閉等等。使用者無須透過任何動作，手勢或語音，利用意念就可以更方便地讓使用者進行輸入或操控。 In summary, with the control system and method of the electronic device of the present invention, characteristic brain waves such as concentration characteristic brain waves, stability characteristic brain waves, blinking characteristic brain waves, and any combination thereof can be utilized for inputting electronic devices or The operation includes scrolling of the image in the display module, or enlargement/reduction of the image in the display module, locking/unlocking of the operating system, hibernation/shutdown of the operating system, selection/on/off of the application or file, and the like. The user does not need to use any action, gesture or voice, and the idea can be more convenient for the user to input or manipulate.
藉由以上較佳具體實施例之詳述，係希望能更加清楚描述本發明之特徵與精神，而並非以上述所揭露的較佳具體實施例來對本發明之範疇加以限制。相反地，其目的是希望能涵蓋各種改變及具相等性的安排於本發明所欲申請之專利範圍的範疇內。雖然本發明已以實施方式揭露如上，然其並非用以限定本發明，任何熟習此技藝者，在不脫離本創作之精神和範圍內，當可作各種之更動與潤飾，因此本發明之保護範圍當視後附之申請專利範圍所界定者為準。 The features and spirit of the present invention will be more apparent from the detailed description of the preferred embodiments. On the contrary, the intention is to cover various modifications and equivalents within the scope of the invention as claimed. The present invention has been disclosed in the above embodiments, and is not intended to limit the present invention. Any one skilled in the art can make various modifications and retouchings without departing from the spirit and scope of the present invention. The scope is subject to the definition of the scope of the patent application attached.
100‧‧‧電子裝置的控制方法 100‧‧‧Electronic device control method
110、111、112、114、116、118、120、122‧‧‧步驟 110, 111, 112, 114, 116, 118, 120, 122‧‧‧ steps
Claims (8)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410338964.7A CN104102348A (en) | 2014-07-16 | 2014-07-16 | Control system and method of electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201604717A TW201604717A (en) | 2016-02-01 |
| TWI544365B true TWI544365B (en) | 2016-08-01 |
Family
ID=51670549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW103132701A TWI544365B (en) | 2014-07-16 | 2014-09-23 | Control system of electronic device and method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104102348A (en) |
| TW (1) | TWI544365B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104936028B (en) * | 2015-06-30 | 2019-01-11 | 深圳市九洲电器有限公司 | Set-top box control method, device, set-top box and system based on brain wave signal |
| CN105389004A (en) * | 2015-10-22 | 2016-03-09 | 上海斐讯数据通信技术有限公司 | Brain wave unlocking terminal screen system and method |
| CN106371580B (en) * | 2015-12-31 | 2019-04-16 | 北京智谷睿拓技术服务有限公司 | It receives ear and determines method and apparatus |
| CN106994689B (en) * | 2016-01-23 | 2020-07-28 | 鸿富锦精密工业(武汉)有限公司 | Intelligent robot system and method based on electroencephalogram signal control |
| US20180184935A1 (en) * | 2017-01-04 | 2018-07-05 | BrainCo Inc. | Systems and methods for neuro-feedback training using iot devices |
| CN106873777A (en) * | 2017-01-20 | 2017-06-20 | 李云昊 | Mobile phone operation method and system based on brain electric control |
| CN106970710A (en) * | 2017-03-31 | 2017-07-21 | 深圳市魔眼科技有限公司 | A kind of machine open/close method and headset equipment based on brain wave |
| CN108388340B (en) * | 2018-02-11 | 2021-01-29 | Oppo广东移动通信有限公司 | Electronic equipment control method and related products |
| CN108399326A (en) * | 2018-02-12 | 2018-08-14 | 广东欧珀移动通信有限公司 | Electronic device, display control method and related product |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5638826A (en) * | 1995-06-01 | 1997-06-17 | Health Research, Inc. | Communication method and system using brain waves for multidimensional control |
| US6529773B1 (en) * | 2001-08-01 | 2003-03-04 | The United States Of America As Represented By The Secretary Of The Air Force | Communication and control by means of brainwave and other processes causing voltage changes that can be measured from the body |
| US9211078B2 (en) * | 2010-09-03 | 2015-12-15 | Faculdades Católicas, a nonprofit association, maintainer of the Pontificia Universidade Católica of Rio de Janeiro | Process and device for brain computer interface |
| CN102289285B (en) * | 2011-08-16 | 2016-06-08 | 海尔集团公司 | A kind of method realizing electronic equipment is controlled based on consciousness |
| CN103246344A (en) * | 2012-02-02 | 2013-08-14 | 联想(北京)有限公司 | Method for controlling electronic device and electronic device |
-
2014
- 2014-07-16 CN CN201410338964.7A patent/CN104102348A/en active Pending
- 2014-09-23 TW TW103132701A patent/TWI544365B/en active
Also Published As
| Publication number | Publication date |
|---|---|
| TW201604717A (en) | 2016-02-01 |
| CN104102348A (en) | 2014-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI544365B (en) | Control system of electronic device and method thereof | |
| CN109464130B (en) | Sleep assisting method, system and readable storage medium | |
| Panahi et al. | Application of fractional Fourier transform in feature extraction from ELECTROCARDIOGRAM and GALVANIC SKIN RESPONSE for emotion recognition | |
| KR20180094907A (en) | Drowsiness start detection technique | |
| Kosmyna et al. | AttentivU: Designing EEG and EOG compatible glasses for physiological sensing and feedback in the car | |
| CN108348157B (en) | Heart Rate Detection Using a Multipurpose Capacitive Touch Sensor | |
| Wang et al. | Integration of artificial intelligence and wearable internet of things for mental health detection | |
| Peng et al. | Fatigue evaluation using multi-scale entropy of EEG in SSVEP-based BCI | |
| Xia et al. | Asynchronous brain–computer interface based on steady-state visual-evoked potential | |
| US20170031440A1 (en) | Brain-controlled interface system and candidate optimization for same | |
| JP6710636B2 (en) | Local collection of biosignals, cursor control in bioelectric signal-based speech assist interface, and bioelectric signal-based alertness detection | |
| Ang et al. | A user-friendly wearable single-channel EOG-based human-computer interface for cursor control | |
| Pinho et al. | myBrain: a novel EEG embedded system for epilepsy monitoring | |
| CN209107350U (en) | Biofeedback Consciousness Disorder Detection and Awakening System | |
| Gorur et al. | Glossokinetic potential based tongue–machine interface for 1-D extraction | |
| Zhao et al. | Wearable EEG-based real-time system for depression monitoring | |
| KR20200128900A (en) | System and method of neuro feedback for improving study concentration and digital detox | |
| CN103690161A (en) | Wearable electroencephalogram sleeping quality evaluator | |
| Schmitz et al. | 3DA: Assessing 3D-Printed Electrodes for Measuring Electrodermal Activity | |
| CN103690162B (en) | Wearable electroencephalogram waking state detector | |
| CN108837271B (en) | Electronic device, method for outputting prompt information, and related products | |
| Nguyen et al. | LIBS: a low-cost in-ear bioelectrical sensing solution for healthcare applications | |
| CN203619552U (en) | Wearable electroencephalogram waking state detector | |
| CN113729732B (en) | Sleep quality monitoring system and method based on EEG signal | |
| Palumbo et al. | An embedded system for EEG acquisition and processing for brain computer interface applications |