CN114594854B - Electronic equipment control method and device, electronic equipment and storage medium - Google Patents
Electronic equipment control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114594854B CN114594854B CN202011440841.6A CN202011440841A CN114594854B CN 114594854 B CN114594854 B CN 114594854B CN 202011440841 A CN202011440841 A CN 202011440841A CN 114594854 B CN114594854 B CN 114594854B
- Authority
- CN
- China
- Prior art keywords
- frequency
- concentration value
- relationship
- control
- flashing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Dermatology (AREA)
- General Health & Medical Sciences (AREA)
- Neurology (AREA)
- Neurosurgery (AREA)
- User Interface Of Digital Computer (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
本公开是关于一种电子设备的控制方法及装置、电子设备及存储介质。所述电子设备的控制方法,包括:显示与预设对象对应的闪烁光;其中,不同所述预设对象对应的闪烁光的闪烁频率不同;获取在显示所述预设对象时目标用户的脑电波,其中,所述脑电波包括:阿尔法脑波和贝达脑波;根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值;根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作。
The present disclosure relates to a control method and device of an electronic device, an electronic device and a storage medium. The control method of the electronic device includes: displaying a flashing light corresponding to a preset object; wherein the flashing frequencies of the flashing lights corresponding to different preset objects are different; obtaining the brain waves of the target user when the preset object is displayed, wherein the brain waves include: alpha brain waves and beta brain waves; determining a concentration value according to the amplitude of the alpha brain wave whose frequency has a first relationship with the flashing frequency and the amplitude of the beta brain wave whose frequency has a second relationship with the flashing frequency; and controlling the electronic device to perform an operation associated with the corresponding preset object according to the concentration value.
Description
技术领域Technical Field
本公开涉及电器设备技术领域,尤其涉及一种电子设备的控制方法及装置、电子设备及存储介质。The present disclosure relates to the technical field of electrical equipment, and in particular to a control method and device for an electronic device, an electronic device, and a storage medium.
背景技术Background technique
目前对于脑电信号研究大多应用于脑机接口和神经反馈,而脑机接口技术通过采集脑电信号,并进行脑点信号处理从而提取出脑电信号的特征;根据提取的特征控制电子设备执行对应的操作。Currently, research on EEG signals is mostly applied to brain-computer interfaces and neural feedback. Brain-computer interface technology collects EEG signals and processes them to extract the characteristics of the EEG signals; the electronic devices are controlled to perform corresponding operations based on the extracted characteristics.
但是在相关技术中,基于脑电信号进行电子设备的控制,具有比较大的延时或控制精度低;导致电子设备的响应速率慢及用户的使用体验差的问题。However, in the related art, the control of electronic devices based on EEG signals has relatively large delay or low control accuracy, which leads to slow response rate of electronic devices and poor user experience.
发明内容Summary of the invention
本公开提供一种电子设备的控制方法及装置、电子设备及存储介质。The present disclosure provides a control method and device for an electronic device, an electronic device, and a storage medium.
本公开实施例第一方面提供一种电子设备的控制方法,包括:A first aspect of an embodiment of the present disclosure provides a control method for an electronic device, including:
显示与预设对象对应的闪烁光;其中,不同所述预设对象对应的闪烁光的闪烁频率不同;Displaying flashing lights corresponding to preset objects; wherein the flashing frequencies of the flashing lights corresponding to different preset objects are different;
获取在显示所述预设对象时目标用户的脑电波,其中,所述脑电波包括:阿尔法脑波和贝达脑波;Acquiring the brain waves of the target user when the preset object is displayed, wherein the brain waves include: alpha brain waves and beta brain waves;
根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值;determining a concentration value based on the amplitude of the alpha brain wave having a frequency having a first relationship to the flicker frequency and the amplitude of the beta brain wave having a frequency having a second relationship to the flicker frequency;
根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作。According to the concentration value, the electronic device is controlled to perform an operation associated with the corresponding preset object.
基于上述方案,所述预设对象包括:操作控件;所述显示与预设对象关联的闪烁光,包括:Based on the above solution, the preset object includes: an operation control; the flashing light associated with the preset object includes:
在第一页面的显示时长达到第一预设时长后,显示提示信息,其中,所述提示信息上具有操作控件及与所述操作控件对应的闪烁光。After the display time of the first page reaches a first preset time, a prompt message is displayed, wherein the prompt message has an operation control and a flashing light corresponding to the operation control.
基于上述方案,所述提示信息上显示有确定控件和/或取消控件;Based on the above solution, a confirmation control and/or a cancel control is displayed on the prompt information;
所述闪烁光包括:以第一频率闪烁的第一闪烁光及以第二频率闪烁的第二闪烁光;The flashing light comprises: a first flashing light flashing at a first frequency and a second flashing light flashing at a second frequency;
所述第一闪烁光在所述确认控件确定控件的显示区间内闪烁光;所述第二闪烁光在所述取消控件的显示区域间内闪烁。The first flashing light flashes within the display interval of the confirmation control; the second flashing light flashes within the display area of the cancellation control.
基于上述方案,所述根据频率域所述闪烁光的闪烁频率具有第一关系的所述阿尔法脑波振幅和频率域所述闪烁光的闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值,包括:Based on the above scheme, determining the concentration value according to the amplitude of the alpha brain wave having a first relationship with the flickering frequency of the flickering light in the frequency domain and the amplitude of the beta brain wave having a second relationship with the flickering frequency of the flickering light in the frequency domain comprises:
根据与所述第一频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第一频率具有第二关系的所述贝达脑波的振幅,确定执行所述确定控件关联的确定操作的所述集中度值;determining the concentration value for performing a determination operation associated with the determination control based on the amplitude of the alpha brainwave having the first relationship with the first frequency and the amplitude of the beta brainwave having a second relationship with the first frequency based on frequency;
或者,or,
根据与所述第二频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第二频率具有第二关系的所述贝达脑波的振幅,确定执行所述取消控件关联的取消操作的所述集中度值。The concentration value for executing a cancel operation associated with the cancel control is determined based on the amplitude of the alpha brainwave having the first relationship with the second frequency and the amplitude of the beta brainwave having a second relationship with the second frequency based on frequency.
基于上述方案,所述第一闪烁光的光波频率不同于所述第二闪烁光的光波频率。Based on the above solution, the light wave frequency of the first scintillation light is different from the light wave frequency of the second scintillation light.
基于上述方案,所述根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值,包括:Based on the above scheme, determining the concentration value according to the amplitude of the alpha brain wave whose frequency has a first relationship with the flicker frequency and the amplitude of the beta brain wave whose frequency has a second relationship with the flicker frequency includes:
确定第一时刻频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅能量及频率与所述闪烁频率具有第一关系的所述阿尔法脑波的最大振幅能量之间的第一比值;Determine a first ratio between the amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency at a first moment and the maximum amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency;
确定所述第一时刻所述频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅能量及所述频率与所述闪烁频率具有第二关系的所述贝达脑波的最大振幅能量之间的第二比值;Determine a second ratio between the amplitude energy of the Beda brain wave whose frequency has a second relationship with the flicker frequency and the maximum amplitude energy of the Beda brain wave whose frequency has a second relationship with the flicker frequency at the first moment;
根据所述第一比值及所述第二比值,得到所述集中度值。The concentration value is obtained according to the first ratio and the second ratio.
基于上述方案,所述根据所述第一比值及所述第二比值,得到所述集中度值,包括:Based on the above solution, obtaining the concentration value according to the first ratio and the second ratio includes:
计算所述第一比值和所述第二比值的差,得到所述集中度值。The difference between the first ratio and the second ratio is calculated to obtain the concentration value.
基于上述方案,所述根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作,包括:Based on the above solution, controlling the electronic device to perform an operation associated with the corresponding preset object according to the concentration value includes:
若所述集中度值满足预设条件,控制所述电子设备执行与所述操作控件关联的操作。If the concentration value meets a preset condition, the electronic device is controlled to perform an operation associated with the operation control.
基于上述方案,所述集中度值满足预设条件,包括:Based on the above solution, the concentration value meets the preset conditions, including:
所述集中度值的波峰值大于第一阈值;The peak value of the concentration value is greater than a first threshold;
和/或,and / or,
所述集中度值的波谷值小于第二阈值;The trough value of the concentration value is less than a second threshold value;
其中,所述第二阈值小于所述第一阈值。The second threshold is smaller than the first threshold.
基于上述方案,所述方法,还包括:Based on the above solution, the method further includes:
在第n检测时刻的集中度值位于预设区间时,确定所述第n检测时刻的集中度值与第 n-1检测时刻的集中度值之间的第一斜率,并确定所述第n检测时刻的集中度值与第n+1检测时刻的集中度值之间的第二斜率;所述集中度值位于预设区间包括:集中度值大于所述第一阈值或集中度值所小于述第二阈值;其中,所述n为正整数;When the concentration value at the nth detection moment is within a preset interval, a first slope between the concentration value at the nth detection moment and the concentration value at the n-1th detection moment is determined, and a second slope between the concentration value at the nth detection moment and the concentration value at the n+1th detection moment is determined; the concentration value being within the preset interval includes: the concentration value being greater than the first threshold or the concentration value being less than the second threshold; wherein n is a positive integer;
若所述第一斜率的符号和所述第二斜率的符号相反,确定所述集中度值的波峰值大于所述第一阈值或者所述集中度值的波谷值小于所述第二阈值。If the sign of the first slope is opposite to the sign of the second slope, it is determined that the peak value of the concentration value is greater than the first threshold or the trough value of the concentration value is less than the second threshold.
基于上述方案,所述方法还包括:在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面。Based on the above solution, the method further includes: if the concentration value satisfying the preset condition is not detected within a second preset time period from the start of displaying the first page, controlling the electronic device to switch to displaying the second page.
基于上述方案,所述方法还包括:Based on the above solution, the method further includes:
获取所述目标用户的眼电波;Acquiring eye waves of the target user;
根据所述眼电波的眼电特征,控制电子设备进行显示页面的切换。According to the electrooculographic characteristics of the electrooculographic waves, the electronic device is controlled to switch the display page.
本公开实施例第二方面提供一种电子设备的控制装置,包括:A second aspect of an embodiment of the present disclosure provides a control device for an electronic device, including:
显示模块,用于显示与预设对象对应的闪烁光;其中,不同所述预设对象对应的闪烁光的闪烁频率不同;A display module, used for displaying flashing lights corresponding to preset objects; wherein the flashing frequencies of the flashing lights corresponding to different preset objects are different;
获取模块,用于获取在显示所述预设对象时目标用户的脑电波,其中,所述脑电波包括:阿尔法脑波和贝达脑波;An acquisition module, used for acquiring the brain waves of the target user when the preset object is displayed, wherein the brain waves include: alpha brain waves and beta brain waves;
确定模块,用于根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值;a determination module, configured to determine a concentration value according to an amplitude of the alpha brain wave having a frequency having a first relationship with the flickering frequency and an amplitude of the beta brain wave having a frequency having a second relationship with the flickering frequency;
控制模块,用于根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作。A control module is used to control the electronic device to perform an operation associated with the corresponding preset object according to the concentration value.
基于上述方案,所述预设对象包括:操作控件;所述显示模块,具体用于在第一页面的显示时长达到第一预设时长后,显示提示信息,其中,所述提示信息上具有操作控件及与所述操作控件对应的闪烁光。Based on the above scheme, the preset object includes: an operation control; the display module is specifically used to display a prompt message after the display time of the first page reaches a first preset time, wherein the prompt message has an operation control and a flashing light corresponding to the operation control.
基于上述方案,所述提示信息上显示有确定控件和/或取消控件;Based on the above solution, a confirmation control and/or a cancel control is displayed on the prompt information;
所述闪烁光包括:以第一频率闪烁的第一闪烁光及以第二频率闪烁的第二闪烁光;The flashing light comprises: a first flashing light flashing at a first frequency and a second flashing light flashing at a second frequency;
所述第一闪烁光在所述确定控件的显示区间内闪烁;所述第二闪烁光在所述取消控件的显示区域间内闪烁。The first flashing light flashes within the display interval of the confirmation control; the second flashing light flashes within the display area of the cancellation control.
基于上述方案,所述确定模块,用于根据与所述第一频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第一频率具有第二关系的所述贝达脑波的振幅,确定执行所述确定控件关联的确定操作的所述集中度值;或者,根据与所述第二频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第二频率具有第二关系的所述贝达脑波的振幅,确定执行所述取消控件关联的取消操作的所述集中度值。Based on the above scheme, the determination module is used to determine the concentration value for executing the determination operation associated with the determination control according to the amplitude of the alpha brain wave having the first relationship with the first frequency and the amplitude of the beta brain wave having the second relationship with the first frequency according to frequency; or, to determine the concentration value for executing the cancellation operation associated with the cancellation control according to the amplitude of the alpha brain wave having the first relationship with the second frequency and the amplitude of the beta brain wave having the second relationship with the second frequency according to frequency.
基于上述方案,所述第一闪烁光的光波频率不同于所述第二闪烁光的光波频率。Based on the above solution, the light wave frequency of the first scintillation light is different from the light wave frequency of the second scintillation light.
基于上述方案,所述确定模块,具体用于确定第一时刻频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅能量及频率与所述闪烁频率具有第一关系的所述阿尔法脑波的最大振幅能量之间的第一比值;确定所述第一时刻所述频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅能量及所述频率与所述闪烁频率具有第二关系的所述贝达脑波的最大振幅能量之间的第二比值;根据所述第一比值及所述第二比值,得到所述集中度值。Based on the above scheme, the determination module is specifically used to determine a first ratio between the amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency at the first moment and the maximum amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency; determine a second ratio between the amplitude energy of the beta brain wave whose frequency has a second relationship with the flicker frequency at the first moment and the maximum amplitude energy of the beta brain wave whose frequency has a second relationship with the flicker frequency; and obtain the concentration value according to the first ratio and the second ratio.
基于上述方案,所述确定模块,还用于计算所述第一比值和所述第二比值的差,得到所述集中度值。Based on the above solution, the determination module is further used to calculate the difference between the first ratio and the second ratio to obtain the concentration value.
基于上述方案,所述控制模块,用于若所述集中度值满足预设条件,控制所述电子设备执行与所述操作控件关联的操作。Based on the above solution, the control module is used to control the electronic device to perform an operation associated with the operation control if the concentration value meets a preset condition.
基于上述方案,所述集中度值满足预设条件,包括:所述集中度值的波峰值大于第一阈值;和/或,所述集中度值的波谷值小于第二阈值;Based on the above solution, the concentration value satisfies the preset conditions, including: the peak value of the concentration value is greater than the first threshold; and/or the trough value of the concentration value is less than the second threshold;
其中,所述第二阈值小于所述第一阈值。The second threshold is smaller than the first threshold.
基于上述方案,所述装置,还包括:Based on the above solution, the device further includes:
斜率模块,用于在第n检测时刻的集中度值位于预设区间时,确定所述第n检测时刻的集中度值与第n-1检测时刻的集中度值之间的第一斜率,并确定所述第n检测时刻的集中度值与第n+1检测时刻的集中度值之间的第二斜率;所述集中度值位于预设区间包括:集中度值大于所述第一阈值或集中度值所小于述第二阈值;其中,所述n为正整数;A slope module, for determining a first slope between the concentration value at the nth detection moment and the concentration value at the n-1th detection moment, and determining a second slope between the concentration value at the nth detection moment and the concentration value at the n+1th detection moment when the concentration value at the nth detection moment is within a preset interval; the concentration value being within the preset interval includes: the concentration value being greater than the first threshold or the concentration value being less than the second threshold; wherein n is a positive integer;
若所述第一斜率的符号和所述第二斜率的符号相反,确定所述集中度值的波峰值大于所述第一阈值或者所述集中度值的波谷值小于所述第二阈值。If the sign of the first slope is opposite to the sign of the second slope, it is determined that the peak value of the concentration value is greater than the first threshold or the trough value of the concentration value is less than the second threshold.
基于上述方案,所述控制模块,还用于在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面。Based on the above solution, the control module is further used to control the electronic device to switch to displaying the second page if the concentration value that meets the preset condition is not detected within a second preset time period from the start of displaying the first page.
基于上述方案,所述获取模块,用于获取在显示所述第一页面和/或所述提示信息时所述目标用户的眼电波;Based on the above solution, the acquisition module is used to acquire the eye waves of the target user when the first page and/or the prompt information is displayed;
所述控制模块,还用于根据所述眼电波的眼电特征,控制电子设备进行显示页面的切换。The control module is also used to control the electronic device to switch the display page according to the electrooculographic characteristics of the electrooculographic wave.
在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面本公开实施例第三方面提供一种电子设备,包括:If the concentration value satisfying the preset condition is not detected within a second preset time period from the start of displaying the first page, the electronic device is controlled to switch to displaying the second page. If the concentration value satisfying the preset condition is not detected within a second preset time period from the start of displaying the first page, the electronic device is controlled to switch to displaying the second page. A third aspect of an embodiment of the present disclosure provides an electronic device, including:
用于存储处理器可执行指令的存储器;a memory for storing processor-executable instructions;
处理器,与所述存储器连接;A processor connected to the memory;
其中,所述处理器被配置为执行如第一方面任意一个技术方案提供的电子设备的控制方法。The processor is configured to execute a control method for an electronic device as provided by any one of the technical solutions of the first aspect.
本公开实施例第四方面提供一种非临时性计算机可读存储介质,当所述存储介质中的指令由计算机的处理器执行时,使得计算机能够执行如第一方面任意一个技术方案提供的电子设备的控制方法。本公开的实施例提供的技术方案可以包括以下有益效果:A fourth aspect of the embodiments of the present disclosure provides a non-transitory computer-readable storage medium, and when the instructions in the storage medium are executed by a processor of a computer, the computer can execute the control method of the electronic device provided by any technical solution of the first aspect. The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects:
本公开实施例提供的技术方案,一方面,会结合脑电信号中的阿尔法脑波和贝达脑波,共同确定表征目标用户观看第一页面的注意力的集中程度的集中度值,从而可以快速的确定出目标用户的意愿(或意图),从而生成与用户的意愿(或意图)对应的第一类控制指令,控制电子设备执行所述控制指令;从而降低了使用脑电信号进行电子设备的控制延时,提升了使用脑电信号控制电子设备的响应速率,并进一步提升了用户满意度。另外一方面,为了精确采用脑电信号控制电子设备,会显示与预设对象对应的闪烁光,不同所述预设对象对应的闪烁光的闪烁频率不同;进一步通过不同闪烁频率的闪烁光对人脑的脑电信号的影响,提升控制精度。The technical solution provided by the disclosed embodiment, on the one hand, will combine the alpha brain waves and beta brain waves in the EEG signal to jointly determine the concentration value that characterizes the degree of concentration of the target user's attention when viewing the first page, so that the target user's intention (or intent) can be quickly determined, thereby generating a first type of control instruction corresponding to the user's intention (or intent), and controlling the electronic device to execute the control instruction; thereby reducing the control delay of the electronic device using EEG signals, improving the response rate of the electronic device controlled by EEG signals, and further improving user satisfaction. On the other hand, in order to accurately use EEG signals to control electronic devices, flashing lights corresponding to preset objects will be displayed, and the flashing frequencies of the flashing lights corresponding to different preset objects are different; further, the control accuracy is improved by the influence of flashing lights of different flashing frequencies on the EEG signals of the human brain.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
图1是根据一示例性实施例示出的电子设备的控制方法的流程示意图;FIG1 is a schematic flow chart of a method for controlling an electronic device according to an exemplary embodiment;
图2是根据一示例性实施例示出的佩戴检测设备的目标用户的效果示意图;FIG2 is a schematic diagram showing the effect of a target user wearing a detection device according to an exemplary embodiment;
图3是根据一示例性实施例示出的确定集中度值的流程示意图;FIG3 is a schematic diagram of a process of determining a concentration value according to an exemplary embodiment;
图4是根据一示例性实施例示出的集中度值在时域的波形示意图;FIG4 is a waveform diagram of a concentration value in the time domain according to an exemplary embodiment;
图5是根据一示例性实施例示出的电子设备的控制方法的流程示意图;FIG5 is a schematic flow chart of a method for controlling an electronic device according to an exemplary embodiment;
图6是根据一示例性实施例示出的电子设备的控制方法的流程示意图;FIG6 is a schematic flow chart of a method for controlling an electronic device according to an exemplary embodiment;
图7是根据一示例性实施例示出的眼电波的波形示意图;FIG7 is a schematic diagram of an electrooculogram waveform according to an exemplary embodiment;
图8是根据一示例性实施例示出的电子设备的结构示意图。Fig. 8 is a schematic structural diagram of an electronic device according to an exemplary embodiment.
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置的例子。Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices consistent with some aspects of the present disclosure as detailed in the appended claims.
如图1所示,本公开实施例提供一种电子设备的控制方法,该控制方法应用于电子设备中。该电子设备的控制方法可包括:As shown in FIG1 , an embodiment of the present disclosure provides a control method for an electronic device, and the control method is applied to the electronic device. The control method for the electronic device may include:
S110:显示与预设对象对应的闪烁光;其中,不同所述预设对象对应的闪烁光的闪烁频率不同;S110: Displaying a flashing light corresponding to a preset object; wherein the flashing frequencies of the flashing lights corresponding to different preset objects are different;
S120:获取在显示所述预设对象时目标用户的脑电波,其中,所述脑电波包括:阿尔法脑波和贝达脑波;S120: Acquire brain waves of the target user when the preset object is displayed, wherein the brain waves include: alpha brain waves and beta brain waves;
S130:根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值;S130: determining a concentration value according to the amplitude of the alpha brain wave whose frequency has a first relationship with the flickering frequency and the amplitude of the beta brain wave whose frequency has a second relationship with the flickering frequency;
S140:根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作。S140: According to the concentration value, control the electronic device to perform an operation associated with the corresponding preset object.
本公开实施例中,该电子设备包括但不限于:各种移动终端和/或固定终端。该移动终端包括但不限于:手机、平板电脑或者可穿戴式设备等。所述固定终端包括:个人电脑(Personal Computer,PC)或投影设备等。In the embodiments of the present disclosure, the electronic device includes but is not limited to: various mobile terminals and/or fixed terminals. The mobile terminal includes but is not limited to: a mobile phone, a tablet computer or a wearable device, etc. The fixed terminal includes: a personal computer (PC) or a projection device, etc.
在一个实施例中,所述电子设备可为屏幕的面积小于第一预设值的小屏设备,小屏设备对于用户的手动触控可能不太方便;或者,所述电子设备可为:显示面积大于第二预设值的大显示设备。所述第二预设值大于第一预设值。此处的大显示设备为投影设备,投影设备悬挂在墙壁上,可能需要专门的控制设备进行控制。如此,用户离开控制设备就不太好控制。而本公开实施例中,目标用户可以佩戴检测设备通过脑电信号进行简化控制。In one embodiment, the electronic device may be a small-screen device whose screen area is smaller than a first preset value, and the small-screen device may not be convenient for the user's manual touch; or, the electronic device may be a large display device whose display area is larger than a second preset value. The second preset value is larger than the first preset value. The large display device here is a projection device, which is hung on the wall and may require a special control device for control. In this way, it is not easy to control when the user leaves the control device. In the embodiment of the present disclosure, the target user can wear a detection device for simplified control through EEG signals.
所述预设对象包括但不限于:操作控件、图片或者文字或者连接。The preset objects include but are not limited to: operation controls, pictures or text or connections.
示例性地,所述预设对象可为:购物页面上可供购买的商品或者服务的描述信息。Exemplarily, the preset object may be: description information of goods or services available for purchase on a shopping page.
示例性地,所述预设对象可为对话框和/或提示信息上内的确认控件和/或取消控件。Exemplarily, the preset object may be a confirmation control and/or a cancel control in a dialog box and/or prompt information.
示例性地,所述预设对象还可为:“上一页”及“下一页”等翻页控件。Exemplarily, the preset object may also be page turning controls such as “previous page” and “next page”.
所述目标用户可为佩戴有检测脑电波的检测设备的用户,或者,观看所述电子设备显示的预设对象的用户。The target user may be a user wearing a detection device for detecting brain waves, or a user viewing a preset object displayed by the electronic device.
所述检测设备可预先与所述电子设备建立有连接。这种连接可以是有线连接,也可以是无线连接。例如,无线连接包括但不限于蓝牙连接或WiFi直连、或者,通过互联网建立有网络连接。该互联网络可包括:接入网和核心网等。接入网包括但不限于:蜂窝移动通信的接入网和/或WiFi热点构建的WiFi网络。所述核心网络连接在接入网的后端,实现不同接入网或者同一个接入网连接的多个设备之间的数据交互。该数据交互包括:脑电波的检测数据。The detection device may be pre-connected with the electronic device. This connection may be a wired connection or a wireless connection. For example, the wireless connection includes but is not limited to a Bluetooth connection or a WiFi direct connection, or a network connection is established through the Internet. The Internet may include: an access network and a core network, etc. The access network includes but is not limited to: an access network for cellular mobile communications and/or a WiFi network constructed by a WiFi hotspot. The core network is connected to the back end of the access network to realize data interaction between different access networks or multiple devices connected to the same access network. The data interaction includes: brain wave detection data.
在一个实施例中,所述脑电波可为检测设备检测的。如图2所示,目标用户在头部佩戴有脑动头带作为检测设备,检测目标用户的脑电信号。如此,电子设备可以从检测设备接收得到前述脑电波。例如,电子设备从检测设备接收脑电信号的原始信号,通过信号分解,得到不同频率的脑电波;根据阿尔法脑波和贝达脑波的频率范围,就可以提取出检测的目标用户的阿尔法脑波和贝达脑波。In one embodiment, the brain waves can be detected by a detection device. As shown in FIG2 , the target user wears a brain-activated headband as a detection device to detect the target user's brain waves. In this way, the electronic device can receive the aforementioned brain waves from the detection device. For example, the electronic device receives the original signal of the brain wave from the detection device, and obtains brain waves of different frequencies by signal decomposition; according to the frequency range of the alpha brain wave and the beta brain wave, the alpha brain wave and the beta brain wave of the detected target user can be extracted.
图2中目标用户手持的手机可为本公开实施例中的电子设备。The mobile phone held by the target user in FIG. 2 may be the electronic device in the embodiment of the present disclosure.
在一个实施例中,所述与所述预设对象关联的闪烁光,可包括:显示在预设对象对应的显示范围内闪烁光,但不限于显示在预设对象的显示区间内的闪烁光。In one embodiment, the flashing light associated with the preset object may include: flashing light displayed within a display range corresponding to the preset object, but is not limited to flashing light displayed within a display interval of the preset object.
例如,将一个显示屏划分为多个显示区间,不同的操作控件显示在不同的显示区间内,一个操作控件可以占满一个显示区间,也可以仅仅占据显示区间的部分区域。For example, a display screen is divided into multiple display intervals, and different operation controls are displayed in different display intervals. An operation control may occupy a whole display interval or only a part of the display interval.
在一个实施例中,所述与所述预设对象的闪烁光,还可包括以下至少之一:In one embodiment, the flashing light associated with the preset object may further include at least one of the following:
显示在预设对象上的闪烁光;Flashing lights displayed on preset objects;
包围预设对象的闪烁光;A flashing light that surrounds a preset object;
在一个实施例中,在预设对象上或者预设对象的周围提供闪烁光。如此目标用户观看哪个预设对象,则会对应闪烁光的闪烁频率,产生与该闪烁光频率相呼应的阿尔法脑波和贝达脑波。阿尔法脑波和贝达脑波的频率与闪烁频率之间的相呼应的关系,可认为:阿尔法脑波和贝达脑波的频率,分别与闪烁频率正相关。例如,闪烁光的闪烁频率越高,则阿尔法脑波和贝达脑波的频率也越高。In one embodiment, a flashing light is provided on or around a preset object. In this way, the preset object viewed by the target user will correspond to the flashing frequency of the flashing light, and generate alpha brain waves and beda brain waves corresponding to the flashing frequency. The corresponding relationship between the frequencies of the alpha brain waves and beda brain waves and the flashing frequency can be considered that the frequencies of the alpha brain waves and beda brain waves are positively correlated with the flashing frequency, respectively. For example, the higher the flashing frequency of the flashing light, the higher the frequencies of the alpha brain waves and beda brain waves.
可以理理解地,所述闪烁光为可见光的一种,由电子设备的显示屏显示或者投影仪投影出闪烁光的效果。例如,所述闪烁光可包括:可见光波段范围内的红光和/或蓝光。It can be understood that the flickering light is a type of visible light, and the flickering light effect is displayed by a display screen of an electronic device or projected by a projector. For example, the flickering light may include: red light and/or blue light within the visible light band.
在一个实施例中,若操作控件有多个,则不同预设对象对应的闪烁光的闪烁频率不同。In one embodiment, if there are multiple operation controls, the flashing frequencies of the flashing lights corresponding to different preset objects are different.
在另一个实施例中,若操作控件有多个,则不同预设对象对应的闪烁光的闪烁频率不同的同时,闪烁光的光频率也不同。In another embodiment, if there are multiple operation controls, the flashing frequencies of the flashing lights corresponding to different preset objects are different, and the light frequencies of the flashing lights are also different.
在本公开实施例中,至少会获取阿尔法脑波和贝达脑波的振幅。根据这两种脑波的振幅综合确定出表征目标用户观看预设对象的注意力高低的集中度值。阿尔法脑波的振幅和贝达脑波的振幅,反应了目标用户的脑部的活跃程度。In the disclosed embodiment, at least the amplitudes of the alpha brain wave and the beta brain wave are obtained. A concentration value representing the degree of attention of the target user when viewing the preset object is determined based on the amplitudes of the two brain waves. The amplitudes of the alpha brain wave and the beta brain wave reflect the activity level of the target user's brain.
本公开实施例提供的技术方案,一方面,会结合脑电信号中的阿尔法脑波和贝达脑波,共同确定表征目标用户观看第一页面的注意力的集中程度的集中度值,从而可以快速的确定出目标用户的意愿(或意图),从而生成与用户的意愿(或意图)对应的第一类控制指令,控制电子设备执行所述控制指令;从而降低了使用脑电信号进行电子设备的控制延时,提升了使用脑电信号控制电子设备的响应速率,并进一步提升了用户满意度。另外一方面,为了精确采用脑电信号控制电子设备,会显示与预设对象对应的闪烁光,不同所述预设对象对应的闪烁光的闪烁频率不同;进一步通过不同闪烁频率的闪烁光对人脑的脑电信号的影响,提升控制精度。The technical solution provided by the disclosed embodiment, on the one hand, will combine the alpha brain waves and beta brain waves in the EEG signal to jointly determine the concentration value that characterizes the degree of concentration of the target user's attention when viewing the first page, so that the target user's intention (or intent) can be quickly determined, thereby generating a first type of control instruction corresponding to the user's intention (or intent), and controlling the electronic device to execute the control instruction; thereby reducing the control delay of the electronic device using EEG signals, improving the response rate of the electronic device controlled by EEG signals, and further improving user satisfaction. On the other hand, in order to accurately use EEG signals to control electronic devices, flashing lights corresponding to preset objects will be displayed, and the flashing frequencies of the flashing lights corresponding to different preset objects are different; further, the control accuracy is improved by the influence of flashing lights of different flashing frequencies on the EEG signals of the human brain.
在一个实施例中,所述闪烁光可为:电子设备显示提示信息时显示的。In one embodiment, the flashing light may be displayed when the electronic device displays prompt information.
例如,所述预设对象包括:操作控件;所述S110可包括:在第一页面的显示时长达到第一预设时长后,显示提示信息,其中,所述提示信息上具有操作控件及与所述操作控件对应的闪烁光。For example, the preset object includes: an operation control; S110 may include: after the display time of the first page reaches a first preset time, displaying a prompt message, wherein the prompt message has an operation control and a flashing light corresponding to the operation control.
所述电子设备显示的第一页面可为系统级页面,也可以是应用级页面。系统级页面包括:操作系统的显示页面。应用级页面包括:任意安装在操作系统中的应用程序的显示页面。The first page displayed by the electronic device may be a system-level page or an application-level page. The system-level page includes: a display page of the operating system. The application-level page includes: a display page of any application installed in the operating system.
所述第一页面显一个或多个目标,例如,进行网络购物的商品信息或者服务信息。再例如,所述目标可为:供目标用户观看的图片和/或阅读的文字等。The first page displays one or more targets, for example, product information or service information for online shopping. For another example, the target may be: pictures to be viewed and/or texts to be read by the target user.
在第一页面显示的时候,会对第一页面的持续显示进行计时,若第一页面的显示时长达到第一预设时长,则说明目标用户没有着急对该页面进行翻页等操作,是对第一页面显示的目标想要指定一定的操作的。故此时电子设备显示提示信息。When the first page is displayed, the continuous display of the first page is timed. If the display time of the first page reaches the first preset time, it means that the target user is not in a hurry to turn the page or perform other operations on the page, but wants to specify a certain operation on the target displayed on the first page. Therefore, the electronic device displays a prompt message at this time.
该提示信息可以以各种形式显示,例如,用于显示提示信息的形式包括但不限于:对话框或者悬浮窗。The prompt information may be displayed in various forms. For example, the forms used to display the prompt information include but are not limited to: a dialog box or a floating window.
该提示信息上具有提示内容,与提示内容对应的操作控件。The prompt information has prompt content and operation controls corresponding to the prompt content.
该提示内容可用于提示是否确定执行针对目标的预设操作。该预设操作包括但不限于以下至少之一:The prompt content can be used to prompt whether to confirm to execute the preset operation for the target. The preset operation includes but is not limited to at least one of the following:
预订操作;例如,交通工具的票的预订操作,网购商品的预订操作等;Booking operations; for example, booking of transportation tickets, booking of online shopping products, etc.
购买操作;网购商品和/或服务的购买。Purchase action: purchase of online goods and/or services.
收藏操作;该收藏操作包括但不限于:网购商品或服务的链接收藏;或者,第一页面显示的文章等内容的收藏;Collection operation; the collection operation includes but is not limited to: collection of links to online shopping products or services; or collection of articles and other content displayed on the first page;
转发操作。Forwarding operation.
转发操作包括:微信等即时社交平台上的文字和/或图像等转发。The forwarding operation includes: forwarding text and/or images on instant social platforms such as WeChat.
以上是对预设操作的举例,具体实现是不局限于此。The above is an example of the preset operation, and the specific implementation is not limited to this.
在本公开实施例中,会结合脑电信号中的阿尔法脑波和贝达脑波,共同确定表征目标用户观看操作控件的注意力的集中程度的集中度值,从而可以快速的确定出目标用户的意愿(或意图),从而生成与用户的意愿(或意图)对应的控制指令,控制电子设备执行与操作控件关联的操作;从而降低了使用脑电信号进行电子设备的控制延时,提升了使用脑电信号控制电子设备的响应速率及并基于提示信息和操作控件对应的闪烁光提升控制精确度,并进一步提升了用户满意度。In the disclosed embodiment, the alpha brain waves and beta brain waves in the EEG signals are combined to jointly determine a concentration value that characterizes the degree of concentration of the target user's attention when viewing the operating controls, so that the target user's intention (or intent) can be quickly determined, thereby generating control instructions corresponding to the user's intention (or intent) to control the electronic device to perform operations associated with the operating controls; thereby reducing the control delay of electronic devices using EEG signals, improving the response rate of electronic devices controlled using EEG signals, and improving control accuracy based on prompt information and flashing light corresponding to the operating controls, and further improving user satisfaction.
在一个实施例中,在操作控件或者操作控件的周围提供闪烁光。如此目标用户观看哪个操作控件,则会对应闪烁光的闪烁频率,产生与该闪烁光频率相呼应的阿尔法脑波和贝达脑波。In one embodiment, a flashing light is provided on or around the operating control, so that the target user will generate alpha brain waves and beta brain waves corresponding to the flashing frequency of the flashing light according to which operating control the target user views.
所述闪烁光为可见光的一种,由电子设备的显示屏显示或者投影仪投影出闪烁光的效果。The flickering light is a type of visible light, and the flickering light effect is displayed by a display screen of an electronic device or projected by a projector.
例如,所述闪烁光可包括:可见光波段范围内的红光和/或蓝光。For example, the flashing light may include: red light and/or blue light within the visible light band.
在一个实施例中,若操作控件有多个,则不同操作控件关联的闪烁光的闪烁频率不同。In one embodiment, if there are multiple operating controls, the flashing frequencies of the flashing lights associated with different operating controls are different.
在另一个实施例中,若操作控件有多个,则不同操作控件关联的闪烁光的闪烁频率不同的同时,闪烁光的光频率也不同。In another embodiment, if there are multiple operating controls, the flashing frequencies of the flashing lights associated with different operating controls are different, and the light frequencies of the flashing lights are also different.
在一个实施例中,所述提示信息上显示有确定控件和/或取消控件;In one embodiment, a confirmation control and/or a cancel control is displayed on the prompt information;
所述闪烁光包括:以第一频率闪烁的第一闪烁光及以第二频率闪烁的第二闪烁光;The flashing light comprises: a first flashing light flashing at a first frequency and a second flashing light flashing at a second frequency;
所述第一闪烁光在所述确定控件的显示区间内闪烁;所述第二闪烁光在所述取消控件的显示区域间内闪烁。The first flashing light flashes within the display interval of the confirmation control; the second flashing light flashes within the display area of the cancellation control.
在一个实施例中,所述提示信息显示显示确定控件不显示取消控件,若检测到与确定控件上或者周围显示的闪烁光的闪烁频率具有第一关系的阿尔法脑波,和检测到与确定控件上或者周围显示的闪烁光的闪烁频率具有第二关系的贝达脑波,则计算针对确定控件的集中度值;若集中度值达标,则可认为目标用户控制电子设备执行确定控件关联的操作。若集中度值不达标,或者,未检测到与所述确定控件上或者周围显示的闪烁光的闪烁频率具有第一关系的的阿尔法脑波,和未检测到与确定控件上或者周围显示的闪烁光的闪烁频率具有第二关系的贝达脑波,则可认为目标用户不想电子设备执行与确定控件相关联的操作。In one embodiment, the prompt information displays a confirmation control but does not display a cancel control. If an alpha brain wave having a first relationship with the flashing frequency of the flashing light displayed on or around the confirmation control is detected, and a beta brain wave having a second relationship with the flashing frequency of the flashing light displayed on or around the confirmation control is detected, then a concentration value for the confirmation control is calculated; if the concentration value meets the standard, it can be considered that the target user controls the electronic device to perform an operation associated with the confirmation control. If the concentration value does not meet the standard, or if an alpha brain wave having a first relationship with the flashing frequency of the flashing light displayed on or around the confirmation control is not detected, and a beta brain wave having a second relationship with the flashing frequency of the flashing light displayed on or around the confirmation control is not detected, it can be considered that the target user does not want the electronic device to perform an operation associated with the confirmation control.
在一个实施例中,在所述提示信息时,显示取消控件不显示确定控件,若检测到与取消控件上或者周围显示的闪烁光的闪烁频率具有第一关系的阿尔法脑波,和检测到与取消控件上或者周围显示的闪烁光的闪烁频率具有第二关系的贝达脑波,则计算针对取消控件的集中度值;若集中度值达标,则可认为目标用户控制电子设备执行取消控件关联的操作。若集中度值不达标,或者,未检测到与所述取消控件上或者周围显示的闪烁光的闪烁频率具有第一关系的的阿尔法脑波,和未检测到与取消控件上或者周围显示的闪烁光的闪烁频率具有第二关系的贝达脑波,则可认为目标用户不想电子设备执行与取消控件相关联的操作。在一个实施例中,若确定出目标用户不想电子设备执行与取消控件相关联的操作,可认为目标用户想控制电子设备执行与取消控件相关联的操作的反向操作。In one embodiment, when the prompt information is displayed, the cancel control is displayed but the confirmation control is not displayed. If an alpha brain wave having a first relationship with the flashing frequency of the flashing light displayed on or around the cancel control is detected, and a beta brain wave having a second relationship with the flashing frequency of the flashing light displayed on or around the cancel control is detected, then the concentration value for the cancel control is calculated; if the concentration value meets the standard, it can be considered that the target user controls the electronic device to perform the operation associated with the cancel control. If the concentration value does not meet the standard, or the alpha brain wave having a first relationship with the flashing frequency of the flashing light displayed on or around the cancel control is not detected, and the beta brain wave having a second relationship with the flashing frequency of the flashing light displayed on or around the cancel control is not detected, it can be considered that the target user does not want the electronic device to perform the operation associated with the cancel control. In one embodiment, if it is determined that the target user does not want the electronic device to perform the operation associated with the cancel control, it can be considered that the target user wants to control the electronic device to perform the reverse operation of the operation associated with the cancel control.
在一个实施例中,在所述提示信息时,显示取消控件且显示确定控件,若检测到与取消控件上或者周围显示的闪烁光的闪烁频率具有第一关系的阿尔法脑波,和检测到与取消控件上或者周围显示的闪烁光的闪烁频率具有第二关系的贝达脑波,则计算针对取消控件的集中度值;且若检测到与确定控件上或者周围显示的闪烁光的闪烁频率具有第一关系的阿尔法脑波,和检测到与确定控件上或者周围显示的闪烁光的闪烁频率具有第二关系的贝达脑波,则计算针对确定控件的集中度值。且确定控件关联的闪烁光和取消控件关联的闪烁光的闪烁频率是不同的。In one embodiment, when the prompt information is displayed, a cancel control is displayed and a confirmation control is displayed, and if an alpha brain wave having a first relationship with the flickering frequency of the flickering light displayed on or around the cancel control is detected, and a beta brain wave having a second relationship with the flickering frequency of the flickering light displayed on or around the cancel control is detected, then a concentration value for the cancel control is calculated; and if an alpha brain wave having a first relationship with the flickering frequency of the flickering light displayed on or around the confirmation control is detected, and a beta brain wave having a second relationship with the flickering frequency of the flickering light displayed on or around the confirmation control is detected, then a concentration value for the confirmation control is calculated. And the flickering frequencies of the flickering light associated with the confirmation control and the flickering light associated with the cancel control are different.
若在一个实施例中,在同时显示确定控件和取消控件时,若检测到与确定控件对应的集中度值达标,且检测到与取消控件和对应的集中度值达标也达标,则此时延迟脑电波的时间,根据延迟的时间内的检测到脑电波,重新确认集中度值,并再次电子设备所需要执行的操作。If in one embodiment, when a confirmation control and a cancel control are displayed at the same time, if it is detected that the concentration value corresponding to the confirmation control meets the standard, and it is detected that the concentration value corresponding to the cancel control also meets the standard, then the time of the brain wave is delayed, and the concentration value is reconfirmed based on the brain wave detected within the delayed time, and the operation that needs to be performed by the electronic device is performed again.
在一个实施例中,在同时显示确定控件和取消控件时,若检测到与确定控件对应的集中度值达标,且检测到与取消控件和对应的集中度值达标也达标,则此时停止与确定控件或取消控件关联的闪烁光的显示,获取其中一个控件的闪烁光取消之后的脑电波的频率,若继续检测到与继续显示的闪烁光关联的阿尔法脑波和贝达脑波,则执行与继续显示有闪烁光的操作控件关联的控制操作,否则执行闪烁光停止的操作控件的操作。In one embodiment, when a confirmation control and a cancel control are displayed at the same time, if it is detected that the concentration value corresponding to the confirmation control has met the standard, and it is detected that the concentration value corresponding to the cancel control has also met the standard, then the display of the flashing light associated with the confirmation control or the cancel control is stopped, and the frequency of the brain waves after the flashing light of one of the controls is cancelled is obtained. If the alpha brain waves and beta brain waves associated with the flashing light that continues to be displayed continue to be detected, the control operation associated with the operation control that continues to display the flashing light is executed, otherwise the operation of the operation control that stops the flashing light is executed.
在一个实施例中,所述S130可包括:根据与所述第一频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第一频率具有第二关系的所述贝达脑波的振幅,确定执行所述确定控件关联的确定操作的所述集中度值;或者,根据与所述第二频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第二频率具有第二关系的所述贝达脑波的振幅,确定执行所述取消控件关联的取消操作的所述集中度值。In one embodiment, the S130 may include: determining the concentration value for executing the determination operation associated with the determination control based on the amplitude of the alpha brain wave having the first relationship with the first frequency and the amplitude of the beta brain wave having the second relationship with the first frequency according to frequency; or determining the concentration value for executing the cancellation operation associated with the cancellation control based on the amplitude of the alpha brain wave having the first relationship with the second frequency and the amplitude of the beta brain wave having the second relationship with the second frequency according to frequency.
在一个实施例中,如图3所示,所述S130可包括:In one embodiment, as shown in FIG3 , the S130 may include:
S131:确定第一时刻频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅能量及频率与所述闪烁频率具有第一关系的所述阿尔法脑波的最大振幅能量之间的第一比值;S131: Determine a first ratio between the amplitude energy of the alpha brain wave whose frequency at a first moment has a first relationship with the flickering frequency and the maximum amplitude energy of the alpha brain wave whose frequency has a first relationship with the flickering frequency;
S132:确定所述第一时刻所述频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅能量及所述频率与所述闪烁频率具有第二关系的所述贝达脑波的最大振幅能量之间的第二比值;S132: determining a second ratio between the amplitude energy of the Beda brain wave whose frequency has a second relationship with the flickering frequency at the first moment and the maximum amplitude energy of the Beda brain wave whose frequency has a second relationship with the flickering frequency;
S133:根据所述第一比值及所述第二比值,得到所述集中度值。S133: Obtain the concentration value according to the first ratio and the second ratio.
振幅能量与振幅平方成正比。Amplitude energy is proportional to the square of the amplitude.
通过观测发现,阿尔法脑波的波峰值和贝达脑波的波谷值或者说阿尔法脑波的波谷值和贝达脑波的波峰值,具有一定的伴随关系。Through observation, it was found that the peak value of alpha brain waves and the trough value of beta brain waves, or the trough value of alpha brain waves and the peak value of beta brain waves, have a certain accompanying relationship.
以第一比值和第二比值这两个比值作为自变量,得到的作为自变量的集中度值,可以使得集中度值具有比较的变化范围。如此,集中度值的变化梯度就增大了,如此,集中度值的变化梯度越大,相当于集中度值会从一个很小值快速上升到一个较大值或者下降到一个较小值,从而能够满足条件时,就可以快速生成第一类控制指令,从而提高电子设备的响应速率。The concentration value obtained as the independent variable using the first ratio and the second ratio as the independent variable can make the concentration value have a comparative range of variation. In this way, the gradient of the concentration value variation increases. In this way, the greater the gradient of the concentration value variation, the concentration value will quickly rise from a very small value to a larger value or drop to a smaller value, so that when the conditions are met, the first type of control instruction can be quickly generated, thereby improving the response rate of the electronic device.
在另一些实施例中,所述根据所述阿尔法脑波的振幅和所述贝达脑波的振幅,确定集中度值,包括:In some other embodiments, determining the concentration value according to the amplitude of the alpha brain wave and the amplitude of the beta brain wave includes:
确定第一时刻所述频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅的绝对值及所述频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅的最大绝对值之间的第一比值;Determine a first ratio between an absolute value of the amplitude of the alpha brain wave whose frequency has a first relationship with the flicker frequency at a first moment and a maximum absolute value of the amplitude of the alpha brain wave whose frequency has a first relationship with the flicker frequency;
确定所述第一时刻频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅的绝对值及频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅的最大绝对值之间的第二比值;Determine a second ratio between the absolute value of the amplitude of the Beda brain wave whose frequency at the first moment has a second relationship with the flickering frequency and the maximum absolute value of the amplitude of the Beda brain wave whose frequency has a second relationship with the flickering frequency;
根据所述第一比值及所述第二比值,得到所述集中度值。The concentration value is obtained according to the first ratio and the second ratio.
在一个实施例中,所述根据所述第一比值及所述第二比值,得到所述集中度值,包括:In one embodiment, obtaining the concentration value according to the first ratio and the second ratio includes:
计算所述第一比值和所述第二比值的差,得到所述集中度值。The difference between the first ratio and the second ratio is calculated to obtain the concentration value.
例如将第一比值减去第二比值的差,得到所述集中度值;在另一个实施例中,还可以将第一比值比上第二比值,得到所述集中度值。总之,根据第一比值和第二比值计算所述集中度值的方式有很多种,不局限于上述任意一种。For example, the concentration value is obtained by subtracting the difference between the first ratio and the second ratio; in another embodiment, the concentration value can also be obtained by adding the first ratio to the second ratio. In short, there are many ways to calculate the concentration value based on the first ratio and the second ratio, which are not limited to any of the above.
例如,采用如下公式计算所述集中度值:For example, the concentration value is calculated using the following formula:
公式(1)中,为t时刻的阿尔法脑波的振幅能量,为t时刻的贝达脑波的振幅能量,Eα为阿尔法波振幅最大能量,Eβ为贝达脑波的振幅最大能量。In formula (1), is the amplitude energy of the alpha brain wave at time t, is the amplitude energy of the Beda brain wave at time t, E α is the maximum amplitude energy of the alpha wave, and E β is the maximum amplitude energy of the Beda brain wave.
本公开实施例中阿尔法脑波的振幅和贝达脑波的振幅都是时域波的振幅。In the disclosed embodiments, the amplitude of the alpha brain wave and the amplitude of the beta brain wave are both amplitudes of time domain waves.
在一个实施例中,所述S140可包括:若所述集中度值满足预设条件,控制所述电子设备执行与所述操作控件关联的操作。In one embodiment, S140 may include: if the concentration value satisfies a preset condition, controlling the electronic device to perform an operation associated with the operation control.
集中度值满足预设条件包括但不限于:集中度值位于预设区域。The concentration value satisfies the preset conditions including but not limited to: the concentration value is located in a preset area.
示例性地,所述集中度值满足预设条件,包括:所述集中度值的波峰值大于第一阈值;和/或,所述集中度值的波谷值小于第二阈值;其中,所述第二阈值小于所述第一阈值。Exemplarily, the concentration value satisfies preset conditions, including: a peak value of the concentration value is greater than a first threshold; and/or a trough value of the concentration value is less than a second threshold; wherein the second threshold is less than the first threshold.
示例性地,预设对象为显示在购物应用页面上的不同商品,若检测到与与商品A对应的闪光频率的脑电波的集中度值大于第一阈值,可认为执行商品A的购买操作;若检测到与与商品A对应的闪光频率的脑电波的集中度值小于第二阈值,可认为取消商品A 的购买操作。Exemplarily, the preset objects are different commodities displayed on the shopping application page. If the concentration value of the brain waves with the flashing frequency corresponding to commodity A is detected to be greater than a first threshold, it can be considered that the purchase operation of commodity A is executed; if the concentration value of the brain waves with the flashing frequency corresponding to commodity A is detected to be less than a second threshold, it can be considered that the purchase operation of commodity A is cancelled.
如图4所示被一种集中度值的时域波形图。集中度值也会呈现一定的周期性规律,例如,基于离散的集中度值连接绘制的时域波形图在正负值之间一次翻转,对应于集中度值的一个周期。A time domain waveform of a concentration value is shown in FIG4 . The concentration value also presents a certain periodicity. For example, a time domain waveform drawn based on discrete concentration values flips between positive and negative values once, corresponding to a cycle of the concentration value.
所述第一阈值可为图4中的B值;所述第二阈值可为图4中的C值。The first threshold may be the B value in FIG. 4 ; the second threshold may be the C value in FIG. 4 .
在所述第一阈值和第二阈值之间的集中度值为:预设区间外的值;而大于第一阈值及小于第二阈值的集中度值为位于预设区间内的值。The concentration value between the first threshold and the second threshold is: a value outside the preset interval; and the concentration value greater than the first threshold and less than the second threshold is a value within the preset interval.
在图4中,t1时刻为集中度值的波峰值;t2时刻为集中度值的波谷值。In FIG4 , time t1 is the peak value of the concentration value; time t2 is the trough value of the concentration value.
在一个实施例中,为了进一步提升电子设备的响应速率,电子设备每获得一个集中度值就进行一次是否生成第一类控制指令的确定,而不是等到集中度值经历过至少一次正负值之间的穿越之后在进行是否生成第一类控制指令的确定。In one embodiment, in order to further improve the response rate of the electronic device, the electronic device determines whether to generate a first-class control instruction each time it obtains a concentration value, rather than waiting until the concentration value has crossed between positive and negative values at least once before determining whether to generate a first-class control instruction.
如此,通过集中度值波峰值是否大于第一阈值,集中度值的波谷值是否小于第一阈值;相对于单独根据集中度值是否预设区间内,可以减少重复生成控制,减少控制指令不必要的生成和误操作。In this way, by determining whether the peak value of the concentration value is greater than the first threshold and whether the trough value of the concentration value is less than the first threshold, compared with determining whether the concentration value is within a preset interval alone, repeated control generation can be reduced, and unnecessary generation of control instructions and erroneous operations can be reduced.
例如,若集中度值一旦大于第一阈值就控制电子设备执行购买操作,由于集中度值的变化连续性,可能会重复购买,从而会出现重复购买等现象,但是显然这不是用户想要的。因此本公开实施例中,使用集中度值的波峰值和波谷值来确定控制电子设备执行对应的操作,可以减小电子设备的误操作,再次提升了用户体验。For example, if the concentration value is greater than the first threshold, the electronic device is controlled to perform a purchase operation. Due to the continuity of the concentration value, repeated purchases may occur, which may lead to repeated purchases. However, this is obviously not what the user wants. Therefore, in the embodiment of the present disclosure, the peak value and trough value of the concentration value are used to determine the control of the electronic device to perform the corresponding operation, which can reduce the erroneous operation of the electronic device and further improve the user experience.
示例性地,所述方法,还包括:Exemplarily, the method further includes:
在第n检测时刻的集中度值位于预设区间时,确定所述第n检测时刻的集中度值与第 n-1检测时刻的集中度值之间的第一斜率,并确定所述第n检测时刻的集中度值与第n+1检测时刻的集中度值之间的第二斜率;所述集中度值位于预设区间包括:集中度值大于所述第一阈值或集中度值所小于述第二阈值;其中,所述n为正整数;When the concentration value at the nth detection moment is within a preset interval, a first slope between the concentration value at the nth detection moment and the concentration value at the n-1th detection moment is determined, and a second slope between the concentration value at the nth detection moment and the concentration value at the n+1th detection moment is determined; the concentration value being within the preset interval includes: the concentration value being greater than the first threshold or the concentration value being less than the second threshold; wherein n is a positive integer;
若所述第一斜率的符号和所述第二斜率的符号相反,确定所述集中度值的波峰值大于所述第一阈值或者所述集中度值的波谷值小于所述第二阈值。If the sign of the first slope is opposite to the sign of the second slope, it is determined that the peak value of the concentration value is greater than the first threshold or the trough value of the concentration value is less than the second threshold.
第n检测时刻可为集中度值的任意一个检测时刻,一个检测时刻可以对应于脑电波的一个检测时刻。第n-1检测时刻是第n检测时刻的前一个检测时刻;第n+1检测时刻是第n检测时刻的下一个检测时刻。以检测时刻的时刻点信息和集中度值在二维坐标系内构建直线的斜率,若发现两条直线的斜率的符号相反,则说明经历了集中度值的一次波峰值或者波谷值。The nth detection moment can be any detection moment of the concentration value, and one detection moment can correspond to a detection moment of the brain wave. The n-1th detection moment is the detection moment before the nth detection moment; the n+1th detection moment is the detection moment after the nth detection moment. The slope of the straight line is constructed in the two-dimensional coordinate system with the moment information of the detection moment and the concentration value. If it is found that the signs of the slopes of the two straight lines are opposite, it means that a peak value or a trough value of the concentration value has been experienced.
所述第一斜率的符号和所述第二斜率的符号相反,包括:The sign of the first slope is opposite to the sign of the second slope, including:
所述第一斜率的正数且所述第二斜率为负数;The first slope is a positive number and the second slope is a negative number;
或者,or,
所述第一斜率为负数且所述第二斜率为正数。The first slope is a negative number and the second slope is a positive number.
至于集中度值当前经历的是波峰值还是波谷值,可以根据集中度值的符号来确定,或者,斜率的符号是从负切换到正,则可认为集中度值经历了一次波谷值,若斜率的符号从正切换为负,则可认为经历一次波峰值。As for whether the concentration value is currently experiencing a peak value or a trough value, it can be determined based on the sign of the concentration value. Alternatively, if the sign of the slope switches from negative to positive, it can be considered that the concentration value has experienced a trough value. If the sign of the slope switches from positive to negative, it can be considered that it has experienced a peak value.
通过直线拟合,并基于直线的斜率,可以快速的知道集中度值的波峰值和波谷值,从而再次加速了第一类控制指令的生成,从而提升了电子设备的响应速率。By fitting a straight line and based on the slope of the straight line, the peak value and the trough value of the concentration value can be quickly known, thereby further accelerating the generation of the first type of control instructions, thereby improving the response rate of the electronic device.
在一些实施例中,所述方法还包括:In some embodiments, the method further comprises:
获取在显示所述第一页面和/或所述提示信息时所述目标用户的眼电波;Acquiring the eye waves of the target user when the first page and/or the prompt information is displayed;
根据所述眼电波获取眼电特征,并根据根据所述眼电特征,控制电子设备的页面切换。The electrooculogram characteristics are obtained according to the electrooculogram characteristics, and the page switching of the electronic device is controlled according to the electrooculogram characteristics.
例如,所述根据所述眼电特征,控制电子设备的页面切换,包括但不限于:For example, controlling the page switching of the electronic device according to the electrooculographic characteristics includes but is not limited to:
根据所述眼电特征,控制电子设备切换到显示第三页面。According to the electrooculographic characteristics, the electronic device is controlled to switch to displaying the third page.
在一个实施例中,所述第三页面为:所述电子设备在显示所述第三页面之前显示的历史页面。在另一个实施例中,所述第三页面可为:所述第一页面之后的下一个页面。In one embodiment, the third page is: a historical page displayed by the electronic device before displaying the third page. In another embodiment, the third page may be: a next page after the first page.
眼电波是反应目标用户的眼动的一种生理波形。Eye waves are a physiological waveform that reflects the eye movements of the target user.
用户的眼动也反应了目标用户对第一页面或提示信息上显示内容的关注度,从而也可以反应出用户的意图或意愿。The user's eye movement also reflects the target user's attention to the content displayed on the first page or prompt information, and thus can also reflect the user's intention or wish.
在本公开实施例中,引入眼电波控制电子设备切换到显示第三页面。如此,控制电子设备执行显示切换,丰富了利用脑电信号对电子设备的控制。眼电波和脑电波都是前述脑电信号的一种。In the embodiment of the present disclosure, eye waves are introduced to control the electronic device to switch to display the third page. In this way, the electronic device is controlled to perform display switching, which enriches the control of the electronic device using brain electrical signals. Eye waves and brain waves are both types of the aforementioned brain electrical signals.
在一个实施例中,所述眼电特征可包括:目标用户的眨眼频次和//或眨眼的幅度。有意识的眨眼的幅度是不同于无意识的眨眼幅度。在一个实施例中,若根据所述眼电特征检测到用户有意识的眨眼,则可控制所述电子设备执行翻页操作,切换到显示第三页面。In one embodiment, the electrooculographic feature may include: the target user's blinking frequency and/or blinking amplitude. The amplitude of conscious blinking is different from the amplitude of unconscious blinking. In one embodiment, if the user's conscious blinking is detected according to the electrooculographic feature, the electronic device may be controlled to perform a page turning operation and switch to displaying the third page.
图7为一种眼电波的波形示意图;在图7中有振幅很高的尖峰。在本公开实施例中,所述眼电特征可为眼电波中的尖峰特征。眼电波的尖峰对应的振幅值大于特定值,则可认为产生了一次有意识的眨眼。在公开实施例中可以根据是否尖峰特征,确定眨眼幅度或者有意识眨眼的频次,确定是否控制电子设备的显示切换。FIG7 is a schematic diagram of an electrooculogram waveform; FIG7 has a peak with a very high amplitude. In the disclosed embodiment, the electrooculogram feature may be a peak feature in the electrooculogram. If the amplitude value corresponding to the peak of the electrooculogram is greater than a specific value, it can be considered that a conscious blink has occurred. In the disclosed embodiment, the amplitude of the blink or the frequency of conscious blinking can be determined based on whether there is a peak feature, and whether to control the display switching of the electronic device.
在一个实施例中,所述眼电特征包括:眨眼频次;In one embodiment, the electrooculographic characteristics include: blinking frequency;
所述根据所述眼电特征,控制电子设备的显示切换,可包括:The controlling the display switching of the electronic device according to the electrooculographic feature may include:
在所述眨眼频次高于频率阈值时,生成控制所述电子设备切换到第三页面,所述第三页面为所述电子设备前一个时刻显示的页面或者在页面列表位于所述第一页面之后的下一个页面。When the blinking frequency is higher than the frequency threshold, a control is generated to switch the electronic device to a third page, where the third page is the page displayed by the electronic device at a previous moment or the next page after the first page in the page list.
为了提升控制精确度,减少电子设备的误操作;本公开实施例中所述眼电特征包括:眨眼频次。且是眨眼幅度大于幅度阈值的眨眼频次,从而是确保目标用户有意识的眨眼频次来控制电子设备,减少单次有意识的眨眼导致的误操作。In order to improve the control accuracy and reduce the misoperation of the electronic device, the electrooculographic features described in the embodiment of the present disclosure include: blink frequency. And the blink frequency is the blink frequency with a blink amplitude greater than the amplitude threshold, so as to ensure that the target user consciously blinks to control the electronic device and reduce the misoperation caused by a single conscious blink.
所述频率阈值可为任意正整数,例如,所述频率阈值可为不小于2的正整数。The frequency threshold may be any positive integer. For example, the frequency threshold may be a positive integer not less than 2.
在一个实施例中,所述方法还包括:In one embodiment, the method further comprises:
在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面。If the concentration value satisfying the preset condition is not detected within a second preset time period after the first page is displayed, the electronic device is controlled to switch to displaying the second page.
利用未检测到满足预设条件的集中度值,控制电子设备的显示翻页,从而再次丰富了电子设备的脑电信号控制形式。By utilizing the concentration value that does not meet the preset conditions, the display page turning of the electronic device is controlled, thereby further enriching the brain wave signal control form of the electronic device.
在一个实施例中,所述第二页面可以为所述第一页面的下一个页面或者第一页面的前一个页面。In one embodiment, the second page may be a next page of the first page or a previous page of the first page.
例如,所述第一页面是购物页面A,若在购物页面A显示的第二预设时长内检测到符合预设条件的集中度值,则说明目标用户对购物页面A上的内容不感兴趣,可以切换到下一个购物页面B。下一个购物页面B可为之前没有显示的任意一个购物页面,如此目标用户可以看到购物页面B上的购物信息。For example, the first page is shopping page A. If a concentration value that meets the preset condition is detected within the second preset time period when shopping page A is displayed, it means that the target user is not interested in the content on shopping page A and can switch to the next shopping page B. The next shopping page B can be any shopping page that has not been displayed before, so that the target user can see the shopping information on shopping page B.
再例如,第一页面是购物页面A,根据眼电波检测到的验电特征,确定控制电子设备执行翻页操作,则电子设备返回显示前一个购物页面C;购物页面C是在购物页面A之前显示过的。For another example, the first page is shopping page A. Based on the electrical characteristics detected by the eye waves, it is determined to control the electronic device to perform a page turning operation, and the electronic device returns to display the previous shopping page C; shopping page C was displayed before shopping page A.
所述第一预设时长和所述第二预设时长是相互的独立的两个时长值。在一个实施例中,所述第二预设时长可大于所述第一预设时长。第一预设时长可为触发电子设备确定是否显示提示信息的时长。所述第二预设时长可为:在没有检测到集中度值符合预设条件的脑电波和/或检测到触发电子设备切换到第三页面的眼电波时切换到第二页面的触发时长。在一个实施例中,所述第二预设时长和所述第一预设时长的起止时间都是从现实第一页面的起始时刻算起。而在达到第一预设时长之后,电子设备显示提示信息,如此对第一页面的显示时长可停止计时;而是否达到第二预设时长的时长可以继续计时。即第二预设时长对应的计时时长可以从显示第一页面延长到显示提示信息。The first preset duration and the second preset duration are two independent duration values. In one embodiment, the second preset duration may be greater than the first preset duration. The first preset duration may be the duration for triggering the electronic device to determine whether to display the prompt information. The second preset duration may be: the trigger duration for switching to the second page when no brain waves with a concentration value that meets the preset conditions are detected and/or eye waves that trigger the electronic device to switch to the third page are detected. In one embodiment, the start and end times of the second preset duration and the first preset duration are both calculated from the start time of the actual first page. After reaching the first preset duration, the electronic device displays the prompt information, so the display duration of the first page can be stopped; and the duration of whether the second preset duration is reached can continue to be counted. That is, the timing duration corresponding to the second preset duration can be extended from displaying the first page to displaying the prompt information.
本公开实施例提供一种电子设备的控制方法,可应用于各种场景,以下以网购场景为例进行说明。若是购物场景在,电子设备当前显示的第一页面为网购页面。The disclosed embodiment provides a control method of an electronic device, which can be applied to various scenarios, and is described below by taking an online shopping scenario as an example. If the shopping scenario is in, the first page currently displayed by the electronic device is an online shopping page.
该技术应用于购物场景,通过意念控制完成在线商城的整个闭环购物场景。例如:This technology is applied to shopping scenarios, and the entire closed-loop shopping scenario of the online mall is completed through mind control. For example:
在网购页面显示有控件“下一个”、“购买”及“上一个”,实现确定购买/取消购买和翻页等操作。主要通过手机购物APP,如小米商城等品牌商城的APP,完成只需要你用脑控制想购买的商品的一系列操作。On the online shopping page, there are controls such as "next", "buy" and "previous" to confirm/cancel purchases and turn pages. You can use mobile shopping apps, such as Xiaomi Mall and other brand mall apps, to complete a series of operations that only require you to use your brain to control the products you want to buy.
首先单通道的脑电头带采集人体前额PF2处的脑电信号,其中,检测设备采集闹店信号的原始波形,可分离出4种不同脑电波和1种眼电波。这4种脑电波就包括前述的阿尔法脑波和贝达脑波。First, the single-channel EEG headband collects EEG signals at the PF2 of the human forehead. The detection equipment collects the original waveform of the noise signal and can separate 4 different brain waves and 1 eye wave. These 4 brain waves include the aforementioned alpha brain waves and beta brain waves.
接着蓝牙传输脑电信号到手机APP,手机APP进行通讯数据的解析,并对原始波形进行算法处理,分离前面所述原始波形,并进行集中度值算法的处理,眼动次数的实时记录;最后进行基于集中度值的曲线的波峰和波谷的阈值判断,和眼电阈值的判断,进行实现相应的操作。Then the Bluetooth transmits the EEG signal to the mobile phone APP, which analyzes the communication data and performs algorithm processing on the original waveform, separates the original waveform mentioned above, processes it with the concentration value algorithm, and records the number of eye movements in real time; finally, it judges the thresholds of the peaks and troughs of the concentration value curve and the electrooculogram threshold to implement corresponding operations.
集中度值的定义为阿尔法波的振幅能量和贝达波的振幅能量之差作为集中度值。其公式为前述公式(1):The concentration value is defined as the difference between the amplitude energy of the alpha wave and the amplitude energy of the beta wave. The formula is the aforementioned formula (1):
如图4所示,相同时间内,集中度值的变化范围是[-100,100],专注度值的变化范围是[0,100]。一般专注度值是单独根据阿尔法脑波的振幅计算的。As shown in Figure 4, within the same period of time, the concentration value changes in the range of [-100, 100], and the focus value changes in the range of [0, 100]. Generally, the focus value is calculated based on the amplitude of the alpha brain wave alone.
结合阿尔法脑波和贝达脑波计算集中度值的方法,得到的集中度值变化梯度变大,从而电子设备的响应更快,使得对应指令执行更快。By combining the method of calculating the concentration value with the alpha brain wave and the beta brain wave, the concentration value change gradient becomes larger, so that the electronic device responds faster and the corresponding instructions are executed faster.
另外,解决视频中指令下发的延迟时间较多的问题,同时是一种新的原始脑波的二次数据处理方法。对于脑电集中度值的阈值判断,当某一时刻出现t1时刻的波峰值时,采用极值算法(即三点之间的斜率变化),找到极值点,并判断最大值是否满足设定的B 要求,最后执行相应指令,t2时刻同理。这样,可以让脑电信号不会重复判断,重复执行指令,加快反应的同时减小记忆性,提高指令的准确率。此处的极值点包括前述的集中度值的波峰值和波谷值。In addition, it solves the problem of long delays in issuing commands in the video, and is also a new secondary data processing method for raw brain waves. For the threshold judgment of the EEG concentration value, when the peak value at time t1 appears at a certain moment, the extreme value algorithm (that is, the slope change between the three points) is used to find the extreme point, and determine whether the maximum value meets the set B requirement, and finally execute the corresponding command, and the same applies to time t2. In this way, the EEG signal will not be repeatedly judged, and the command will be repeatedly executed, which will speed up the reaction while reducing memory and improving the accuracy of the command. The extreme points here include the peak value and trough value of the aforementioned concentration value.
如图5所示,首先在手机等电子设备上的应用程序(Application,App)控制手机屏幕上边两端分别放置A频率闪烁的红光,B频率闪烁的蓝光,或者在被选中的商品环绕一圈A/B频率周期性轮换闪烁的红/蓝光。接着单通道的脑电头带采集人体的前额PF2处响应的脑电信号,其中的原始波形,可分离出5种不同波形信号,分别是4中脑电波和1 种眼电波。在4种脑电波中就包括:阿尔法脑波和贝达脑波。接着蓝牙传输脑电信号到手机APP,进行通讯数据的解析,并对原始波形进行算法处理,主要分离出阿尔法脑法和贝达脑波及眼电波,并进行集中度值算法的处理,眼动反应的实时记录;最后由于不同频率闪烁的光线的刺激,会让大脑响应出不同的脑波频率的阿尔法脑法和贝达脑波,并对相应的阿尔法脑法和贝达脑波的集中度值进行阈值判断,眼动特征用于生成另一个控制电子设备的控制指令,进行基于集中度曲线二分法的阈值判断,和眼电阈值的判断,进而实现不同功能。As shown in Figure 5, first, the application (Application, App) on the mobile phone or other electronic devices controls the placement of red light flashing at frequency A and blue light flashing at frequency B at the two ends of the mobile phone screen, or the red/blue light flashing at frequency A/B periodically rotates around the selected product. Then the single-channel EEG headband collects the EEG signal of the human forehead PF2. The original waveform can be separated into 5 different waveform signals, namely 4 brain waves and 1 eye wave. The 4 brain waves include: Alpha brain waves and Beda brain waves. Then the EEG signal is transmitted to the mobile phone APP via Bluetooth, the communication data is analyzed, and the original waveform is processed by algorithm, mainly separating the alpha and beta brain waves and eye waves, and processing the concentration value algorithm, and recording the eye movement response in real time; finally, due to the stimulation of light flashing at different frequencies, the brain will respond to alpha and beta brain waves with different brain wave frequencies, and the concentration values of the corresponding alpha and beta brain waves will be judged by threshold. The eye movement characteristics are used to generate another control instruction for controlling the electronic device, and threshold judgments are made based on the dichotomy of the concentration curve and the electrooculogram threshold, thereby realizing different functions.
具体的操作流程,可参考图6所示,电子设备的控制方法可包括:For a specific operation flow, please refer to FIG6 . The control method of the electronic device may include:
获取头带原始脑波信号,此处的头带原始脑波信号可为头部佩戴的任意检测设备检测的原始的脑波信。在检测头带等检测设备检测脑波信号时,电子设备上有A频率闪烁的红宫和以B频率闪烁的蓝光;Obtain the original brain wave signal of the headband. Here, the original brain wave signal of the headband can be the original brain wave signal detected by any detection device worn on the head. When the detection device such as the headband detects the brain wave signal, there is a red light flashing at frequency A and a blue light flashing at frequency B on the electronic device;
解析数据,例如通过傅里叶变换等,分离头带原始脑波信号中的阿尔法脑波、贝达脑波及眼电波。Analyze the data, for example, by Fourier transform, to separate the alpha brainwaves, beta brainwaves and eye waves from the raw brainwave signal from the headband.
根据阿尔法脑波、贝达脑波的振幅能力算法,提取集中度值;Extract the concentration value based on the amplitude capacity algorithm of alpha brain waves and beta brain waves;
当眼电波的波分位于某一个区间c,执行第一指令(command-1),该控制指令可为任意像是的翻页指令;电子设备在执行翻页指令时,会切换屏幕上显示的页面;When the eye wave is in a certain interval c, the first command (command-1) is executed. The control command can be any page turning command such as ; when the electronic device executes the page turning command, the page displayed on the screen is switched;
当A频率闪烁的红光所响应的脑电波的集中度值的某个波峰值大于阈值d1时,执第二指令(command-2),When a peak value of the concentration value of the brain wave in response to the red light flashing at frequency A is greater than the threshold value d1, the second command (command-2) is executed.
当B频率闪烁的红光所响应的脑电波的大于阈值d2时,执行第三指令(command-3);When the brain wave in response to the red light flashing at frequency B is greater than the threshold d2, the third command (command-3) is executed;
当一定时间内均没有检测到任何指令阈值时,则执行第四指令(command-4)。此处的一定时间可为前述的第二预设时长。When no command threshold is detected within a certain period of time, the fourth command (command-4) is executed. The certain period of time here can be the aforementioned second preset time length.
在一个实施例中,所述阈值d1和阈值d2可以相等,也可以不相等。此处阈值d1和d2可对应于前述的第一阈值或图4中的B。In one embodiment, the threshold d1 and the threshold d2 may be equal or unequal. Here, the thresholds d1 and d2 may correspond to the aforementioned first threshold or B in FIG4 .
可以理解地,在一些情况下,若当A频率闪烁的红光所响应的脑电波的集中度值的某个波谷值小于阈值f1时,取消执行第二指令(command-2);和/或,当B频率闪烁的红光所响应的脑电波的集中度值的博固执小于阈值f2时,取消执行第三指令 (command-3)。此处的阈值f1和阈值f2可为前述第二阈值。It can be understood that in some cases, if a certain trough value of the concentration value of the brain wave responded to the red light flashing at the A frequency is less than the threshold value f1, the execution of the second instruction (command-2) is canceled; and/or, when the concentration value of the brain wave responded to the red light flashing at the B frequency is less than the threshold value f2, the execution of the third instruction (command-3) is canceled. The threshold value f1 and the threshold value f2 here can be the aforementioned second threshold value.
首先单通道头带采集原始脑电波信号,并且A频率闪烁的红光,采用基于节律波能量法分离出阿尔法脑波、贝尔达脑波和眼电波。接着根据集中度的能量波算法处理成实时的集中度值,根据眼电波的尖峰区间阈值筛选出眼电次数;最后进行阈值判断,当眼电特征处于某一区间c时,执行信号指令command-1;当人眼捕捉到A频率闪烁的红光并响应出对应脑电波形,其集中度值大于阈值d1时,执行信号指令command-2,当人眼捕捉到A频率闪烁的红光并响应出对应脑电波形,其集中度值大于阈值d2时,执行信号指令 command-3;当一定时间内均没有检测到任何指令阈值时,则执行信号指令command-4。对于其中的红蓝光进行区分时,建议设置成两端,这样会提高准确率,指令稍微少。但是设置成循环闪烁的不同频率灯光,其原理类似霍金的打字系统,可实现非常多的指令,但是效率可能比较低。First, the single-channel headband collects the original brain wave signal, and the red light flashing at the A frequency is used to separate the alpha brain wave, the beta brain wave and the eye wave based on the rhythm wave energy method. Then, the energy wave algorithm of the concentration is processed into a real-time concentration value, and the number of eye waves is screened out according to the peak interval threshold of the eye wave; finally, the threshold is judged. When the eye wave feature is in a certain interval c, the signal instruction command-1 is executed; when the human eye captures the red light flashing at the A frequency and responds to the corresponding brain wave, and its concentration value is greater than the threshold d1, the signal instruction command-2 is executed; when the human eye captures the red light flashing at the A frequency and responds to the corresponding brain wave, and its concentration value is greater than the threshold d2, the signal instruction command-3 is executed; when no command threshold is detected within a certain period of time, the signal instruction command-4 is executed. When distinguishing between the red and blue light, it is recommended to set it to both ends, which will improve the accuracy and have slightly fewer instructions. However, setting the lights to flash in a loop at different frequencies is similar to Hawking's typing system, which can implement a large number of instructions, but the efficiency may be relatively low.
本公开实施例提供一种电子设备的控制装置,包括:An embodiment of the present disclosure provides a control device for an electronic device, comprising:
显示模块,用于显示与预设对象对应的闪烁光;其中,不同所述预设对象对应的闪烁光的闪烁频率不同;A display module, used for displaying flashing lights corresponding to preset objects; wherein the flashing frequencies of the flashing lights corresponding to different preset objects are different;
获取模块,用于获取在显示所述预设对象时目标用户的脑电波,其中,所述脑电波包括:阿尔法脑波和贝达脑波;An acquisition module, used for acquiring the brain waves of the target user when the preset object is displayed, wherein the brain waves include: alpha brain waves and beta brain waves;
确定模块,用于根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值;a determination module, configured to determine a concentration value according to an amplitude of the alpha brain wave having a frequency having a first relationship with the flickering frequency and an amplitude of the beta brain wave having a frequency having a second relationship with the flickering frequency;
控制模块,用于根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作。A control module is used to control the electronic device to perform an operation associated with the corresponding preset object according to the concentration value.
在一些实施例中,所述显示模块、获取模块、确定模块及控制模块包括程序模块;所述程序模块被处理器执行之后,能够实现上述任意模块的功能。In some embodiments, the display module, acquisition module, determination module and control module include a program module; after the program module is executed by the processor, the functions of any of the above modules can be realized.
在一些实施例中,所述显示模块、获取模块、确定模块及控制模块包括软硬结合模块;所述软硬结合模块包括但不限于可编程阵列;所述可编程阵列包括但不限于:复杂可编程阵列和/或现场可编程阵列。In some embodiments, the display module, acquisition module, determination module and control module include a soft-hard combination module; the soft-hard combination module includes but is not limited to a programmable array; the programmable array includes but is not limited to: a complex programmable array and/or a field programmable array.
在一些实施例中,所述显示模块、获取模块、确定模块及控制模块可包括纯硬件模块;所述纯硬件模块包括但不限于专用集成电路。In some embodiments, the display module, acquisition module, determination module and control module may include pure hardware modules; the pure hardware modules include but are not limited to application-specific integrated circuits.
可以理解地,所述预设对象包括:操作控件;所述显示模块,具体用于在第一页面的显示时长达到第一预设时长后,显示提示信息,其中,所述提示信息上具有操作控件及与所述操作控件对应的闪烁光。It can be understood that the preset object includes: an operation control; the display module is specifically used to display a prompt message after the display time of the first page reaches a first preset time, wherein the prompt message has an operation control and a flashing light corresponding to the operation control.
可以理解地,所述提示信息上显示有确定控件和/或取消控件;It can be understood that a confirmation control and/or a cancel control is displayed on the prompt information;
所述闪烁光包括:以第一频率闪烁的第一闪烁光及以第二频率闪烁的第二闪烁光;The flashing light comprises: a first flashing light flashing at a first frequency and a second flashing light flashing at a second frequency;
所述第一闪烁光在所述确定控件的显示区间内闪烁;所述第二闪烁光在所述取消控件的显示区域间内闪烁。The first flashing light flashes within the display interval of the confirmation control; the second flashing light flashes within the display area of the cancellation control.
可以理解地,所述确定模块,用于根据与所述第一频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第一频率具有第二关系的所述贝达脑波的振幅,确定执行所述确定控件关联的确定操作的所述集中度值;或者,根据与所述第二频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第二频率具有第二关系的所述贝达脑波的振幅,确定执行所述取消控件关联的取消操作的所述集中度值。It can be understood that the determination module is used to determine the concentration value for executing the determination operation associated with the determination control based on the amplitude of the alpha brain wave having the first relationship with the first frequency and the amplitude of the beta brain wave having the second relationship with the first frequency according to frequency; or, to determine the concentration value for executing the cancel operation associated with the cancel control based on the amplitude of the alpha brain wave having the first relationship with the second frequency and the amplitude of the beta brain wave having the second relationship with the second frequency according to frequency.
可以理解地,所述第一闪烁光的光波频率不同于所述第二闪烁光的光波频率。It can be understood that the light wave frequency of the first scintillation light is different from the light wave frequency of the second scintillation light.
可以理解地,所述确定模块,具体用于确定第一时刻频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅能量及频率与所述闪烁频率具有第一关系的所述阿尔法脑波的最大振幅能量之间的第一比值;确定所述第一时刻所述频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅能量及所述频率与所述闪烁频率具有第二关系的所述贝达脑波的最大振幅能量之间的第二比值;根据所述第一比值及所述第二比值,得到所述集中度值。It can be understood that the determination module is specifically used to determine a first ratio between the amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency at the first moment and the maximum amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency; determine a second ratio between the amplitude energy of the beta brain wave whose frequency has a second relationship with the flicker frequency at the first moment and the maximum amplitude energy of the beta brain wave whose frequency has a second relationship with the flicker frequency; and obtain the concentration value according to the first ratio and the second ratio.
可以理解地,所述确定模块,还用于计算所述第一比值和所述第二比值的差,得到所述集中度值。It can be understood that the determination module is also used to calculate the difference between the first ratio and the second ratio to obtain the concentration value.
可以理解地,所述控制模块,用于若所述集中度值满足预设条件,控制所述电子设备执行与所述操作控件关联的操作。It can be understood that the control module is used to control the electronic device to perform an operation associated with the operation control if the concentration value meets a preset condition.
可以理解地,所述集中度值满足预设条件,包括:所述集中度值的波峰值大于第一阈值;和/或,所述集中度值的波谷值小于第二阈值;It can be understood that the concentration value satisfies the preset conditions, including: the peak value of the concentration value is greater than a first threshold; and/or the trough value of the concentration value is less than a second threshold;
其中,所述第二阈值小于所述第一阈值。The second threshold is smaller than the first threshold.
可以理解地,所述装置,还包括:It can be understood that the device further includes:
斜率模块,用于在第n检测时刻的集中度值位于预设区间时,确定所述第n检测时刻的集中度值与第n-1检测时刻的集中度值之间的第一斜率,并确定所述第n检测时刻的集中度值与第n+1检测时刻的集中度值之间的第二斜率;所述集中度值位于预设区间包括:集中度值大于所述第一阈值或集中度值所小于述第二阈值;其中,所述n为正整数;A slope module, for determining a first slope between the concentration value at the nth detection moment and the concentration value at the n-1th detection moment, and determining a second slope between the concentration value at the nth detection moment and the concentration value at the n+1th detection moment when the concentration value at the nth detection moment is within a preset interval; the concentration value being within the preset interval includes: the concentration value being greater than the first threshold or the concentration value being less than the second threshold; wherein n is a positive integer;
若所述第一斜率的符号和所述第二斜率的符号相反,确定所述集中度值的波峰值大于所述第一阈值或者所述集中度值的波谷值小于所述第二阈值。If the sign of the first slope is opposite to the sign of the second slope, it is determined that the peak value of the concentration value is greater than the first threshold or the trough value of the concentration value is less than the second threshold.
可以理解地,所述控制模块,还用于在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面。It can be understood that the control module is further used to control the electronic device to switch to displaying the second page if the concentration value that meets the preset condition is not detected within a second preset time period from the start of displaying the first page.
可以理解地,所述获取模块,用于获取在显示所述第一页面和/或所述提示信息时所述目标用户的眼电波;It can be understood that the acquisition module is used to acquire the eye waves of the target user when the first page and/or the prompt information is displayed;
所述控制模块,还用于根据所述眼电波的眼电特征,控制电子设备进行显示页面的切换。The control module is also used to control the electronic device to switch the display page according to the electrooculographic characteristics of the electrooculographic wave.
本公开实施例提供一种电子设备,包括:An embodiment of the present disclosure provides an electronic device, including:
用于存储处理器可执行指令的存储器;a memory for storing processor-executable instructions;
处理器,与存储器连接;A processor connected to the memory;
其中,处理器被配置为执行前述任意技术方案提供的电子设备的控制方法。The processor is configured to execute the control method of the electronic device provided by any of the aforementioned technical solutions.
处理器可包括各种类型的存储介质,该存储介质为非临时性计算机存储介质,在通信设备掉电之后能够继续记忆存储其上的信息。The processor may include various types of storage media, which are non-transitory computer storage media that can continue to remember information stored thereon after the communication device loses power.
这里,电子设备可包括:被控制的电子设备本身。该电子设备包括但不限于:手机、平板或者投影设备等各种移动终端或固定终端。Here, the electronic device may include: the electronic device itself being controlled. The electronic device includes but is not limited to: various mobile terminals or fixed terminals such as mobile phones, tablets or projection devices.
处理器可以通过总线等与存储器连接,用于读取存储器上存储的可执行程序,例如,能够执行如图1、图3、图5至图6任意所示方法的至少其中之一。The processor may be connected to the memory via a bus or the like, and is used to read an executable program stored in the memory, for example, capable of executing at least one of the methods shown in any of FIG. 1 , FIG. 3 , and FIG. 5 to FIG. 6 .
图8是根据一示例性实施例示出的一种移动电子设备800的框图。例如,电子设备800可以是移动电话,移动电脑等。Fig. 8 is a block diagram of a mobile electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, a mobile computer, etc.
参照图8,电子设备800可以包括以下一个或多个组件:处理组件802,存储器804,电源组件806,多媒体组件808,音频组件810,输入/输出(I/O)的接口812,传感器组件814,以及通信组件816。8 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , a sensor component 814 , and a communication component 816 .
处理组件802通常控制电子设备800的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件802可以包括一个或多个处理器820来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件802可以包括一个或多个模块,便于处理组件802和其他组件之间的交互。例如,处理组件802可以包括多媒体模块,以方便多媒体组件808和处理组件802之间的交互。The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
存储器804被配置为存储各种类型的数据以支持在设备800的操作。这些数据的示例包括用于在电子设备800上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
电源组件806为电子设备800的各种组件提供电力。电力组件806可以包括电源管理系统,一个或多个电源,及其他与为电子设备800生成、管理和分配电力相关联的组件。The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.
多媒体组件808包括在电子设备800和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件808包括一个前置摄像头和/或后置摄像头。当设备800处于操作状态,如拍摄状态或视频状态时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operating state, such as a shooting state or a video state, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
音频组件810被配置为输出和/或输入音频信号。例如,音频组件810包括一个麦克风(MIC),当电子设备800处于操作状态,如呼叫状态、记录状态和语音识别状态时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器804 或经由通信组件816发送。在一些实施例中,音频组件810还包括一个扬声器,用于输出音频信号。The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating state, such as a call state, a recording state, and a voice recognition state, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.
I/O接口812为处理组件802和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。I/O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.
传感器组件814包括一个或多个传感器,用于为电子设备800提供各个方面的状态评估。例如,传感器组件814可以检测到设备800的打开/关闭状态,组件的相对定位,例如组件为电子设备800的显示器和小键盘,传感器组件814还可以检测电子设备800或电子设备800一个组件的位置改变,用户与电子设备800接触的存在或不存在,电子设备 800方位或加速/减速和电子设备800的温度变化。传感器组件814可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件814还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open/closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
通信组件816被配置为便于电子设备800和其他设备之间有线或无线方式的通信。电子设备800可以接入基于通信标准的无线网络,如Wi-Fi,2G或3G,或它们的组合。在一个示例性实施例中,通信组件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,通信组件816还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA) 技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
在示例性实施例中,电子设备800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器804,上述指令可由电子设备800的处理器820执行以完成上述方法。例如,非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the above instructions can be executed by the processor 820 of the electronic device 800 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
本公开实施例提供一种非临时性计算机可读存储介质,当存储介质中的指令由电子设备的处理器执行时,使得电子设备能够执行前述任意实施例提供的电子设备的控制方法,例如,能够执行如图1、图3、图5至图6任意所示方法的至少其中之一。An embodiment of the present disclosure provides a non-temporary computer-readable storage medium. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute a control method for an electronic device provided by any of the aforementioned embodiments, for example, can execute at least one of the methods shown in any of Figures 1, 3, 5 to 6.
该电子设备的控制方法,可包括:显示与预设对象对应的闪烁光;其中,不同所述预设对象对应的闪烁光的闪烁频率不同;获取在显示所述预设对象时目标用户的脑电波,其中,所述脑电波包括:阿尔法脑波和贝达脑波;根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值;根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作。The control method of the electronic device may include: displaying a flashing light corresponding to a preset object; wherein the flashing frequencies of the flashing lights corresponding to different preset objects are different; acquiring brain waves of a target user when the preset object is displayed, wherein the brain waves include: alpha brain waves and beta brain waves; determining a concentration value based on the amplitude of the alpha brain wave whose frequency has a first relationship with the flashing frequency and the amplitude of the beta brain wave whose frequency has a second relationship with the flashing frequency; and controlling the electronic device to perform an operation associated with the corresponding preset object based on the concentration value.
可以理解地,所述预设对象包括:操作控件;所述显示与预设对象关联的闪烁光,包括:在第一页面的显示时长达到第一预设时长后,显示提示信息,其中,所述提示信息上具有操作控件及与所述操作控件对应的闪烁光。It can be understood that the preset object includes: operation controls; the display of flashing light associated with the preset object includes: displaying prompt information after the display time of the first page reaches a first preset time, wherein the prompt information has operation controls and flashing light corresponding to the operation controls.
可以理解地,所述提示信息上显示有确定控件和/或取消控件;所述闪烁光包括:以第一频率闪烁的第一闪烁光及以第二频率闪烁的第二闪烁光;所述第一闪烁光在所述确认控件确定控件的显示区间内闪烁光;所述第二闪烁光在所述取消控件的显示区域间内闪烁。It can be understood that a confirmation control and/or a cancel control is displayed on the prompt information; the flashing light includes: a first flashing light flashing at a first frequency and a second flashing light flashing at a second frequency; the first flashing light flashes within the display interval of the confirmation control and the confirmation control; the second flashing light flashes within the display area of the cancel control.
可以理解地,所述根据频率域所述闪烁光的闪烁频率具有第一关系的所述阿尔法脑波振幅和频率域所述闪烁光的闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值,包括:根据与所述第一频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第一频率具有第二关系的所述贝达脑波的振幅,确定执行所述确定控件关联的确定操作的所述集中度值;或者,根据与所述第二频率具有所述第一关系的所述阿尔法脑波振幅和根据频率与所述第二频率具有第二关系的所述贝达脑波的振幅,确定执行所述取消控件关联的取消操作的所述集中度值。It can be understood that the concentration value is determined based on the amplitude of the alpha brain wave having a first relationship with the flickering frequency of the flickering light in the frequency domain and the amplitude of the beta brain wave having a second relationship with the flickering frequency of the flickering light in the frequency domain, including: determining the concentration value for executing the determination operation associated with the determination control based on the amplitude of the alpha brain wave having the first relationship with the first frequency and the amplitude of the beta brain wave having the second relationship with the first frequency based on frequency; or determining the concentration value for executing the cancel operation associated with the cancel control based on the amplitude of the alpha brain wave having the first relationship with the second frequency and the amplitude of the beta brain wave having the second relationship with the second frequency based on frequency.
可以理解地,所述第一闪烁光的光波频率不同于所述第二闪烁光的光波频率。It can be understood that the light wave frequency of the first scintillation light is different from the light wave frequency of the second scintillation light.
可以理解地,所述根据频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅和频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅,确定集中度值,包括:确定第一时刻频率与所述闪烁频率具有第一关系的所述阿尔法脑波的振幅能量及频率与所述闪烁频率具有第一关系的所述阿尔法脑波的最大振幅能量之间的第一比值;确定所述第一时刻所述频率与所述闪烁频率具有第二关系的所述贝达脑波的振幅能量及所述频率与所述闪烁频率具有第二关系的所述贝达脑波的最大振幅能量之间的第二比值;根据所述第一比值及所述第二比值,得到所述集中度值。It can be understood that the concentration value is determined according to the amplitude of the alpha brain wave whose frequency has a first relationship with the flicker frequency and the amplitude of the beta brain wave whose frequency has a second relationship with the flicker frequency, including: determining a first ratio between the amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency and the maximum amplitude energy of the alpha brain wave whose frequency has a first relationship with the flicker frequency at a first moment; determining a second ratio between the amplitude energy of the beta brain wave whose frequency has a second relationship with the flicker frequency and the maximum amplitude energy of the beta brain wave whose frequency has a second relationship with the flicker frequency at the first moment; and obtaining the concentration value according to the first ratio and the second ratio.
可以理解地,所述根据所述第一比值及所述第二比值,得到所述集中度值,包括:计算所述第一比值和所述第二比值的差,得到所述集中度值。It can be understood that obtaining the concentration value according to the first ratio and the second ratio includes: calculating the difference between the first ratio and the second ratio to obtain the concentration value.
可以理解地,所述根据所述集中度值,控制所述电子设备执行与对应的所述预设对象关联的操作,包括:若所述集中度值满足预设条件,控制所述电子设备执行与所述操作控件关联的操作。It can be understood that controlling the electronic device to perform an operation associated with the corresponding preset object according to the concentration value includes: if the concentration value meets a preset condition, controlling the electronic device to perform an operation associated with the operation control.
可以理解地,所述集中度值满足预设条件,包括:所述集中度值的波峰值大于第一阈值;和/或,所述集中度值的波谷值小于第二阈值;其中,所述第二阈值小于所述第一阈值。It can be understood that the concentration value satisfies preset conditions, including: the peak value of the concentration value is greater than a first threshold; and/or the trough value of the concentration value is less than a second threshold; wherein the second threshold is less than the first threshold.
可以理解地,所述方法,还包括:在第n检测时刻的集中度值位于预设区间时,确定所述第n检测时刻的集中度值与第n-1检测时刻的集中度值之间的第一斜率,并确定所述第n检测时刻的集中度值与第n+1检测时刻的集中度值之间的第二斜率;所述集中度值位于预设区间包括:集中度值大于所述第一阈值或集中度值所小于述第二阈值;其中,所述n为正整数;若所述第一斜率的符号和所述第二斜率的符号相反,确定所述集中度值的波峰值大于所述第一阈值或者所述集中度值的波谷值小于所述第二阈值。It can be understood that the method also includes: when the concentration value at the nth detection moment is within a preset interval, determining a first slope between the concentration value at the nth detection moment and the concentration value at the n-1th detection moment, and determining a second slope between the concentration value at the nth detection moment and the concentration value at the n+1th detection moment; the concentration value being within the preset interval includes: the concentration value being greater than the first threshold or the concentration value being less than the second threshold; wherein n is a positive integer; if the sign of the first slope is opposite to the sign of the second slope, determining that the peak value of the concentration value is greater than the first threshold or the trough value of the concentration value is less than the second threshold.
可以理解地,所述方法还包括:在所述第一页面显示开始的第二预设时长内未检测到满足所述预设条件的所述集中度值,控制所述电子设备切换到显示第二页面。It can be understood that the method further includes: if the concentration value satisfying the preset condition is not detected within a second preset time period after the first page starts to be displayed, controlling the electronic device to switch to displaying the second page.
可以理解地,所述方法还包括:获取所述目标用户的眼电波;根据所述眼电波的眼电特征,控制电子设备进行显示页面的切换。It can be understood that the method further includes: acquiring the eye waves of the target user; and controlling the electronic device to switch the display page according to the eye wave characteristics.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (20)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011440841.6A CN114594854B (en) | 2020-12-07 | 2020-12-07 | Electronic equipment control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011440841.6A CN114594854B (en) | 2020-12-07 | 2020-12-07 | Electronic equipment control method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114594854A CN114594854A (en) | 2022-06-07 |
| CN114594854B true CN114594854B (en) | 2024-07-02 |
Family
ID=81802654
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011440841.6A Active CN114594854B (en) | 2020-12-07 | 2020-12-07 | Electronic equipment control method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114594854B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116540883B (en) * | 2023-07-07 | 2023-09-19 | 之江实验室 | Signal acquisition method and device, storage medium and electronic equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1776572A (en) * | 2005-12-08 | 2006-05-24 | 清华大学 | Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves |
| CN110298712A (en) * | 2019-08-01 | 2019-10-01 | 秒针信息技术有限公司 | A kind of method and device obtaining user's engagement |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101373402A (en) * | 2007-08-24 | 2009-02-25 | 中兴通讯股份有限公司 | System and method for human-machine interaction based on brain wave excited by vision |
| US9701197B1 (en) * | 2011-09-22 | 2017-07-11 | Rockwell Collins, Inc. | Positive acknowledgement method that information is received |
| KR101612037B1 (en) * | 2015-02-02 | 2016-04-20 | 한양대학교 에리카산학협력단 | Electronic equipment control device using brain wave |
| CN105163180A (en) * | 2015-08-21 | 2015-12-16 | 小米科技有限责任公司 | Play control method, play control device and terminal |
| KR20170096278A (en) * | 2016-02-15 | 2017-08-24 | 한양대학교 에리카산학협력단 | Study condition control system using brain wave |
-
2020
- 2020-12-07 CN CN202011440841.6A patent/CN114594854B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1776572A (en) * | 2005-12-08 | 2006-05-24 | 清华大学 | Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves |
| CN110298712A (en) * | 2019-08-01 | 2019-10-01 | 秒针信息技术有限公司 | A kind of method and device obtaining user's engagement |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114594854A (en) | 2022-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10075653B2 (en) | Method and electronic device for image processing | |
| CN110554815B (en) | Icon awakening method, electronic device and storage medium | |
| CN105425657B (en) | Alarm clock jingle bell control method and device | |
| JP6355735B2 (en) | Method and apparatus for initiating an energy saving mode | |
| CN111984347B (en) | Interactive processing method, device, equipment and storage medium | |
| RU2637884C2 (en) | Method and device for displaying mark on pictogram | |
| CN107193976B (en) | Information resource display method, device and computer readable storage medium | |
| WO2017084183A1 (en) | Information displaying method and device | |
| JP2017509308A (en) | CHARGE MANAGEMENT METHOD, CHARGE MANAGEMENT DEVICE, PROGRAM, AND RECORDING MEDIUM | |
| CN113703937B (en) | Animation switching method and device and storage medium | |
| WO2019206243A1 (en) | Material display method, terminal, and computer storage medium | |
| WO2017088260A1 (en) | Sleep state detection method, apparatus, and system | |
| EP2922212A2 (en) | Method, apparatus and system for controlling emission | |
| CN109189986B (en) | Information recommendation method and device, electronic equipment and readable storage medium | |
| CN108616775B (en) | Method and device for intelligently capturing picture during video playing, storage medium and intelligent terminal | |
| US20210165670A1 (en) | Method, apparatus for adding shortcut plug-in, and intelligent device | |
| CN105678266A (en) | Method and device for combining photo albums of human faces | |
| CN111061906A (en) | Music information processing method and device, electronic equipment and computer readable storage medium | |
| US11507264B2 (en) | Method and device for managing information | |
| CN114594854B (en) | Electronic equipment control method and device, electronic equipment and storage medium | |
| US20230031021A1 (en) | Information processing method, electronic device and storage medium | |
| CN112114653A (en) | Terminal device control method, device, equipment and storage medium | |
| CN114594852B (en) | Electronic device control method and device, electronic device and storage medium | |
| CN114343597A (en) | Physiological parameter monitoring method and device, keyboard, electronic equipment and storage medium | |
| CN105589601B (en) | Back light brightness regulating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |