TWI638281B - Providing a method for patients to visually request assistance information - Google Patents
Providing a method for patients to visually request assistance information Download PDFInfo
- Publication number
- TWI638281B TWI638281B TW106124886A TW106124886A TWI638281B TW I638281 B TWI638281 B TW I638281B TW 106124886 A TW106124886 A TW 106124886A TW 106124886 A TW106124886 A TW 106124886A TW I638281 B TWI638281 B TW I638281B
- Authority
- TW
- Taiwan
- Prior art keywords
- patient
- instruction
- assistance information
- user interface
- demand
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000000007 visual effect Effects 0.000 claims abstract description 17
- 208000002193 Pain Diseases 0.000 claims description 25
- 239000010410 layer Substances 0.000 claims description 17
- 238000013022 venting Methods 0.000 claims description 13
- 208000003251 Pruritus Diseases 0.000 claims description 9
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims description 6
- 239000002356 single layer Substances 0.000 claims description 6
- 201000010099 disease Diseases 0.000 claims description 5
- 230000007803 itching Effects 0.000 claims description 5
- 230000001953 sensory effect Effects 0.000 claims description 5
- 210000001747 pupil Anatomy 0.000 claims description 4
- 244000025254 Cannabis sativa Species 0.000 claims description 3
- 235000012766 Cannabis sativa ssp. sativa var. sativa Nutrition 0.000 claims description 3
- 235000012765 Cannabis sativa ssp. sativa var. spontanea Nutrition 0.000 claims description 3
- 235000009120 camo Nutrition 0.000 claims description 3
- 235000005607 chanvre indien Nutrition 0.000 claims description 3
- 239000011487 hemp Substances 0.000 claims description 3
- 239000000700 radioactive tracer Substances 0.000 abstract description 3
- 230000006735 deficit Effects 0.000 abstract 1
- 208000027905 limb weakness Diseases 0.000 abstract 1
- 231100000861 limb weakness Toxicity 0.000 abstract 1
- 230000035807 sensation Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000037213 diet Effects 0.000 description 4
- 235000005911 diet Nutrition 0.000 description 4
- 239000003814 drug Substances 0.000 description 4
- 230000008014 freezing Effects 0.000 description 4
- 238000007710 freezing Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012937 correction Methods 0.000 description 3
- 229940079593 drug Drugs 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 208000005264 motor neuron disease Diseases 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000013517 stratification Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 208000004044 Hypesthesia Diseases 0.000 description 1
- 208000026072 Motor neurone disease Diseases 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 208000027499 body ache Diseases 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 208000035475 disorder Diseases 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 208000034783 hypoesthesia Diseases 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 235000015250 liver sausages Nutrition 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 231100000862 numbness Toxicity 0.000 description 1
- 208000035824 paresthesia Diseases 0.000 description 1
- 230000002980 postoperative effect Effects 0.000 description 1
- 238000005086 pumping Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000001179 sorption measurement Methods 0.000 description 1
- 208000027765 speech disease Diseases 0.000 description 1
- 230000009747 swallowing Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 238000002627 tracheal intubation Methods 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
本發明涉及一種提供患者以視覺下達需求協助信息的方法,包括依患者的共通需求預先設定多個具有分層及分類之關聯性的眼控指令集,並藉此建置多個按下事件圖塊及多個使用者介面,所述多個使用者介面能於一顯示幕中分層揭示多個分類的按下事件圖塊,並且應用該顯示幕所搭載的一追瞳儀,檢知患者凝視所述多個使用者介面中的各該按下事件圖塊而生成一翻頁信號或一觸發信號;該翻頁信號命令各該分層之使用者介面翻頁,該觸發信號命令一提示單元生成患者的一需求協助信息,以改善具有言語障礙且四肢無力的患者在下達需求協助信息時的方便性。 The present invention relates to a method for providing a patient with visual assistance request information, including presetting a plurality of eye control instruction sets having hierarchical and classified associations according to a common requirement of the patient, and thereby constructing a plurality of pressed event maps. And a plurality of user interfaces, wherein the plurality of user interfaces can hierarchically reveal a plurality of classified pressing event tiles in a display screen, and apply a tracer mounted on the display screen to detect the patient Navigating each of the plurality of user interfaces to generate a page flipping signal or a triggering signal; the page turning signal commands each layered user interface to page through, the triggering signal commanding a prompt The unit generates a demand assistance information for the patient to improve the convenience of the patient with speech impairment and limb weakness in the request assistance information.
Description
本發明涉及使用者介面(User Interface)的視覺操作(Eye-Control)技術,特別有關一種提供患者以視覺下達需求協助信息的方法。 The present invention relates to the user interface (Eye-Control) technology, and more particularly to a method of providing a patient with visual assistance request information.
患者意指起因於肢體受傷或染患某種疾病的對象,不論其是否住院,一般皆會躺臥於床上接受治療或休養。有些患者會因病症而導致其無法說話,或無法清楚地用口語或肢體手勢向醫護人員、看護人員或家屬明確地表達或指引出例如身體痛、癢或不適的部位。 A patient means a subject who is caused by a physical injury or is suffering from a disease, whether or not he is hospitalized, usually lying on the bed for treatment or recuperation. Some patients may be unable to speak because of a condition, or they may not clearly articulate or direct to a health care provider, caregiver, or family member, such as a bodyache, itching, or discomfort, with a spoken or physical gesture.
坊間有一種罕見的漸凍人症,全名為「運動神經元疾病」(Motor Neuron Diseases,MND)。染患此種病症的患者,初期其身體會漸漸地無法動彈,仿彿身體被凍結了一般;大約在確診後三年內即開始有吞嚥困難、飲食會嗆到、舌頭無力的狀態,且逐漸地無法以正常人的口語速度說話,造成溝通上的障礙。此外,例如是已執行氣切的患者,用口說話也是相當的不容易,乃至於在溝通上也是一大挑戰。 There is a rare form of gradual freezing human disease, the full name of "Motor Neuron Diseases" (MND). In patients with this condition, the body will gradually become unable to move at the beginning, as if the body is frozen; about three years after the diagnosis, it will begin to have difficulty swallowing, eating, and the tongue is weak, and gradually Unable to speak at the normal speaking speed, causing communication obstacles. In addition, for example, a patient who has performed a gas cut is not easy to speak with, but it is also a challenge in communication.
為了改善上述問題,坊間較先進的技術已存在內建有眼控追瞳儀的視覺操作輔具,能提供患者以眼控方式來下達需求協助的信息。其中,視覺操作又稱為眼控操作(Eye-Control),一般是以電腦螢幕作為患者眼睛的觀看介面,電腦螢幕會顯示出注音符號、英文字母與數字等可供眼睛凝視(Gazing)進而點選的字元區塊,供患者能用眼睛打字的方式,來表達需求協助信息。但是, 倘若患者(例如是罹患漸凍人症的患者)正處於有急迫需求時,例如想上廁所,或某處疼痛難耐等,應用上述眼控打字方式表達必須耗費較長時間,在此過程十分難耐是可想而知的。 In order to improve the above problems, the more advanced technology in the market already has visual operation aids with built-in eye tracking devices, which can provide patients with information on eye contact to request assistance. Among them, the visual operation is also called Eye-Control. Generally, the computer screen is used as the viewing interface of the patient's eyes. The computer screen will display the phonetic symbols, English letters and numbers, etc. for the eyes to stare (Gazing) and then point. The selected character block is used by the patient to express the demand assistance information by means of eye typing. but, If a patient (for example, a patient with gradual freezing disease) is in urgent need, such as going to the toilet or suffering from a certain pain, it takes a long time to apply the above-mentioned eye-control typing method, which is very difficult in this process. It is conceivable.
另一方面,以一般正常人而言,用手指操作鍵盤、滑鼠來輸入指令是相當容易的;但是,用眼睛凝視螢幕介面中的所述字元區塊來操作一按下(key down/click)事件時,乃受限於眼睛不容易直覺式的按下;因此,坊間發展出了許多眼控輸入法,讓眼控時得以產生按下(click)事件。 On the other hand, in the case of a normal person, it is quite easy to use a finger to operate the keyboard and the mouse to input an instruction; however, the eyes are gazing at the character block in the screen interface to operate a key press (key down/ The click event is limited by the fact that the eye is not easy to intuitively press; therefore, a lot of eye control input methods have been developed to allow the eye control to produce a click event.
坊間多數的共識,都是以眼睛凝視時間(dwell time)來產生按下事件。然而,人眼凝視某物的時間若是過長(>1000ms),眼睛很容易疲倦;凝視時間若是過短(<300ms),則眼控追瞳儀不容易捕捉瞳孔位置。且知,用眼睛打字的凝視時間,平均落在400~1000ms左右,會因持續學習的關係加速。有人用掃視方法,人們掃視的速度是相當快的(<100ms),平均凝視時間約100-600ms,使用者透過一種特定順序的掃視方式,以取得使用者的指令;但是,這種掃視方法,使用者必須要練習、記憶、甚至要演練想像,並不是一個很直覺的方法;相對於患者而言,在眼控操作按下事件的靈敏性及方便性上,仍存在有改善的空間。 Most of the consensus among the parties is to generate a press event with dwell time. However, if the human eye gaze at something for too long (>1000ms), the eyes are easily tired; if the gaze time is too short (<300ms), the eye tracking device is not easy to capture the pupil position. It is also known that the gaze time of typing with the eyes falls on the average of 400~1000ms, which is accelerated by the continuous learning relationship. Some people use the glance method, the speed of people's glance is quite fast (<100ms), the average gaze time is about 100-600ms, the user uses a specific order of glance to obtain the user's instructions; however, this method of glance, The user has to practice, remember, and even practice the imagination. It is not a very intuitive method. Compared with the patient, there is still room for improvement in the sensitivity and convenience of the eye control operation.
有鑑於此,本發明旨在改善傳統眼控打字方式須耗費較多操作時間,對身患病痛之苦的患者用戶而言,在下達需求協助信息時顯有緩不濟急而存在操作方便利欠佳的問題。 In view of this, the present invention aims to improve the traditional eye-controlled typing method, which requires more operation time, and for the patient suffering from the pain of the patient, when the demand assistance information is released, it is obviously unsatisfactory and has convenient operation and owing. Good question.
進一步的說,本發明之一目的在於捨棄傳統眼控打字的操作方式,而改以預先收集患者病程所需的共同指令為基礎,製作一個易於以眼睛控制選取指令的介面,搭配文字轉語音系統(TTS)、預先翻譯(多國語言)、身體地圖(Body Map)等作為介面選項,讓患者可以快速地眼控點選所需指令而對外下達需求協助的信息。 Further, one of the objects of the present invention is to abandon the operation mode of the traditional eye-controlled typing, and to create an interface that is easy to use the eye to control the selection command based on the common instruction required to collect the patient's course in advance, and to match the text-to-speech system. (TTS), pre-translated (multi-language), body map (Body Map), etc. as interface options, allowing patients to quickly control the information required by clicking on the required instructions.
為了實現上述目的,本發明一較佳實施例在於提出 一種提供患者以視覺下達需求協助信息的方法,包括依序執行:(1)依患者的共通需求設定多個眼控指令集,所述多個眼控指令集具有分層及分類之關聯性;(2)建置多個按下事件圖塊及多個使用者介面,所述多個按下事件圖塊依所述多個眼控指令集分層及分類之關聯性編輯而成,所述多個使用者介面分層揭示所述多個分類的按下事件圖塊,且所述多個使用者介面依序揭示於一顯示幕;(3)應用該顯示幕所搭載之一追瞳儀,檢知患者瞳孔凝視所述多個使用者介面中的各該按下事件圖塊而生成一翻頁信號或一觸發信號;該翻頁信號命令各該分層之使用者介面翻頁,該觸發信號命令一提示單元生成患者的一需求協助信息;其中,所述多個按下事件圖塊中至少包含一身體部位圖案指令,且該需求協助信息至少包含以聲音下達。 In order to achieve the above object, a preferred embodiment of the present invention is to propose A method for providing a patient with visual assistance demand information, comprising: sequentially performing: (1) setting a plurality of eye control instruction sets according to a common requirement of the patient, the plurality of eye control instruction sets having a hierarchical and classification association; (2) constructing a plurality of pressed event tiles and a plurality of user interfaces, wherein the plurality of pressed event tiles are edited according to the association of the plurality of eye control command sets and classifications, The plurality of user interface layers are layered to reveal the plurality of classified pressing event tiles, and the plurality of user interfaces are sequentially displayed on a display screen; (3) applying the display screen to one of the tracking devices Detecting that the patient's pupil gaze at each of the plurality of user interfaces to generate a page turning signal or a trigger signal; the page turning signal commands each user interface of the layer to turn pages, The trigger signal command a prompting unit generates a demand assistance information of the patient; wherein the plurality of pressed event tiles include at least one body part pattern instruction, and the demand assistance information includes at least sound release.
在進一步實施中,所述多個按下事件圖塊包含於各該單層的使用者介面中顯示分類的多個特定操作指令圖塊及多個特定需求指令圖塊,所述身體部位圖案指令隸屬於特定需求指令圖塊的其中之一。其中: In a further implementation, the plurality of pressed event tiles are included in a user interface of each single layer to display a plurality of specific operation instruction tiles and a plurality of specific requirement instruction tiles, and the body part pattern instruction Belong to one of the specific demand instruction tiles. among them:
所述多個特定操作指令圖塊至少包含一服務鈴指令及一翻頁指令。 The plurality of specific operation instruction blocks include at least one service ring instruction and one page turning instruction.
所述特定需求指令圖塊包含一身體感覺指令,該身體部位圖案指令係於該身體感覺指令次層的使用者介面中顯示。該身體部位圖案指令包含於單一層使用者介面中分隔顯示一3D身體局部放大圖案指令及至少一全身圖案指令,該3D身體局部放大圖案指令能動態顯示該3D全身圖案指令所指引的身體放大部位。更進一步的,該身體局部放大圖案指令的周邊佈設有多個方向指令圖塊、多個縮放指令圖塊及多個旋轉指令圖塊,以供患者精確地點選出身體不適或疼痛的部位。 The specific demand instruction block includes a body sensation command displayed in a user interface of the body sensation command sublayer. The body part pattern command includes a 3D body part enlargement pattern command and at least one whole body pattern command separately displayed in the single layer user interface, and the 3D body part enlargement pattern command can dynamically display the body enlargement part guided by the 3D whole body pattern instruction. Further, the periphery of the body part enlargement pattern command is provided with a plurality of direction command blocks, a plurality of zoom instruction blocks and a plurality of rotation instruction blocks for the patient to accurately select a part of physical discomfort or pain.
該身體部位圖案指令包含於該單一層使用者介面中分隔顯示一我感覺指令。該我感覺指令次層的使用者介面中顯示 有至少一感覺指令圖塊或多個等級指令圖塊;所述感覺指令圖塊包含癢、痛、麻、累、冷、熱的至少其中之一,所述多個等級指令圖塊包含一點點、輕微、很、非常、無法忍受之中的至少兩個,或者是包含刺痛、抽痛、悶痛、酸痛、脹痛、抽痛之中的至少兩個,以供患者精確地下達身體不適或疼痛的程度。 The body part pattern instruction includes a separate display of a sensory command in the single layer user interface. I feel that the command sub-layer is displayed in the user interface. Having at least one sensation instruction tile or a plurality of gradation instruction tiles; the sensation instruction tile includes at least one of itch, pain, hemp, tired, cold, and hot, and the plurality of hierarchical instruction tiles include a little bit At least two of mild, very, very, intolerable, or at least two of stinging, pain, numbness, soreness, pain, and pain, for the patient to accurately reach the discomfort Or the extent of the pain.
基於上述,本發明所能呈現的技術功效,在於讓一位具有言語表達障礙的患者,例如是罹患有運動神經元疾病之漸凍人症的患者,或者是視覺意識無慮但罹患有身體其它部位疾病或重症的患者,在無法清楚用口語表達意識且四肢無力的狀況下,能夠快速地用眼睛來對外溝通暨下達身體上需求協助的信息。 Based on the above, the technical effect of the present invention is to enable a patient with a speech expression disorder, such as a patient with a gradual freezing of a motor neuron disease, or a visually conscious person who suffers from other parts of the body. In patients with severe illness or severe illness, they can quickly communicate with their eyes and provide information on physical assistance in the situation when they are unable to clearly express their sense of language and their limbs are weak.
本發明之另一目的,在於提升眼控操作按下事件時視覺回饋的靈敏性及方便性。 Another object of the present invention is to improve the sensitivity and convenience of visual feedback when an eye control operation presses an event.
為了實現此目的,本發明還包含下列實施例: To achieve this, the present invention also encompasses the following embodiments:
在進一步實施中,該追瞳儀在檢知患者眼睛凝視位置時,能以一視線游標顯示於各該使用者介面,該視線游標並跟隨患者眼睛的凝視位置而在各該使用者介面中移動及停止。其中,該視線游標接觸到各該按下事件圖塊的一邊緣而生成一重疊區域時,該按下事件圖塊能自動吸附視線游標至該按下事件圖塊的中心位置,以改善人體的眼睛視線容易抖動的問題。 In a further implementation, the tracking device can display a visual line cursor on each user interface when detecting the gaze position of the patient's eye, and the visual line cursor moves in the user interface along the gaze position of the patient's eye. And stop. Wherein, when the line of sight cursor contacts an edge of each pressed event block to generate an overlapping area, the pressed event block can automatically absorb the line of sight cursor to the center position of the pressed event block to improve the human body. Eye sight is easy to shake.
在進一步實施中,各該使用者介面中顯示的所述多個特定操作指令圖塊及多個特定需求指令圖塊之間形成有一空白區域,該空白區域規劃形成至少一凝視放空區,供患者在不操作按下事件時眼睛視線可稍作休息,或以眼角餘光查看畫面。其中,該凝視放空區可揭示預先內建翻譯好的說明用或指引用文字。 In a further implementation, a blank area is formed between the plurality of specific operation instruction blocks and the plurality of specific requirement instruction blocks displayed in each user interface, and the blank area is planned to form at least one gaze emptying area for the patient. The eye line of sight can be rested a little while the press event is not being operated, or the picture can be viewed with the corner of the eye. Wherein, the gaze emptying area can reveal the pre-built built-in explanatory or guiding text.
在進一步實施中,該追瞳儀在檢知患者眼睛凝的各該按下事件圖塊時,各該使用者介面20能顯示一附具倒數數字的計時圖塊。其中該凝視放空區揭示有預先內建翻譯好的說明用或指引用文字。 In a further implementation, the user interface 20 can display a timing block with a countdown number when detecting the respective pressing event tiles of the patient's eyes. The gaze venting area reveals a pre-built translation of the instructional or guiding text.
在進一步實施中,各該使用者介面中佈設有陣列式 的若干網點,所述網點顯露於所述多個按下事件圖塊周邊的空白區域內。 In a further implementation, each user interface is provided with an array a plurality of network points, the network dots being exposed in a blank area around the plurality of pressed event tiles.
據此,本發明所能呈現的技術功效還包含:提供有利的視覺回饋機制,讓患者眼睛在凝視暨點選事件圖塊過程中,能像磁鐵般地吸附到眼睛所凝視的事件圖塊上,且在眼睛不點選時能夠獲得休息,還有產生放大視窗、放大按鈕、按鈕動畫設計、按扭標示文字並附予顏色作區隔等,讓患者能夠清楚地看見自己凝視的游標點及其需求協助的待點選內容,避免許多患者因為不知所措而產生的操作錯誤,因此有助於提升患者使用上的便利性。 Accordingly, the technical effects that can be presented by the present invention include: providing an advantageous visual feedback mechanism that allows the patient's eyes to be magnet-likely adsorbed onto the event tile that the eye is gazing during the gaze and point-selection event tile. And can get a rest when the eyes are not selected, as well as a magnifying window, a magnifying button, a button animation design, a button to mark the text and a color for separation, so that the patient can clearly see the gaze point of his gaze and The need to assist in the selection of content, to avoid the operation errors caused by many patients because of overwhelming, thus helping to improve the convenience of the patient.
以上所述之方法與裝置之技術手段及其產生效能的具體實施細節,請參照下列實施例及圖式加以說明。 The specific implementation details of the above-mentioned methods and devices and the specific implementation details thereof will be described with reference to the following embodiments and drawings.
10‧‧‧顯示幕 10‧‧‧ display screen
11‧‧‧追瞳儀 11‧‧‧Tracker
12‧‧‧眼睛 12‧‧‧ eyes
13、13a、13b‧‧‧視線游標 13, 13a, 13b‧‧ Sight sight cursors
20、20a、20b、20c、20d‧‧‧使用者介面 20, 20a, 20b, 20c, 20d‧‧‧ user interface
21、21a‧‧‧網點 21, 21a‧‧‧ outlets
30‧‧‧按下事件圖塊 30‧‧‧Press event tile
31‧‧‧特定操作指令圖塊 31‧‧‧Specific Operational Instruction Blocks
31a‧‧‧服務鈴指令 31a‧‧‧Service Bell Instructions
31b‧‧‧情緒表達指令 31b‧‧‧Emotional expression instructions
31c‧‧‧休眠模式指令 31c‧‧‧Sleep mode command
31d‧‧‧翻頁指令 31d‧‧‧Page turning instructions
31e‧‧‧虛擬照服員表情指令 31e‧‧‧Virtual Guardian Expression Command
31f‧‧‧首頁指令 31f‧‧‧Home Instructions
31g‧‧‧開啟呼叫指令 31g‧‧‧Open call command
31h‧‧‧返回(或上一頁)指令 31h‧‧‧Return (or previous page) instructions
31j‧‧‧確認指令 31j‧‧‧Confirmation order
32‧‧‧特定需求指令圖塊 32‧‧‧Special Demand Instruction Blocks
32a‧‧‧日常生活指令 32a‧‧‧ Daily life instructions
32b‧‧‧特別狀況指令 32b‧‧ Special Situational Directive
32c‧‧‧身體感覺指令 32c‧‧‧ body feeling instructions
32d‧‧‧飲食指令 32d‧‧‧Diet Directive
32e‧‧‧藥物指令 32e‧‧ Drug Directive
32f‧‧‧個人衛生指令 32f‧‧‧Personal Health Directive
32g‧‧‧身體部位圖案指令 32g‧‧‧ body part pattern instruction
32g’‧‧‧3D身體局部放大圖案指令 32g'‧‧3D body part enlargement pattern instruction
320g’‧‧‧方向指令圖塊 320g’‧‧‧ Directional Instruction Block
321g’‧‧‧縮放指令圖塊 321g'‧‧‧ zoom instruction block
322g’‧‧‧旋轉指令圖塊 322g'‧‧‧Rotary Instruction Block
32g”‧‧‧3D全身圖案指令 32g"‧‧3D body pattern instruction
32h‧‧‧我感覺指令 32h‧‧‧I feel the order
32i‧‧‧感覺指令圖塊 32i‧‧‧Feeling instruction block
32j‧‧‧等級指令圖塊 32j‧‧‧ level instruction block
33、33a、33b‧‧‧凝視放空區 33, 33a, 33b‧‧ gaze at the venting area
34‧‧‧計時圖塊 34‧‧‧Timed block
40‧‧‧翻頁信號 40‧‧‧Page turning signal
50‧‧‧觸發信號 50‧‧‧ trigger signal
60‧‧‧提示單元 60‧‧‧Cue unit
61‧‧‧需求協助信息 61‧‧‧ Demand assistance information
61a‧‧‧聲音 61a‧‧‧Sound
61b‧‧‧文字/圖形 61b‧‧‧Text/Graph
A‧‧‧重疊區域 A‧‧‧Overlapping area
S1至S3‧‧‧步驟說明 S1 to S3‧‧‧Step Description
圖1是本發明方法的程序圖。 BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a program diagram of the method of the present invention.
圖2是本發明提供眼控操作的硬體架構示意圖。 2 is a schematic diagram of a hardware architecture of the present invention for providing eye control operations.
圖3是本發明憑藉圖2所示的顯示幕來揭示多個使用者介面的示意圖。 3 is a schematic diagram of the present invention for revealing a plurality of user interfaces by means of the display screen shown in FIG. 2.
圖3a至圖3e分別說明本發明多個分層顯示之使用者介面態樣的示意圖。 3a to 3e are schematic views respectively showing user interface aspects of a plurality of hierarchical displays of the present invention.
圖4是本發明檢知按下事件的程序圖。 4 is a sequence diagram of the present invention for detecting a press event.
圖5是本發明利用網點修正患者視線誤差的解說圖。 FIG. 5 is an explanatory diagram of the present invention for correcting a patient's line of sight error using a halftone dot.
圖6是本發明按下事件圖塊能夠磁吸視線游標的解說圖。 Figure 6 is an illustration of a push-down event cursor of a pop-down line cursor of the present invention.
圖7是本發明操作按下事件的倒數邏輯圖。 Figure 7 is a reciprocal logic diagram of the operation down event of the present invention.
首先,請參閱圖1,揭示出本發明提供患者以視覺下達需求協助信息方法的程序圖,說明包括依序執行下列步驟S1至S3: First, referring to FIG. 1, the present invention discloses a program diagram for providing a method for visually releasing a demand assistance information for a patient, and the description includes sequentially performing the following steps S1 to S3:
步驟S1:預先設定多個眼控指令集。 Step S1: A plurality of eye control instruction sets are set in advance.
本發明針對有言語障礙、意識清楚可以靈活運用眼
睛但四肢無力的患者,例如漸凍人、氣切、中風、術後插管等作為目標族群,蒐集其病因及症狀的每日需求,例如是緊急叫人、解決溝通障礙、快速且精簡地提出協助需求、多國語言的語音溝通等,並且擬定醫護人員、照顧人員及親友等作為溝通對象,來預先設定或編輯好一套眼控快速溝通的功能指令集(如表一所示,以下簡稱為眼控指令集),例如包括患者日常生活的需求指令、重要指令、不同情境指令(居家、外出、就醫等)、發生迫切需求時的常用指令等,用以提供換者操作,讓患者能夠快速地和所述溝通對象進行溝通。根據表一內容,本發明進一步產出符合多數患者共通需求的多個眼控指令集資料檔(如表二所示):
根據表一及表二所揭的多個眼控指令集,還可以進一步規劃出:對需求指令分層及分類、需求指令預先翻譯(中、英、印尼、越南四國語言)、設定所述指令的前綴語(例如:我想要、我需要、感覺、無)、設定該指令是否對應身體地圖場景、使用者呼叫次數、是否設定為捷徑等模式,使得所述患者共通需求指令之間具有分層及分類之關聯性。再者,所述多個眼控指令集並以軟體程式呈現。 According to the multiple eye control instruction sets disclosed in Tables 1 and 2, further planning: stratification and classification of demand instructions, pre-translation of demand instructions (Chinese, English, Indonesian, Vietnamese), setting The prefix of the instruction (for example: I want, I need, feel, no), whether the instruction corresponds to the body map scene, the number of user calls, whether it is set to shortcut or the like, so that the patient has a common requirement between the instructions The relevance of stratification and classification. Furthermore, the plurality of sets of eye control instructions are presented in a software program.
步驟S2:優化互動介面。 Step S2: Optimize the interactive interface.
如表一所示,本發明需應用電腦、顯示幕(或螢幕)、滑鼠等硬體,來執行及維護如表二所示多個眼控指令集編製而成的軟體程式。其中,滑鼠僅供程式維護人員、醫護人員或看護人員使用,並非患者下達需求協助信息時所必須,但亦可供手指活動無障礙的患者使用。 As shown in Table 1, the present invention requires a computer, a display screen (or a screen), a mouse, and the like to execute and maintain a software program compiled from a plurality of eye control instruction sets as shown in Table 2. Among them, the mouse is only used by program maintenance personnel, medical staff or caregivers. It is not necessary for the patient to request the assistance information, but it can also be used by patients with finger movements.
請參閱圖2,揭示本發明並於該顯示幕10的一周邊(例如顯示幕10的下方)搭載一追瞳儀11(或稱追瞳裝置),供患者眼睛12的視線便於凝視整個顯示幕10的畫面,並且憑藉追瞳儀11來檢知患者眼控的按下事件。 Referring to FIG. 2, the present invention is disclosed and mounted on a periphery of the display screen 10 (for example, below the display screen 10) with a tracer 11 (or a tracking device) for allowing the patient's eye 12 to view the entire display screen. The screen of 10, and with the tracer 11 to detect the pressing event of the patient's eye control.
請續參閱圖3,說明本發明憑藉該顯示幕10來揭示可供患者眼睛觀察的多個使用者介面20。所述每一個使用者介面20中並建置有多個按下事件圖塊30,所述多個按下事件圖塊30可依事件指令類型之不同而區分成多個特定操作指令圖塊31(舉例以圓形圖塊表示),及多個特定需求指令圖塊32(舉例以正方形圖塊表示);使得所述多個使用者介面20能以層劃分(即分層)來揭示所述多個分類的按下事件圖塊30。所述多個特定操作指令圖塊31及多個特定需求指令圖塊32內可以各自附加特定的事件文字(或稱指令名稱)並附予特定顏色顯示,以利視覺分辨(如圖3a、圖3b、圖3d、圖3e所示,容後詳述)。 Referring to FIG. 3, the present invention utilizes the display screen 10 to reveal a plurality of user interfaces 20 that are viewable by the patient's eyes. Each of the user interfaces 20 is configured with a plurality of pressing event blocks 30, and the plurality of pressing event blocks 30 can be divided into a plurality of specific operation instruction blocks 31 according to different types of event instructions. (indicated by circular tiles, for example), and a plurality of specific demand instruction tiles 32 (indicated by square tiles, for example); such that the plurality of user interfaces 20 can be layered (ie, layered) to reveal the Pressing event block 30 for multiple categories. Each of the plurality of specific operation instruction blocks 31 and the plurality of specific requirement instruction blocks 32 may be respectively attached with a specific event text (or an instruction name) and attached to a specific color display for visual resolution (as shown in FIG. 3a and FIG. 3b, Figure 3d, Figure 3e, detailed later.
此外,圖2中所示的追瞳儀11在檢知患者眼睛12的凝視位置時可以在各該使用者介面20中顯示出一視線游標13(如圖3中虛線圓圈所示),該視線游標13可被設計成特定的幾何形狀或特定符號表示,且該視線游標13能跟隨患者眼睛12的凝視位置而在各該使用者介面20中移動,並且停止在特定的圖塊位置。 In addition, the tracker 11 shown in FIG. 2 can display a line of sight cursor 13 (shown by a dotted circle in FIG. 3) in each of the user interfaces 20 when detecting the gaze position of the patient's eye 12, the line of sight. The cursor 13 can be designed to a particular geometric shape or a particular symbolic representation, and the line of sight cursor 13 can follow the gaze position of the patient's eye 12 in each of the user interfaces 20 and stop at a particular tile position.
另外,復如圖3所示,本發明在每一頁使用者介面20上,特別是在所述多個特定操作指令圖塊31及多個特定需求指令圖塊32之間的空白區域,規劃有多個凝視放空區33;且部分的特定操作指令圖塊31(例如是圖3a所示的情緒表達指令31b、虛擬照服員表情指令31e)以及部分的特定需求指令圖塊32(例如是圖3a所示的飲食指令32d、藥物指令32e、個人衛生指令32f)還能坐落於凝視放空區33內。 In addition, as shown in FIG. 3, the present invention is planned on each page user interface 20, particularly in a blank area between the plurality of specific operation instruction blocks 31 and a plurality of specific demand instruction blocks 32. There are a plurality of gaze venting areas 33; and a part of the specific operation instruction block 31 (for example, the emotion expression instruction 31b shown in FIG. 3a, the virtual attendant expression instruction 31e) and a part of the specific requirement instruction block 32 (for example, The diet instruction 32d, the medication instruction 32e, and the personal hygiene instruction 32f) shown in Fig. 3a can also be located in the gaze venting area 33.
藉此,所述多個凝視放空區33中能揭示預先內建翻譯好的說明用或指引用文字(例如中、英、印尼、越南等國語言),以指引患者眼睛凝視相關操作狀態。所述多個凝視放空區33還能提供患者在不操作按下事件時作為眼睛視線稍作休息的區域。必須特別說明的是,上述特定操作指令圖塊31、特定需求指令圖塊32及凝視放空區33的數量及位置,係可根據各該使用者介面20 的實際配置需求而增減及替換。 Thereby, the plurality of gaze venting areas 33 can reveal pre-built translated instructions or guiding words (for example, Chinese, English, Indonesian, Vietnamese, etc.) to guide the patient's eyes to gaze related operational states. The plurality of gaze venting zones 33 can also provide an area for the patient to rest slightly as the line of sight of the eye when the pressing event is not operated. It should be particularly noted that the number and location of the specific operation instruction block 31, the specific requirement instruction block 32, and the gaze venting area 33 may be based on each user interface 20 Increase, decrease and replace the actual configuration requirements.
另一方面,本發明著眼於提升眼控操作按下事件圖塊30時的精確度,特別在各該使用者介面20中佈設陣列式的若干網點21(如圖3所示),以作為校正患者眼睛凝視位置的輔助參考點。 On the other hand, the present invention focuses on improving the accuracy of the eye control operation pressing the event block 30, and in particular, a plurality of array dots 21 (shown in FIG. 3) are arranged in each of the user interfaces 20 as corrections. Auxiliary reference point for the patient's eye gaze position.
請參閱圖3a,揭露出一作為首頁之使用者介面20a的較佳實施形態,說明當所述多個按下事件圖塊30附予顏色顯示時,位在圖塊30內或者背後的網點21可以被所述多個按下事件圖塊30遮蓋,而使所述網點21顯露於所述多個按下事件圖塊30周邊的空白區域內。 Referring to FIG. 3a, a preferred embodiment of the user interface 20a as a front page is disclosed. When the plurality of press event blocks 30 are attached to the color display, the dots 21 located in or behind the block 30 are illustrated. The plurality of pressed event tiles 30 may be covered, and the dots 21 may be exposed in a blank area around the plurality of pressed event tiles 30.
復如圖3a所示,還揭露出多個特定操作指令圖塊31a至31e可依揭示上之需求,而以不同顏色的區塊分別配置於各該使用者介面20的四周端緣,作為例如是服務鈴指令31a、情緒表達指令31b、休眠模式指令31c、翻頁指令31d、虛擬照服員表情指令31e,或是其他例如身體感覺指令、介面縮放指令等的配置區,以供患者眼控點選(即操作按下)之用。 As shown in FIG. 3a, it is also revealed that a plurality of specific operation command blocks 31a to 31e can be respectively disposed at the peripheral edges of the user interfaces 20 in different color blocks as required by the disclosure. It is a service bell command 31a, an emotion expression command 31b, a sleep mode command 31c, a page turning command 31d, a virtual attendant expression command 31e, or other configuration areas such as a body sense command, an interface zoom command, etc., for patient eye control. Click (ie, press the button).
圖3a中更進一步揭露出所述多個特定需求指令圖塊32a至32f能以不同顏色的區塊分別間隔配置於該首頁(使用者介面20a)的中心區域,作為例如是日常生活指令32a、特別狀況指令32b、身體感覺指令32c、飲食指令32d、藥物指令32e、個人衛生指令32f等需求協助指令的配置區;除此之外,多個特定需求指令圖塊32還可以作為上述需求指令的前綴語(例如:我想要、我需要、感覺、無)的配置區,其中特別包含點選上述身體感覺指令32c後會於次層的使用者介面20b顯示一身體部位圖案指令32g(如圖3b所示),以供患者眼控點選(即操作按下)之用。 It is further revealed in FIG. 3a that the plurality of specific requirement instruction blocks 32a to 32f can be respectively arranged in the central area of the first page (user interface 20a) with different color blocks, for example, as the daily life instruction 32a, a special situation command 32b, a body sense command 32c, a diet command 32d, a drug command 32e, a personal hygiene command 32f, and the like, and a configuration area of the demand assistance command; in addition, a plurality of specific demand instruction blocks 32 may also serve as the above-mentioned demand instruction. The configuration area of the prefix language (for example, I want, I need, feel, no), in particular, including the above-mentioned body feeling command 32c, a body part pattern instruction 32g is displayed on the sub-layer user interface 20b (as shown in the figure). 3b) for the eye control of the patient (ie, the operation is pressed).
續如圖3b所示,揭示出圖3a中點選身體感覺指令32c之後顯示的次層使用者介面20b的較佳實施形態。進一步說明隸屬於特定操作指令圖塊的首頁指令31f、開啟呼叫指令31g、返回(或上一頁)指令31h等可依操作需求分別配置於該使用者介面 20b的四周端緣,隸屬於特定需求指令圖塊的身體部位圖案指令32g可配置於該層使用者介面20b的中心區域。此外,該層使用者介面20b一分為二的區分配置有佈設上述網點(未繪示)的一上方的凝視放空區33a及一下方的凝視放空區33b,上方的凝視放空區33a可分佈於首頁指令31f、開啟呼叫指令31g、返回指令31h、身體部位圖案指令32g的周邊,下方的凝視放空區33b並揭示有說明用或指引用文字。 Continuing with Figure 3b, a preferred embodiment of the sub-layer user interface 20b shown after clicking the body sensation command 32c in Figure 3a is disclosed. Further, the first page command 31f, the open call command 31g, the return (or previous page) command 31h, and the like belonging to the specific operation instruction block may be respectively configured in the user interface according to the operation requirement. At the peripheral edge of 20b, the body part pattern command 32g belonging to the specific demand instruction block can be disposed in the central area of the layer user interface 20b. In addition, the user interface 20b of the layer is divided into two. The upper gaze area 33a and the lower gaze area 33b are disposed on the upper layer (not shown), and the upper gaze area 33a is distributed. The home command 31f, the open call command 31g, the return command 31h, and the body part pattern command 32g are provided, and the lower gaze vent area 33b is provided with a text for explanation or guidance.
必須進一步說明的是,圖3b所示的身體部位圖案指令32g包含附加視覺化回饋而分隔顯示的一3D身體局部放大圖案指令32g’及至少一3D全身圖案指令32g”;患者眼睛能先凝視並用眼控翻轉該3D全身圖案指令32g”所顯示的身體部位,使得3D身體局部放大圖案指令32g’能動態顯示出該3D全身圖案指令32g’,所指引的身體放大部位。在圖3b所示的實施例中,揭示患者先眼控視線游標13a移動來點選3D全身圖案指令32g”中所揭示的人體手掌,隨後該身體局部放大圖案指令32g’便能動態顯示出該手掌處的放大圖,患者能進一步從該身體局部放大圖案指令32g’的圖示中眼控視線游標13a移動,來縮放及點選其手掌實際疼痛的手指部位。 It should be further noted that the body part pattern command 32g shown in FIG. 3b includes a 3D body part enlargement pattern command 32g' and at least one 3D whole body pattern command 32g separated by display with additional visual feedback; the patient's eyes can first gaze and use The eye control flips the body part displayed by the 3D whole body pattern command 32g" so that the 3D body part enlargement pattern command 32g' can dynamically display the 3D whole body pattern command 32g', the guided body enlargement portion. In the embodiment shown in FIG. 3b, the patient's first eye control line cursor 13a is moved to select the human hand palm disclosed in the 3D whole body pattern command 32g", and then the body part enlargement pattern command 32g' can dynamically display the palm of the hand. In the enlarged view, the patient can further move from the eye-control sight cursor 13a in the illustration of the body partial magnification pattern command 32g' to zoom and click on the finger portion of the palm where the palm is actually painful.
再請參閱圖3c,揭露該身體局部放大圖案指令32g’的周邊佈設有方向指令圖塊320g’、縮放指令圖塊321g’、旋轉指令圖塊322g’,患者能移動視線游標13a來點選這些圖塊,以便於移動、縮小、放大、旋轉身體圖案至如圖3b中所示的手指部位,進而點選該手指暨下達癢或疼痛的需求協助信息。 Referring to FIG. 3c again, the periphery of the body part enlargement pattern command 32g' is provided with a direction command block 320g', a zoom instruction block 321g', and a rotation instruction block 322g'. The patient can move the line of sight cursor 13a to select these. The block is arranged to move, reduce, enlarge, and rotate the body pattern to the finger portion as shown in FIG. 3b, and then select the finger and the need assistance information for the itching or pain.
此外,復如圖3b中還揭露位於該凝視放空區33b可以配置隸屬於該身體感覺指令32c同層的一我感覺指令32h,以供患者眼控點選,並於該凝視放空區33b內顯示出一輕微養、很養、輕微疼痛或很疼痛等的說明性或表達感覺的文字信息,該說明性或表達感覺的文字信息還能以聲音(如圖4,容後詳述)對外提示;依此,便於患者能快速且精確地點選按下指令暨下達身體感覺(例 如癢或疼痛)的需求協助信息。 In addition, as shown in FIG. 3b, the gaze venting area 33b can be disposed with a sensation command 32h belonging to the same layer of the body sensation command 32c for the eye control of the patient, and displayed in the gaze venting area 33b. Descriptive or expressive textual information that is slightly raised, very raised, slightly painful or very painful, and the textual information that expresses or expresses the feeling can also be prompted by sound (as shown in Figure 4, detailed later); In this way, it is convenient for the patient to select the command and the body feeling quickly and accurately. Need help information such as itching or pain).
請進一步參閱圖3d及圖3e,其中圖3d揭露當患者點選圖3b所示的我感覺指令32h之後,會顯示一次層的使用者介面20c,其中配置有隸屬於特定需求指令圖塊的多個感覺指令圖塊32i,例如癢、痛、麻、累、冷、熱等感覺指令圖塊32i,患者眼控點選所需的感覺指令32i之後,會顯示如圖3e所示的次層使用者介面20d,其配置有隸屬於特定需求指令圖塊的多個癢或疼痛的等級指令圖塊32j,例如一點點、輕微、很、非常、無法忍受的癢或疼痛的等級指令圖塊32j;又例如,在點選痛的感覺指令圖塊32i之後,也可產生另一類似圖3d配置方式的次層使用者介面來顯示例如是刺痛、抽痛、悶痛、酸痛、脹痛、抽痛等等級指令圖塊(未繪示);總之,患者只須眼控翻頁並依序眼控點選所需的等級指令圖塊32j之後,再點選隸屬於特定操作指令圖塊的確認指令31j,即可準確下達身體感覺的需求協助信息。 Please refer to FIG. 3d and FIG. 3e. FIG. 3d discloses that after the patient selects the I feel command 32h shown in FIG. 3b, the user interface 20c of the primary layer is displayed, and the configuration is associated with the specific requirement instruction block. The sensation command block 32i, for example, the itch, pain, hemp, tired, cold, hot and other sensation command block 32i, after the patient's eye control clicks the desired sensation command 32i, the sub-layer use as shown in Fig. 3e is displayed. Interface 20d, which is configured with a plurality of itchy or painful level command blocks 32j belonging to a particular demand instruction block, such as a little, slight, very, very, intolerable itch or pain level command block 32j; For another example, after clicking the painful sense command block 32i, another sub-layer user interface similar to the configuration of FIG. 3d may be generated to display, for example, tingling, pain, pain, soreness, pain, and pumping. Pain level instruction block (not shown); in short, the patient only needs to control the page turning and select the desired level instruction block 32j in order, and then click the confirmation of the specific operation instruction block. Command 31j, you can accurately get a sense of body It needs assistance information.
在此必須聲明的是,圖3b至圖3e只是揭露圖3a中身體感覺指令32c該分類所衍生顯示之分層使用者介面的實施態樣而已;舉凡依此實施態樣的分層邏輯,同樣能應用於上述多個特定操作指令圖塊31a中,以及其它例如是日常生活指令32a、特別狀況指令32b、飲食指令32d、藥物指令32e、個人衛生指令32f等多個分類的特定需求指令圖塊中,提供患者分層逐次的眼控點選。其中,身體部位圖案指令32g所衍生的身體部位的動畫指引,以及癢或痛等感覺不適程度的文字圖塊(或指令)指引,則可因應上述特定操作指令圖塊31a及特定需求指令圖塊32a、32b、32d、32e、32f所預想之患者實際狀況需求而增減配置,或替換成非動畫式的文字或聲音指令圖塊,皆屬本發明所思及之應用範圍。 It must be stated here that Figures 3b to 3e merely disclose the implementation of the layered user interface derived from the classification of the body sensation command 32c in Fig. 3a; It can be applied to the plurality of specific operation instruction blocks 31a, and other specific requirement instruction blocks such as the daily life instruction 32a, the special status instruction 32b, the diet instruction 32d, the medicine instruction 32e, and the personal hygiene instruction 32f. In the middle, the patient is provided with layered and successive eye control points. Wherein, the animation guide of the body part derived from the body part pattern instruction 32g, and the text block (or instruction) guidance of the degree of discomfort such as itching or pain may be adapted to the specific operation instruction block 31a and the specific requirement instruction block. 32a, 32b, 32d, 32e, 32f is expected to increase or decrease the actual situation of the patient, or replace it with a non-animated text or voice command block, which is within the scope of application of the present invention.
步驟S3:檢知按下事件。 Step S3: Detecting a press event.
請參閱圖4,揭露本發明檢知按下事件的程序圖,說明由表二所示多個眼控指令集編製而成的軟體程式,在檢知患者眼控操作按下事件(即點選)的過程,包括:先由患者瞳孔凝視所述 多個使用者介面20中的需求頁面(例如首頁),用以眼控點選所需的按下事件圖塊30;接著,軟體程式會依患者點選按下事件圖塊30指令的指引,而生成一翻頁信號40或一觸發信號50。 Referring to FIG. 4, a program diagram for detecting a press event according to the present invention is disclosed, and a software program compiled from a plurality of eye control instruction sets shown in Table 2 is used to detect a pressing event of a patient's eye control operation (ie, click to select The process consists of: first gazing at the patient's pupil The demand page (for example, the home page) of the plurality of user interfaces 20 is used for eye control to select the desired pressing event block 30; then, the software program selects the instruction of pressing the event block 30 according to the patient's selection. A page flip signal 40 or a trigger signal 50 is generated.
當患者眼控點選到所需的按下事件圖塊30而生成翻頁信號40時,軟體程式會回復至所述多個使用者介面20中去進行翻頁,以命令分層的使用者介面揭示於顯示幕上;依此可往復實施上、下頁的翻頁動作,方便患者能逐層搜尋及點選所需的類別的按下事件圖塊30。 When the patient's eye control selects the desired press event block 30 to generate the page flip signal 40, the software program will revert to the plurality of user interfaces 20 for page turning to command the layered user. The interface is displayed on the display screen; accordingly, the page turning action of the upper and lower pages can be performed back and forth, so that the patient can search and click the desired event type of the event block 30 layer by layer.
當患者眼控點選到所需的按下事件圖塊30而生成觸發信號50時,軟體程式會命令一提示單元60生成患者的一需求協助信息61;其中,該需求協助信息61可以包含以聲音61a、文字/圖形61b形式下達給醫護人員、照顧人員或親友知悉。例如,患者眼控點選隸屬於特定操作指令圖塊的服務鈴指令31a時(如圖3a),軟體程式會生成觸發信號50(如圖4)進而命令提示單元60以聲音61a形式,或聲音61a及文字/圖形61b形式的需求協助信息61對外下達。其中,該聲音及文字信息分別可為軟體程式設定或選定的多國語言中的至少一種語音或文字,該聲音也包含非語音之提示聲。 When the patient eye control selects the desired press event block 30 to generate the trigger signal 50, the software program commands a prompting unit 60 to generate a demand assistance information 61 of the patient; wherein the demand assistance information 61 can include The sound 61a and the text/graphic 61b form are sent to the medical staff, caregivers or relatives and friends. For example, when the patient eye control selects the service bell command 31a belonging to the specific operation command block (as shown in FIG. 3a), the software program generates a trigger signal 50 (as shown in FIG. 4) to command the prompt unit 60 to sound 61a, or sound. Request assistance information 61 in the form of 61a and text/graphics 61b is released to the public. The sound and text information may be at least one of voice or text in a software program setting or selected multi-language, and the sound also includes a non-speech voice.
進一步的說,在圖4揭示檢知按下事件的過程中,由於人體眼睛有時候會存在視線誤差的問題,而導致無法順利的眼控點選按下事件圖塊。本發明為了克服此問題,提出如圖5所揭示的實施例,說明當患者發現顯示凝視位置的視線游標13a與所欲凝視的按下事件圖塊30的位置之間有所誤差時,可以利用眼角餘光凝視該按下事件圖塊30周邊的網點21a作為修正誤差的凝視位置,以便於校正患者的視線游標13a至想要凝視之按下事件圖塊30的中心位置,藉此提升軟體程式檢知按下事件的妥善率。 Further, in FIG. 4, in the process of detecting the pressing event, there is a problem that the human eye sometimes has a line of sight error, and the eye control is not selected smoothly. In order to overcome this problem, the present invention proposes an embodiment as disclosed in FIG. 5, which illustrates that when the patient finds an error between the line of sight cursor 13a displaying the gaze position and the position of the pressed event block 30 to be gazed, the present invention can be utilized. The corner of the eye gaze at the dot 21a around the pressing event block 30 as the gaze position of the correction error, so as to correct the patient's sight cursor 13a to the center position of the pressing event block 30 to be gazed, thereby improving the software program. Check the appropriate rate of the press event.
其次,由於人體眼睛視線移動的速度非常快,在視線移動瞬間極容易發生抖動(eye jitter)現象。對此,本發明也提出改善方案。請參閱圖6,說明當跟隨患者視線移動的視線游標13b 僅僅接觸到按下事件圖塊30的一端邊緣而生成重疊區域A時,該按下事件圖塊30能透過軟體程式設定的感測電路(屬已知技術,故不加贅述)偵測到該重疊區域A,使得各該該按下事件圖塊30能夠自動吸附視線游標13b至該按下事件圖塊30的中心位置,以提升眼控操作時自動定位視線游標13b的方便性,進而改善上述視線抖動的問題。 Secondly, since the human eye's line of sight moves at a very fast speed, it is extremely prone to eye jitter when the line of sight moves. In this regard, the present invention also proposes an improvement. Please refer to FIG. 6 to illustrate the line of sight cursor 13b when following the patient's line of sight. When only the edge of one end of the event block 30 is pressed to generate the overlapping area A, the pressed event block 30 can be detected by the software-programmed sensing circuit (known in the art, so no further description). The overlapping area A is such that each of the pressing event blocks 30 can automatically adsorb the line of sight cursor 13b to the center position of the pressed event block 30 to improve the convenience of automatically positioning the sight line cursor 13b during the eye control operation, thereby improving the above. The problem of line of sight jitter.
此外,因為眼控操作不像一般手、眼並用的滑鼠,會明確的產生按下事件,因此本發明軟體程式還搭配有凝視時間(dwell time)的計時,以便於決定是否檢知按下事件。進一步的說,本發明特別加強視覺回饋的機制,而於所需的使用者介面的凝視放空區中,顯示倒數計時的示意畫面,以便於讓患者確知其所操作的眼控按下事件的動作是真實完成的。 In addition, because the eye control operation is not like the general hand and eye mouse, the pressing event is clearly generated, so the software program of the present invention is also equipped with the timing of the dwell time, so as to decide whether to detect the pressing. event. Further, the present invention particularly enhances the mechanism of visual feedback, and in the gaze venting area of the desired user interface, displays a schematic view of the countdown to facilitate the patient to know the action of the eye-controlled press event that he is operating. It is true.
如圖7所示,揭露出本發明操作按下事件的倒數邏輯圖,說明當患者眼睛凝視一使用者介面20c時,會於該使用者介面20c顯示出視線游標13c,該視線游標13c跟隨患者視線移動至所欲選取的按下事件圖塊30,此過程中會根據圖4所示網點21a的視線誤差修正機能,以及圖5所示重疊區域A的吸附機能,而使視線游標13c快速的鎖定在所欲選取之按下事件圖塊30的中心位置,隨後進入系統預先設定的倒數時間,例如依序執行2秒、1秒、0秒的倒數,隨後立即執行該按下事件圖塊30的指令。其中該倒數2秒、1秒、0秒的狀態,能以附具倒數數字的計時圖塊34或動畫,動態顯示於各該使用者介面20的凝視放空區33中。 As shown in FIG. 7, the reciprocal logic diagram of the operation pressing event of the present invention is disclosed, indicating that when the patient's eyes gaze at a user interface 20c, a line of sight cursor 13c is displayed on the user interface 20c, and the line of sight cursor 13c follows the patient. The line of sight moves to the pressed event block 30 to be selected. In this process, according to the line of sight error correction function of the dot 21a shown in FIG. 4 and the adsorption function of the overlapping area A shown in FIG. 5, the line of sight cursor 13c is fast. Locked at the center position of the pressed event block 30 to be selected, and then enters the system's preset countdown time, for example, the reciprocal of 2 seconds, 1 second, and 0 seconds is sequentially performed, and then the pressed event block 30 is executed immediately. Instructions. The state of the last 2 seconds, 1 second, and 0 seconds can be dynamically displayed in the gaze venting area 33 of each user interface 20 by a timed block 34 or an animation with a reciprocal number.
根據上述實施例之說明,應該不難理解並確知本發明刪除了打字介面,而改採預先設置指令、轉化成電腦介面上的指令按鈕,又增加了3D身體部位圖案(或稱3D人體地圖),能讓患者明確標註出身體不適的位置,以此縮短患者表達需求信息的時間。此外,本發明也應用了即時語音發音、字幕提示等功能,讓患者與醫護者、照顧者或家屬即使在語言不通的情況下,仍然得以快速地瞭解患者的需求,進而協助處理患者身體所發生的病 痛問題。再者,本發明應用電腦、顯示幕等硬體的成本相當低廉,是一般常人都可負擔的輔具費用。 According to the description of the above embodiments, it should be understood and confirmed that the present invention deletes the typing interface, and changes the preset command, converts it into a command button on the computer interface, and adds a 3D body part pattern (or 3D body map). It allows the patient to clearly identify the location of physical discomfort, thereby shortening the time for patients to express demand information. In addition, the present invention also applies functions such as instant voice pronunciation and subtitle prompting, so that the patient and the caregiver, the caregiver or the family can quickly understand the patient's needs even if the language is not available, thereby assisting in dealing with the patient's body. Disease Pain problem. Furthermore, the cost of applying the hardware such as a computer or a display screen to the present invention is relatively low, and is an accessory cost that can be generally affordable to ordinary people.
必須特別聲明的是,上述實施例之說明中有關「事件」用語可解為「指令」之意,有關「點選」用語可解為「操作按下」或「眼控凝視」之意,有關「圖塊」用語可解為「按鈕(Icon)」之意。另外,有關「患者」用語可解為「使用者」之意,因此本發明並非專供例如是罹患漸凍人症的病友使用;換言之,一般正常人亦可使用;但請注意:本發明不是拿來聊天用的,而是用來供人快速提出需求協助問題,縮短溝通或患者忍受痛苦時間而建立的。 It must be specifically stated that the term "event" in the description of the above embodiments can be interpreted as "instruction". The term "click" can be interpreted as "operational press" or "eye-control gaze". The term "tile" can be interpreted as "Icon". In addition, the term "patient" can be interpreted as "user". Therefore, the present invention is not intended for use by, for example, a patient suffering from gradual freezing of a person; in other words, a normal person can also use it; however, please note that the present invention is not Used for chatting, but used to quickly ask for help, shorten communication or patients endure painful time.
以上實施例僅為表達了本發明的較佳實施方式,但並不能因此而理解為對本發明專利範圍的限制。因此,本發明應以申請專利範圍中限定的請求項內容為準。 The above embodiments are merely illustrative of preferred embodiments of the invention, but are not to be construed as limiting the scope of the invention. Therefore, the present invention should be based on the content of the claims defined in the scope of the patent application.
Claims (17)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW106124886A TWI638281B (en) | 2017-07-25 | 2017-07-25 | Providing a method for patients to visually request assistance information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW106124886A TWI638281B (en) | 2017-07-25 | 2017-07-25 | Providing a method for patients to visually request assistance information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI638281B true TWI638281B (en) | 2018-10-11 |
| TW201908921A TW201908921A (en) | 2019-03-01 |
Family
ID=64797556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW106124886A TWI638281B (en) | 2017-07-25 | 2017-07-25 | Providing a method for patients to visually request assistance information |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI638281B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109508092A (en) * | 2018-11-08 | 2019-03-22 | 北京七鑫易维信息技术有限公司 | Method, apparatus and terminal based on eyeball tracking controlling terminal equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6603491B2 (en) * | 2000-05-26 | 2003-08-05 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
| US20120086645A1 (en) * | 2010-10-11 | 2012-04-12 | Siemens Corporation | Eye typing system using a three-layer user interface |
| US8593375B2 (en) * | 2010-07-23 | 2013-11-26 | Gregory A Maltz | Eye gaze user interface and method |
| TW201539037A (en) * | 2014-03-13 | 2015-10-16 | Julian Michael Urbach | Electronic contact lenses and an image system comprising the same |
| CN102822771B (en) * | 2010-01-21 | 2016-04-13 | 托比股份公司 | Based on the contextual action of eye tracker |
-
2017
- 2017-07-25 TW TW106124886A patent/TWI638281B/en active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6603491B2 (en) * | 2000-05-26 | 2003-08-05 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
| CN102822771B (en) * | 2010-01-21 | 2016-04-13 | 托比股份公司 | Based on the contextual action of eye tracker |
| US8593375B2 (en) * | 2010-07-23 | 2013-11-26 | Gregory A Maltz | Eye gaze user interface and method |
| US20120086645A1 (en) * | 2010-10-11 | 2012-04-12 | Siemens Corporation | Eye typing system using a three-layer user interface |
| TW201539037A (en) * | 2014-03-13 | 2015-10-16 | Julian Michael Urbach | Electronic contact lenses and an image system comprising the same |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109508092A (en) * | 2018-11-08 | 2019-03-22 | 北京七鑫易维信息技术有限公司 | Method, apparatus and terminal based on eyeball tracking controlling terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201908921A (en) | 2019-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Majaranta et al. | Twenty years of eye typing: systems and design issues | |
| US10564714B2 (en) | Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects | |
| CN108351685B (en) | System and method for biomechanical based eye signals for interaction with real and virtual objects | |
| US20220084511A1 (en) | Using augmentation to create natural language models | |
| US9535494B2 (en) | Apparatus and method for selecting from a display | |
| US5999895A (en) | Sound operated menu method and apparatus | |
| US8549443B2 (en) | Zeroclick | |
| US7624355B2 (en) | System and method for controlling a user interface | |
| JP2021073589A (en) | System and method for enabling communication through eye feedback | |
| WO2016122775A1 (en) | System and method for facilitating communication with communication-vulnerable patients | |
| Fager et al. | Patients' experiences with technology during inpatient rehabilitation: opportunities to support independence and therapeutic engagement | |
| WO2019003616A1 (en) | Information processing device, information processing method, and recording medium | |
| Majaranta | Text entry by eye gaze | |
| US20240104860A1 (en) | Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments | |
| Blignaut | Development of a gaze-controlled support system for a person in an advanced stage of multiple sclerosis: a case study | |
| TWI638281B (en) | Providing a method for patients to visually request assistance information | |
| WO2019167052A1 (en) | A system for augmentative and alternative communication for people with severe speech and motor disabilities | |
| Tantisatirapong et al. | Design of user-friendly virtual thai keyboard based on eye-tracking controlled system | |
| CN115083415B (en) | Continuous conversation with digital assistant | |
| Porter et al. | Blink, pull, nudge or tap? the impact of secondary input modalities on eye-typing performance | |
| JP2025534284A (en) | Device, method and graphical user interface for interacting with a three-dimensional environment | |
| Nonoka et al. | Study on wearable gaze-based communication system for patients with amyotrophic lateral sclerosis (ALS) | |
| KR20220075172A (en) | Pupil tracking-based expression system | |
| Hitchcock | Computer access for people after stroke | |
| US20250363987A1 (en) | Synchronizing responses with display content |