201201087 PNAI-SW-0305-TWXX 34774twf.d〇c/n 六、發明說明： 【發明所屬之技術領域】 本發明是有關於一種於制 於-種視覺輔助的控制游2 =的方法’且特別是有關 【先前技術】 岸用達的社會中，由於電腦可被廣泛地 二幾乎已經成為各行各業基本工具之 步。已㈤達到轉戶戶都至少擁有—部個人電腦的地 用者ίitt統中’滑鼠控制為系統操作的重要角色。使 鼠相對地移動系統中的游標位置，進而選 移動二/案運=° —般而言’當使用者欲使用滑鼠來 巾知道游標位於晝面的何處時，使用者會先大 以來尋找晝面中的游標所在地。之後，使用 者再移動滑鼠將游標移動至定點。 而，在顯不器解析度較高的情況之下，晝面中的游 小，制者要花上更多時間以在晝面中搜尋游標。 二外’由=科技的進步，顯示器的尺寸越來越大，在大尺 ^ ^顯7FS巾’使用者在晝面尋肋標所在地的時間亦會 2地增加m使用者在尋找游標以及移動游標 、、間將會增加，進而減少使用滑鼠的便利性。 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n 【發明内容】 本發明提供一種控制游標的方法，導入視覺輔助來改 善控制游標的方法。 本發明提出一種控制游標的方法，適於控制顯示裝置 上的游標。在此方法中，先將顯示裝置的畫面劃分為多個 區塊。並且’利用影像擷取裝置擷取使用者的影像。依據 影像的瞳孔位置’推測視線位置。而在晝面中找出與視線 位置相對應的觀看區塊，其中觀看區塊為其中一區塊。最 後’將游標移動至觀看區塊。 在本發明之一實施例中，上述將顯示裝置的晝面劃分 為多個區塊的步驟中’可判斷使用者與顯示裝置之間的觀 員距離’再依據觀賞距離決定顯示裝置的晝面所欲劃分的 區塊的個數。或者’可自顯示裝置的擴充顯示器識別資料 (Extended Display Identification Data，EDID )中讀取顯示 裴置的尺寸’再依據顯示裝置的尺寸決定顯示裝置的晝面 所欲劃分的區塊的個數。 在本發明之一實施例中，上述將游標移動至觀看區塊 的步驟為將游標移至觀看區塊中的預設位置。 在本發明之-實施例中，上述控制游標的方法更包括 在顯示-提示視窗時，躺視線位置相對應的觀看區塊是 =為晝面的中央區塊。若觀看區坑為晝面的中央區塊，將 游標移至提示視窗的預設位置。 縣=之—實施财’上述控伽標的方法更可在 仃預》又件的時間點，記錄游標移動的執跡。此預設 201201087, PNAI-SW-0305-TWXX 34774twf.doc/n 事件例如為開機。 在本發明之一實施例中，上述控制游標的方法更可在 開啟預設檔案（例如為文書處理檔案）時，將晝面區分為 有效晝面與無效晝面，而將有效晝面劃分為多個區塊。 基於上述，本發明利用影像擷取裝置來擷取使用者的 影像，再藉由影像處理技術來判斷使用者的視線在顯示裝 置的旦面中相對應的觀看區塊，而將游標移動至此觀看區 鲁 塊據此，可快速移動游標至目的地附近，不僅縮短搜尋 游標的時間，亦縮短移動游標的時間。 為讓本發明之上述特徵和優點能更明顯易懂，下文特 舉實施例，並配合所附圖式作詳細說明如下。 【實施方式】 一般而言，使用者控制游標會先在顯示裝置的晝面上 找尋目前的游標位置，再根據目前位置相對地移動滑鼠來 移動游標，對於大尺寸或是高解析度的顯示裝置而言相當 馨不便。為此，本發明提出一種控制游標的方法，導入視覺 輔助來改善傳統控制游標的方法。 圖1疋依照本發明一實施例所繪示的控制游標的方法 流程圖。請參照圖1，在本實施例中，將影像擷取裝置設 置於顯示裝置端，藉以根據影像擷取裝置所擷取到的影像 來判斷使用者觀看顯示裝置的相對應位置，藉此來控制游 標的移動。例如，在電腦系統中設置一輔助系統，透過抓 取人臉輪廓和人眼的瞳孔位置，根據使用者瞳孔位置與顯 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n 不裝置的晝面相對應位置關係，將可推斷出使用者所觀看 的晝面位置。詳細說明如下 為了判斷使用者觀看顯示裝置的柏對應位置，在步驟 S105中’將顯示褒置的晝面劃分為多個區塊，以便於與使 用者的觀看視線進行對應。而在步驟SUG中，利用影像 操取裝置練使用者的影像。接著，如步驟su5所示， 依據像：的瞳孔位置，推測使用者的視線位置。 般而δ，利用視線追蹤技術可偵測到眼睛所注視的 方向。在本實施例中，利用影像她裝置所擷取到的影像 中的瞳孔位置來推測視線位置。例如，利用異色邊界追縱 法（limbUStraCkmg)、瞳孔追縱法（pupiltrackmg)、瞳 孔與角膜反射追蹤法或是類神經網路等技術。 在步驟S120巾’在晝面中找出與視線位置相對應的 區塊’其中觀看區塊為此晝面所劃分的其中一區塊。 這是因為，在-般的使用環境下，使用者所觀看的視線位 置通常會伴隨著移動游標至眼睛所看的地方。 牡為了增加視線位置與顯示裝置的匹配準確性，當顯示 裝置^寸越大，畫面所劃分的區塊數量也會越多。據此， 在執行劃分區塊時（也就是步驟sl〇5)，可自顯示裝置的 » ^ II ^ 1 1¾ ^.J f # ( Extended Display Identification Data EDID)中讀取顯示裝置的尺寸，再依據顯示裝置的 尺寸決定顯示裝置的晝面所欲劃分的區塊個數。 此外，使用者的觀賞距離亦會影響視線位置與顯示裝 置的匹配準確性。當使用者的觀賞歸越遠，則劃分的區 201201087 PNAI-SW-0305-TWXX 34774twfd〇c/n , 塊越多；反之，觀#距離越近，劃分的區塊則越少。在本 貝施例中’使用者觀賞距離的判斷可藉由影像操取裝置操 取使用者的影像來判斷使用者與顯示裝置之間的觀賞距 離。例如，透過影像處理中物件辨識的方式，由此影像來 辨，使用者與顯示裝置之間的觀賞距離。之後，便可依據 硯賞距離來決定顯示襄置的晝面所欲劃分的區塊個數。 一舉，來說’圖2是依照本發明一實施例所繪示的依據 籲*員距離與顯示裝置尺寸來決定區塊數量的示意圖。請參 照圖2 ’在本實施例中，圖2中的區塊個數的走向並非是 用來限定觀賞距離與顯示裝置尺寸之間的關係。本實施例 僅為舉例說明顯示裝置尺寸與區塊個數之間的關係，以及 硯賞距離與區塊健的關係，並不以此來限定其範圍。 在此，區塊數量的多寡可由觀賞距離或顯示裝置尺寸 來決定。若以顯示裝置的尺相言，顯轉置的尺寸越大， 則晝面劃分區塊的數#越多；反之，示裝置的尺寸越小， 則晝面劃分區塊的數量越少。另外，若以觀賞距離而今， φ 觀賞距離越遠，則晝面劃分區塊的數量越多；反之，觀賞 距離越近，則畫面劃分區塊的數量越少。 、 在獲得使用者視線位置對應的觀看區塊之後，如步驟 S125所示，將游標移動至觀看區塊。例如，可將游標移至 觀看區塊中的預設位置（例如中央位置）。 、 以下再舉一實施例來說明。圖3A〜圖3c是依照本發 明一實施例所繪示的控制游標移動的方法示意圖。請參= 圖3A〜圖3C，在圖3A中，游標3〇1座落於晝面中任咅^ 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n 置:此時，使用者想要點選晝面左下方的“開始”。經過輔 助系統的處理，將晝面劃分成若干區塊。在本實施例中如 圖3B所示’將晝面劃分為16個區塊。而輔助系統再根據 使用者觀看晝面的瞳孔位置來推測對應的視線位置，並且 刀析視線位置與顯示裝置的相對應關係。假設使用者的視 線位置落於左下方區塊。此時，辅助系統便將游標移動至 左下方區塊，如圖3C所示，藉以減少使用者尋找游標位 置的不便利性。 搭配上述控制游標的方法可改善使用者控制游標的便 ’並且可衍生出相關的應用。例如，當使用者在操作 2業系統過程中，在操作不當或有訊息提示時，系統會在 ς面中間出現提示視窗’藉叫知使用者特定訊息。並且， =點選其中—選項來_此提示視窗。由於提示視窗 :，使用者會被打斷先前的操作，並且需要將游標移 至^視窗來進行_的動作，因此在本實施例中， =不視窗時，會先崎視線位置相對應的觀看區塊 央區塊。若觀看區塊為晝面的中央區塊，便將 /1動至提示視窗的預設位置，例如“確定，，選項處。 游;p相’圖4疋錢本發明—實闕所繪示的控制 應用的示意圖。請參照圖4，在本實施例中，當 線：丨:05出現後，使用者的第一動作即是將眼睛的視 並且使用正中央。此時，辅助系統在提示視窗出現 吏用者眼睛目視晝面中央，則幫助使用者將游標4〇1 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n' 移動到提示視窗405，並預設游標401位置位於選項4〇3。 據此，搭配上述控制游標的方法，便可輕鬆來關閉提示視 窗，進而減少使用者在畫面中尋找游標4〇1並移動游標4〇1 至提示視窗405上，增加游標操控的便利性。 由於不見得使用者每次移動眼睛的視線，就得要移動 游標至相對應位置。因此’本發明之控麟標的方法可與 使用者操作的制程式作結合。例如，在錢者觀看電景) 時，若移祕標將會造成使用者的困擾，因此游標的移^ 在此時可被忽略。例如，當錢行全螢幕織時 自動暫時麟標控制關，使得游標不會根據使用者變 視線位置而移動。 另外，當開啟某一預設檔案時，可將晝面區 =與無效晝面，而對有效畫面進行區塊_分。以預二 槽案為文書處賴案而言，在文書處職案的操作環 :(有效畫面）的顯示比例未佔滿整個佥 ί於，用的操作位置。當使用者的視線:置落= 二面¥ ’則不會將游標移動至此無效晝 j 的游標移動。 充不必要 作游ii卜生二避=眼睛視線位_作游標與滑⑽ ，產生衝…在偵測到滑鼠移動時關閉輔助系：插 將游標操控權交還給滑鼠。 ]補助糸統， 並且，更可導入歷史紀錄的概念 的時間點’記錄游標移動的軌預设事件 可加速游彳*的移動與 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n 控制。例如’在開機的狀況下，錢者通常會將游標移動 至右下角闕或開始常駐程式。或者，當執行文書處理樓 案時’會將游標移動至左上角點選開啟新槽或是開啟舊 檔。在這樣的操作方式，可加速游標的移動與控制。 綜上所述’上述實施例中，利用影像掏取^置的視覺 輔助，得知使用者的視線位置與顯轉置晝面的相對應關 係，而控制游標移動至使用者所觀看之晝面中的位置。據 此，不僅雜搜尋游標的關，亦驗移動游標的時間， 提高使用者猶游標的便雜。並且，更可在搭配視覺輔 助之下’衍生出相關的應用。 雖然本發明已以實施例揭露如上，然其並非用以限定 本發明，任何所屬技術領域中具有通常知識者，在不脫離 本發明之精神和範_，當可作些許之更動朗飾，故本 發明之保護範圍當視後附之申料職圍所界定者為準。 【圖式簡單說明】 圖1是依照本發明一實施例所繪示的控制游標的方法 流程圖。 圖2疋依恥本發明一實施例所繪示的依據觀賞距離與 顯示裝置尺寸來決定區塊數量的示意圖。 一 圖3A〜圖3C是依照本發明一實施例所綠示的控制游 標移動的方法示意圖。 圖4是依照本發明一實施例所繪示的控制游標相關應 用的示意圖。 〜 201201087 ^ PNAI-SW-0305-TWXX 34774twf.doc/n 【主要元件符號說明】 301、401 :游標 403 :選項 405 :提示視窗 S105〜S125 :本發明一實施例之控制游標的方法各步 驟201201087 PNAI-SW-0305-TWXX 34774twf.d〇c/n VI. Description of the Invention: [Technical Field of the Invention] The present invention relates to a method for controlling a tour 2 = made by a visual aid - and It is related to [previous technology] In the society of shore use, because computers can be widely used, they have almost become the basic tools of all walks of life. (5) To achieve the important role of the system operation in the transfer of households with at least the personal computer. Move the mouse relative to the cursor position in the system, and then choose to move the second / casework = ° - in general - when the user wants to use the mouse to know where the cursor is located, the user will be the first Look for the location of the cursor in the face. After that, the user moves the mouse to move the cursor to the fixed point. However, in the case where the resolution of the display is high, the cursor in the face is small, and the maker takes more time to search for the cursor in the face. The second is 'by = technology advancement, the size of the display is getting bigger and bigger, in the large size ^ ^ display 7FS towel 'users will find the location of the ribs in the face will also increase the number of users in the search for cursors and mobile The cursor, and the number will increase, which will reduce the convenience of using the mouse. 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n SUMMARY OF THE INVENTION The present invention provides a method of controlling a cursor, introducing visual aids to improve the method of controlling the cursor. The present invention provides a method of controlling a cursor that is adapted to control a cursor on a display device. In this method, the screen of the display device is first divided into a plurality of blocks. And using the image capture device to capture the image of the user. The position of the line of sight is estimated based on the pupil position of the image. A viewing block corresponding to the position of the line of sight is found in the facet, wherein the viewing block is one of the blocks. Finally, move the cursor to the viewing block. In an embodiment of the present invention, in the step of dividing the facet of the display device into a plurality of blocks, the device can determine the viewing distance between the user and the display device, and then determine the face of the display device according to the viewing distance. The number of blocks to be divided. Alternatively, the size of the display device can be read from the Extended Display Identification Data (EDID) of the display device, and the number of blocks to be divided by the face of the display device can be determined according to the size of the display device. In an embodiment of the invention, the step of moving the cursor to the viewing block is to move the cursor to a preset position in the viewing block. In the embodiment of the present invention, the method for controlling the cursor further includes: when the display-prompt window is displayed, the viewing block corresponding to the position of the lying line of sight is = the central block of the face. If the viewing area pit is the central block of the face, move the cursor to the preset position of the prompt window. County = - Implementation of the financial method of the above-mentioned control of the gamma can be recorded at the time of the 仃 Pre-", record the cursor movement. This preset 201201087, PNAI-SW-0305-TWXX 34774twf.doc/n event is for example boot. In an embodiment of the present invention, the method for controlling the cursor further divides the face into an effective face and an invalid face when the preset file is opened (for example, a document processing file), and divides the effective face into Multiple blocks. Based on the above, the image capture device is used to capture the image of the user, and the image processing technology is used to determine the user's line of sight in the corresponding viewing block of the display device, and the cursor is moved to the viewing. According to this, the block can quickly move the cursor to the vicinity of the destination, which not only shortens the time for searching for the cursor, but also shortens the time for moving the cursor. The above described features and advantages of the present invention will become more apparent from the description of the appended claims. [Embodiment] Generally, the user controls the cursor to first find the current cursor position on the surface of the display device, and then moves the cursor relative to the current position to move the cursor for large-size or high-resolution display. The device is quite inconvenient. To this end, the present invention proposes a method of controlling a cursor, introducing visual aids to improve the traditional method of controlling a cursor. FIG. 1 is a flow chart of a method for controlling a cursor according to an embodiment of the invention. Referring to FIG. 1 , in the embodiment, the image capturing device is disposed on the display device end, so as to determine the corresponding position of the user viewing the display device according to the image captured by the image capturing device, thereby controlling The movement of the cursor. For example, an auxiliary system is set in the computer system, by grasping the contour of the face and the pupil position of the human eye, according to the position of the user's pupil, corresponding to the face of the device that is not installed by the display 2010201087 PNAI-SW-0305-TWXX 34774twf.doc/n The positional relationship will infer the position of the face that the user is viewing. The details are as follows. In order to judge the position where the user views the cypress of the display device, the face of the display device is divided into a plurality of blocks in step S105 so as to correspond to the viewing line of sight of the user. In step SUG, the image of the user is trained by the image manipulation device. Next, as shown in step su5, the user's line of sight position is estimated based on the pupil position of the image. In general, δ, using line-of-sight tracking technology, can detect the direction in which the eye is looking. In the present embodiment, the position of the line of sight is estimated by using the position of the pupil in the image captured by the device. For example, techniques such as the libUStraCkmg, the pupiltrackmg method, the pupil and corneal reflex tracking, or a neural network are used. In step S120, the patch 'is found in the facet corresponding to the position of the line of sight', wherein the viewing block is one of the blocks divided by the face. This is because, in a general use environment, the position of the line of sight viewed by the user is usually accompanied by moving the cursor to where the eye sees. In order to increase the matching accuracy between the position of the line of sight and the display device, the larger the display device, the more the number of blocks divided by the picture. According to this, when the partitioning block is executed (that is, step sl5), the size of the display device can be read from the » ^ II ^ 1 13⁄4 ^.J f # (Wide Display Information EDID) of the display device, and then The number of blocks to be divided by the face of the display device is determined according to the size of the display device. In addition, the viewing distance of the user also affects the matching accuracy of the line of sight position and the display device. When the user's viewing is further away, the divided area 201201087 PNAI-SW-0305-TWXX 34774twfd〇c/n, the more blocks; conversely, the closer the distance is, the fewer the divided blocks. In the present embodiment, the determination of the viewing distance of the user can be performed by the image manipulation device to determine the viewing distance between the user and the display device. For example, by means of object recognition in image processing, the viewing distance between the user and the display device is discriminated by the image. After that, the number of blocks to be divided by the face of the display device can be determined according to the reward distance. In one embodiment, FIG. 2 is a schematic diagram of determining the number of blocks according to the distance between the caller and the size of the display device according to an embodiment of the invention. Referring to Fig. 2', in the present embodiment, the trend of the number of blocks in Fig. 2 is not intended to define the relationship between the viewing distance and the size of the display device. This embodiment is merely illustrative of the relationship between the size of the display device and the number of blocks, and the relationship between the viewing distance and the block health, and does not limit the range thereof. Here, the number of blocks can be determined by the viewing distance or the size of the display device. If the size of the display transpose is larger in the scale of the display device, the number of the number of the divided blocks is larger; conversely, the smaller the size of the display device, the smaller the number of the divided blocks. In addition, if the viewing distance is larger, the farther the viewing distance is, the more the number of blocks is divided. On the contrary, the closer the viewing distance is, the smaller the number of screen dividing blocks. After obtaining the viewing block corresponding to the user's line of sight position, as shown in step S125, the cursor is moved to the viewing block. For example, you can move the cursor to a preset location in the viewing block (for example, a central location). Hereinafter, an embodiment will be described. 3A-3c are schematic diagrams showing a method of controlling cursor movement according to an embodiment of the invention. Please refer to Fig. 3A to Fig. 3C. In Fig. 3A, the cursor 3〇1 is located in the 昼 咅 ^ 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n: At this time, the user wants to click "Start" at the bottom left of the face. After the assistance of the auxiliary system, the face is divided into several blocks. In the present embodiment, as shown in Fig. 3B, the face is divided into 16 blocks. The auxiliary system then estimates the corresponding line of sight position according to the position of the pupil in which the user views the pupil, and analyzes the corresponding relationship between the line of sight position and the display device. Assume that the user's line of sight is in the lower left block. At this point, the secondary system moves the cursor to the lower left block, as shown in Figure 3C, thereby reducing the inconvenience of the user in finding the position of the cursor. The above method of controlling the cursor can improve the user's control of the cursor and can derive related applications. For example, when the user is operating the system, when the operation is improper or there is a message prompt, the system will display a prompt window in the middle of the page to call the user-specific message. And, = click on the - option to _ this prompt window. Due to the prompt window: the user will be interrupted by the previous operation, and the cursor needs to be moved to the ^ window to perform the action of _, so in this embodiment, when the window is not closed, the viewing area corresponding to the line position will be first met. Block central block. If the viewing block is the central block of the face, move /1 to the preset position of the prompt window, for example, "OK, option. Tour; p phase" Figure 4: The invention is shown Schematic diagram of the control application. Referring to FIG. 4, in the embodiment, after the line: 丨: 05 appears, the first action of the user is to view the eye and use the center. At this time, the auxiliary system is prompted. The window appears in the center of the user's eyes and visually helps the user move the cursor 4〇1 201201087 PNAI-SW-0305-TWXX 34774twf.doc/n' to the prompt window 405, and the preset cursor 401 position is located in the option 4〇 3. According to this, with the above method of controlling the cursor, the prompt window can be easily closed, thereby reducing the user's search for the cursor 4〇1 in the screen and moving the cursor 4〇1 to the prompt window 405, thereby increasing the convenience of the cursor manipulation. Since it is not necessary for the user to move the eye of the eye every time, the cursor has to be moved to the corresponding position. Therefore, the method of controlling the label of the present invention can be combined with the user-operated program. For example, when the consumer watches the electricity Scene) The secret label will cause confusion for the user, so the movement of the cursor can be ignored at this time. For example, when the money is fully screened, the automatic temporary label control is turned off, so that the cursor does not move according to the user's position of the line of sight. In addition, when a certain preset file is opened, the face area = invalid and the invalid picture can be made, and the effective picture is blocked _. In the case of the pre-two-slot case, in the case of the instrument, The operation loop of the case: the display ratio of (effective screen) does not occupy the entire operation position. When the user's line of sight: drop = two sides ¥ ', the cursor will not be moved to the cursor of this invalid 昼j Move. Unnecessary travel ii 卜 二 避 = = eye line position _ for cursor and slide (10), generate rush... close the auxiliary system when detecting the movement of the mouse: insert the control of the cursor back to the mouse. SiS, and, at the point in time when the concept of history can be imported, the track preset event of the record cursor movement can accelerate the movement of the cursor* with the control of 2010201087 PNAI-SW-0305-TWXX 34774twf.doc/n. For example, 'in the In the case of booting up, the money usually will be the cursor Move to the lower right corner 阙 or start the resident program. Or, when executing the document processing project, move the cursor to the upper left corner and click to open the new slot or open the old file. In this way, the cursor movement can be accelerated. In the above embodiment, the visual aid of the image capture device is used to know the corresponding relationship between the user's line of sight position and the display transposition surface, and the control cursor is moved to the user's view. The position in the face. According to this, not only the search for the cursor, but also the time to move the cursor, improve the user's sneak peek, and, more, with the visual aid to derive the relevant application. The present invention has been disclosed in the above embodiments, but it is not intended to limit the present invention. Any one of ordinary skill in the art, without departing from the spirit and scope of the present invention, may make some modifications. The scope of protection shall be subject to the definition of the attached application. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a flow chart showing a method of controlling a cursor according to an embodiment of the invention. FIG. 2 is a schematic diagram showing the number of blocks according to the viewing distance and the size of the display device according to an embodiment of the present invention. 3A-3C are schematic diagrams showing a method of controlling cursor movement in green according to an embodiment of the invention. FIG. 4 is a schematic diagram of controlling a cursor related application according to an embodiment of the invention. 〜 201201087 ^ PNAI-SW-0305-TWXX 34774twf.doc/n [Description of main component symbols] 301, 401: Cursor 403: Option 405: Prompt window S105~S125: Steps of controlling the cursor in an embodiment of the present invention
1111