JP2019149031A - Symbol selection device and program for symbol selection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a symbol selection device capable of easily selecting a symbol such as a character or a symbol displayed on a screen by a line of sight without performing calibration. SOLUTION: This is a symbol selection device capable of selecting a plurality of symbols such as characters and symbols displayed on a screen by the line of sight of a user, and detects the line of sight of the user directed to the screen, and the detection result of the line of sight. Based on, the user's viewpoint position on the screen is estimated, and the symbol is moved to a preset selection position on the screen based on the estimated viewpoint position, which is the estimated viewpoint position. Let me select. The selected position is fixed at a predetermined position on the screen, and when the distance between the estimated viewpoint position and the selected position is less than or equal to the predetermined value, the symbol closest to the estimated viewpoint position is pulled into the selected position. Move. [Selection diagram] Fig. 3

Description

  The present invention relates to a symbol selection device and a program for the symbol selection device that can select symbols such as characters and symbols displayed on the screen (hereinafter sometimes simply referred to as “symbols”) with a user's line of sight. About.

  In recent years, a symbol selection device has been developed that enables selection of symbols displayed on the screen by line of sight as a tool to support the communication of patients who have difficulty moving other than the eyeball due to severe limb paralysis or cerebral palsy. Yes.

  As such a symbol selection device, for example, in Patent Document 1, a user's line of sight is detected using a camera, a cursor on the screen is moved in accordance with the detected line of sight, and a symbol displayed on the screen is displayed. What has been made available for selection is disclosed. In this symbol selection device, the viewpoint position of the user on the screen is estimated based on the detected line of sight, and a cursor is displayed at the estimated viewpoint position. The user can select the symbol by moving the line of sight to move the cursor on the screen to the symbol, for example, by blinking.

JP 2009-054101 A

  However, in the kind of symbol selection device that detects the user's line of sight using the camera or the like as described above, there is a slight difference between the user's actual viewpoint position on the screen and the viewpoint position estimated from the detected line of sight. There will be a discrepancy. In such a case, in order to accurately align the cursor with the symbol, the user does not look at the center of the symbol to be selected, but considers the amount of deviation between the actual viewpoint position and the cursor position. It is necessary to shift the line of sight from the center of the screen and confirm that the cursor points to the desired symbol by peripheral vision. However, the user inevitably moves his / her line of sight in order to see the cursor unconsciously, so that it is difficult to perform an operation for accurately selecting the cursor according to the symbol, and the stress on the user is great.

  In order to eliminate such a deviation between the actual viewpoint position and the viewpoint position estimated from the detected line of sight, it is conceivable that the apparatus is equipped with a calibration function. However, when a calibration function is installed in the apparatus, it is necessary to perform a calibration work before using the apparatus every time the user changes, which is very laborious. In many cases, involuntary movement occurs due to tension or convulsions caused by cerebral palsy or the like, making it difficult to perform calibration work.

  The present invention has been made in view of such a problem, and a symbol selection device that can easily select a plurality of symbols such as characters and symbols displayed on a screen by line of sight without performing calibration. The purpose is to provide.

  That is, the symbol selection device according to the present invention can select a plurality of symbols such as characters and symbols displayed on the screen by the user's line of sight, and detects the user's line of sight directed to the screen. And a viewpoint position estimation unit that estimates the viewpoint position of the user on the screen based on a detection result of the line-of-sight detection unit, and an estimated viewpoint that is a viewpoint position estimated by the viewpoint position estimation unit A selection symbol display control unit that moves the symbol to a selection position set in advance on the screen based on a position; and a selection unit that selects the symbol at the selection position, and the selection position includes: When the selected symbol display control unit is fixed at a predetermined position on the screen and the distance between the estimated viewpoint position and the selected position is a predetermined value or less. , The closest symbol to the estimated viewpoint position, and moving to draw in the selected position.

With such a configuration, when the distance between the estimated viewpoint position and the selected position is equal to or smaller than a predetermined value, the selected symbol display control unit moves to draw the symbol closest to the estimated viewpoint position to the selected position. Therefore, even if there is a deviation between the actual viewpoint position and the estimated viewpoint position, the symbol can be easily adjusted to the selected position. In other words, after the symbol to be selected is brought close to the selected position to some extent, the user does not have to shift his / her line of sight to accurately match the symbol to the selected position, but the symbol is automatically moved to the selected position simply by looking at the symbol. The symbol can be selected.
As described above, according to the symbol selection device of the present invention, since it is possible to select a symbol without accurately matching the symbol to the selection position, even if there is a deviation between the actual viewpoint position and the estimated viewpoint position. The user can easily select a symbol without performing a calibration operation. Therefore, even if the user changes, it can be used immediately.
Also, since the cursor is not displayed at the estimated viewpoint position and the line of sight is not moved so that the cursor is aligned with the symbol, even if there is a gap between the actual viewpoint position and the estimated viewpoint position, the user can It is not possible to select a symbol correctly by following the cursor.

The selected symbol display control unit preferably moves the symbol along the direction from the estimated viewpoint position toward the selected position when the distance between the estimated viewpoint position and the selected position is greater than a predetermined value.
In such a case, when the symbol to be selected is displayed at a position far from the selection position, the user can move the symbol closer to the selection position by continuing to look at the symbol. . In other words, if this is the case, wherever the symbol you want to select is on the screen, the user can simply look at the symbol and the symbol will automatically move to the selection position and select it. Will be able to.

Here, when the distance between the estimated viewpoint position and the selected position is larger than a predetermined value, the symbol is moved along the direction from the symbol closest to the estimated viewpoint position toward the selected position, for example, the estimated viewpoint When the position is in the middle of a plurality of symbols, the symbol closest to the estimated viewpoint position is easily switched by a slight fluctuation of the user's line of sight. Then, the symbol appears to move while meandering, and the visual stress on the user increases.
However, since the symbol is moved along the direction from the estimated viewpoint position to the selected position in this way, the symbol is excessive even when the user's line of sight fluctuates while the symbol is moving. It is possible to move toward the selected position without meandering. Therefore, the visual stress given to the user can be reduced.

The selected symbol display control unit displays adjacent symbols separated from each other so that the specific symbol that the user actually sees and the symbol closest to the estimated viewpoint position are the same regardless of the difference in the user. It is preferable to do.
The magnitude of the difference between the actual viewpoint position and the estimated viewpoint position varies slightly depending on the user's eyeball shape and the like. When a user views a symbol, the user does not always look at the center of the symbol, but the viewing position differs depending on the shape of the symbol, and there are individual differences in the viewing position. However, with such a configuration, the symbol that is actually seen and the symbol that is closest to the estimated viewpoint position can be matched regardless of the eyeball shape of the user and the habit when viewing the symbol. Even if used, the symbol that the user wants to select can be definitely selected.

Thus, by displaying symbols that are adjacent to each other so as to absorb individual differences between users, it may not be possible to display all symbols on the screen. In such a case, the selected symbol display control unit displays on the screen along the direction from the estimated viewpoint position toward the selected position when the distance between the estimated viewpoint position and the selected position is greater than a predetermined value. It is preferable that the symbol to be scrolled is scrolled.
With such a configuration, the user can scroll the symbols on the screen by looking at a location that exceeds the predetermined value from the selected position on the screen, so symbols that cannot be displayed on the screen are displayed. , Move it on the screen to display and select.

The selected symbol display control unit increases the scroll speed as the distance between the estimated viewpoint position and the selected position increases when the distance between the estimated viewpoint position and the selected position is greater than the predetermined value. Preferably there is.
With such a configuration, the user can scroll the symbols on the screen at high speed by looking at a position far from the selection position such as the edge of the screen, so that the symbols can be selected more comfortably.

The selection position is preferably set at the center of the screen.
The difference between the actual viewpoint position and the estimated viewpoint position becomes smaller as the distance between the user's eyeball and the actual viewpoint position on the display is closer. Therefore, the deviation between the actual viewpoint position and the estimated viewpoint position is smaller at the center of the screen than when the actual viewpoint position of the user is at the edge of the screen. Therefore, by setting the selection position at the center of the screen, it is possible to more reliably match the actually viewed symbol and the symbol closest to the estimated viewpoint position. If the selection position is set at the center of the screen, the symbols on the screen can be looked over widely, so that a desired symbol can be selected more easily.
The selection position is more preferably set at the center of the screen.

When the symbol selection unit selects one symbol, the selected symbol display control unit preferably newly displays one or a plurality of symbols associated with the selected symbol on the screen. .
In such a case, when one symbol is selected, a symbol associated with the symbol is displayed on the screen, so that the user can easily find the symbol to be selected next.

The symbol selection device described above further includes a defined symbol display control unit that displays on the screen a symbol string display window that displays the symbols selected by the symbol selection unit in the order of selection, and the confirmed symbol display control Display the plurality of selected symbols in the symbol column display window, or instead of displaying the selected symbols in the symbol column display window It is preferable that a message corresponding to the combination is displayed in the symbol string display window.
In such a case, it is possible to create a message earlier than when creating a message by selecting symbols such as characters one by one.

  By the way, when creating a message by selecting a symbol using the symbol selection device as described above, the user usually confirms the already selected symbol displayed in the symbol row display window while Select a symbol. When the symbol column display window is fixedly displayed on the screen, for example, toward the edge, the user can create a message between the symbol selected on the screen and the symbol column display window. You have to go back and forth again. Then, an unintended symbol may be erroneously selected while the line of sight is reciprocated many times.

In order to solve such a problem, the confirmed symbol display control unit may set the display position of the symbol column display window to a position adjacent to one symbol selected by the symbol selection unit.
In such a case, the symbol row display window is displayed at a position adjacent to one symbol selected by the symbol selection unit, so that the user increases the line of sight after selecting and viewing the desired symbol. The symbol string displayed in the symbol string display window can be confirmed without being moved. That is, since the user does not have to move his / her line of sight over a plurality of other symbols displayed on the screen in order to confirm the selected symbol row, it is possible to reduce erroneous symbol selection. Can do. Further, since it is not necessary to move the line of sight largely between the selected symbol and the symbol column display window, the user can easily confirm the selected symbol column.

Preferably, the confirmed symbol display control unit displays the symbol row display window so that at least a part of each of a plurality of symbols adjacent to the symbol selected by the symbol selection unit can be seen.
If this is the case, the user can check all symbols displayed on the screen while the symbol row display window is displayed, so it is easier to find the next symbol to select. be able to.

It is preferable that the fixed symbol display control unit transparently displays the symbol row display window.
In such a case, since the symbols on the screen overlapping the symbol row display window can be checked through the watermark, the user can check all the symbols displayed on the screen. Thereby, it is possible to more easily find a symbol to be selected next.

The fixed symbol display control unit displays the symbol row in the symbol row display window in horizontal writing and is centered with the horizontal coordinate position of the center of one symbol selected by the symbol selection unit as the center. Is preferably displayed.
When viewing a symbol, the user often looks around the center of the symbol. In such a case, since the selected symbol row is displayed in a center alignment slightly above (or slightly below) the center of the symbol that the user actually sees, the user actually sees it. The entire symbol string can be confirmed by shifting the line of sight slightly upward (or slightly downward) from the symbol. That is, since the movement distance of the line of sight for confirming the symbol row can be further shortened, erroneous symbol selection can be further reduced.

  A program for a symbol selection device according to the present invention includes a line-of-sight detection means for detecting the line of sight of the user directed to the screen, and can select a symbol such as a character or a symbol displayed on the screen by the line of sight of the user. A function as a viewpoint position estimating unit that estimates the viewpoint position of the user on the screen based on a detection result of the line-of-sight detection unit, and the viewpoint position estimation The symbol is moved to a selection position set in advance on the screen based on the estimated viewpoint position that is the viewpoint position estimated by the unit, and a distance between the estimated viewpoint position and the selected position is a predetermined value. A function as a selected symbol display control unit that moves a symbol closest to the estimated viewpoint position to the selected position when And functions as a symbol selector for selecting said symbol in the serial selected position, characterized in that to exert.

  Such a program for a symbol selection device can achieve the same effects as the operational effects obtained by the symbol selection device described above.

  According to the present invention as described above, it is possible to provide a symbol selection device that can easily select a plurality of symbols such as characters and symbols displayed on the screen by line of sight without performing calibration. .

The figure which shows typically the whole structure of the symbol selection apparatus of this embodiment. The block diagram which shows the apparatus structure of the symbol selection apparatus of the embodiment. The functional block diagram which shows the apparatus structure of the symbol selection apparatus of the embodiment. The screen illustration figure which shows an example of the display mode of the screen in the embodiment. The operation | movement flowchart of the symbol selection apparatus in the embodiment. The screen illustration figure which shows an example of the display mode of the screen in other embodiment.

  A symbol selection apparatus according to an embodiment of the present invention will be described below with reference to the drawings.

The symbol selection device 100 according to the present embodiment is intended to support the communication of a person who has difficulty moving a limb or mouth.
Specifically, as shown in FIG. 1, the symbol selection device 100 includes a notebook computer 1 having a display 2 and a computer main body 3, and line-of-sight detection means 4 that detects the line of sight of the user. The screen 21 of the display 2 displays a symbol panel 211 in which symbols such as characters and symbols are arranged side by side. The user moves the symbol panel 211 by moving his / her line of sight, and a desired panel in the symbol panel 211 is displayed. One symbol can be selected by matching with a predetermined selection position fixed on the screen 21.
In the present embodiment, the coordinates of the selected position are set to be the same as the center coordinates of the screen 21.

The line-of-sight detection means 4 detects a user's line of sight directed to the screen 21 of the display 2 and outputs the detection result as a line-of-sight signal.
Specifically, a light source (not shown) that irradiates the user's eyeball with near infrared rays, a camera (not shown) that images the user's eyeball, and imaging data output from the camera are processed to detect the line of sight. And a line-of-sight signal output unit (not shown) for outputting as a line-of-sight signal.
The line-of-sight detection means 4 of this embodiment is a so-called attachment type, and is attached to the lower part of the display 2 so that the light source and the camera face the user side.

  The display 2 displays an image indicated by the image data transmitted from the computer main body 3 on the screen 21.

  As shown in FIG. 2, the computer main body 3 is structurally provided with a CPU 301, a memory 302, an input / output interface 303, and the like. As shown in FIG. 3, the computer main body 3 is configured such that the CPU 301 and its peripheral devices cooperate with each other based on various application software (hereinafter referred to as programs) stored in the memory 302. The estimator 31, the symbol related data storage 32, the selected symbol display controller 33, the symbol selector 34, and the confirmed symbol display controller 35 are configured to realize the functions.

  Next, each part will be described.

  The viewpoint position estimation unit 31 estimates the viewpoint position of the user on the screen 21 based on the detection result of the line-of-sight detection means 4. Specifically, a line-of-sight signal is received from the line-of-sight detection means 4, the viewpoint position of the user on the screen 21 is estimated based on the line-of-sight signal, and the estimated viewpoint position Le, which is the estimated viewpoint position, is estimated. Output viewpoint position data.

The symbol related data storage unit 32 is set in a predetermined area of the memory 302 and stores symbol related data indicating codes of various symbols such as characters and symbols.
The “character” in the present embodiment is, for example, hiragana, katakana, kanji, numbers, alphabets, and the like. The “symbol” is a figure or the like having a meaning such as a mark, a pictograph, an emoticon or the like.

The selected symbol display control unit 33 acquires symbol-related data and estimated viewpoint position data, generates image data based on them, and outputs them to the display 2. More specifically, a symbol panel 211 in which a plurality of symbols (here, hiragana) are arranged side by side is displayed on the screen 21, and the symbol panel 211 is displayed on the screen 21 based on the estimated viewpoint position Le. It is to be moved.
Here, a plurality of symbols are arranged on the symbol panel 211 so as to be arranged at equal intervals in a vertical and horizontal matrix. More specifically, the symbol panel 211 is partitioned by square grids arranged vertically and horizontally. Each square defines a display area of each symbol. In each square, one symbol is displayed so that the center of the square coincides with the center position of the symbol.

  Note that the selected symbol display control unit 33 displays the symbol panel 211 so that the symbol that the user actually sees when using the symbol and the symbol closest to the estimated viewpoint position Le are the same regardless of the user. The symbols adjacent to each other are displayed separately from each other. That is, regardless of the shape of the eyeball, the wrinkles when viewing the symbol, the accuracy of the estimated viewpoint position Le, etc., no matter what user sees the character “N” displayed on the symbol panel 211, the estimated viewpoint Adjacent symbols are displayed so as to be separated from each other to the extent that the symbol closest to the position Le becomes the character “Nu”. For this reason, the symbol panel 211 of the present embodiment is larger than the size of the screen 21, and all symbols can be selected by scrolling the symbol panel 211 as will be described later.

  The selected symbol display control unit 33 of the present embodiment refers to the coordinates of the estimated viewpoint position Le and the coordinates of the selected position Ls set on the screen 21 in advance, and measures the distance d between them, The symbol panel 211 is configured to move in multiple steps according to the distance d.

Specifically, as shown in FIG. 4A, when the distance d between the estimated viewpoint position Le and the selected position Ls exceeds a predetermined value D set in advance, the estimated viewpoint position Le The symbol panel 211 is moved along the direction toward the selection position Ls (the direction indicated by the arrow). The speed at which the symbol panel 211 is moved increases as the distance d increases.
Here, when the symbol panel 211 is moved, the symbol panel 211 is configured to scroll along a direction from the estimated viewpoint position Le toward the selection position Ls. That is, the symbol panel is moved and a new symbol is displayed from the end of the screen 21.

On the other hand, as shown in FIG. 4B, when the distance d between the estimated viewpoint position Le and the selected position Ls is equal to or less than the predetermined value D, the symbol closest to the estimated viewpoint position Le is selected. The symbol panel 211 is moved so as to be pulled to the position Ls, and the coordinates of the center position of the symbol are adjusted to the coordinates of the selected position Ls. That is, the center position of the square containing the estimated viewpoint position Le is configured to match the coordinates of the selected position Ls.
When the distance d is equal to or less than the predetermined value D and the coordinates of the center position of the symbol closest to the estimated viewpoint position Le coincide with the coordinates of the selection position Ls, the symbol panel 211 is not moved.

  In addition to the above-described function, the selection symbol display control unit 33 also has a cursor so as to surround the square containing the symbol when the coordinates of the center position of the symbol coincide with the coordinates of the selection position Ls. 212 is displayed on the screen 21 and symbol data indicating the symbol is output. The cursor 212 is a cursor indicating that the coordinates of the center position and the coordinates of the selection position Ls are the same.

The symbol selector 34 selects one symbol at the selection position Ls. Specifically, the symbol data and the estimated viewpoint position data are acquired, and based on these, the symbol indicated by the symbol data is determined as a symbol that the user wants to select, and the determined symbol data indicating the symbol is output.
Here, the symbol selection unit 34 measures the time t when the distance d is equal to or less than the predetermined value D when the coordinates of the center position of a certain symbol match the coordinates of the selection position Ls. It is configured. And when this time t exceeds the predetermined time T set beforehand, it is comprised so that fixed symbol data may be output.

  The confirmed symbol display control unit 35 displays on the screen 21 a symbol string display window 22 that displays the symbols selected by the symbol selection unit 34 in the order of selection. Also, the symbol selected by the symbol selector 34 is received in the symbol string display window 22 upon receipt of the confirmed symbol data.

  The confirmed symbol display control unit 35 is configured to display the symbol string display window 22 so as to overlap the symbol panel 211 in a transparent manner. As a result, the user can check the symbols on the symbol panel 211 overlapping the symbol row display window 22 through the watermark. The transparency of the symbol column display window 22 is configured to be changed as appropriate.

The symbol column display window 22 is fixed at a predetermined position on the screen 21 and is always displayed. The user can check the symbol column determined so far at any time.
4 and 6, the symbol column display window 22 is not transparently displayed for the sake of simplification.

  The confirmed symbol display control unit 35 is configured to set the position for displaying the symbol string display window 22 to a position adjacent to the symbol selected by the symbol selection unit 34.

  As shown in FIG. 4C, the symbol string display window 22 has a horizontally long rectangular shape, and the symbol selection unit 34 selects the symbol (here, the character “N”) immediately above the symbol. Displayed along the grid containing the symbol. In other words, the lower side of the symbol row display window 22 is displayed so as to be substantially the same height as the upper end of the square in which the symbol selected by the symbol selection unit 34 enters, and does not overlap the selected symbol. It has become. The symbol string display window 22 is displayed along the cursor 212.

  The vertical length of the symbol row display window 22 is configured to be equal to or less than half the vertical length of each square, and is adjacent to the symbol selected by the symbol selection unit 34 (here. Then, a part of the character “ni”) is made visible.

In the symbol string display window 22, the symbol string selected by the symbol selector 34 is displayed horizontally. Then, the coordinate position in the horizontal direction of the selection position Ls is displayed in the symbol row display window 22 so as to be center-aligned.
Within the symbol row display window 22, the symbol rows may be displayed in a single row in the horizontal direction, and a line feed may be made when the number of selected symbols exceeds a predetermined value.

The horizontal length of the symbol column display window 22 is configured to change according to the number of symbols displayed in the horizontal direction in the symbol column display window 22. Specifically, the length of the symbol column display window 22 in the horizontal direction decreases as the number of symbols displayed in the horizontal direction in the symbol column display window 22 decreases.
Note that the size of the symbol displayed in the symbol row display window 22 is made smaller than the size of the symbol displayed in the symbol panel 211.

  Next, the operation of the symbol selection apparatus 100 having such a configuration will be described below with reference to FIGS. Here, an example in which the user selects the character “N” from the symbol panel 211 displayed on the screen 21 will be described. 4A to 4C show the estimated viewpoint position Le, the selected position Ls, the range of the distance D from the selected position Ls, and the direction in which the symbol panel 211 moves. It is shown for convenience and is not actually displayed on the screen 21.

  As shown in FIG. 4A, the selected symbol display control unit 33 displays a symbol panel 211 on which a plurality of characters are arranged on the screen 21 of the display 2 (step S1). The user looks at the character “N” displayed on the symbol panel 211.

  The line-of-sight detection means 4 detects the user's line of sight and outputs it as a line-of-sight signal (step S2). Upon receiving the line-of-sight signal from the line-of-sight detection means 4, the viewpoint position estimation unit 31 estimates the viewpoint position of the user on the screen 21 based on this line-of-sight signal (step S3). Here, the user actually sees the center of the character “Nu”, but the estimated viewpoint position Le is slightly lower right from the center of the character “Nu” as shown in FIG. is there.

  Since the distance d between the estimated viewpoint position Le and the selected position Ls exceeds a predetermined value D set in advance, the selected symbol display control unit 33 selects from the estimated viewpoint position Le as shown in FIG. The symbol panel 211 is moved along the direction toward the position Ls (steps S4 and S5). At this time, the user moves his / her line of sight to follow the moving character “Nu”. Then, the estimated viewpoint position Le moves accordingly. That is, as the character “Nu” on the symbol panel 211 approaches the selection position Ls, the estimated viewpoint position Le also approaches the selection position Ls.

  When the user continues to follow the moving character “Nu”, the distance d between the estimated viewpoint position Le and the selected position Ls gradually becomes a predetermined value D or less. Then, as shown in FIG. 4B, the selected symbol display control unit 33 moves the character “N” closest to the estimated viewpoint position Le to the selected position Ls, and moves the center position of the character “N”. Is displayed at the selected position Ls and the cursor 212 is displayed (steps S4 and S6).

  When the user sees the character “Nu” for a predetermined time T seconds or longer with the center position of the character “Nu” at the selection position Ls, the symbol selection unit 34 determines the character “Nu” as the character the user wants to select The confirmed symbol data is output (step S7). Then, the confirmed symbol display control unit 35 displays the character “Nu” in the symbol string display window 22 displayed immediately above the character “Nu” at the selection position Ls (Step S8).

In the symbol selection device 100 of the present embodiment configured as described above, the selected symbol display control unit 33 performs the estimated viewpoint position when the distance between the estimated viewpoint position Le and the selected position Ls is equal to or less than a predetermined value D. Since the symbol closest to Le is moved so as to be drawn into the selected position Ls, even if there is a deviation between the actual viewpoint position and the estimated viewpoint position Le, the symbol can be easily adjusted to the selected position Ls. That is, after the symbol to be selected is brought close to the selection position Ls to some extent, the user does not have to shift his / her line of sight so as to accurately match the symbol to the selection position Ls. The symbol can be selected by being automatically drawn into Ls. Therefore, even if there is a deviation between the actual viewpoint position and the estimated viewpoint position Le, the user can easily select a desired symbol without performing calibration work. Thus, since it is not necessary to perform a calibration operation, it can be used immediately even when the user changes.
Further, for example, an arrow-shaped cursor is displayed at the estimated viewpoint position Le, and the line of sight is not moved so that the cursor is aligned with the symbol, so there is a deviation between the actual viewpoint position and the estimated viewpoint position Le. However, the user cannot follow the cursor on the screen 21 with his / her eyes and cannot select the symbols correctly.

  The selected symbol display control unit 33 also connects adjacent symbols to each other so that the specific symbol that the user actually sees and the symbol closest to the estimated viewpoint position Le are the same regardless of the user. Since the images are displayed separately from each other, the user can match the actually viewed symbol with the symbol closest to the estimated viewpoint position Le regardless of the eyeball shape of the user and the habit when viewing the symbol. Even so, the symbol that the user wants to select can be definitely selected.

  Further, by separating the adjacent symbols in this way, even if the size of the symbol panel 211 is larger than the size of the screen 21, the selected symbol display control unit 33 causes the estimated viewpoint position Le and the selected position Ls. Is larger than the predetermined value D, the symbol panel 211 displayed on the screen 21 is scrolled along the direction from the estimated viewpoint position Le to the selected position Ls. Symbols that cannot be displayed can be moved and displayed on the screen 21 for selection.

  The present invention is not limited to the above embodiment.

  In the previous embodiment, the coordinates of the selection position Ls are set to be the same as the center coordinates of the screen 21, but the present invention is not limited to this, and may be set to coordinates other than the center coordinates of the screen 21.

  In the above-described embodiment, the plurality of symbols are arranged on the symbol panel 211 so as to be arranged at equal intervals in a vertical and horizontal matrix, but the present invention is not limited thereto. For example, the symbol panels 211 may be arranged in a radial pattern. Further, the intervals between the symbols need not be equal.

In another embodiment, when the symbol on the symbol panel 211 is a symbol and the symbol selection unit 34 selects a symbol at the selection position Ls, the selected symbol display control unit 33 further adds the selected symbol to the selected symbol. One or a plurality of symbols associated in advance may be newly displayed on the screen 21.
Specifically, as shown in FIG. 6B, when the symbol selection unit 34 selects a symbol at the selection position Ls (here, a symbol meaning “hot spring”), the symbol is displayed next to the symbol. A related symbol panel 213 in which a plurality of associated symbols (here, symbols representing various means of transportation) are arranged may be displayed.
Then, based on the estimated viewpoint position Le, the related symbol panel 213 may be moved on the screen 21 in the same manner as moving the symbol panel 211 described above, and a desired symbol may be selected. .

In another embodiment, the selected symbol display control unit 33 displays a plurality of selected symbols in the symbol column display window 22 and displays a message corresponding to the combination of these symbols in the symbol column display window 22. It may be configured as follows.
Specifically, as shown in FIG. 6C, when a symbol meaning “hot spring” is selected by the symbol selection unit 34 and then a symbol meaning “bus” is further selected, the symbol A message “I would like to go to the hot springs by bus” may be displayed in the column display window 22 after these two symbols.

  In another embodiment, the selected symbol display control unit 33 displays a message corresponding to a combination of these symbols in the symbol column display window instead of displaying the selected symbols in the symbol column display window 22. 22 may be configured to display.

In the above embodiment, the symbol column display window 22 is displayed immediately above the symbol selected by the symbol selection unit 34. However, the present invention is not limited to this, and the symbol selection unit 34 is directly below the symbol selected by the symbol selection unit 34. You may make it display. That is, the upper side of the symbol row display window 22 may be displayed so as to be substantially the same height as the lower end of the square containing the symbol selected by the symbol selection unit 34.
Further, the symbols displayed in the symbol row display window 22 are not limited to center alignment, and may be left alignment or right alignment.

In another embodiment, the symbol row display window 22 may be displayed on the right or left of the symbol so as to be adjacent to the symbol selected by the symbol selection unit 34. In this case, the symbol column display window 22 may be a vertically long rectangular symbol column display window 22 and may be configured such that symbols are displayed vertically. Further, in this case, the symbol string displayed in the symbol string display window 22 is displayed so as to be centered with the vertical coordinate position of the center of the symbol selected by the symbol selection unit 34 being the center position. It may be configured to be.
The symbol columns displayed in the symbol column display window 22 are not limited to center alignment, and may be top aligned or bottom aligned.

  In the embodiment, the vertical length of the symbol string display window 22 is configured to be equal to or less than half the vertical length of each square, but the present invention is not limited to this.

  In the embodiment, the symbol panel 211 is larger than the screen 21, but is not limited thereto, and may be smaller than the screen 21. That is, all symbols displayed on the symbol panel 211 may be displayed on the screen 21 at a time.

  In the embodiment, the square squares are displayed on the symbol panel 211, but the present invention is not limited to this. The squares may be hidden.

In the embodiment, the symbol selection unit 34, when the coordinates of the center position of a certain symbol coincide with the coordinates of the selection position Ls, allows the user to view the determined symbol data by viewing the symbol for a predetermined time T or more. Although it was comprised so that it might output, it is not limited to this.
In another embodiment, the symbol selection unit 34 is configured to output determined symbol data when the user blinks when the coordinates of the center position of a certain symbol coincide with the coordinates of the selection position Ls. May be.

  The line-of-sight detection means 4 in the above embodiment is a so-called attachment type, but is not limited thereto, and may be a wearable type such as a spectacle type.

  In the above embodiment, the display 2 and the computer main body 3 are integrally provided in the notebook computer 1, but are not limited thereto. The desktop personal computer may be provided integrally, or the display 2 and the computer main body 3 may be provided in different devices. The display 2 may be configured by a projector and a projection screen.

  In addition, it goes without saying that the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 100 ... Symbol selection device 21 ... Screen 211 ... Symbol panel 31 ... Viewpoint position estimation part 33 ... Selection symbol display control part 34 ... Symbol selection part 35 ... Confirmation symbol display control Part 4 ・ ・ ・ Gaze detection means Ls ・ ・ ・ Selected position Le ・ ・ ・ Estimated viewpoint position

Claims (9)

A symbol selection device that enables a user to select a plurality of symbols such as characters and symbols displayed on a screen,
A line-of-sight detecting means for detecting the line of sight of the user directed to the screen;
A viewpoint position estimation unit that estimates the viewpoint position of the user on the screen based on a detection result of the line-of-sight detection unit;
A selection symbol display control unit that moves the symbol to a selection position set in advance on the screen based on the estimated viewpoint position that is the viewpoint position estimated by the viewpoint position estimation unit;
A symbol selection unit that selects the symbol at the selection position;
The selected position is fixed at a predetermined position on the screen;
When the distance between the estimated viewpoint position and the selected position is equal to or less than a predetermined value, the selected symbol display control unit moves the symbol closest to the estimated viewpoint position so as to be drawn into the selected position. A symbol selection device characterized by the above.   The selected symbol display control unit moves the symbol along a direction from the estimated viewpoint position toward the selected position when a distance between the estimated viewpoint position and the selected position is larger than the predetermined value. The symbol selection device according to claim 1.   The selected symbol display control unit separates adjacent symbols from each other to such an extent that the specific symbol that the user actually sees and the symbol closest to the estimated viewpoint position are the same regardless of the user. The symbol selection device according to claim 1, wherein the symbol selection device displays the symbol.   When the distance between the estimated viewpoint position and the selected position is greater than the predetermined value, the selected symbol display control unit displays on the screen along a direction from the estimated viewpoint position toward the selected position. 4. The symbol selection device according to claim 3, wherein the symbol to be scrolled is scrolled.   When the distance between the estimated viewpoint position and the selected position is greater than the predetermined value, the selection symbol display control unit scrolls as the distance between the estimated viewpoint position and the selected position increases. The symbol selection device according to claim 4, wherein the symbol selection device increases the speed.   The symbol selection device according to claim 1, wherein the selection position is set at a center of the screen.   The selection symbol display control unit newly displays one or a plurality of symbols associated with the selected one symbol on the screen when the symbol selection unit selects one symbol. The symbol selection apparatus in any one of 1-6. A symbol string display window that displays the symbols selected by the symbol selection unit in a selected order, and further includes a confirmed symbol display control unit that displays on the screen;
The fixed symbol display control unit displays the selected plurality of symbols in the symbol row display window, or instead of displaying the selected plurality of symbols in the window, the selected plurality of symbols The symbol selection device according to claim 1, wherein a message corresponding to the combination of symbols is displayed in the symbol row display window. A program that is applied to a symbol selection device that includes line-of-sight detection means for detecting the line of sight of a user directed to a screen and that allows a user to select a symbol such as a character or a symbol displayed on the screen. And
A function as a viewpoint position estimation unit that estimates the viewpoint position of the user on the screen based on the detection result of the line-of-sight detection unit;
Based on the estimated viewpoint position that is the viewpoint position estimated by the viewpoint position estimation unit, the symbol is moved to a selection position set in advance on the screen, and between the estimated viewpoint position and the selection position. A function as a selection symbol display control unit that moves a symbol closest to the estimated viewpoint position so as to be pulled into the selection position when the distance is equal to or less than a predetermined value;
A function as a symbol selection unit for selecting the symbol at the selection position;
A program for a symbol selection device, characterized in that