JPH0583926B2 - - Google Patents

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to a user interface method, particularly a user interface of an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information. It is related to the method.

[Prior Art] Various information processing systems such as personal computers, workstations, word processors, CAD, and CAM machines process text, images, and other information.

Currently, this type of information processing system uses a display such as a CRT, a keyboard, or even a pointing device such as a mouse as a user interface means.

In the old days, character terminals such as teletypes were used as terminals for computer systems, so even in information processing systems that use displays, there was no way to simply input strings from the keyboard to input commands or determine the processing mode. It was used.

However, nowadays, various functions can be selected by displaying pop-up (or pull-down) menus and icons on the display and selecting them using a pointing device such as a mouse. More and more user interface methods are being used.

FIG. 9 shows an example of a menu used in such a user interface method. The illustrated menu M is popped up or pulled down on the display screen D in response to operations such as pressing keys on the keyboard or pointing device, and is divided into multiple areas M1, M2...Mn. Displayed within the area are functions (commands (text, various data such as images, copying, deleting, and other editing of the file), mode), etc. that are selected by inputting characters into the area.

Spatial information (coordinates, size, etc.) on the display screen of areas M1, M2...Mn of menu M
is recognized by an interface control means such as a microprocessor, and the pointer P moved by the pointing device is moved inside one of these areas, and the button of the pointing device is operated at that position. When a function is selected, the interface control means selects the function (command, mode, etc.) and performs the corresponding process.

When selecting an icon, a display section representing a menu or information file is similarly set on the display, and by moving the pointer inside the section or operating a key, the icon or a command, mode, etc. corresponding to the icon is selected.

Note that to move the pointer, not only the mouse but also a track ball, keyboard cursor keys, joystick, digitizer, etc. are used.

[Problems to be Solved by the Invention] With the above-mentioned menu-driven or icon-driven user interface system, functions can be easily and quickly selected without requiring complicated character input.

On the other hand, in such a user interface system, a display occupies a large position.
That is, the operation of selecting a menu or icon is nothing but an operation of selecting the position of a pointer moved by a pointing device on a display screen at a lower processing level of the system.

Therefore, the user must always visually check the position of the pointer while pulling down or popping up the menu, and select an entry or icon within the menu, which may result in overuse of the user's vision. The problem is that the level of fatigue is high.

For example, in the menu system as shown in Figure 9,
The user must move the pointer P while checking the character display in areas M1 and M2, and must confirm that the pointer is within the target area before performing key inputs, button operations, etc.

Additionally, menus typically extend upward or downward from the pointer location where you select the menu display, so if the menu is long, you may have to move your pointing device a considerable distance to select the desired function. There must be. Meanwhile,
Since the above-mentioned visual confirmation must be performed, selecting a menu with many entries is quite troublesome.

In order to avoid the above-mentioned problems, a technique is known in which, for example, one of the menu functions corresponds to a predetermined key operation, so that the function can be selected by pressing that key. In this case, the operability will not be much different from the conventional method driven by string commands.

As described above, in the conventional menu-driven or icon-driven user interface system, the above-mentioned problems arise due to the principle that information is input based on the position information of the pointer on the display.

An object of the present invention is to take the above problems into consideration and provide a method that enables a more efficient user interface by selecting functions using information other than position information on the display. .

[Means for Solving the Problems] In order to solve the above problems, the present invention provides a user interface for an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information. a display means having a display coordinate system corresponding to the predetermined coordinate system; a means for inputting coordinate information of a starting point and an end point in the predetermined coordinate system; Directionality information forming means for forming information related to directionality; and when the coordinates of a starting point are inputted by the inputting means, radial information is formed around a predetermined point in the display coordinate system of the displaying means corresponding to the starting point. A menu display consisting of a plurality of display areas arranged in the display means and each corresponding to a predetermined information processing function is displayed on the display means, and a directional display is provided inside the boundary line of each display area of this menu display or its extension line. A configuration is adopted in which a control means is provided for inputting an end point for forming information using the input means and executing a predetermined information processing function associated with the directional information obtained from the directional information forming means. .

[Operation] According to the above configuration, the user can input the coordinates of the starting point and the ending point in the predetermined coordinate system, and the predetermined information processing function associated with the directional information indicated by the starting point and the ending point can be executed. In addition, when the coordinates of the starting point are input, a plurality of display areas are arranged radially around a predetermined point in the display coordinate system of the display means corresponding to the starting point, and are each associated with a predetermined information processing function. A menu display consisting of is displayed on the display means, and if an end point for forming directional information is input inside the boundary line of each display area of this menu display or its extension line, the corresponding information processing function is executed. I can do it.

[Examples] The present invention will be described in detail below based on examples shown in the drawings.

FIG. 1A shows the configuration of a device that employs the user interface system of the present invention. The configuration shown here is common to various information processing devices such as personal computers, CAD, CAM systems, and word processors.

In the figure, reference numeral 1 denotes a CPU composed of a microprocessor or the like, which is connected to various circuit members shown around it via an address bus, a data bus, or an interface circuit (not shown). Each member connected to the CPU 1 will be explained below.

First, ROM2 is used to store control procedures for CPU1. Part or all of the control program described below may be stored in this ROM2, or only a program for loading a control program described later or a program such as an operating system from an external storage device (not shown) may be stored in the ROM2. You can leave it there.

RAM3 is used as a work area for CPU1, and when a program to be described later is loaded from an external storage device, it is placed in the memory space of RAM3.

The operating section 4, display 5, and pointing device 6 are used as user interface means. The operation unit 4 can be accessed from a keyboard with a JIS layout, etc., and the display 5 can be accessed from a keyboard with a JIS layout, etc.
It consists of a CRT display, LCD panel, etc.

The pointing device 6 is used to control a cursor or pointer displayed on the display 5, and is composed of a mouse, joystick, trackball, digitizer pad, or the like. In addition, the cursor keys of the operation unit 4,
A numeric keypad or the like may be used as the pointing device 6.

FIG. 1B shows the simplest model of the user interface scheme according to the invention. In FIG. 1B, reference numeral 51 indicates the screen of the display 5 (or a display area such as a window set on the screen).

In this embodiment, the pointing device 6 is used to select various functions of the apparatus, and this function is selected by moving the pointer P displayed on the display screen 51 of the display 5 using the pointing device 6. , select the desired function depending on the direction of movement.

Predetermined processing functions are assigned in advance to a plurality of moving directions of the pointer P. Multiple movement directions and predetermined processing functions are available in ROM2 or RAM.
The function to be executed is selected by inputting the detected moving direction information into this table.

Normally, in such a method of moving the pointer P using the pointing device 6, the moving direction of the pointing device 6 and the moving direction of the pointer P are controlled in a 1:1 ratio, so the above function selection process is, in other words, a pointing process. This is nothing more than selecting a function by moving or operating the device 6.

Here, we will consider a comparison with the conventional technology.

In the case of conventional pop-up or pull-down menus, for example, the pointer is moved to a predetermined position on the pop-up or pull-down menu to perform a predetermined input. Function selection is performed depending on the pointer position. In contrast, in this embodiment, function selection is performed depending on the direction of movement of the pointer on the screen. As already mentioned, in the conventional function selection that depends on the pointer position, the user's gaze on the screen is essential, whereas in the present embodiment, the function selection that depends on the direction of the pointer movement does not necessarily require the user's gaze on the screen. do not.

The user interface control described above will be explained in detail below, starting from the simplest control example.

Figure 2 shows the simplest CPU for selecting functions based on the direction of pointer movement as shown in Figure 1B.
A model of the control procedure in step 1 is shown as a flowchart.

The illustrated routine is a subroutine that is executed at a predetermined timing during image processing, character processing, or other control by the CPU 1.

In step S21 of FIG. 2, the moving direction of the pointing device 6 is detected as a direction selection made by the user. This detection process is performed via an interface means not shown in FIG. 1A. To obtain the operation information of the pointing device 6, a known system call prepared by a known operating system or the like is used.

At this time, the CPU 1 moves the pointer P on the display screen 51 of the display 5 by the same amount in the same direction simultaneously with the movement of the pointing device 6. This allows the user to monitor his or her selection direction via the display 5 if necessary.

In fact, the direction selection in step S21 is performed by inputting information regarding the start point and end point in the display coordinate system, and performing predetermined arithmetic processing on the coordinate information of the start point and end point, as explained in FIG. 5 and subsequent figures. It is detected by

Next, in step S22, CPU1
Various functions assigned in advance to the direction selected in S1, such as deleting and moving characters and images, and selecting various modes, are executed. At this time, a table in the ROM 2 or RAM 3 that associates selection directions with processing functions is referred to, and the function to be executed is selected.

The control model shown in FIG. 2 is the simplest one, and does not specify when the user's selection process starts or ends. Furthermore, the possibility that the user interrupts the selection process or changes the selection direction is not considered. The control models shown in FIGS. 3 and 4 show these points in more detail.

First, in step S31 of FIG. 3, the CPU 1 detects whether a selection operation has been performed by the user. The selection operation is performed using the operation unit 4 and the pointing device 6.
This can be done by pressing a button on the pointing device 6, as will be described later.

When the user performs a selection operation in step S31, a loop of steps S32 to S34 is entered, in which the selection direction is detected and the display operation set for the selected menu entry, such as inverting the menu area, is performed.

It is checked whether the user is able to select the desired function by display control such as reverse display.

First, in step S32, the moving direction of the pointing device 6 (and the movement of the pointer P) is detected.
Do the following. In this detection, for example, the coordinate values of the pointer P on the display screen 51 when the selection operation was performed in step S31 (the coordinate values of the starting point (start point) of the selection operation) are memorized, and the coordinate values of the pointer P are This can be done by comparing the coordinate values of the pointer P, which is moved according to the input movement amount. Furthermore, as will be described later, the direction may be detected by comparing the coordinate values at the end point (end point) of the selection operation.

In step S33, the operation set corresponding to the selected movement direction (such as the above-mentioned inverted display of the menu area) is executed. At this time, ROM2
Alternatively, a table in the RAM 3 that associates selection directions with processing functions is referred to, and the operation to be executed is selected.

In step S34, it is determined whether the function selection has been completed. The determination in step S34 is made by detecting whether or not a predetermined button of the pointing device 6 is pressed or released.

According to such control, the user can start the function selection process, or interrupt or end the function selection at a timing of his/her preference, through the process of step S31.

The actually selected function (editing of images, characters, etc.) is executed after the procedure shown in FIG. 3 is completed. Also at this time, the table in ROM2 or RAM3 is referred to.

More specifically, steps S31 and S33 in FIG. 3 can be configured as shown in FIG. 4. Also, in Figure 4,
To make it possible to change the selection direction mid-way, the step
S35 is inserted between steps S32 and S33.

Step S31 in FIG. 4 is composed of a loop of step S31a and step S31b. step
In step S31a, the start of the selection operation is detected by, for example, pressing a predetermined button on the pointing device 6, and in step S31b, the user actually starts selecting a function by detecting the pressing of another release button on the pointing device 6. Detect whether or not. Then, if a valid selection start is performed, the process advances to step S32, and if a release button or the like is operated, the process returns to step S31a.

Also, in step S35a following step S32,
First, the validity of the direction selection made in step S32 is determined. This is done, for example, by determining whether or not the selection direction has been determined through arithmetic processing.

Next, in step S35b, the operation of the release button of the pointing device 6 is detected,
It is determined whether or not a valid direction selection has been made, and if no cancellation has been made and a valid function selection has been made, the process returns to step S32 and the user's direction selection is accepted again (or step
You may return to S31a and cancel the selection process completely).

In step S33, step S33b is provided after step S33a, which is the same as step S33 in FIG. This is done by the user, and by controlling the reverse display in step S33a,
This is to make sure that the user has selected the function that he or she wants.

According to the process shown in FIG. 4, it is possible to start a selection operation and cancel the selection operation that has been started, and it is possible to change the selected function or change the selected function until the function selection is finally confirmed. Function selection can be canceled.

Next, with reference to FIGS. 5 and 6, more detailed input control when a mouse is used as the pointing device 6 and details of screen control that were not described in detail in the above example will be described. For convenience of explanation, the mouse reference number 61 is used here.
Use.

In the above-mentioned FIG. 1B, the menu displayed on the display 5 was not shown in order to show only the main points, but if the menu shown in FIG. 5 is displayed on the display 5, the user can confirm the selection direction. , desired functions, changes, etc. can be easily performed.

In FIG. 5, reference numeral 51 indicates a display screen (or window) of the display 5, and this display area is used for editing various data such as characters and images depending on the application. Here, an example will be shown in which eight processing functions are selected according to the moving direction of the pointer P.

A menu M is displayed on the display screen 51 in response to pressing of a predetermined button of the mouse 61. Although the shape of the menu M may be any shape such as a circle or a diamond, a square shape is exemplified here.

The menu M is divided into eight sections M1 to M8 in order to visually display the moving direction of the pointer P (and therefore of the mouse 61) assigned to the selectable function.
It is divided radially into . This division on the screen is performed by changing display colors, displaying straight lines, etc.

Here, the center O of menu M is the center point, and two horizontal and vertical boundaries define menu M.
is divided into four sections, which are further divided by two border lines that are inclined at 45 degrees to the two horizontal and vertical border lines to form eight sections. Each section M1
~ Inside M8, the selected processing function is displayed in characters.

Here, an overview of the user interface using menu M in FIG. 5 will be explained.

When a predetermined button of the mouse 61 is pressed while the menu M is not displayed, the menu M is displayed with the center point O of the menu M set at the position where the pointer P was present at that time. The coordinates of point O are CPU
1 uses RAM as the coordinate information of the starting point of the selection operation.
3 is stored. Also, at this time, pointer P is displayed overlapping menu M.

Next, the user moves the mouse 61 to move the pointer P in a desired direction. You can tell which function you want to select from sections M1 to M8 of menu M (or the function display with letters attached to it).
The user moves the pointer P inside any one of the sections M1 to M8 corresponding to the desired function. Alternatively, even if it is outside the menu M, it may be inside an extension of two boundary lines dividing the desired section from other sections.

When a predetermined button on the mouse 61 is pressed or released, the coordinates of the pointer P at that time are taken in as the coordinate values of the end point of the selection operation. This operation confirms the user's function selection.

As a result, the CPU 1 uses the coordinates of the center point O (starting point) of the menu M stored in advance in the RAM 3,
The selected movement direction is detected from the coordinates of the position (end point) of the pointer P at the time when a predetermined button of the mouse 61 is pressed or released, and the direction of movement is correspondingly assigned in the tables in ROM2 and RAM3. Execute the processing functions that are available.

FIG. 6 illustrates a control procedure of the CPU 1 for realizing the user interface shown in FIG. 5.
Here, an example is shown in which a cancellation operation is enabled during function selection.

In step S61 in FIG. 6, pressing of a predetermined mouse button to command the start of function selection is detected.
When a predetermined mouse button is pressed, the process advances to step S62, and the x and y coordinates of the pointer P at the time of pressing the mouse button are set as the center O (starting point) of the menu M.
In step S63, a menu M as shown in FIG. 5 is displayed on the display screen 51 of the display 5.

In step S64, while detecting the movement of the mouse 61 and controlling the corresponding movement of the pointer P, confirmation of selection by pressing or releasing the mouse button is detected. At this time, a release operation using another mouse button or the like is also detected, and if a release operation is detected, the currently displayed menu is erased in step S70 and the process returns to step S61.

On the other hand, when the selection is confirmed by pressing or releasing the mouse button in step S64, the x and y coordinates of the position (end point) of pointer P when the mouse button was pressed or released at step S65 are input, and the value is is converted into coordinate system data whose origin is the coordinates of the center point O (starting point) of the menu M stored in the RAM 3 in step S66.

In step S67, the information converted in step S66 is
The selected direction is detected by checking the x and y coordinates of the position (end point) of the pointer P when the mouse button is pressed or released. This process is
Data regarding directionality is obtained from information on the starting point and ending point of the selection process, and is configured by, for example, the processing shown in FIGS. 7 and 8, which will be described later.

When the selected direction is detected in step S67, menu M is deleted from the display screen 51 in step S68, and then the function corresponding to the selected direction is executed in step S69. A table in ROM2 or RAM3 is used for function selection.

In this way, the user can easily and reliably select a desired function by using the mouse 61 and the menu M display. Although the user can clearly distinguish the moving direction of the pointer P by displaying the menu, according to this embodiment, it is not always necessary to display the menu M.
No need to watch.

In this embodiment, the function is selected by the direction of movement from the point where the selection operation is started (starting point: center O of menu M) to the point where the selection is finally confirmed (end point). Once you get used to it, you can select a desired function without looking at the display screen 51. In this respect, this embodiment is superior to conventional pop-up or pull-down menus. Furthermore, for the same reason, it goes without saying that the user's selection changes can be allowed until the final confirmation operation is performed.

Furthermore, when the user actively uses the menu display, the following effects can be obtained.

In other words, when confirming a function selection by pressing or releasing a button, it is sufficient to press or release the button even if it is outside the menu M, as long as it is inside the extension of the two border lines dividing the desired section from other sections. ,section
By performing the operation inside any one of M1 to M8, the user can more clearly monitor the function he/she is trying to select while performing the operation. In this case,
The usability of the menu is similar to that of conventional menus, so even if you transition from the conventional menu system, you can operate it without any discomfort.

Note that the assignment of the buttons on the mouse 61 is arbitrary; for example, even if it is a one-button mouse, menu M is displayed when the first button is pressed, and then the pointer P is moved in the desired direction while the button is pressed. Then, the function can be confirmed by releasing the button. Alternatively, after the menu is displayed, the selection may be confirmed by pressing the mouse button again without pressing the mouse button while the pointer P is moving.

In addition, in the embodiment shown in FIG. 6, directionality judgment (step
Of course, it is also possible to combine S32) with a corresponding inversion display control of the menu area.

Here, details of the process of detecting directionality information from the coordinates of the starting point and ending point of the selection operation in FIG. 6 are illustrated in FIG. 7. This control is
It is also possible to use something other than a mouse as the pointing device 6.

FIG. 7A shows the assignment of detection directions used in the detection process of FIG. 7B.

In FIG. 7A, the symbol O represents the display 5.
indicates the center point of menu M displayed on the screen. As shown in the figure, in FIG. 7A, the menu M is divided into eight equal parts of 45 degrees in the same manner as in FIG. 5, and eight directions 1 to 8, as shown, corresponding to each division can be selected.
Note that the symbols x and y indicate orthogonal coordinate axes whose origin is the center O of the menu.

Here, the vertical y-axis is set so that the vertically downward side takes a positive value, as in screen control of a normal computer. The boundaries separating the eight directions are straight lines y=x and straight lines y=-, respectively.
x, straight line x=0 (y axis), straight line y=0 (x axis).

FIG. 7B shows an example of a direction detection routine when the direction to be detected is divided into eight parts as shown in FIG. 7A.

In FIG. 7, the same step S66 as in FIG. 6 is illustrated, and here the coordinate values when the input is finally made with the pointing device 6 are the coordinates in the coordinate system whose origin is the center O of the menu. Convert to value (px, py) and then perform steps S71 to S77
Then, the direction of movement is detected by checking these coordinate values (px, py).

In steps S71 to S77, the coordinate values px and py are positive,
Which direction in FIG. 7A is selected is determined by negative or large/small calculations. Here, the equation of the boundary straight line that defines each direction is x=0, y=
0, x=y, x=-y, so direction 1~
The conditions for detecting each of 8 are as follows.

Direction 1: px>0 and py<0 and px>-py...(1) Direction 2: px>0 and py<0 and px<-px...(2) Direction 3: px>0 and py<0 and −px＜−py
...(3) Direction 4: px<0 and py<0 and -px>-py
...(4) Direction 5: px<0 and py>0 and -px>py ...(5) Direction 6: px<0 and py>0 and -px<py ...(6) Direction 7: px> 0 and py > 0 and px < py ... (7) Direction 8: px > 0 and py > 0 and px > py ... (8) Steps S71 to S77 satisfy each of these conditions (1) to (8)
(the order does not match the above in the flowchart), and when each condition is satisfied, one of directions 1 to 8 is selected by the user in steps S78 to S85. Detected as a direction.

When the selected direction is determined by the control shown in FIG. 7, the function corresponding to the selected direction is executed. For function selection,
A table in ROM2 or RAM3 is used.

In the case of FIGS. 5 and 7, the selectable directions are eight directions obtained by dividing the upper right, upper left, lower right, and lower left directions into halves, respectively. Furthermore, the angles of division are equal. However, when operating the pointing device 6 (especially a mouse, etc.) without looking at the screen, it is possible to operate the pointing device 6 (especially a mouse) fairly accurately in the vertical and horizontal directions by blind operation, but compared to this, the angle cannot be accurately controlled in diagonal directions. seems to be unmanageable.

Therefore, FIG. 8 shows a different selection direction setting method. Here, eight directions can be selected: horizontal left/right direction, vertical up/down direction, and upper right, upper left, lower right, and lower left directions, and the accuracy of blind operation between vertical, horizontal, and diagonal directions. The angular width in each direction is set to a different value in consideration of the difference in .

FIG. 8A shows eight selectable directions 1-8 in a similar manner to FIG. 7A. The straight lines of the boundary line dividing each direction 1 to 8 are y=ax, y=
It is indicated by x/a, y=-ax, y=-x/a.

The direction set in this way can be identified by the procedure shown in FIG. 8B.

Steps S66, S71 to S77 in Figure 8B are shown in Figure 7B.
, and each of the above conditions (1) to (8) is checked. Then, steps S91 to S98 are provided instead of steps S78 to S85 in FIG.
Direction is detected by comparing 1/a. This threshold value is determined by the straight lines of the boundary lines dividing each direction 1 to 8, y=ax, y=x/a, y, respectively.
=-ax, y=-x/a.

For example, if step S75 is affirmative, it means that the area in direction 1 in FIG. 7A has been detected, but in the case of FIG. must be detected.

In step S91, the slope of the straight line y = -x/a -
Direction 1 or 2 is determined by comparing 1/a with the quotient of the x and y coordinate values. step
In S91, direction 1 is detected if py/px>-1/a is satisfied.

Similarly, in steps S92 to S98, straight lines y=ax, y=x/a, y=-ax, y=
The selection direction is finally determined by comparing the slope of -x/a and the quotient of the x and y coordinate values. With such control, in the case of FIG. 8, one selection direction is determined in one of two steps.
For example, direction 2 is determined in one of the two steps S100 and S102.

As described above, according to the control shown in FIG.
Vertical direction and the upper right, lower right, upper left,
It is possible to detect the selection in the 8 directions at the bottom left and execute the corresponding function.

In particular, according to the configuration of FIG. 8, steps S91 to
By changing the setting of the value a that determines the threshold value in S98, the range of selectable directions can be controlled as desired. As a result, it is possible to narrow the range in the directions considered to be vertical and horizontal, and to set the range in the diagonal direction to be large, taking into account the accuracy of the user's blind operation as described above.

Also, the four straight lines in Figure 8 y=ax, y=
Although the slopes of x/a, y=-ax, and y=-x/a are determined based on the same value a, these values may be determined separately. In this case, the threshold values in steps S91 to S98 in FIG. 8B are set separately.

For example, directions 1, 8, and 4 in FIG.
The slope of the straight line y=x/a that divides 5 is m
If the value is changed to , the threshold value used in steps S93 and S95 becomes m.

By setting the selection direction ranges separately in this way, for example, when a user makes a horizontal input using the pointing device 6, the direction of movement of the pointing device 6 is always tilted. It is possible to correct operating habits.

Furthermore, the straight lines dividing each direction may be considered as eight straight lines starting from the origin O, and the slopes of these lines may be made different. This makes it possible to set, for example, the detection conditions for direction 1 to be stricter and the detection conditions for direction 5 to be less strict.

Note that the threshold value that defines the selection direction may be set to a value of the user's preference. This setting can be performed by inputting numerical values using the operating section 4 and pointing device 6, or by selecting from a menu. Of course, during this setting, the menu related to the present invention may be used.

In FIGS. 7 and 8, for ease of explanation,
Although data on the boundary line is not considered, condition (1) ~
(8) Alternatively, by appropriately placing equal signs in the inequalities in steps S91 to S98 in Figure 8, it goes without saying that an input on a boundary line can be detected as one of the selection directions delimited by that boundary line. .

In the above example, the corresponding function is executed according to the selection of eight directions, but any number of selectable directions may be used.

Further, as a pointing device, in addition to a mouse, a trackball, digitizer pad, stick, etc. can be used. In the case of a joystick or the like, the operating section is not "moved," but in this case, similar control is possible by replacing "movement" in the above embodiment with "tilting" of the stake.

In addition, the cursor keys, numeric keypad, etc. used on a conventional keyboard (used as the operation unit 4 in Fig. 1) can be used as a pointing device in conjunction with a menu as shown in Fig. 5, for example. I can do it.

In the case of cursor keys, each key with up, down, left and right arrows can be used to select four directions, or by accepting input from two of each key, such as up and right, you can select an additional four directions, that is, eight directions in total. can be done. When using cursor keys, use other keys to start and end directional selection. These keys are detected, for example, in steps S31a and S34 in the control procedure shown in FIG.
In the case shown in the figure, it is detected in S61 and S65.

That is, after pressing a predetermined key (escape key, etc.) to start direction selection, displaying the menu as described above with the current position of the pointer, move the pointer using the cursor keys, and press the enter key (return key). , the same escape key used to start selection, etc.) to select the direction. Direction detection can also be performed using cursor keys with opposite directions,
For example, direction selection may be started or ended by pressing both the left and right keys simultaneously. Similar to the above-described embodiment, direction selection can be detected from the coordinates of the pointer at the point where the direction selection starts and ends.

You can also use a numeric keypad. In this case, among the keys arranged like 789 456 123 0, the surrounding 7, 8,
Keys 9, 4, 6, 1, 2, and 3 correspond to eight directions, and the direction is selected by pressing the keys.

In the case of a numeric keypad, a key is required to start and end direction selection.For example, the 5 key in the center of the numeric keypad is not necessary for direction selection, so this key is used to start and end direction selection. can be assigned to

In other words, by pressing the 5 key in the center of the numeric keypad,
Display a menu at the current position of the pointer, then move the pointer in the corresponding direction in response to pressing the surrounding keys 7, 8, 9, 4, 6, 1, 2, 3,
The selection direction is confirmed by pressing the 5 key again or by pressing another confirmation key. Starting and ending direction selection, direction detection, etc. are performed in the same way as with the cursor keys.

By using a cursor key, numeric keypad, etc., the advantages of the menu system of the present invention can be enjoyed even in devices that do not have a pointing device. When using cursor keys or numeric keys, it goes without saying that any key can be used to start and end direction selection.

In addition, in the conventional menu interface,
A so-called hierarchical menu structure is known in which a certain menu item is selected in response to a predetermined input operation, and a sub-menu with lower-level functions of that menu is displayed to allow function selection. For example, in the menu shown in FIG. 5, it is of course possible to adopt a configuration in which a certain menu item is similarly designated by directional selection and its submenu is displayed.

[Effects of the Invention] As is clear from the above description, according to the present invention, in a user interface system for an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information, a display means having a display coordinate system corresponding to the predetermined coordinate system; a means for inputting coordinate information of a start point and an end point in the predetermined coordinate system; and a means for inputting coordinate information of a start point and an end point in the predetermined coordinate system; directional information forming means for forming related information; and when the coordinates of a starting point are input by the input means, directional information forming means is arranged radially around a predetermined point in the display coordinate system of the display means corresponding to the starting point. , a menu display consisting of a plurality of display areas each associated with a predetermined information processing function is displayed on the display means, and directional information is formed inside the boundary line of each display area of this menu display or its extension line. A configuration is adopted in which a control means is provided for inputting an end point for the direction using the input means and for executing a predetermined information processing function associated with the directional information obtained from the directional information forming means.

Therefore, by having the user input the coordinates of the starting point and the ending point in the predetermined coordinate system, it is possible to execute a predetermined information processing function that is associated with the directional information indicated by the starting point and the ending point.

In addition, when the coordinates of the starting point are input, multiple display areas arranged radially around a predetermined point in the display coordinate system of the display means corresponding to the starting point and each corresponding to a predetermined information processing function are displayed. Since the menu display is displayed on the display means, information processing functions can be displayed efficiently and easily to the user. By inputting the end point for forming directional information, the corresponding information processing function can be executed, and a user interface method with excellent operability can be provided.

Furthermore, with a single action of inputting a start point and an end point, it is possible to extremely easily display a radial menu centered on the start point and select a function corresponding to the menu display.

Note that inputting the start point and end point can be easily performed using a pointing device such as a mouse or a trackball, and in the present invention, since directional information ultimately has meaning, the direction information is indicated by the start point and end point. Directional information can be input easily without necessarily requiring a monitor display, blind operation is easy, and user fatigue can be reduced.
It has excellent effects such as

[Brief explanation of drawings]

FIG. 1A is a block diagram of an information processing device adopting the user interface method of the present invention, FIG. 1B is an explanatory diagram showing a basic model of function selection by direction in the present invention, and FIG. Figures 3 and 4 are flowcharts showing a basic model of function selection control based on direction. Figures 3 and 4 are flowcharts showing a basic model of function selection control based on more complicated directions. Figure 5 is a flowchart showing a basic model of function selection control based on direction. FIG. 6 is a flowchart showing user interface control using a mouse, FIG. 7A is an explanatory diagram showing an example of setting the direction to be selected, and FIG. 7A is a flowchart of the selection direction detection control, FIG. 8A is an explanatory diagram showing different setting examples of the selected direction, and FIG. 8B is a flowchart of the selection direction detection control of FIG. 8A. The flowchart in FIG. 9 is an explanatory diagram showing an example of a conventional menu display. 1...CPU, 2...ROM, 3...RAM, 4
...Operation unit, 5...Display, 6...Pointing device, 51...Display screen.

Claims (1)

[Scope of Claims] 1. In a user interface system for an information processing device that has a predetermined coordinate system and performs information processing according to input coordinate information, the display has a display coordinate system corresponding to the predetermined coordinate system. means for inputting coordinate information of a start point and an end point in the predetermined coordinate system; directional information forming means for forming information related to directionality in the predetermined coordinate system from the coordinate information of the start point and end point; When the coordinates of a starting point are input by the input means, a plurality of coordinates are arranged radially around a predetermined point in the display coordinate system of the display means corresponding to the starting point, and each corresponds to a predetermined information processing function. displaying a menu display consisting of display areas on the display means, causing the input means to input an end point for forming directional information inside the boundary line of each display area of the menu display or an extension thereof, and A user interface system characterized by comprising a control means for executing a predetermined information processing function associated with direction information obtained from a direction information forming means.