JP2009003566A - Window display device and window display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve operability and visibility of an operation menu present in a depth direction of a virtual three-dimensional space area. <P>SOLUTION: This window display device has: a display control means for displaying a three-dimensional window and a control area image related to control of display contents of the three-dimensional window in the virtual three-dimensional space area on a screen; an acquisition means for acquiring indication position information of an input device; and a conversion means for converting the control area image such that the control area image is magnified according to the indication position information, display position information of the three-dimensional window, and display position information of the control area image. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a window display device and a window display method.

  In general, a display screen of an information device such as a computer is used by displaying a plurality of windows. Since the display screen area is limited, in order to display many windows (window information) there, it is basically necessary to increase the resolution of the display. However, it is often difficult to realize due to problems such as hardware restrictions, cost, and the size of displayed characters and the like.

  Therefore, a technique has been proposed in which a display screen area is virtually enlarged even when the resolution is the same. For example, this is a technology called virtual desktop. Although this technique can reduce the overlap of windows, the number of windows that can be simultaneously displayed on one screen is limited, and this is not an essential solution. Moreover, although a semi-transparent window and a window to be temporarily avoided are implemented by software, it is difficult to say that these methods are also essential solutions.

  On the other hand, in terms of display efficiency, a technique has been proposed in which a window is displayed by virtually expanding a display screen area in a depth direction using a display screen area as a three-dimensional area (see, for example, Patent Document 1). .

  In addition, there is also a proposal in which a window analysis unit is added to Patent Document 1 to determine a window layout position in a three-dimensional space, and thereby display the window by tilting it in the depth direction in the three-dimensional space. (For example, refer to Patent Document 2).

JP-A-6-222899 Japanese Patent Laid-Open No. 11-65806

  When a window is arranged in a three-dimensional space, a window arranged away from the screen in the depth direction of the screen is displayed with a reduced display content as the virtual distance from the screen increases. Therefore, there is a problem that it is difficult to execute a menu for controlling display information of a window, for example, a window title bar, a menu bar, and a scroll bar with a pointing device such as a mouse. Here, the window title bar refers to icons such as window maximization, minimization, and close. The menu bar is a menu for executing a command such as opening a file or help. The scroll bar is a slider or the like that scrolls the display content of the window vertically or horizontally.

  In the above-mentioned Patent Document 2, there are two descriptions of contents for solving the above problems. First, there is a description of contents for changing the position of the title bar and the menu bar in accordance with the inclination of the window. More specifically, when the window is tilted in the depth direction, the position of the window information image is changed so that the window information image (title bar and menu bar images) is displayed on the front side of the window. To do. The second is to change the display of the scroll bar in conjunction with the size of the display area determined to be indistinguishable caused by tilting the window.

  However, the first solution has a problem that it is difficult to perform an intuitive operation because the arrangement of the window information image is different from the case of the two-dimensional window display. In addition, when the front side of the window is in the depth direction, even if the window information image is moved forward, the display is small and the visibility remains low. The second solution has a problem that the position of the control menu bar itself does not change, so that it cannot be operated or is difficult to operate when there is a scroll bar in the depth direction.

  The present invention has been made in view of such problems, and an object thereof is to improve the visibility and operability of an operation menu in the depth direction of a virtual three-dimensional space region.

  Therefore, the window display device of the present invention includes a display control means for displaying a three-dimensional window in a virtual three-dimensional space region on the screen and a control region image related to control of display contents of the three-dimensional window, and an input device. The control unit image is converted to be enlarged according to the acquisition means for acquiring the specified position information, the specified position information, the display position information of the three-dimensional window, and the display position information of the control area image. Conversion means.

  The present invention is also a window display method in a window display device, which displays a three-dimensional window in a virtual three-dimensional space region on a screen and a control region image related to control of display contents of the three-dimensional window. The control according to the display control step, the acquisition step of acquiring the indicated position information of the input device, the indicated position information, the display position information of the three-dimensional window, and the display position information of the control area image A conversion step of converting the region image to enlarge.

  The present invention may be a program and a storage medium.

  According to the present invention, the visibility and operability of the operation menu in the depth direction of the virtual three-dimensional space area can be improved.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing apparatus (computer) that is an example of a window display apparatus. As illustrated in FIG. 1, the information processing apparatus includes a CPU 3 that controls the entire information processing apparatus. When the CPU 3 performs processing based on a program stored in the memory 5, each function or flowchart described later is realized.

  A display device 1, an input device 4, and a memory 5 are connected to the CPU 3 through a bus. The memory 5 includes, for example, a ROM, a RAM, a hard disk device, and the like, and stores information (or data) used in processing based on the program in addition to the above-described program. The display device 1 is a display device that displays a screen or the like. The input device 4 is a keyboard and / or a mouse that inputs data to the information processing device.

FIG. 2 is a diagram illustrating an example of a functional configuration of the information processing apparatus.
The display control unit 2 controls display of the display device 1 (three-dimensional window display, control area image display). The texture mapping unit 6 pastes an image to be displayed on a three-dimensional window image described later. The two-dimensional window image generation unit 7 generates a two-dimensional window image to be displayed in the two-dimensional space area.

  The three-dimensional window image generation unit 8 generates a three-dimensional window image to be displayed in the three-dimensional space area (virtual three-dimensional space area). The window image position changing unit 9 changes the display position of the two-dimensional window and the three-dimensional window. The window image direction changing unit 10 changes the display direction of the three-dimensional window.

  The control area determination unit 11 is a menu image for controlling window display information, and for example, determines a display area (hereinafter referred to as a control area) such as a window title bar, a menu bar, and a scroll bar from the display information. The control component data management unit 12 manages data such as component attributes related to the control area.

  The control part image management unit 13 manages an image of a part related to the control area. The control component position determining unit 14 determines a position to be displayed in the control area. The control component adding unit 15 adds a control area to the window image.

  When the information processing apparatus displays a three-dimensional window in the virtual three-dimensional space area, if a display image in the depth direction of the three-dimensional space is small and visibility is reduced, display of menus for controlling display contents of the window is displayed. The control area which is an image is enlarged and displayed as appropriate. This improves visibility and operability.

FIG. 3 is a diagram illustrating an example of a window display displayed by the information processing apparatus.
In FIG. 3A, reference numeral 21 denotes a screen displayed by the information processing apparatus. Reference numeral 22 denotes a two-dimensional window displayed in the two-dimensional space area. Reference numerals 23 and 24 denote three-dimensional windows displayed in the virtual three-dimensional space area.

  In FIG. 3B, reference numeral 27 denotes a coordinate axis for displaying a window on the screen, and is composed of X, Y, and Z axes representing a virtual three-dimensional space region. For example, each window is displayed with the lower left corner of the screen as the origin (0, 0, 0).

  The three-dimensional window is arranged using a space in the depth direction of the screen, that is, the Z-axis direction. For example, the three-dimensional window 23 in FIG. 3A shows a case where the two-dimensional window 22 is moved in the Z-axis direction and further moved in the X-axis direction and the Y-axis direction by a predetermined value and copied. The three-dimensional window 24 is copied by rotating from the X-axis to the Z-axis with the left end side (Y-axis direction) of the two-dimensional window 22 as an axis, and further moving by a predetermined value in the X-axis and Y-axis directions. Shows the case.

  A display image of the two-dimensional window is generated by the two-dimensional window image generation unit 7. A display image of the three-dimensional window is generated by the three-dimensional window image generation unit 8. The display position of each generated window is determined by the window image position changing unit 9 and displayed on the screen. For the three-dimensional window, the window image direction changing unit 10 determines the rotation direction of the Z-axis direction and the X-axis or Y-axis.

  In FIG. 3A, reference numerals 25 and 26 denote control areas (or control area images) of the menu image for controlling the display information of the window.

  The control component data management unit 12 manages and selects control component data (component data) displayed in the control area. The control component image management unit 13 performs an operation for converting the image of the control component into a predetermined size and shape set in advance.

  Then, the control component position determination unit 14 performs processing for determining the position on the screen where the image-converted control component is to be arranged. Then, the control component adding unit 15 performs processing for adding the image-converted control component to the display area at the determined position.

  In FIG. 3A, when the two-dimensional window 22 is compared with the three-dimensional windows 23 and 24, the three-dimensional window 23 is displayed as if the entire window is reduced. Therefore, the control area of the three-dimensional window 23 is also reduced and displayed. On the other hand, in the three-dimensional window 24, the right side of the window is tilted in the Z-axis direction, so that the image is reduced and displayed as it goes to the right side.

  As described above, when a three-dimensional window is displayed in the virtual three-dimensional space (virtual three-dimensional space area), the control area arranged in the Z-axis direction (depth direction) is reduced, so that the display content of the window is controlled. There is a problem that the operation is hindered.

  Even if it is a three-dimensional window, the displayed screen is a two-dimensional real space, and the input device 4 instructs coordinates to the two-dimensional space. Therefore, the information processing apparatus (or CPU 3) needs to determine the attribute of whether the target window is a two-dimensional window or a three-dimensional window with respect to the designated position. When the target window is a three-dimensional window, the information processing apparatus needs to determine where the window is arranged in the three-dimensional space.

  FIG. 4 is a diagram for explaining the relationship between the indicated position (indicated position information) when operating the three-dimensional window and the display position information (coordinate information) of the target three-dimensional window.

  In FIG. 4, reference numerals 31 to 34 denote vertices constituting the window. 35 to 37 are cursors displayed in accordance with the operation of the input device 4. For example, when the input position information is input from the input device 4 at the position of the cursor 35, the information processing device (or the CPU 3) determines the Z axis in the vicinity of the cursor on the side constituted by the vertex 31 and the vertex 33. Whether or not to convert the control area is determined based on the coordinates. That is, the information processing apparatus determines whether or not the control area can be operated based on the distance in the Z-axis direction. If the information processing apparatus determines that the control area cannot be operated, the control area is sized to be operable. The image is converted and displayed.

  In the case of FIG. 4, for example, when the input position information is input from the input device 4 at the position of the cursor 35, the CPU 3 does not perform control area conversion. However, when the input position information is input from the input device 4 at the positions of the cursors 36 and 37, the CPU 3 executes conversion of the control area. That is, regarding the cursor 35, the CPU 3 determines that the display content of the control area displayed in the vicinity of the designated position information (or the designated position of the cursor 35) is displayed in a size that can be designated. As for the cursor 36 and the cursor 37, the CPU 3 indicates that the display content of the control area displayed in the vicinity of the designated position information (or the designated position of the cursor 36 and the cursor 37) is too small for the user to designate. to decide.

  As described above, the information processing apparatus (or CPU 3) may determine whether or not to convert the control area according to the Z-axis coordinate with respect to the designated position of the input device 4 on the side of the three-dimensional window. It may be determined as follows. In other words, the information processing apparatus (or CPU 3) performs input depending on whether the indicated position information (indicated position) of the input device 4 is a three-dimensional window image or within a predetermined distance (that is, in the vicinity) from the three-dimensional window image. The control area in the vicinity of the position may be converted.

  FIG. 5 is a flowchart for explaining an example of processing related to enlarged display of the control area. Note that the processing in each step of the flowchart is executed under the control of the CPU 3.

  In step S102, the CPU 3 acquires designated position information from the input device 4 and executes detection of designated position information (designated position).

  Subsequently, in step S103, the CPU 3 determines whether or not the indicated position detected in step S102 is in the vicinity of the three-dimensional window. If this processing is within the three-dimensional window, it can be determined by associating the display position (display position information) of the three-dimensional window with the designated position (designated position information). When the designated position is far from the display position of the three-dimensional window, the CPU 3 determines that the designated position is in the vicinity of the three-dimensional window if it is within a predetermined distance.

  As described above, when an affirmative determination is made in step S103, the CPU 3 proceeds to step S104 and acquires information such as attributes of the target three-dimensional window. If it is determined in step S103 that the display position of the three-dimensional window and the designated position of the input device 4 are greater than or equal to the predetermined distance, the CPU 3 ends the process shown in FIG.

  In step S105, the CPU 3 determines whether or not conversion of the control area is necessary. More specifically, the CPU 3 makes this determination based on the attribute information of the target three-dimensional window and the designated position of the input device 4. For example, when the value in the Z-axis direction of the coordinates of the three-dimensional window near the designated position of the input device 4 is equal to or greater than a predetermined value, the CPU 3 determines that the control area needs to be converted. If the CPU 3 determines that the control area needs to be converted, the process proceeds to step S106. If the CPU 3 determines that the control area does not need to be converted, the process shown in FIG.

If it is determined in step S105 that the control area needs to be converted, in step S106, the CPU 3 (or control component data management unit 12) selects control component data (control component image) in the target control area.
Here, the CPU 3 (or the control component data management unit 12) controls the target control area according to, for example, the designated position information, the display position information of the three-dimensional window, and the display position information of the control area. Select part data.

In step S107, the CPU 3 (or the control component image management unit 13) converts the image of the control component in the target control area into, for example, a predetermined size and shape set in advance.
Here, the CPU 3 determines the enlargement ratio (or size) and / or shape of the control area based on the indicated position information of the input device 4, the display position information of the three-dimensional window, and the display position information of the control area. May be determined (enlargement rate determination).
Further, the CPU 3 controls the control area based on the indicated position information of the input device 4 and the value in the Z-axis direction of the coordinates of the three-dimensional window (that is, the coordinate information in the virtual depth direction related to the three-dimensional window). The magnification (or size) and / or shape of the image may be determined.
Further, the CPU 3 may determine the enlargement factor and / or shape of the control area (control area image) according to the two-dimensional window associated with the three-dimensional window. That is, the CPU 3 determines the enlargement ratio and / or shape so that the size of the control area of the three-dimensional window is the same as the size of the control area when the three-dimensional window is changed to a two-dimensional window. May be.

In step S108, the CPU 3 (or control component position determination unit 14) determines where to place (display) the control component image-converted in step S107 in the target control area on the screen. ).
Here, the CPU 3 controls the control component (control region or control region image) that has been image-converted based on the indicated position information of the input device 4, the display position information of the three-dimensional window, and the display position information of the control region. ) May be determined.
Further, the CPU 3 determines the arrangement position of the image-converted control component (control area or control area image) based on the indicated position information of the input device 4 and the value in the Z-axis direction of the coordinates of the three-dimensional window. You may decide.

  In step S109, the CPU 3 (or control component adding unit 15) performs a process of adding (or displaying) the image-converted control component to the arrangement position determined in step S108.

FIG. 6 shows an example of a combination of a three-dimensional window and a control area regarding how the control area is arranged and displayed with respect to the three-dimensional window.
FIG. 6 is a diagram illustrating an example of a combination of a three-dimensional window and a control area.

  FIG. 6A shows an example of a three-dimensional window when rotated about the left side (Y axis) of the two-dimensional window. When an input is made at the position of the cursor 503 with respect to the three-dimensional window 501, the control area 502 is arranged and displayed as shown in FIG.

  That is, it is assumed that an input is made near the right side of the three-dimensional window 501 (position of the cursor 503). Then, the CPU 3 is the same as the control area of the two-dimensional window in which the control area existing on the right side of the three-dimensional window 501 is rotated so that the three-dimensional window 501 is returned to its original position around the rotation axis (left side (Y axis)). Enlarge to size. Then, the CPU 3 displays the enlarged control area 502 so as to be arranged in a three-dimensional window.

  FIG. 6B shows an example of a three-dimensional window when rotated around the lower side (X axis) of the two-dimensional window. When an input is made at the position of the cursor 506 with respect to the three-dimensional window 504, the control area 505 is arranged and displayed as shown in FIG.

  That is, it is assumed that an input is made near the right side of the three-dimensional window 504 (position of the cursor 506). Then, the CPU 3 displays the control area existing on the right side of the three-dimensional window 504 in a three-dimensionally enlarged manner so as to be arranged on the right side of the three-dimensional window 504 (control area 505).

  FIG. 6C shows an example of a three-dimensional window when rotated around the lower side (X axis) of the two-dimensional window. When an input is made at the position of the cursor 509 with respect to the three-dimensional window 507, the control area 508 is arranged and displayed as shown in FIG.

  That is, it is assumed that an input is made near the upper side of the three-dimensional window 507 (position of the cursor 509). Then, the CPU 3 is the same as the control area of the two-dimensional window in which the control area existing on the upper side of the three-dimensional window 507 is rotated so that the three-dimensional window 507 is returned to the original position around the rotation axis (lower side (X axis)). Enlarge to size. Then, the CPU 3 displays the enlarged control area 508 so as to be arranged in a three-dimensional window.

  FIG. 6D shows an example of a three-dimensional window when the two-dimensional window is displayed while being displaced in the Z-axis direction. When an input is made at the position of the cursor 512 with respect to the three-dimensional window 510, the control area 511 is arranged and displayed as shown in FIG.

  That is, it is assumed that an input is made near the upper right vertex (position of the cursor 512) of the three-dimensional window 510. Then, the CPU 3 expands the control area existing on the upper side of the three-dimensional window 510 to the same size as the control area when the three-dimensional window 510 is converted (returned) into the two-dimensional window. Then, the CPU 3 displays the enlarged control area 511 so as to be arranged in a three-dimensional window.

  As described above, the display example of the three-dimensional window and the control area has been described. However, the display position of the control area needs to be displayed side by side in the control area of the target three-dimensional window as shown in FIG. It does not necessarily have to be displayed so as to overlap. In that case, the CPU 3 may display the original control area in a transparent manner.

  Further, the timing for converting and displaying the control area may be operated after the input device 4 actually detects a command such as a left mouse click in the vicinity of the control area with respect to the three-dimensional window.

  In addition, the timing for deleting the converted and displayed control area may be appropriately changed, for example, when the input of the input device 4 is away from the control area by a predetermined distance, or when a certain time has elapsed since the operation of the control area.

  Also, if the display size of the control area after conversion is the same size as that of the two-dimensional window, it is owned as part data when the two-dimensional window is displayed, so there is no load required for conversion. This is advantageous for conversion time and the like. However, the size and shape may be changed as appropriate depending on the positional relationship between the target three-dimensional window and another window in the vicinity.

  Further, when both the control area before conversion and after the conversion are displayed, the input of the input device 4 is valid only in the control area after the conversion, so that an operator's erroneous operation can be prevented. .

  In addition, the control area before and after the conversion may display a linked operation. For example, when the slider after conversion is operated and moved, it may be displayed so that the slider before conversion operates in conjunction with it.

<Other embodiments>
The object of the present invention is achieved by the following. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the central processing means (CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium recording the program code constitutes the present invention.

  In addition, by executing the program code read by the central processing means of the system or apparatus, an operating system (OS) or the like operating on the system or apparatus performs actual processing based on the instruction of the program code. Do some or all. The case where the function of the above-described embodiment is realized by the processing is also included.

  Further, it is assumed that the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the system or apparatus or a function expansion unit connected thereto. After that, based on the instruction of the program code, the CPU of the function expansion card or function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is realized by the processing. It is.

  When the present invention is applied to the storage medium, the program code corresponding to the flowchart described above is stored in the storage medium.

  As described above, according to the above-described embodiment, when the display image at a far distance in the depth direction of the three-dimensional space is small and the visibility is lowered, the control is a display image of a menu for controlling the display content of the window. The area can be enlarged and displayed as appropriate.

  Therefore, the visibility and operability of the operation menu in the depth direction of the virtual three-dimensional space area can be improved.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications can be made within the scope of the gist of the present invention described in the claims.・ Change is possible.

It is a figure which shows an example of the hardware constitutions of the information processing apparatus (computer) which is an example of a window display apparatus. It is a diagram showing an example of the functional configuration of the information processing device. It is a figure which shows an example of the window display which an information processing apparatus displays. It is a figure for demonstrating the relationship between the indication position (indication position information) in the case of operating a three-dimensional window, and the display position information (coordinate information) of the target three-dimensional window. It is a flowchart for demonstrating an example of the process which concerns on the enlarged display of a control area. It is a figure which shows the example of the combination of a three-dimensional window and a control area.

Explanation of symbols

1 Display device 3 CPU
4 Input device 5 Memory

Claims (12)

Display control means for displaying a three-dimensional window in a virtual three-dimensional space area on the screen and a control region image related to control of display contents of the three-dimensional window;
Obtaining means for obtaining designated position information of the input device;
Conversion means for converting the control area image to be enlarged according to the indication position information, the display position information of the three-dimensional window, and the display position information of the control area image;
A window display device comprising:   Based on the indicated position information acquired by the acquisition unit and the virtual depth direction coordinate information related to the three-dimensional window, it is determined whether or not to convert the control area image in the conversion unit. The window display device according to claim 1, further comprising a determination unit that performs the determination.   An enlargement for determining an enlargement ratio related to the conversion of the control area image in the conversion means based on the indicated position information acquired in the acquisition means and the virtual depth direction coordinate information related to the three-dimensional window. The window display device according to claim 1, further comprising rate determining means.   An enlargement ratio determining means for determining an enlargement ratio relating to the conversion of the control area image in the conversion means so as to be the same size as the control area image of the two-dimensional window obtained by rotating the three-dimensional window around the rotation axis; The window display device according to claim 1, further comprising:   A position for determining the display position of the control area image converted by the conversion means according to the indicated position information, the display position information of the three-dimensional window, and the display position information of the control area image before conversion. The window display device according to claim 1, further comprising a determining unit. A window display method in a window display device,
A display control step of displaying a three-dimensional window in a virtual three-dimensional space area on the screen and a control region image related to control of display contents of the three-dimensional window;
An acquisition step of acquiring indicated position information of the input device;
A conversion step of converting the control area image to be enlarged according to the indication position information, the display position information of the three-dimensional window, and the display position information of the control area image;
A window display method characterized by comprising:   Based on the indicated position information acquired in the acquisition step and the virtual depth direction coordinate information related to the three-dimensional window, it is determined whether or not to convert the control area image in the conversion step. The window display method according to claim 6, further comprising a determination step of:   Enlargement for determining an enlargement ratio related to the conversion of the control area image in the conversion step based on the indicated position information acquired in the acquisition step and the virtual depth direction coordinate information related to the three-dimensional window The window display method according to claim 6, further comprising a rate determining step.   An enlargement ratio determining step for determining an enlargement ratio relating to the conversion of the control area image in the conversion step so as to be the same size as the control area image of the two-dimensional window obtained by rotating the three-dimensional window around the rotation axis; The window display method according to claim 6 or 7, further comprising:   A position for determining the display position of the control area image converted in the conversion step according to the indicated position information, the display position information of the three-dimensional window, and the display position information of the control area image before conversion. The window display method according to claim 6, further comprising a determination step. On the computer,
A display control step of displaying a three-dimensional window in a virtual three-dimensional space area on the screen and a control region image related to control of display contents of the three-dimensional window;
An acquisition step of acquiring indicated position information of the input device;
A conversion step of converting the control area image to be enlarged according to the indication position information, the display position information of the three-dimensional window, and the display position information of the control area image;
A program characterized by having executed.   A computer-readable storage medium storing the program according to claim 11.

Images