WO2008012966A1 - Information processing device, user interface method, and information storage medium - Google Patents
Information processing device, user interface method, and information storage medium Download PDFInfo
- Publication number
- WO2008012966A1 WO2008012966A1 PCT/JP2007/054966 JP2007054966W WO2008012966A1 WO 2008012966 A1 WO2008012966 A1 WO 2008012966A1 JP 2007054966 W JP2007054966 W JP 2007054966W WO 2008012966 A1 WO2008012966 A1 WO 2008012966A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- program
- closed
- related position
- positions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
Definitions
- Information processing apparatus user interface method, and information storage medium
- the present invention relates to an information processing apparatus, a user interface method, and an information storage medium, and particularly to a user interface used when executing data processing by a program.
- GUI graphic user interface
- an icon indicating program data is displayed on the monitor, and an icon indicating the data to be processed (processing target data) is also displayed on the monitor.
- processing target data is also displayed on the monitor.
- arbitrary processing target data can be processed by the arbitrary program.
- the icon position of the data to be processed overlaps the display position of the program icon, the color of the program icon is changed so that the user can know that both icons overlap.
- the present invention has been made in view of the above problems, and an object of the present invention is to make it possible for the user to recognize in advance that data to be processed can be processed by a program according to an operation by the user, It is to provide a user interface method and an information storage medium.
- an information processing apparatus provides a program data A plurality of data related positions including a data related position related to the data and a data related position related to the processing target data to be processed by the program are set, and each data related position is singly or together with other data related positions.
- Display means for displaying an image of a space surrounded by the closed area so that each closed area can be identified, operation means for performing an operation for the user to arbitrarily move each data-related position in the space, and Closed area updating means for updating each closed area in the space according to movement of each data related position in the space, data related position related to the data of the program, and data related to the processing target data Execution of a program that processes the data to be processed by the program at a given timing when the position is surrounded by a common closed region
- the closed region updating means includes, as the closed region, a region in the space that is a set of positions where the sum of the values of the decreasing function of the distance to each data related position is equal to or greater than a predetermined threshold. It is characterized by setting.
- the user interface method includes a plurality of data related positions including a data related position related to program data and a data related position related to processing target data which is a processing target of the program.
- a spatial image display step for displaying an image of a space surrounded by a closed area with each data-related position alone or together with another data-related position so that each closed area can be identified;
- a move operation accepting step for accepting an operation for the user to arbitrarily move each data related position in the space, and a closed region updating step for updating each closed region in the space according to the movement of each data related position in the space
- a data related position related to the program data and a data related position related to the processing target data are surrounded by a common closed area.
- a program execution step of processing the data to be processed by the program at a given timing, and the closed region update step includes a value of a decreasing function value of a distance to each data related position.
- An area in the space which is a set of positions where the sum is equal to or greater than a predetermined threshold, is set as the closed area.
- the information storage medium has a plurality of data related positions including a data related position related to program data and a data related position related to processing target data which is a processing target of the program. And each data related position is set independently. Or a display means for displaying an image of a space surrounded by a closed area together with other data-related positions so that each closed area can be identified, and for performing an operation of arbitrarily moving each data-related position in the space.
- closed area updating means for updating each closed area in the space in accordance with the movement of each data related position in the space, and the data related position related to the program data and the processing target data Related data
- a computer-readable program that stores a program for causing a computer to function as program execution means for processing the data to be processed by the program at a given timing when related positions are surrounded by a common closed area.
- the closed region updating means is a value of a decreasing function of the distance to each data related position.
- the area in total is set at a position equal to or greater than a predetermined threshold value the space is set as the closed region, and wherein the.
- the computer is, for example, a personal computer, a home game machine, an arcade game machine, a portable game machine, a mobile phone, or a portable information terminal.
- the program can be stored on a computer-readable information storage medium such as a CD-ROM or DVD-ROM.
- a closed region which is a region in the space, which is a set of positions at which the sum of the values of the decreasing function of the distance to each data related position is equal to or greater than a predetermined threshold value is identified and displayed. For this reason, when the closed area surrounding the data-related position related to the program data and the closed area surrounding the data-related position related to the processing target data approach each other according to the operation by the user, the both closed areas are integrated. Even before, both closed regions are deformed. Therefore, the user can recognize in advance that the processing target data can be processed by the program. When both closed areas are integrated and the data-related position related to the program data and the data-related position related to the processing target data are surrounded by the common closed area, the program is given at a given timing. The processing target data is processed.
- the "given timing” may be a timing at which both closed areas are integrated, or after the both closed areas are integrated, the user instructs processing of processing target data by a program. It may be timing.
- the “space” may be a three-dimensional space or a two-dimensional space, that is, a plane.
- grouping means for grouping data related to the data related positions is further included. In this way, a plurality of data can be easily grouped simply by moving the data-related position in the space.
- the grouping means may link data-related positions surrounded by the common closed region in the space in accordance with an operation performed by the operation means. In this way, it is possible to move the space by collecting data related positions related to the grouped data.
- threshold value changing means for changing the given threshold value may be further included. In this way, by changing the given threshold value, adjacent data-related positions are surrounded by a common closed area, or are surrounded by separate closed areas.
- the degree of association between the data is calculated based on the attribute information of each data, and the data-related position related to the data is approached or separated in the space according to the degree of association. And associated position separation / separation means. In this way, it becomes possible to promote gnorape or to suppress grouping according to the degree of association between data, thereby improving user convenience.
- the operation means may be means for allowing the user to arbitrarily move the closed areas identified and displayed by the image. When each closed area moves, one or a plurality of data-related positions surrounded by the closed area may be moved. By doing this, it is possible to move the data-related position surrounded by moving any closed region using the operating means.
- FIG. 1 is a diagram showing a virtual space (before moving a closed region) managed in the information processing apparatus according to the embodiment of the present invention.
- FIG. 2 is a diagram showing an example of a metaball function.
- FIG. 3 is a diagram showing a spatial image displayed on the display device.
- FIG. 4 is a diagram showing a virtual space (after movement of a closed region) managed in the information processing apparatus according to the embodiment of the present invention.
- FIG. 5 is a diagram showing a spatial image displayed on the display device.
- FIG. 6 is a diagram showing the distribution of the sum of function values in the virtual space.
- FIG. 7 is a diagram showing a spatial image at the time of spatial enlarged display.
- FIG. 8 is a hardware configuration diagram of the information processing apparatus.
- FIG. 9 is a functional block diagram of the information processing apparatus.
- FIG. 10 is a configuration diagram of a data information database.
- FIG. 11 is a configuration diagram of a group database.
- FIG. 12 is a diagram showing another example of a spatial image.
- the information processing apparatus includes a computer, and a virtual space is constructed on a storage device of the computer. Data-related positions of various data stored in the computer or stored in another computer connected to the computer via a network are set in the virtual space.
- the data is, for example, data (processing target data) such as still images, moving images, music, etc., and data of programs for processing such data by playing back or editing the data.
- An image showing this virtual space is displayed on a display device constituting the information processing apparatus.
- This spatial image constitutes a graphical user interface for the user to instruct the grouping and release of data. It also configures a graphic user interface for the user to instruct the processing of various processing target data by the program.
- FIG. 1 is a diagram showing an example of such a virtual space.
- a three-dimensional virtual space 10 is constructed on a computer storage device, and data-related positions 12a to 12c associated with electronic data are set in the virtual space 10, respectively. Yes.
- the data related positions 12a to 12c in the virtual space 10 are respectively surrounded by three-dimensional closed regions 14a to 14c.
- each data-related position 14a to 14c is associated with a metaball function, and a value obtained by adding the values of these functions (metaball density value) is a given threshold value (surface indication value).
- the set of positions in the virtual space 10 as described above, that is, the regions are determined as closed regions (regions occupied by the metaballs) 14a to 14c.
- Fig. 2 shows an example of the metaball function. As indicated by the solid line in the figure, the metaball function is a decreasing function with respect to the distance from each data-related position, and is greater than a predetermined distance LM.
- It has a value of zero.
- the data-related positions are associated with each other.
- the surface of the closed region surrounding the data-related position is provided at a position where the value of the function of the metaball becomes a given surface indication value, that is, at a distance L0 from each data-related position.
- a spherical surface having a radius L0 centered on each data-related position is the surface of the closed region surrounding the data-related position.
- the value obtained by adding the values of the metaball functions related to these data-related positions is the given surface indication.
- the surface of the closed region of 1 or 2 is provided at the position where the value is obtained. That is, if one closed region surface is provided, the closed region surrounds two data-related locations. Also, if two closed area surfaces are provided, they surround each data-related location. Then, when another data related position surrounded by the other closed area approaches the data related position surrounded by one closed area, and when both positions are less than 2 LM, the other closed position of the two closed areas is closed. The part close to the area will swell. If the data-related positions are brought closer, the two closed areas are integrated, and two data-related positions are surrounded by one closed area.
- FIG. 3 is a diagram showing an example of an image (spatial image) showing the virtual space 10 displayed on the display device constituting the information processing apparatus according to the present embodiment.
- the spatial image shown in FIG. 1 is a visualization of the virtual space 10 shown in FIG. 1.A data-related position 12a and a closed area 14a surrounding the data-related position 12a, a data-related position 12b, and a closed area surrounding it. 14 includes a region image 18b corresponding to 14b, a data-related position 12c, and a region image 18c corresponding to the closed region 14c surrounding it.
- This spatial image is obtained by setting the viewpoint and the line-of-sight direction in the virtual space 10 and imaging the state of the line-of-sight viewed from the viewpoint.
- the corresponding data related position 12 is associated with the area image 18.
- An image relating to the recorded data is included.
- a thumbnail image related to data may be represented in the area image 18, or a character string of a data name (file name) may be represented in the area image 18.
- the spatial image also includes a cursor image 16.
- the cursor image 16 is a spatial image in accordance with an operation on an input device including a pointing device such as a mouse and a coordinate input unit such as a touch pad that constitutes the information processing device. It is designed to move inside. By placing the cursor image 16 in one of the area images 18 with the input device and moving the cursor image 16 while holding down the predetermined button on the input device (by performing a so-called drag-and-drop operation). ), And can move the region image 18 in the spatial image. Along with this, the data-related position corresponding to the region image 18 moves in the virtual space 10.
- the information processing apparatus may be provided with a camera (imaging means), and the area image 18 may be moved in the spatial image according to the movement of the user imaged by the camera.
- FIG. 4 is a diagram showing the virtual space 10 after the operation for bringing the data related position 12b closer to the data related position 12a is performed. As shown in the figure, when the data related position 12b is brought closer to the data related position 12a, the closed area 14b corresponding to the data related position 12b is integrated with the closed area 14a corresponding to the data related position 12a. A closed area 14ab that surrounds both the position 12a and the data-related position 12b appears in the virtual space 10.
- FIG. 5 shows a spatial image obtained by visualizing the virtual space 10 in the state shown in FIG.
- this spatial image includes a region image 18ab showing a closed region 14ab formed by integrating the closed region 14a and the closed region 14b.
- This area image 18ab includes thumbnail images associated with the data associated with the data-related positions 12a and 12b surrounded by the corresponding closed area 14ab.
- FIG. 6 shows the distribution of the sum of the function values on the line 15 passing through the data-related positions 12a to 12c shown in FIG.
- the sum of the function values corresponding to the data related positions 12a and 12b exceeds the surface indication value d at the position between them.
- an integrated closed region 14ab is generated.
- the cursor image 16 is moved to the spatial image by the input device, and the data-related position is moved in the virtual space 10 according to the movement. Can be made.
- the closed area surrounding each data-related position is deformed, and then the two closed areas are integrated.
- the data associated with each of the plurality of data related positions surrounded by the integrated closed region is a processing target of the program, they are grouped.
- the region image related to the integrated closed region includes a thumbnail image related to the processing target data associated with the data-related position surrounded by the closed region.
- the program data and the data to be processed by the program are included in the data associated with each of the plurality of data related positions surrounded by the integrated closed region. Is included, the processing of the data to be processed by the program is executed. That is, when the user performs an operation to bring the closed area related to the program close to the closed area related to the processing target data, both are deformed and then integrated. Then, by integrating the closed areas in this way, it is possible to instruct the processing of the processing target data by the program.
- the interval between the data-related position associated with the program and the data-related position associated with the processing target data immediately after the processing of the processing target data by the program is started or after waiting for the processing to end Is forcibly expanded, and the integrated closure
- the area is divided into a closed area related to the program and a closed area related to the processing target data.
- a physical simulation may be used to reproduce how both data-related positions are separated by a repulsive force that is inversely proportional to the distance between them or a power value thereof. .
- the closed regions of the program or the closed region of the processing target data when at least one of the closed region of the program or the closed region of the processing target data is moved in this manner and the closed regions are brought close to each other, the closed regions are deformed. Therefore, it is possible to make the user recognize in advance that the processing target data is processed by the program according to the operation by the user.
- both closed regions may remain integrated after the processing of the program.
- the texture indicating the processing history of the program may be attached to the closed area.
- the texture indicating the processing history includes, for example, an image showing that an amount of liquid corresponding to the number of processed processing target data has accumulated in the closed region, an image formed by combining thumbnail images of the processing target data, and the like. Available.
- the user can arbitrarily change the above-described surface indication value.
- the position of the surface of each closed region 14 is determined by the surface indication value.
- the surface indication value can be arbitrarily changed by the user using the input device so that the position of the surface of each closed region 14 can be changed. That is, as shown in FIG. 7A, for example, when a region image 18ab showing a closed region surrounding two data-related positions is displayed on the display device, the region image 18ab is indicated by the cursor image 16.
- the surface indication value is changed to a large value. Then, as shown in FIG.
- the area image 18ab is separated into two area images 18a and 18b. That is, as shown in FIG. 6, by changing the surface indication value d to a larger surface indication value d ′, the region having the sum of the function values exceeding the surface indication value d ′ is narrowed.
- Image 18ab is separated into region images 18a and 18b.
- a spatial image that is enlarged and displayed around the position in the virtual space 10 designated by the cursor image 16 is displayed on the display device.
- the area image 18ab is separated into two area images 18a and 18b, the grouping of the data related to the area image 18a and the data related to the area image 18b is canceled accordingly. You can do it.
- the user can change the surface indication value in this way, the user can immediately know how many pieces of data the area image relates to, and convenience is improved. If an operation to change the surface indication value to a small value (for example, an operation to change the surface indication value d ′ in FIG. 6 to the surface indication value d), the surface indication value is changed to a small value.
- the region images 18a and 18b are integrated again and changed to the region image 18ab.
- the degree of association between data is calculated based on the attribute of each data (for example, the type of data), and the data-related position of the data is approximated in the virtual space 10 according to the degree of association. Alternatively, they are separated.
- the data-related positions of data whose relevance is greater than or equal to a predetermined threshold are located within a predetermined distance in the virtual space 10
- these data-related positions can be moved and approached.
- the data related positions of the data whose relevance is less than the predetermined threshold are located within a predetermined distance in the virtual space 10
- FIG. 8 is a diagram illustrating a hardware configuration of the information processing apparatus according to the present embodiment.
- the information processing apparatus includes a display device 20, a computer 22, and an input device 24.
- the display device 20 is configured by a CRT, an LCD, or the like.
- the computer is mainly composed of a processor and a memory, and is realized by using, for example, a personal computer, a home game machine, a home server, or the like.
- the input device 24 includes a pointing device such as a mouse, a keyboard, and a remote controller.
- FIG. 9 is a functional block diagram of the information processing apparatus according to the present embodiment.
- the computer 22 of the information processing apparatus functionally includes a spatial image generation unit 32, a surface indication value change unit 34, a data-related position update unit 38, a data information database 40, a group linkage unit 42.
- the data-related location / separation unit 44, the group management unit 46, the program execution unit 47, and the group database 48 are included. These functions are realized by the computer 22 executing the program according to the present embodiment.
- the data information database 40 is provided in a storage device such as a hard disk provided in the computer 22, and as shown in FIG. 10, data ID, path, data related position, thumbnail data, Attribute 1 and attribute 2 are stored in association with each other.
- the data ID is identification information of data stored in the computer 22 or another computer (not shown) connected to the computer 22 in communication.
- the path is data that specifies the location of the data identified by the data ID.
- the data related position is a position coordinate in the virtual space 10 associated with the data identified by the data ID.
- the thumbnail data is data that specifies the location of the thumbnail image related to the data identified by the data ID.
- Attribute 1 is data indicating the attribute of the data identified by the data ID, and here is one or a plurality of keywords related to the data.
- Attribute 2 is data that specifies a program for processing the processing target data if the data identified by the data ID is processing target data. Further, if the data identified by the data ID is program data, it is data (for example, file extension of data) that specifies the type of data to be processed by the program.
- the gnole database 48 is also provided in a storage device provided in the computer 22, and stores a gnole ID and a data ID in association with each other as shown in FIG.
- a group is formed by a plurality of data, and the group ID is data for identifying the group of the data.
- the data ID is the data ID of each data belonging to the gnole identified by the gnole ID.
- the data-related position update unit 38 selects a data-related position to be operated according to the position of the cursor image 16 operated by the input device 24, and sets the data-related position according to the movement of the cursor image 16. Moving within the virtual space 10. For example, when the tip of the cursor image 16 is located in any one of the area images 18, among the positions in the spatial image corresponding to the data-related positions in the area image 18, the tip of the cursor image 16 Select the closest object to move. Then, the moving direction and the moving amount of the cursor image 16 at the time of drag and drop are acquired, and the moving object is set as the moving object according to them. To move the data-related position selected.
- the data related position update unit 38 updates the data related position selected as the movement target already stored in the data information database 40 to the one after the movement.
- the data-related position update unit 38 moves any data-related position
- the data-related position, moving direction, and amount of data associated with the data-related position are transferred to the group linkage unit 42.
- the cursor image 16 operated by the input device 24 is located in any of the area images 18, all the positions in the spatial image corresponding to the data related positions in the area image 18 are to be moved. You can choose as les. In this case, the movement direction and movement amount of the cursor image 16 at the time of drag and drop are acquired, and the data related position selected as the movement target is moved according to them, and the region image 18 itself is not moved accordingly. 'Yeah.
- the group link unit 42 refers to the group database 48 and links the data-related positions of other data belonging to the same gnope when the data-related positions of data belonging to any group move. Is. That is, when any of the data-related positions is updated, the data ID, the movement direction, and the movement amount notified from the data-related position update unit 38 are acquired. Then, it is checked whether the acquired data ID is already stored in the gnolepe database 48. If it is stored, the other data ID stored in association with the same group ID is read out. Then, the data related position related to the read data ID is read from the data information database 40, and the value is updated according to the moving direction and moving amount notified from the data related position updating unit 38.
- the data related position approach / separation unit 44 reads the data of each attribute 1 stored in the data information database 40, calculates the degree of association between the data, and according to the degree of association, the data related position of the data information database 40 Update the data. For example, when calculating the relevance of two pieces of data, the attribute 1 data related to the data is read from the data information database 40, and the data is calculated based on the number of common keywords included in the data. What is necessary is just to calculate the relevance degree. Furthermore, the data-related positions of those data are read from the data information database 40, and both are read according to the degree of association. Move them closer together or away from each other.
- the distance d is an increase function of the relevance s, for example, the constraint distance lc determined by kl X s is less than or equal to lc.
- kd X s is preferable (kl and kd are constants).
- kl and kd are constants.
- the higher the relevance s is, the closer the data related position P and the data related position P are, the closer to and away from each other.
- the higher the relevance s the stronger (faster) the data-related position P and the data-related position P approach or move away from each other.
- the higher the relevance s the greater the restraint distance k, and the farther data related positions P and P are spring restrained.
- the data-related position associated with the program and the data-related position associated with the processing target data are forcibly set. And release the integration of the closed region.
- the spatial image generation unit 32 generates an image showing the virtual space 10 based on the information stored in the data information database 40, that is, a spatial image, and causes the display unit 20 to display it. Specifically, some or all of the data-related positions are read from the data information database 40 according to the viewpoint position and the line-of-sight direction set in the virtual space 10. Then, the position of the surface of the closed region 14 in the virtual space 10 is determined according to the data-related position and the function of the metaball. In other words, the position where the value obtained by adding the values of the function of the metaball associated with each data-related position becomes the given surface indication value is the position of the surface of the closed region surrounding one or more of these data-related positions. To be determined.
- the thumbnail data associated with the data-related position surrounded by each closed region 14 whose surface position is determined in this way is read out from the data information database 40, and the thumbnail image specified by the thumbnail data is read out from each closed image. Place on the surface of area 14.
- an image of the virtual space 10 in which the thumbnail image is arranged on the surface of each closed region 14 is generated according to the viewpoint position and the line-of-sight direction, and is displayed on the display device. Display with position 20.
- the gnolepe management unit 46 When determining the position of the surface of each closed region as described above, the gnolepe management unit 46 newly determines whether the surface of any closed region has been integrated with another closed region. Judgment is made on whether or not conversion is released.
- all of the data-related positions surrounded by a certain closed area and all the data-related positions surrounded by another closed area are arranged in the virtual space 10 at each position on a line connecting them.
- the sum of the metaball function values associated with the data-related positions is calculated. If the position where the value is less than the surface indication value does not exist on the line, it is determined that the both closed regions are newly integrated. In addition, if there is at least one position on the line where the sum of the metaball function values is less than the surface indication value, the two closed areas related to the two selected data-related positions are still integrated. Judge that it is not.
- the group management unit 46 is associated with all the data related positions arranged in the virtual space 10 at each position on the line connecting one of the data related positions surrounded by a certain closed area and the other. Calculate the sum of the metaball function values. If there is no position on the line whose value is less than the surface indication value, these data-related positions are still surrounded by a common closed area (unification is maintained). to decide. Also, if there is at least one position on the line where the sum of the function values of the metaball is less than the surface indication value, the integration is canceled and the one data-related position is surrounded by another closed region. Judge that
- a fixed-size casting box (configured by polygons) is arranged for each data-related position so as to surround the data-related position, and the bounding boxes interfere with each other.
- the above-mentioned detailed integration determination may be performed only when the casting boxes interfere with each other. Alternatively, it may be more easily determined whether the closed areas are integrated and whether the integration is released or not, depending on whether the casting boxes interfere with each other.
- the distance between the data-related positions is less than a predetermined distance, and the above-described detailed integration determination is performed only when the distance is less than the predetermined distance. You may do it. Or, more simply, the distance between data-related positions is less than a predetermined distance. Whether or not each closed region has been integrated or whether the integration has been released may be determined based on whether or not the integration is complete.
- the gnole management unit 46 associates the data IDs of the data associated with the data-related positions surrounded by the integrated closed areas with the common group ID. Stored in the group database 48.
- the group database 48 stores the data IDs of the data associated with the data-related positions surrounded by the separated closed regions.
- the data IDs of the data associated with the data-related positions surrounded by the separated closed regions are stored in the gnole database 48 in association with different gnole IDs. If one or both of the separated closed areas enclose only one data-related position, the data ID of the data associated with the data-related position is deleted from the group database 48.
- the processing data is immediately processed by the program. To do. If the number is plural, the menu screen is displayed and a part or all of the instructed is instructed by the user, and then the instructed part or all is processed. Alternatively, all or a part selected according to a predetermined criterion may be sequentially processed.
- the program execution unit 47 After processing the processing target data by the program, the program execution unit 47 causes the data related position approach / separation unit 44 to separate the data related position related to the program and the data related position related to the processing target data. Instruct.
- the surface indication value changing unit 34 changes the surface indication value described above in response to an operation on the input device 24. Thereby, the size of each closed region 12 is increased or decreased.
- a plurality of data can be easily gnolled simply by moving the data-related position 12 in the virtual space 10 using the input device 24 such as a mouse. Convenience is improved.
- the information processing apparatus described above can be variously modified, and for example, other images may be included in the spatial image.
- the view image 17 is included in the spatial image and the region image 18 is dragged and dropped at the position of the view image 17, an image related to the region image is displayed inside the view image 17.
- an image related to the region image is displayed inside the view image 17.
- the thumbnail images of the two pieces of data related to the region image 18ab may be displayed separately on the view frame image 17. In this way, data information related to the region image 18 can be output by an intuitive operation.
- the closed region related to the program and the closed region related to one or more processing target data are integrated, a part or all of the processing target data is promptly executed by the program.
- the power to start the process The process may be performed after an explicit instruction from the user.
- a data ID for identifying the program or processing target data associated with the data-related position surrounded by the integrated closed region is once registered in the gnole database 48, and later, the integrated closed region is registered.
- the processing target data should be processed by the program as described above.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
明 細 書 Specification
情報処理装置、ユーザインタフェース方法及び情報記憶媒体 Information processing apparatus, user interface method, and information storage medium
技術分野 Technical field
[0001] 本発明は情報処理装置、ユーザインタフェース方法及び情報記憶媒体に関し、特 にプログラムによるデータの処理を実行する際に用いるユーザインタフェースに関す る。 The present invention relates to an information processing apparatus, a user interface method, and an information storage medium, and particularly to a user interface used when executing data processing by a program.
背景技術 Background art
[0002] グラフィックユーザインターフェース(GUI)により、各種情報処理装置の使い勝手 は飛躍的に向上した。一般的な GUIでは、プログラムのデータを示すアイコンがモニ タに表示されるとともに、その処理対象のデータ(処理対象データ)を示すアイコンも モニタに表示される。そして、処理対象データのアイコンの表示位置を、いわゆるドラ ッグアンドドロップ操作によって、プログラムのアイコンの表示位置に重ね合わせるこ とで、任意の処理対象データを任意のプログラムにより処理することができる。このと き、処理対象データのアイコン位置がプログラムのアイコンの表示位置に重なると、プ ログラムのアイコンの色調を変更するなどして、両アイコンが重なったことがユーザに 分かるようにしている。 [0002] Usability of various information processing devices has been dramatically improved by a graphic user interface (GUI). In a general GUI, an icon indicating program data is displayed on the monitor, and an icon indicating the data to be processed (processing target data) is also displayed on the monitor. Then, by superimposing the display position of the icon of the processing target data on the display position of the icon of the program by a so-called drag and drop operation, arbitrary processing target data can be processed by the arbitrary program. At this time, if the icon position of the data to be processed overlaps the display position of the program icon, the color of the program icon is changed so that the user can know that both icons overlap.
発明の開示 Disclosure of the invention
発明が解決しょうとする課題 Problems to be solved by the invention
[0003] しかしながら、従来の GUIでは、 2つのアイコンが重なるまでは、いずれのアイコン の表示にも変化が現れなかったため、プログラムにより処理対象データが処理されう ることをユーザに認識させることができないという問題があった。 [0003] However, in the conventional GUI, until the two icons overlap, there is no change in the display of either icon, so the user cannot recognize that the processing target data can be processed by the program. There was a problem.
[0004] 本発明は上記課題に鑑みてなされたものであって、その目的は、ユーザによる操作 に従ってプログラムにより処理対象データが処理されうることをユーザに事前に認識 させることができる情報処理装置、ユーザインタフェース方法及び情報記憶媒体を提 供することにある。 [0004] The present invention has been made in view of the above problems, and an object of the present invention is to make it possible for the user to recognize in advance that data to be processed can be processed by a program according to an operation by the user, It is to provide a user interface method and an information storage medium.
課題を解決するための手段 Means for solving the problem
[0005] 上記課題を解決するために、本発明に係る情報処理装置は、プログラムのデータ に関連するデータ関連位置及び前記プログラムの処理対象である処理対象データ に関連するデータ関連位置を含む複数のデータ関連位置が設定されるとともに、各 データ関連位置が単独で又は他のデータ関連位置とともに閉領域で囲まれた空間 の画像を、各閉領域が識別可能なよう表示する表示手段と、前記空間において各デ ータ関連位置をユーザが任意に移動させる操作を行うための操作手段と、各データ 関連位置の前記空間における移動に応じて、前記空間中の各閉領域を更新する閉 領域更新手段と、前記プログラムのデータに関連するデータ関連位置と前記処理対 象データに関連するデータ関連位置が共通の閉領域に囲まれる場合に、所与のタイ ミングにて、前記プログラムにより前記処理対象データを処理するプログラム実行手 段と、を含み、前記閉領域更新手段は、各データ関連位置までの距離の減少関数の 値の総和が所定の閾値以上となる位置の集合である前記空間中の領域を、前記閉 領域として設定する、ことを特徴とする。 In order to solve the above problems, an information processing apparatus according to the present invention provides a program data A plurality of data related positions including a data related position related to the data and a data related position related to the processing target data to be processed by the program are set, and each data related position is singly or together with other data related positions. Display means for displaying an image of a space surrounded by the closed area so that each closed area can be identified, operation means for performing an operation for the user to arbitrarily move each data-related position in the space, and Closed area updating means for updating each closed area in the space according to movement of each data related position in the space, data related position related to the data of the program, and data related to the processing target data Execution of a program that processes the data to be processed by the program at a given timing when the position is surrounded by a common closed region The closed region updating means includes, as the closed region, a region in the space that is a set of positions where the sum of the values of the decreasing function of the distance to each data related position is equal to or greater than a predetermined threshold. It is characterized by setting.
[0006] また、本発明に係るユーザインタフェース方法は、プログラムのデータに関連するデ ータ関連位置及び前記プログラムの処理対象である処理対象データに関連するデ ータ関連位置を含む複数のデータ関連位置が設定されるとともに、各データ関連位 置が単独で又は他のデータ関連位置とともに閉領域で囲まれた空間の画像を、各閉 領域が識別可能なよう表示する空間画像表示ステップと、前記空間において各デー タ関連位置をユーザが任意に移動させる操作を受け付ける移動操作受付ステップと 、各データ関連位置の前記空間における移動に応じて、前記空間中の各閉領域を 更新する閉領域更新ステップと、前記プログラムのデータに関連するデータ関連位 置と前記処理対象データに関連するデータ関連位置が共通の閉領域に囲まれる場 合に、所与のタイミングにて、前記プログラムにより前記処理対象データを処理する プログラム実行ステップと、を含み、前記閉領域更新ステップは、各データ関連位置 までの距離の減少関数の値の総和が所定の閾値以上となる位置の集合である前記 空間中の領域を、前記閉領域として設定する。 [0006] Further, the user interface method according to the present invention includes a plurality of data related positions including a data related position related to program data and a data related position related to processing target data which is a processing target of the program. A spatial image display step for displaying an image of a space surrounded by a closed area with each data-related position alone or together with another data-related position so that each closed area can be identified; A move operation accepting step for accepting an operation for the user to arbitrarily move each data related position in the space, and a closed region updating step for updating each closed region in the space according to the movement of each data related position in the space And a data related position related to the program data and a data related position related to the processing target data are surrounded by a common closed area. A program execution step of processing the data to be processed by the program at a given timing, and the closed region update step includes a value of a decreasing function value of a distance to each data related position. An area in the space, which is a set of positions where the sum is equal to or greater than a predetermined threshold, is set as the closed area.
[0007] また、本発明に係る情報記憶媒体は、プログラムのデータに関連するデータ関連位 置及び前記プログラムの処理対象である処理対象データに関連するデータ関連位 置を含む複数のデータ関連位置が設定されるとともに、各データ関連位置が単独で 又は他のデータ関連位置とともに閉領域で囲まれた空間の画像を、各閉領域が識別 可能なよう表示する表示手段、前記空間において各データ関連位置をユーザが任 意に移動させる操作を行うための操作手段、各データ関連位置の前記空間における 移動に応じて、前記空間中の各閉領域を更新する閉領域更新手段、及び前記プロ グラムのデータに関連するデータ関連位置と前記処理対象データに関連するデータ 関連位置が共通の閉領域に囲まれる場合に、所与のタイミングにて、前記プログラム により前記処理対象データを処理するプログラム実行手段としてコンピュータを機能 させるためのプログラムを記憶したコンピュータ読み取り可能な情報記憶媒体であつ て、前記閉領域更新手段は、各データ関連位置までの距離の減少関数の値の総和 が所定の閾値以上となる位置の集合である前記空間中の領域を、前記閉領域として 設定する、ことを特徴とする。コンピュータは、例えばパーソナルコンピュータ、家庭用 ゲーム機、業務用ゲーム機、携帯ゲーム機、携帯電話機、携帯情報端末等である。 また、プログラムは、 CD— ROMや DVD— ROM等のコンピュータ読み取り可能な情 報記憶媒体に格納されてよレ、。 [0007] Further, the information storage medium according to the present invention has a plurality of data related positions including a data related position related to program data and a data related position related to processing target data which is a processing target of the program. And each data related position is set independently. Or a display means for displaying an image of a space surrounded by a closed area together with other data-related positions so that each closed area can be identified, and for performing an operation of arbitrarily moving each data-related position in the space. Operating means, closed area updating means for updating each closed area in the space in accordance with the movement of each data related position in the space, and the data related position related to the program data and the processing target data Related data A computer-readable program that stores a program for causing a computer to function as program execution means for processing the data to be processed by the program at a given timing when related positions are surrounded by a common closed area. The closed region updating means is a value of a decreasing function of the distance to each data related position. The area in total is set at a position equal to or greater than a predetermined threshold value the space is set as the closed region, and wherein the. The computer is, for example, a personal computer, a home game machine, an arcade game machine, a portable game machine, a mobile phone, or a portable information terminal. The program can be stored on a computer-readable information storage medium such as a CD-ROM or DVD-ROM.
[0008] 本発明によると、各データ関連位置までの距離の減少関数の値の総和が所定の閾 値以上となる位置の集合である前記空間中の領域である閉領域が識別表示される。 このため、ユーザによる操作に従って、プログラムのデータに関連するデータ関連位 置を囲む閉領域と、処理対象データに関連するデータ関連位置を囲む閉領域と、が 近づくと、両閉領域が一体化する以前においても、両閉領域は変形する。このため、 プログラムにより処理対象データが処理されうることをユーザに事前に認識させること ができる。そして、両閉領域が一体化して、プログラムのデータに関連するデータ関 連位置と処理対象データに関連するデータ関連位置とが共通の閉領域に囲まれるこ ととなると、所与のタイミングでプログラムにより処理対象データが処理される。 [0008] According to the present invention, a closed region, which is a region in the space, which is a set of positions at which the sum of the values of the decreasing function of the distance to each data related position is equal to or greater than a predetermined threshold value is identified and displayed. For this reason, when the closed area surrounding the data-related position related to the program data and the closed area surrounding the data-related position related to the processing target data approach each other according to the operation by the user, the both closed areas are integrated. Even before, both closed regions are deformed. Therefore, the user can recognize in advance that the processing target data can be processed by the program. When both closed areas are integrated and the data-related position related to the program data and the data-related position related to the processing target data are surrounded by the common closed area, the program is given at a given timing. The processing target data is processed.
[0009] なお、「所与のタイミング」は、両閉領域が一体化したタイミングであってもよいし、両 閉領域が一体化した後、ユーザがプログラムによる処理対象データの処理を指示し たタイミングであってもよい。また、「空間」は、 3次元空間であってよいし、 2次元空間 、すなわち平面であってもよい。 [0009] It should be noted that the "given timing" may be a timing at which both closed areas are integrated, or after the both closed areas are integrated, the user instructs processing of processing target data by a program. It may be timing. The “space” may be a three-dimensional space or a two-dimensional space, that is, a plane.
[0010] また、本発明の一態様では、複数のデータ関連位置が共通の閉領域に囲まれる場 合に、それらデータ関連位置に関連するデータをグループィ匕するグループィ匕手段を さらに含む。こうすれば、空間におけるデータ関連位置を移動させるだけで、簡単に 複数のデータをグループィ匕することができる。 [0010] Further, according to one embodiment of the present invention, a case where a plurality of data-related positions are surrounded by a common closed region. In addition, grouping means for grouping data related to the data related positions is further included. In this way, a plurality of data can be easily grouped simply by moving the data-related position in the space.
[0011] なお、前記グループ化手段は、前記操作手段により行われる操作に応じて、前記 共通の閉領域に囲まれるデータ関連位置を前記空間において連動させるようにして もよレ、。こうすれば、グループ化されたデータに関連するデータ関連位置を一纏めに して空間を移動させることができるようになる。 [0011] Note that the grouping means may link data-related positions surrounded by the common closed region in the space in accordance with an operation performed by the operation means. In this way, it is possible to move the space by collecting data related positions related to the grouped data.
[0012] また、前記所与の閾値を変更する閾値変更手段をさらに含むようにしてもよい。こう すれば、前記所与の閾値を変更することで、隣接するデータ関連位置が共通の閉領 域に囲まれたり、或いは別々の閉領域に囲まれたりするようになる。 [0012] Further, threshold value changing means for changing the given threshold value may be further included. In this way, by changing the given threshold value, adjacent data-related positions are surrounded by a common closed area, or are surrounded by separate closed areas.
[0013] また、各データの属性情報に基づいてデータ間の関連度を算出するとともに、該関 連度に応じて、それらデータに関連するデータ関連位置を前記空間において接近さ せ又は離間させるデータ関連位置接離手段と、をさらに含んでよい。こうすれば、デ ータ間の関連度に応じてグノレープ化を促進したり、或いはグループ化を抑制したりで きるようになり、ユーザの利便性が向上する。 [0013] Further, the degree of association between the data is calculated based on the attribute information of each data, and the data-related position related to the data is approached or separated in the space according to the degree of association. And associated position separation / separation means. In this way, it becomes possible to promote gnorape or to suppress grouping according to the degree of association between data, thereby improving user convenience.
[0014] また、前記操作手段は、前記画像により識別表示される前記各閉領域を前記ユー ザが任意に移動させる手段であってよい。そして、前記各閉領域が移動する場合に は、該閉領域により囲まれる 1又は複数のデータ関連位置を移動させてよい。こうす れば、操作手段を用いて、任意の閉領域を移動させることにより、それにより囲まれる データ関連位置を移動させることができる。 [0014] Further, the operation means may be means for allowing the user to arbitrarily move the closed areas identified and displayed by the image. When each closed area moves, one or a plurality of data-related positions surrounded by the closed area may be moved. By doing this, it is possible to move the data-related position surrounded by moving any closed region using the operating means.
図面の簡単な説明 Brief Description of Drawings
[0015] [図 1]本発明の実施形態に係る情報処理装置において管理される仮想空間(閉領域 の移動前)を示す図である。 FIG. 1 is a diagram showing a virtual space (before moving a closed region) managed in the information processing apparatus according to the embodiment of the present invention.
[図 2]メタボールの関数の一例を示す図である。 FIG. 2 is a diagram showing an example of a metaball function.
[図 3]表示装置に表示される空間画像を示す図である。 FIG. 3 is a diagram showing a spatial image displayed on the display device.
[図 4]本発明の実施形態に係る情報処理装置において管理される仮想空間(閉領域 の移動後)を示す図である。 FIG. 4 is a diagram showing a virtual space (after movement of a closed region) managed in the information processing apparatus according to the embodiment of the present invention.
[図 5]表示装置に表示される空間画像を示す図である。 [図 6]仮想空間内の関数値の和の分布を示す図である。 FIG. 5 is a diagram showing a spatial image displayed on the display device. FIG. 6 is a diagram showing the distribution of the sum of function values in the virtual space.
[図 7]空間拡大表示時の空間画像を示す図である。 FIG. 7 is a diagram showing a spatial image at the time of spatial enlarged display.
[図 8]情報処理装置のハードウェア構成図である。 FIG. 8 is a hardware configuration diagram of the information processing apparatus.
[図 9]情報処理装置の機能ブロック図である。 FIG. 9 is a functional block diagram of the information processing apparatus.
[図 10]データ情報データベースの構成図である。 FIG. 10 is a configuration diagram of a data information database.
[図 11]グループデータベースの構成図である。 FIG. 11 is a configuration diagram of a group database.
[図 12]空間画像の他の例を示す図である。 FIG. 12 is a diagram showing another example of a spatial image.
発明を実施するための最良の形態 BEST MODE FOR CARRYING OUT THE INVENTION
[0016] 以下、本発明の一実施形態について図面に基づき詳細に説明する。 Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
[0017] 本実施形態に係る情報処理装置はコンピュータを含んで構成され、該コンピュータ の記憶装置上に仮想空間が構築される。そして、コンピュータに記憶され、或いは該 コンピュータとネットワークを介して接続された他のコンピュータに記憶された各種の データのデータ関連位置が該仮想空間に設定されている。データは、例えば静止画 像、動画像、音楽等のデータ(処理対象データ)や、それらのデータを再生したり編 集したりして処理するプログラムのデータである。そして、この仮想空間を示す画像( 空間画像)が同情報処理装置を構成する表示装置に表示されるようになっている。こ の空間画像は、データのグループ化並びにその解除をユーザが指示するためのダラ フィックユーザインターフェースを構成する。また、各種処理対象データのプログラム による処理をユーザが指示するためのグラフィックユーザインタフェースを構成する。 The information processing apparatus according to the present embodiment includes a computer, and a virtual space is constructed on a storage device of the computer. Data-related positions of various data stored in the computer or stored in another computer connected to the computer via a network are set in the virtual space. The data is, for example, data (processing target data) such as still images, moving images, music, etc., and data of programs for processing such data by playing back or editing the data. An image showing this virtual space (spatial image) is displayed on a display device constituting the information processing apparatus. This spatial image constitutes a graphical user interface for the user to instruct the grouping and release of data. It also configures a graphic user interface for the user to instruct the processing of various processing target data by the program.
[0018] 図 1は、かかる仮想空間の一例を示す図である。同図に示すように、コンピュータの 記憶装置上には 3次元の仮想空間 10が構築されており、この仮想空間 10にそれぞ れ電子データに関連づけられたデータ関連位置 12a〜12cが設定されている。同図 では、仮想空間 10の各データ関連位置 12a〜: 12cは、 3次元の閉領域 14a〜14cに より、それぞれ囲まれている。 FIG. 1 is a diagram showing an example of such a virtual space. As shown in the figure, a three-dimensional virtual space 10 is constructed on a computer storage device, and data-related positions 12a to 12c associated with electronic data are set in the virtual space 10, respectively. Yes. In the figure, the data related positions 12a to 12c in the virtual space 10 are respectively surrounded by three-dimensional closed regions 14a to 14c.
[0019] これらの閉領域 14a〜14cは、いわゆるメタボールとよばれるコンピュータグラフイツ タスの手法により、後述する領域画像として表示装置に表示されるものである。すな わち、各データ関連位置 14a〜14cには、メタボールの関数が関連づけられており、 それらの関数の値 (メタボールの濃度値)を加算した値が所与の閾値 (表面指示値) 以上となる仮想空間 10における位置の集合、すなわち領域が閉領域 (メタボールの 占める領域) 14a〜14cとして決定される。図 2は、メタボールの関数の例を示してお り、同図において実線で示されるように、メタボールの関数は、各データ関連位置か らの距離に関する減少関数であって、所定距離 LM以上は零の値を有している。例 えば仮想空間 10に 1つのデータ関連位置が配置されてレ、る場合や、複数のデータ 関連位置が互いに距離 2LM以上離れて配置されている場合には、各データ関連位 置に関連づけられたメタボールの関数の値が所与の表面指示値となる位置、すなわ ち各データ関連位置から距離 L0の位置に該データ関連位置を囲む閉領域の表面 が設けられることになる。換言すれば、各データ関連位置を中心とする半径 L0の球 面が該データ関連位置を囲む閉領域の表面となる。また、例えば仮想空間 10に 2つ のデータ関連位置が距離 2LM未満に設定されている場合、これらのデータ関連位 置に関連づけられたメタボールの関数の値を足し合わせた値が所与の表面指示値と なる位置に、 1又は 2の閉領域の表面が設けられる。すなわち、 1の閉領域の表面が 設けられる場合、該閉領域は 2つのデータ関連位置を囲む。また、 2つの閉領域の表 面が設けられる場合、それらはそれぞれのデータ関連位置を囲む。そして、一方の 閉領域により囲まれたデータ関連位置に対して、他方の閉領域により囲まれた別の データ関連位置が接近し、両位置が距離 2LM未満となると、両閉領域の他方の閉 領域に近い部分が膨らむことになる。そして、そのままデータ関連位置を近づけると、 両閉領域は一体化し、 1つの閉領域により 2つのデータ関連位置が囲まれることとな る。 These closed regions 14a to 14c are displayed on the display device as region images to be described later by a so-called computer graph status method called a metaball. In other words, each data-related position 14a to 14c is associated with a metaball function, and a value obtained by adding the values of these functions (metaball density value) is a given threshold value (surface indication value). The set of positions in the virtual space 10 as described above, that is, the regions are determined as closed regions (regions occupied by the metaballs) 14a to 14c. Fig. 2 shows an example of the metaball function. As indicated by the solid line in the figure, the metaball function is a decreasing function with respect to the distance from each data-related position, and is greater than a predetermined distance LM. It has a value of zero. For example, if one data-related position is placed in the virtual space 10, or if multiple data-related positions are located at a distance of 2 LM or more from each other, the data-related positions are associated with each other. The surface of the closed region surrounding the data-related position is provided at a position where the value of the function of the metaball becomes a given surface indication value, that is, at a distance L0 from each data-related position. In other words, a spherical surface having a radius L0 centered on each data-related position is the surface of the closed region surrounding the data-related position. For example, when two data-related positions are set to a distance of less than 2LM in the virtual space 10, the value obtained by adding the values of the metaball functions related to these data-related positions is the given surface indication. The surface of the closed region of 1 or 2 is provided at the position where the value is obtained. That is, if one closed region surface is provided, the closed region surrounds two data-related locations. Also, if two closed area surfaces are provided, they surround each data-related location. Then, when another data related position surrounded by the other closed area approaches the data related position surrounded by one closed area, and when both positions are less than 2 LM, the other closed position of the two closed areas is closed. The part close to the area will swell. If the data-related positions are brought closer, the two closed areas are integrated, and two data-related positions are surrounded by one closed area.
図 3は、本実施形態に係る情報処理装置を構成する表示装置に表示される、仮想 空間 10を示す画像(空間画像)の一例を示す図である。同図に示す空間画像は、図 1に示す仮想空間 10を可視化したものであり、データ関連位置 12a及びそれを囲む 閉領域 14aに対応する領域画像 18a、データ関連位置 12b及びそれを囲む閉領域 1 4bに対応する領域画像 18b、データ関連位置 12c及びそれを囲む閉領域 14cに対 応する領域画像 18cが含まれている。この空間画像は、仮想空間 10に視点及び視 線方向を設定するとともに、視点から視線方向を見た様子を画像化することにより得 られるものである。また、領域画像 18には、対応するデータ関連位置 12が関連づけ られたデータに関する画像が含まれる。例えば、データに関連するサムネイル画像が 領域画像 18に表されてもよいし、データ名(ファイル名)の文字列が領域画像 18に 表されてもよい。 FIG. 3 is a diagram showing an example of an image (spatial image) showing the virtual space 10 displayed on the display device constituting the information processing apparatus according to the present embodiment. The spatial image shown in FIG. 1 is a visualization of the virtual space 10 shown in FIG. 1.A data-related position 12a and a closed area 14a surrounding the data-related position 12a, a data-related position 12b, and a closed area surrounding it. 14 includes a region image 18b corresponding to 14b, a data-related position 12c, and a region image 18c corresponding to the closed region 14c surrounding it. This spatial image is obtained by setting the viewpoint and the line-of-sight direction in the virtual space 10 and imaging the state of the line-of-sight viewed from the viewpoint. In addition, the corresponding data related position 12 is associated with the area image 18. An image relating to the recorded data is included. For example, a thumbnail image related to data may be represented in the area image 18, or a character string of a data name (file name) may be represented in the area image 18.
[0021] 空間画像にはカーソル画像 16も含まれており、このカーソル画像 16は、情報処理 装置を構成するマウス等のポインティングデバイス、タツチパッド等の座標入力手段 を含む入力装置に対する操作に従って、空間画像内を移動するようになっている。 入力装置によりカーソル画像 16をいずれかの領域画像 18内に位置させ、その状態 で入力装置の所定ボタンを押しながらカーソル画像 16を移動させることで(レ、わゆる ドラッグアンドドロップ操作を行うことで)、その領域画像 18を空間画像において移動 させること力できる。また、これに伴って該領域画像 18に対応するデータ関連位置が 仮想空間 10において移動するようになっている。なお、情報処理装置にカメラ(撮像 手段)を備えるようにして、該カメラにより撮像されるユーザの動きに従って、領域画 像 18を空間画像において移動させるようにしてもよい。 The spatial image also includes a cursor image 16. The cursor image 16 is a spatial image in accordance with an operation on an input device including a pointing device such as a mouse and a coordinate input unit such as a touch pad that constitutes the information processing device. It is designed to move inside. By placing the cursor image 16 in one of the area images 18 with the input device and moving the cursor image 16 while holding down the predetermined button on the input device (by performing a so-called drag-and-drop operation). ), And can move the region image 18 in the spatial image. Along with this, the data-related position corresponding to the region image 18 moves in the virtual space 10. The information processing apparatus may be provided with a camera (imaging means), and the area image 18 may be moved in the spatial image according to the movement of the user imaged by the camera.
[0022] こうした操作による、いずれかのデータ関連位置の移動に応じて、仮想空間 10内の 閉領域 14a〜14cが変形し、場合によりそのうち一部又は全部が一体化することにな る。図 4は、データ関連位置 12bをデータ関連位置 12aに接近させる操作を行った後 の仮想空間 10を示す図である。同図に示すように、データ関連位置 12bをデータ関 連位置 12aに接近させると、データ関連位置 12bに対応する閉領域 14bは、データ 関連位置 12aに対応する閉領域 14aと一体化し、データ関連位置 12a及びデータ関 連位置 12bの双方を囲む閉領域 14abが仮想空間 10に現れる。図 5は、図 4に示さ れる状態の仮想空間 10を可視化してなる空間画像を示している。同図に示すように 、この空間画像は、閉領域 14aと閉領域 14bとを一体化してなる閉領域 14abを示す 領域画像 18abを含んでいる。この領域画像 18abには、対応する閉領域 14abにより 囲まれるデータ関連位置 12a及び 12bに関連づけられたデータのそれぞれに関連 するサムネイル画像等が含まれる。また、図 6は、図 5に示される、データ関連位置 12 a〜 12cを通る線 15上における関数値の総和の分布を示している。同図に示すよう に、データ関連位置 12aとデータ 12bとが接近した結果、両者の間の位置において 各データ関連位置 12a, 12bに対応する関数値の和が表面指示値 dを上回っており 、これにより一体化した閉領域 14abが生成されている。 [0022] The closed regions 14a to 14c in the virtual space 10 are deformed according to the movement of one of the data-related positions by such an operation, and some or all of them are integrated in some cases. FIG. 4 is a diagram showing the virtual space 10 after the operation for bringing the data related position 12b closer to the data related position 12a is performed. As shown in the figure, when the data related position 12b is brought closer to the data related position 12a, the closed area 14b corresponding to the data related position 12b is integrated with the closed area 14a corresponding to the data related position 12a. A closed area 14ab that surrounds both the position 12a and the data-related position 12b appears in the virtual space 10. FIG. 5 shows a spatial image obtained by visualizing the virtual space 10 in the state shown in FIG. As shown in the figure, this spatial image includes a region image 18ab showing a closed region 14ab formed by integrating the closed region 14a and the closed region 14b. This area image 18ab includes thumbnail images associated with the data associated with the data-related positions 12a and 12b surrounded by the corresponding closed area 14ab. FIG. 6 shows the distribution of the sum of the function values on the line 15 passing through the data-related positions 12a to 12c shown in FIG. As shown in the figure, as a result of the proximity of the data related position 12a and the data 12b, the sum of the function values corresponding to the data related positions 12a and 12b exceeds the surface indication value d at the position between them. As a result, an integrated closed region 14ab is generated.
[0023] このように、本実施形態に係る情報処理装置では、入力装置によりカーソル画像 16 を空間画像にぉレ、て移動させ、該移動に従つてデータ関連位置を仮想空間 10にお いて移動させることができる。そして、あるデータのデータ関連位置が別のデータの データ関連位置に近づくと、各データ関連位置を囲む閉領域は変形し、その後、両 閉領域は一体化するようになっている。このとき、一体化した閉領域により囲まれる複 数のデータ関連位置のそれぞれに関連づけられたデータがプログラムの処理対象で あれば、それらはグループ化される。そして、一体化した閉領域に係る領域画像には 、該閉領域により囲まれるデータ関連位置に関連づけられた処理対象データに関す るサムネイル画像等が含まれるようになつている。こうして複数の閉領域 14が一体化 すると、その後、該一体化した閉領域 14に囲まれるデータ関連位置の一部を移動さ せる場合、該閉領域に囲まれる残りのデータ関連位置も仮想空間 10において連動 するようになつている。このように、本実施形態によれば、任意の処理対象データに 関するデータ関連位置を他の処理対象データに関するデータ関連位置に接近させ るだけで、簡単にそれら処理対象データをグノレープ化することができる。また、グノレ ープ化した処理対象データ群に係る領域画像には、それら処理対象データ群に関 するサムネイル画像等が含まれるので、グループィヒした処理対象データ群がどのよう な内容のものであるかをユーザは直感的に把握することができる。 As described above, in the information processing apparatus according to the present embodiment, the cursor image 16 is moved to the spatial image by the input device, and the data-related position is moved in the virtual space 10 according to the movement. Can be made. When the data-related position of one data approaches the data-related position of another data, the closed area surrounding each data-related position is deformed, and then the two closed areas are integrated. At this time, if the data associated with each of the plurality of data related positions surrounded by the integrated closed region is a processing target of the program, they are grouped. The region image related to the integrated closed region includes a thumbnail image related to the processing target data associated with the data-related position surrounded by the closed region. When a plurality of closed areas 14 are integrated in this way, when a part of the data related positions surrounded by the integrated closed areas 14 is moved after that, the remaining data related positions surrounded by the closed areas 14 are also virtual space 10. Are linked to each other. As described above, according to this embodiment, it is possible to easily gnoleize the processing target data simply by bringing the data related position related to arbitrary processing target data close to the data related position related to other processing target data. it can. In addition, since the region images related to the grouped processing target data group include thumbnail images related to the processing target data group, what kind of contents the grouped processing target data group has The user can grasp intuitively.
[0024] さらに、本実施形態では、一体化した閉領域により囲まれる複数のデータ関連位置 のそれぞれに関連づけられたデータに、プログラムのデータ及びそのプログラムの処 理対象であるデータ、すなわち処理対象データが含まれていれば、同プログラムによ る同処理対象データの処理が実行される。すなわち、ユーザが、プログラムに関連す る閉領域と、その処理対象データに関連する閉領域と、を接近させる操作を行うと、 両者は変形し、その後一体化する。そして、そのようにして閉領域を一体化させること により、プログラムによる処理対象データの処理を指示することができる。プログラム による処理対象データの処理が開始されると、直ちに、あるいは処理が終了するのを 待って、プログラムに関連づけられたデータ関連位置と、処理対象データに関連づ けられたデータ関連位置との間隔が強制的に広げられ、これにより一体化していた閉 領域は、プログラムに係る閉領域と、処理対象データに係る閉領域に分離する。デー タ関連位置を強制的に分離するには、例えば両データ関連位置が、それらの間の距 離又はそのべき乗の値に反比例する反発力により引き離される様子を物理シミュレ ーシヨンにより再現してもよい。 [0024] Further, in the present embodiment, the program data and the data to be processed by the program, that is, the data to be processed are included in the data associated with each of the plurality of data related positions surrounded by the integrated closed region. Is included, the processing of the data to be processed by the program is executed. That is, when the user performs an operation to bring the closed area related to the program close to the closed area related to the processing target data, both are deformed and then integrated. Then, by integrating the closed areas in this way, it is possible to instruct the processing of the processing target data by the program. The interval between the data-related position associated with the program and the data-related position associated with the processing target data immediately after the processing of the processing target data by the program is started or after waiting for the processing to end Is forcibly expanded, and the integrated closure The area is divided into a closed area related to the program and a closed area related to the processing target data. In order to forcibly separate the data-related positions, for example, a physical simulation may be used to reproduce how both data-related positions are separated by a repulsive force that is inversely proportional to the distance between them or a power value thereof. .
[0025] 本実施形態では、このようにプログラムの閉領域又は処理対象データの閉領域の 少なくとも一方を移動させ、両閉領域を近づけると、それら閉領域が変形する。このた め、ユーザによる操作に従ってプログラムにより処理対象データが処理されることをュ 一ザに事前に認識させることができる。 In the present embodiment, when at least one of the closed region of the program or the closed region of the processing target data is moved in this manner and the closed regions are brought close to each other, the closed regions are deformed. Therefore, it is possible to make the user recognize in advance that the processing target data is processed by the program according to the operation by the user.
[0026] なお、プログラムの処理後、両閉領域を一体化したままにしておいてもよいのはもち ろんである。この場合には、プログラムの処理履歴を示すテクスチャを一体化したまま の閉領域に貼付してもよレ、。この処理履歴を示すテクスチャとしては、例えば閉領域 内に処理済みの処理対象データの数に応じた量の液体が溜まった様子を示す画像 、処理対象データのサムネイル画像を合成してなる画像等が利用できる。 [0026] It should be noted that both closed regions may remain integrated after the processing of the program. In this case, the texture indicating the processing history of the program may be attached to the closed area. The texture indicating the processing history includes, for example, an image showing that an amount of liquid corresponding to the number of processed processing target data has accumulated in the closed region, an image formed by combining thumbnail images of the processing target data, and the like. Available.
[0027] また、本実施形態では上述した表面指示値をユーザが任意に変更できるようになつ ている。上述のように各閉領域 14の表面の位置は表面指示値によって決まる。本実 施形態では、この表面指示値をユーザが入力装置を用いて任意に変更できるように して、各閉領域 14の表面の位置を変更できるようにしている。すなわち、図 7 (a)に示 すように、例えば 2つのデータ関連位置を囲む閉領域を示す領域画像 18abが表示 装置に表示されている場合に、該領域画像 18abをカーソル画像 16により指示しな がら、表面指示値を大きな値に変更する操作 (例えばマウスのダブルクリック等)を行 うと、表面指示値が大きな値に変更される。そして、同図(b)に示すように、領域画像 18abが 2つの領域画像 18a及び 18bに分離するようになっている。すなわち、図 6に 示すように、表面指示値 dをそれよりも大きな表面指示値 d'に変更することにより、該 表面指示値 d'を上回る関数値の和を有する領域が狭まり、これにより領域画像 18ab が領域画像 18a及び 18bに分離する。このとき、カーソル画像 16により指示された仮 想空間 10における位置を中心に拡大して表示する空間画像が表示装置に表示され る。また、領域画像 18abが 2つの領域画像 18a及び 18bに分離する場合、それに応 じて領域画像 18aに係るデータと領域画像 18bに係るデータとのグループ化を解除 するようにしてもよレ、。このように表面指示値をユーザが変更できるようにすると、領域 画像が幾つのデータに関連するものであるかを、ユーザは直ちに把握できるようにな り、利便性が向上する。なお、表面指示値を小さな値に変更する操作を行うと (例え ば、図 6における表面指示値 d'を表面指示値 dに変更する操作を行うと)、表面指示 値が小さな値に変更される。この場合、領域画像 18a及び 18bは再び一体化して領 域画像 18abに変化する。 [0027] In the present embodiment, the user can arbitrarily change the above-described surface indication value. As described above, the position of the surface of each closed region 14 is determined by the surface indication value. In the present embodiment, the surface indication value can be arbitrarily changed by the user using the input device so that the position of the surface of each closed region 14 can be changed. That is, as shown in FIG. 7A, for example, when a region image 18ab showing a closed region surrounding two data-related positions is displayed on the display device, the region image 18ab is indicated by the cursor image 16. However, if an operation for changing the surface indication value to a large value (for example, double-clicking the mouse) is performed, the surface indication value is changed to a large value. Then, as shown in FIG. 5B, the area image 18ab is separated into two area images 18a and 18b. That is, as shown in FIG. 6, by changing the surface indication value d to a larger surface indication value d ′, the region having the sum of the function values exceeding the surface indication value d ′ is narrowed. Image 18ab is separated into region images 18a and 18b. At this time, a spatial image that is enlarged and displayed around the position in the virtual space 10 designated by the cursor image 16 is displayed on the display device. When the area image 18ab is separated into two area images 18a and 18b, the grouping of the data related to the area image 18a and the data related to the area image 18b is canceled accordingly. You can do it. When the user can change the surface indication value in this way, the user can immediately know how many pieces of data the area image relates to, and convenience is improved. If an operation to change the surface indication value to a small value (for example, an operation to change the surface indication value d ′ in FIG. 6 to the surface indication value d), the surface indication value is changed to a small value. The In this case, the region images 18a and 18b are integrated again and changed to the region image 18ab.
[0028] また、本実施形態では、各データの属性 (例えばデータの種類)に基づいてデータ 間の関連度を算出するとともに、該関連度に従ってそれらデータのデータ関連位置 を仮想空間 10において接近させ、或いは離間させるようにしている。これにより、関 連度が所定閾値以上のデータのデータ関連位置が仮想空間 10において所定距離 内に位置している場合に、それらのデータ関連位置を移動させ、接近させることがで きる。また、関連度が所定閾値未満のデータのデータ関連位置が仮想空間 10にお いて所定距離内に位置している場合に、それらのデータ関連位置を移動させ、離間 させること力 Sできる。こうして、関連するデータをグループ化しやすくし、また関連しな レヽデータのグループィ匕をし難くし、利便性を向上させるようにしてレ、る。 [0028] Further, in the present embodiment, the degree of association between data is calculated based on the attribute of each data (for example, the type of data), and the data-related position of the data is approximated in the virtual space 10 according to the degree of association. Alternatively, they are separated. As a result, when data-related positions of data whose relevance is greater than or equal to a predetermined threshold are located within a predetermined distance in the virtual space 10, these data-related positions can be moved and approached. In addition, when the data related positions of the data whose relevance is less than the predetermined threshold are located within a predetermined distance in the virtual space 10, it is possible to move and separate these data related positions. This makes it easy to group related data, makes it difficult to group related data, and improves convenience.
[0029] 以下、本実施形態に係る情報処理装置の構成について説明する。図 8は、本実施 形態に係る情報処理装置のハードウェア構成を示す図である。同図に示すように、 本情報処理装置は、表示装置 20とコンピュータ 22と入力装置 24とを含んで構成さ れており、表示装置 20は CRTや LCD等により構成されている。また、コンピュータは プロセッサやメモリを中心に構成されており、例えばパーソナルコンピュータ、家庭用 ゲーム機、ホームサーバ等を用いて実現される。入力装置 24は、マウス等のポインテ イングデバイス、キーボード、リモコン等を含んでいる。 Hereinafter, a configuration of the information processing apparatus according to the present embodiment will be described. FIG. 8 is a diagram illustrating a hardware configuration of the information processing apparatus according to the present embodiment. As shown in the figure, the information processing apparatus includes a display device 20, a computer 22, and an input device 24. The display device 20 is configured by a CRT, an LCD, or the like. The computer is mainly composed of a processor and a memory, and is realized by using, for example, a personal computer, a home game machine, a home server, or the like. The input device 24 includes a pointing device such as a mouse, a keyboard, and a remote controller.
[0030] 図 9は、本実施形態に係る情報処理装置の機能ブロック図である。同図に示すよう に、本情報処理装置のコンピュータ 22は、機能的には空間画像生成部 32、表面指 示値変更部 34、データ関連位置更新部 38、データ情報データベース 40、グループ 連動部 42、データ関連位置接離部 44、グループ管理部 46、プログラム実行部 47及 びグループデータベース 48を含んで構成されている。これらの機能は、コンピュータ 22において本実施形態に係るプログラムが実行されることにより実現されるものであ る。 FIG. 9 is a functional block diagram of the information processing apparatus according to the present embodiment. As shown in the figure, the computer 22 of the information processing apparatus functionally includes a spatial image generation unit 32, a surface indication value change unit 34, a data-related position update unit 38, a data information database 40, a group linkage unit 42. The data-related location / separation unit 44, the group management unit 46, the program execution unit 47, and the group database 48 are included. These functions are realized by the computer 22 executing the program according to the present embodiment. The
[0031] まず、データ情報データベース 40は、コンピュータ 22に備えられたハードディスク 等の記憶装置に設けられるものであって、図 10に示すように、データ ID、パス、デー タ関連位置、サムネイルデータ、属性 1及び属性 2を関連づけて記憶するものである 。データ IDは、コンピュータ 22又はコンピュータ 22と通信接続された他のコンピュー タ(不図示)に記憶されているデータの識別情報である。パスは、データ IDにより識別 されるデータの所在を特定するデータである。データ関連位置は、データ IDにより識 別されるデータに関連づけられた仮想空間 10における位置座標である。サムネイル データは、データ IDにより識別されるデータに関するサムネイル画像の所在を特定 するデータである。属性 1は、データ IDにより識別されるデータの属性を示すデータ であり、ここでは該データに関連する 1又は複数のキーワードである。属性 2は、デー タ IDにより識別されるデータが処理対象データであれば、その処理対象データを処 理するためのプログラムを特定するデータである。また、データ IDにより識別されるデ ータがプログラムのデータであれば、そのプログラムの処理対象となるデータの種類 を特定するデータ(例えばデータのファイル拡張子)である。 [0031] First, the data information database 40 is provided in a storage device such as a hard disk provided in the computer 22, and as shown in FIG. 10, data ID, path, data related position, thumbnail data, Attribute 1 and attribute 2 are stored in association with each other. The data ID is identification information of data stored in the computer 22 or another computer (not shown) connected to the computer 22 in communication. The path is data that specifies the location of the data identified by the data ID. The data related position is a position coordinate in the virtual space 10 associated with the data identified by the data ID. The thumbnail data is data that specifies the location of the thumbnail image related to the data identified by the data ID. Attribute 1 is data indicating the attribute of the data identified by the data ID, and here is one or a plurality of keywords related to the data. Attribute 2 is data that specifies a program for processing the processing target data if the data identified by the data ID is processing target data. Further, if the data identified by the data ID is program data, it is data (for example, file extension of data) that specifies the type of data to be processed by the program.
[0032] グノレープデータベース 48も、コンピュータ 22に備えられた記憶装置に設けられるも のであって、図 11に示すように、グノレープ ID及びデータ IDを関連づけて記憶するも のである。上述のように本実施形態に係る情報処理装置では、複数のデータによりグ ループが形成されるようになっており、グループ IDはこのデータのグループを識別す るデータである。また、データ IDは、グノレープ IDにより識別されるグノレープに属する 各データのデータ IDである。 [0032] The gnole database 48 is also provided in a storage device provided in the computer 22, and stores a gnole ID and a data ID in association with each other as shown in FIG. As described above, in the information processing apparatus according to the present embodiment, a group is formed by a plurality of data, and the group ID is data for identifying the group of the data. The data ID is the data ID of each data belonging to the gnole identified by the gnole ID.
[0033] データ関連位置更新部 38は、入力装置 24により操作されるカーソル画像 16の位 置に応じて操作対象となるデータ関連位置を選択し、該データ関連位置をカーソル 画像 16の移動に応じて仮想空間 10内を移動させるものである。例えば、カーソル画 像 16の先端部がいずれかの領域画像 18内に位置する場合に、該領域画像 18内の データ関連位置に対応する空間画像内の位置のうち、カーソル画像 16の先端部に 最も近いものを移動対象として選択する。そして、ドラッグアンドドロップ時のカーソノレ 画像 16の移動方向及び移動量を取得するとともに、それらに従って、移動対象とし て選択されたデータ関連位置を移動させる。そして、データ関連位置更新部 38は、 データ情報データベース 40に既に記憶されている、移動対象として選択されたデー タ関連位置を移動後のものに更新する。また、データ関連位置更新部 38は、いずれ 力、のデータ関連位置を移動させる場合に、該データ関連位置に関連づけられたデ ータのデータ ID、移動方向及び移動量を、グループ連動部 42に通知する。なお、入 力装置 24により操作されるカーソル画像 16がいずれかの領域画像 18内に位置する 場合に、該領域画像 18内のデータ関連位置に対応する空間画像内の位置のすべ てを移動対象として選択してよレ、。この場合、ドラッグアンドドロップ時のカーソル画像 16の移動方向及び移動量を取得して、それらに従って、移動対象として選択された データ関連位置を移動させるとともに、領域画像 18自体もそれらに従って移動させ れは'よレ、。 [0033] The data-related position update unit 38 selects a data-related position to be operated according to the position of the cursor image 16 operated by the input device 24, and sets the data-related position according to the movement of the cursor image 16. Moving within the virtual space 10. For example, when the tip of the cursor image 16 is located in any one of the area images 18, among the positions in the spatial image corresponding to the data-related positions in the area image 18, the tip of the cursor image 16 Select the closest object to move. Then, the moving direction and the moving amount of the cursor image 16 at the time of drag and drop are acquired, and the moving object is set as the moving object according to them. To move the data-related position selected. Then, the data related position update unit 38 updates the data related position selected as the movement target already stored in the data information database 40 to the one after the movement. In addition, when the data-related position update unit 38 moves any data-related position, the data-related position, moving direction, and amount of data associated with the data-related position are transferred to the group linkage unit 42. Notice. When the cursor image 16 operated by the input device 24 is located in any of the area images 18, all the positions in the spatial image corresponding to the data related positions in the area image 18 are to be moved. You can choose as les. In this case, the movement direction and movement amount of the cursor image 16 at the time of drag and drop are acquired, and the data related position selected as the movement target is moved according to them, and the region image 18 itself is not moved accordingly. 'Yeah.
[0034] グループ連動部 42は、グループデータベース 48を参照して、いずれかのグループ に属するデータのデータ関連位置が移動した場合に、同じグノレープに属する他のデ ータのデータ関連位置を連動させるものである。すなわち、いずれかのデータ関連位 置が更新される場合、データ関連位置更新部 38から通知されるデータ ID、移動方 向及び移動量を取得する。そして、取得したデータ IDがグノレープデータベース 48に 既に記憶されているかどうかを調べる。そして、記憶されていれば、同じグループ ID に関連づけて記憶された、他のデータ IDを読み出す。そして、読み出されたデータ I Dに関連するデータ関連位置をデータ情報データベース 40から読み出すとともに、 その値を、データ関連位置更新部 38から通知される移動方向及び移動量に従って 更新する。 [0034] The group link unit 42 refers to the group database 48 and links the data-related positions of other data belonging to the same gnope when the data-related positions of data belonging to any group move. Is. That is, when any of the data-related positions is updated, the data ID, the movement direction, and the movement amount notified from the data-related position update unit 38 are acquired. Then, it is checked whether the acquired data ID is already stored in the gnolepe database 48. If it is stored, the other data ID stored in association with the same group ID is read out. Then, the data related position related to the read data ID is read from the data information database 40, and the value is updated according to the moving direction and moving amount notified from the data related position updating unit 38.
[0035] データ関連位置接離部 44は、データ情報データベース 40に記憶された各属性 1 のデータを読み出し、データ間の関連度を算出し、該関連度に従ってデータ情報デ ータベース 40のデータ関連位置のデータを更新する。例えば、ある 2つのデータの 関連度を算出する場合、それらのデータに関する属性 1のデータをデータ情報デー タベース 40から読み出すとともに、それらデータの中に含まれる共通のキーワードの 数に基づいて、それらデータの関連度を算出すればよい。さらに、それらのデータの データ関連位置をデータ情報データベース 40から読み出し、関連度に従って両者 を接近させたり、離間させたりする。 [0035] The data related position approach / separation unit 44 reads the data of each attribute 1 stored in the data information database 40, calculates the degree of association between the data, and according to the degree of association, the data related position of the data information database 40 Update the data. For example, when calculating the relevance of two pieces of data, the attribute 1 data related to the data is read from the data information database 40, and the data is calculated based on the number of common keywords included in the data. What is necessary is just to calculate the relevance degree. Furthermore, the data-related positions of those data are read from the data information database 40, and both are read according to the degree of association. Move them closer together or away from each other.
[0036] 例えば、データ関連位置 Pとデータ関連位置 P間の距離を dとし、これらのデータ リ [0036] For example, let d be the distance between data-related position P and data-related position P, and these data
関連位置に関連するデータ属性に基づいて算出された関連度 sとしたとき、距離 d 、関連度 sの増加関数、例えば kl X sにより決まる拘束距離 lc以下となったときに リ When the relevance s is calculated based on the data attribute related to the relevance position, the distance d is an increase function of the relevance s, for example, the constraint distance lc determined by kl X s is less than or equal to lc.
、仮想的なばねにより両データ関連位置 P, Pを拘束する。すなわち、この仮想的な ばねの自然長を関連度 sの減少関数、例えば kl X (1/s )とし、ばね定数 kを関連 リ リ Both data-related positions P and P are constrained by a virtual spring. In other words, the natural length of this hypothetical spring is assumed to be a decreasing function of relevance s, for example, kl X (1 / s), and the spring constant k is related to
度 sの増加関数、例えば kd X sとするのが好適である(kl, kdはいずれも定数)。こう すれば、関連度 sが高いほどデータ関連位置 Pとデータ関連位置 Pとが近い位置を 基準にして、互いに接近したり離間したりするようになる。また、関連度 sが高いほど データ関連位置 Pとデータ関連位置 Pとが強く(速く)接近したり離間したりする。さら に、関連度 sが高いほど拘束距離 kが大きくなり、遠くに位置するデータ関連位置 P , Pがばね拘束されるようになる。 An increasing function of degree s, for example, kd X s is preferable (kl and kd are constants). In this way, the higher the relevance s is, the closer the data related position P and the data related position P are, the closer to and away from each other. In addition, the higher the relevance s, the stronger (faster) the data-related position P and the data-related position P approach or move away from each other. Furthermore, the higher the relevance s, the greater the restraint distance k, and the farther data related positions P and P are spring restrained.
[0037] また、後述するように、プログラムにより処理対象データの処理が実行された後は、 該プログラムに関連づけられたデータ関連位置と、処理対象データに関連づけられ たデータ関連位置と、を強制的に離間させ、閉領域の一体化を解除する。 [0037] Further, as will be described later, after the processing of the processing target data is executed by the program, the data-related position associated with the program and the data-related position associated with the processing target data are forcibly set. And release the integration of the closed region.
[0038] 空間画像生成部 32は、データ情報データベース 40に記憶された情報に基づいて 、仮想空間 10を示す画像、すなわち空間画像を生成し、表示部 20にそれを表示さ せるものである。具体的には、仮想空間 10に設定された視点位置及び視線方向に 従って、データ情報データベース 40から一部又は全部のデータ関連位置を読み出 す。そして、それらデータ関連位置、及びメタボールの関数に従って、仮想空間 10 内の閉領域 14の表面の位置を決定する。すなわち、各データ関連位置に関連づけ られたメタボールの関数の値を足し合わせた値が所与の表面指示値となる位置を、 これらのデータ関連位置のうち 1又は複数を囲む閉領域の表面の位置として決定す る。そして、こうして表面の位置が決定された各閉領域 14により囲まれるデータ関連 位置に関連づけられたサムネイルデータを、データ情報データベース 40から読み出 し、該サムネイルデータによって特定されるサムネイル画像を、各閉領域 14の表面に 配置する。そして、このようにして各閉領域 14の表面にサムネイル画像が配置された 仮想空間 10の画像を、前記視点位置及び視線方向に従って生成し、それを表示装 置 20により表示させる。 The spatial image generation unit 32 generates an image showing the virtual space 10 based on the information stored in the data information database 40, that is, a spatial image, and causes the display unit 20 to display it. Specifically, some or all of the data-related positions are read from the data information database 40 according to the viewpoint position and the line-of-sight direction set in the virtual space 10. Then, the position of the surface of the closed region 14 in the virtual space 10 is determined according to the data-related position and the function of the metaball. In other words, the position where the value obtained by adding the values of the function of the metaball associated with each data-related position becomes the given surface indication value is the position of the surface of the closed region surrounding one or more of these data-related positions. To be determined. Then, the thumbnail data associated with the data-related position surrounded by each closed region 14 whose surface position is determined in this way is read out from the data information database 40, and the thumbnail image specified by the thumbnail data is read out from each closed image. Place on the surface of area 14. In this way, an image of the virtual space 10 in which the thumbnail image is arranged on the surface of each closed region 14 is generated according to the viewpoint position and the line-of-sight direction, and is displayed on the display device. Display with position 20.
[0039] グノレープ管理部 46は、上記のようにして各閉領域の表面の位置を決定する際に、 新たにいずれかの閉領域の表面が他の閉領域と一体化したか否力、一体化が解除 されたか否力 ^判定する。 [0039] When determining the position of the surface of each closed region as described above, the gnolepe management unit 46 newly determines whether the surface of any closed region has been integrated with another closed region. Judgment is made on whether or not conversion is released.
[0040] 例えば、ある閉領域に囲まれるデータ関連位置のそれぞれと、他の閉領域に囲ま れるデータ関連位置のそれぞれと、を結ぶ線上の各位置における、仮想空間 10に 配置されたすベてのデータ関連位置に関連づけられたメタボールの関数の値の総 和を計算する。そして、その値が表面指示値未満となる位置が前記線上に存在しな ければ、両閉領域は新たに一体化したと判断する。また、メタボールの関数の値の総 和が表面指示値未満となる位置が前記線上に 1つでも存在すれば、選択された 2つ のデータ関連位置にそれぞれ関連する 2つの閉領域は未だ一体化されていないと 判断する。また、グループ管理部 46は、ある閉領域に囲まれるデータ関連位置のう ち 1つと、他のそれぞれとを結ぶ線上の各位置における、仮想空間 10に配置された すべてのデータ関連位置に関連づけられたメタボールの関数の値の総和を計算す る。そして、その値が表面指示値未満となる位置が前記線上に存在しなければ、そ れらデータ関連位置はレ、まだ共通の閉領域により囲まれている(一体化が維持され ている)と判断する。また、メタボールの関数の値の総和が表面指示値未満となる位 置が前記線上に 1つでも存在すれば、一体化が解除され、当該 1つのデータ関連位 置は別の閉領域により囲まれていると判断する。 [0040] For example, all of the data-related positions surrounded by a certain closed area and all the data-related positions surrounded by another closed area are arranged in the virtual space 10 at each position on a line connecting them. The sum of the metaball function values associated with the data-related positions is calculated. If the position where the value is less than the surface indication value does not exist on the line, it is determined that the both closed regions are newly integrated. In addition, if there is at least one position on the line where the sum of the metaball function values is less than the surface indication value, the two closed areas related to the two selected data-related positions are still integrated. Judge that it is not. In addition, the group management unit 46 is associated with all the data related positions arranged in the virtual space 10 at each position on the line connecting one of the data related positions surrounded by a certain closed area and the other. Calculate the sum of the metaball function values. If there is no position on the line whose value is less than the surface indication value, these data-related positions are still surrounded by a common closed area (unification is maintained). to decide. Also, if there is at least one position on the line where the sum of the function values of the metaball is less than the surface indication value, the integration is canceled and the one data-related position is surrounded by another closed region. Judge that
[0041] また、他の態様として、データ関連位置ごとに固定サイズのパウンデイングボックス( ポリゴンにより構成される)を該データ関連位置を囲むように配置しておき、このバウ ンデイングボックス同士が干渉するか否力、を判定して、パウンデイングボックス同士が 干渉する場合にだけ、上述した詳細な一体化の判断を行うようにしてもよい。或いは 、より簡易に、パウンデイングボックス同士が干渉するか否かにより、各閉領域が一体 化した力、、該一体化が解除されたかを判断するようにしてもよい。 [0041] Further, as another aspect, a fixed-size casting box (configured by polygons) is arranged for each data-related position so as to surround the data-related position, and the bounding boxes interfere with each other. The above-mentioned detailed integration determination may be performed only when the casting boxes interfere with each other. Alternatively, it may be more easily determined whether the closed areas are integrated and whether the integration is released or not, depending on whether the casting boxes interfere with each other.
[0042] また、さらに他の態様として、データ関連位置間の距離が所定距離未満であるか否 かを判定して、所定距離未満の場合にだけ、上述した詳細な一体化の判断を行うよ うにしてもよい。或いは、より簡易に、データ関連位置間の距離が所定距離未満であ るか否かにより、各閉領域が一体化したか、該一体化が解除されたかを判断するよう にしてもよい。 [0042] As yet another aspect, it is determined whether or not the distance between the data-related positions is less than a predetermined distance, and the above-described detailed integration determination is performed only when the distance is less than the predetermined distance. You may do it. Or, more simply, the distance between data-related positions is less than a predetermined distance. Whether or not each closed region has been integrated or whether the integration has been released may be determined based on whether or not the integration is complete.
[0043] そして、閉領域が一体化した場合には、グノレープ管理部 46は、それら一体化した 閉領域により囲まれたデータ関連位置に関連づけられたデータのデータ IDを、共通 のグループ IDに関連づけてグループデータベース 48に記憶させる。こうして、閉領 域が一体化する場合に、それに応じてデータのグノレープ化を行うようにしている。ま た、一体化が解除された場合には、分離した各閉領域により囲まれるデータ関連位 置に関連づけられたデータのデータ IDを、それぞれ別のグノレープ IDに関連づけて グノレープデータベース 48に記憶させる。分離した閉領域のうち一方又は双方が、 1 つのデータ関連位置のみを囲む場合には、そのデータ関連位置に関連づけられた データのデータ IDをグループデータベース 48から削除する。 [0043] When the closed areas are integrated, the gnole management unit 46 associates the data IDs of the data associated with the data-related positions surrounded by the integrated closed areas with the common group ID. Stored in the group database 48. Thus, when closed areas are integrated, data is gnolled accordingly. When the integration is released, the data IDs of the data associated with the data-related positions surrounded by the separated closed regions are stored in the gnole database 48 in association with different gnole IDs. If one or both of the separated closed areas enclose only one data-related position, the data ID of the data associated with the data-related position is deleted from the group database 48.
[0044] また、特にプログラムのデータに関連づけられたデータ関連位置を囲む閉領域と、 該プログラムの処理対象データに関連づけられたデータ関連位置を囲む閉領域と、 が新たに一体化した場合には、後者の閉領域により囲まれるデータ関連位置に関連 づけられた処理対象データの中から一部又は全部を、前者により囲まれるデータ関 連位置に関連づけられたプログラムにより処理する。すなわち、データ情報データべ ース 40の属性 2の欄を参照して、プログラムに係るデータ関連位置とその処理対象 データに係るデータ関連位置とが共通の閉領域により囲まれることとなったかどうかを 判断して、そのようになった場合には、プログラムを起動するとともに、その引数として 処理対象データを指定する。この場合、一体化した閉領域により囲まれた処理対象 データのデータ関連位置の数を、グループデータベース 48を参照することによって 調べて、それが一つであれば、プログラムにより同処理データを直ちに処理する。ま た、複数であれば、メニュー画面を表示してユーザにより一部又は全部を指示させた 後、指示された一部又は全部を処理させる。あるいは、全部又は事前に定められた 基準により選択された一部を順次処理してもよい。 [0044] Further, in particular, when the closed region surrounding the data-related position associated with the program data and the closed region surrounding the data-related position associated with the processing target data of the program are newly integrated A part or all of the processing target data associated with the data-related position surrounded by the latter closed region is processed by a program associated with the data-related position surrounded by the former. That is, referring to the attribute 2 column of the data information database 40, it is determined whether or not the data related position related to the program and the data related position related to the processing target data are surrounded by a common closed area. If this happens, start the program and specify the data to be processed as its argument. In this case, the number of data-related positions of the processing target data surrounded by the integrated closed area is checked by referring to the group database 48. If there is one, the processing data is immediately processed by the program. To do. If the number is plural, the menu screen is displayed and a part or all of the instructed is instructed by the user, and then the instructed part or all is processed. Alternatively, all or a part selected according to a predetermined criterion may be sequentially processed.
[0045] プログラムによる処理対象データの処理後は、プログラム実行部 47は、データ関連 位置接離部 44に対して、プログラムに係るデータ関連位置と処理対象データに係る データ関連位置とを離間させるよう指示する。 [0046] 表面指示値変更部 34は、入力装置 24に対する操作に応じて、上述した表面指示 値を変更するものである。これにより、各閉領域 12の大きさが大小する。 [0045] After processing the processing target data by the program, the program execution unit 47 causes the data related position approach / separation unit 44 to separate the data related position related to the program and the data related position related to the processing target data. Instruct. The surface indication value changing unit 34 changes the surface indication value described above in response to an operation on the input device 24. Thereby, the size of each closed region 12 is increased or decreased.
[0047] 以上説明した情報処理装置によれば、仮想空間 10におけるデータ関連位置 12を マウス等の入力装置 24を用いて移動させるだけで、簡単に複数のデータをグノレープ 化することができ、大変利便性が向上する。 [0047] According to the information processing apparatus described above, a plurality of data can be easily gnolled simply by moving the data-related position 12 in the virtual space 10 using the input device 24 such as a mouse. Convenience is improved.
[0048] なお、上述した情報処理装置は種々の変形実施が可能であり、例えば空間画像に は他の画像を含めるようにしてもよい。例えば、空間画像にビューヮ画像 17を含める ようにして、このビューヮ画像 17の位置に領域画像 18をドラッグアンドドロップすると、 該領域画像に関連する画像がビューヮ画像 17の内部に表示されるようにしてもよい 。例えば、図 12 (a)に示すように、 2つのデータに関連する領域画像 18abをカーソル 画像 16を用いてビューヮ画像 17の位置にドラッグアンドドロップした場合には、同図 (b)に示すように、領域画像 18abに関連する 2つのデータのそれぞれのサムネィノレ 画像を離間してビューヮ画像 17に表示するようにしてもよい。こうすれば、領域画像 1 8に関連するデータの情報を、直感的な操作により出力させることができるようになる Note that the information processing apparatus described above can be variously modified, and for example, other images may be included in the spatial image. For example, if the view image 17 is included in the spatial image and the region image 18 is dragged and dropped at the position of the view image 17, an image related to the region image is displayed inside the view image 17. Also good. For example, as shown in Fig. 12 (a), when the region image 18ab related to the two data is dragged and dropped to the position of the view 17 image 17 using the cursor image 16, as shown in Fig. 12 (b). In addition, the thumbnail images of the two pieces of data related to the region image 18ab may be displayed separately on the view frame image 17. In this way, data information related to the region image 18 can be output by an intuitive operation.
[0049] また、以上の説明では、プログラムに係る閉領域と、 1又は複数の処理対象データ に係る閉領域と、が一体化した場合に、速やかにプログラムにより一部又は全部の処 理対象データの処理を開始するようにした力 ユーザによる明示の指示があってから 、同処理を行うようにしてもよい。この場合には、一体化した閉領域により囲まれるデ ータ関連位置に関連づけられたプログラムや処理対象データを識別するデータ IDを グノレープデータベース 48に一旦登録しておき、後に、一体化した閉領域、すなわち グノレープを指定したプログラム実行の指示があれば、上記と同様にしてプログラムに よる処理対象データの処理を行えばょレ、。 [0049] Further, in the above description, when the closed region related to the program and the closed region related to one or more processing target data are integrated, a part or all of the processing target data is promptly executed by the program. The power to start the process The process may be performed after an explicit instruction from the user. In this case, a data ID for identifying the program or processing target data associated with the data-related position surrounded by the integrated closed region is once registered in the gnole database 48, and later, the integrated closed region is registered. In other words, if there is an instruction to execute a program specifying Gnorape, the processing target data should be processed by the program as described above.
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2006202591A JP4675856B2 (en) | 2006-07-25 | 2006-07-25 | Information processing apparatus, user interface method, and program |
| JP2006-202591 | 2006-07-25 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2008012966A1 true WO2008012966A1 (en) | 2008-01-31 |
Family
ID=38981282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2007/054966 Ceased WO2008012966A1 (en) | 2006-07-25 | 2007-03-13 | Information processing device, user interface method, and information storage medium |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP4675856B2 (en) |
| WO (1) | WO2008012966A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5928248B2 (en) | 2012-08-27 | 2016-06-01 | 富士通株式会社 | Evaluation method, information processing apparatus, and program |
| DK3192283T3 (en) | 2014-09-10 | 2018-10-01 | Lego As | PROCEDURE FOR ESTABLISHING A WIRELESS CONNECTION BETWEEN ELECTRONIC DEVICES |
| DK3191940T3 (en) | 2014-09-10 | 2020-02-03 | Lego As | PROCEDURE FOR ESTABLISHING A FUNCTIONAL RELATIONSHIP BETWEEN INPUT AND OUTPUT FUNCTIONS |
-
2006
- 2006-07-25 JP JP2006202591A patent/JP4675856B2/en not_active Expired - Fee Related
-
2007
- 2007-03-13 WO PCT/JP2007/054966 patent/WO2008012966A1/en not_active Ceased
Non-Patent Citations (1)
| Title |
|---|
| WATANABE N. AND IGARASHI T.: "Bubble Clusters: Icon no Kukanteki na Matomari o Riyo shita Joho Kanri Kiko", DAI 13 KAI WORKSHOP ON INTERACTIVE SYSTEMS AND SOFTWARE (WISS 2005) RONBUNSHU, no. 38, 7 December 2005 (2005-12-07), pages 75 - 80, XP003020680 * |
Also Published As
| Publication number | Publication date |
|---|---|
| JP4675856B2 (en) | 2011-04-27 |
| JP2008027398A (en) | 2008-02-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2008012965A1 (en) | Information processing device, user interface method and information storing medium | |
| CN101377787B (en) | Image searching device, image searching method | |
| US8264488B2 (en) | Information processing apparatus, information processing method, and program | |
| JP5062884B2 (en) | Image search apparatus, image search method and program | |
| JP3630721B2 (en) | Multimedia data processing method, multimedia data processing device, attribute information registration device, and attribute information registration method | |
| EP4170654A1 (en) | Methods, systems, and media for object grouping and manipulation in immersive environments | |
| JP5613058B2 (en) | Display device, program, and display method | |
| US20100287493A1 (en) | Method and system for viewing and editing an image in a magnified view | |
| CN109375865A (en) | Jump, check mark and delete gesture | |
| US20140232723A1 (en) | Moving visualizations between displays and contexts | |
| US20230266982A1 (en) | Device navigational maps for connected devices | |
| US10712921B2 (en) | Authoring a collection of images for an image gallery | |
| US7420556B2 (en) | Information processing method and information processing apparatus | |
| JP4701124B2 (en) | Information processing apparatus and information processing method | |
| JP2012155367A (en) | Screen data editing device for programmable display unit | |
| WO2008012966A1 (en) | Information processing device, user interface method, and information storage medium | |
| JP2015036930A (en) | Display device, display method and program | |
| US11269419B2 (en) | Virtual reality platform with haptic interface for interfacing with media items having metadata | |
| JP6939294B2 (en) | Information processing equipment and programs | |
| JP3498733B2 (en) | Tree structure display editing device | |
| CN116931779A (en) | Information processing apparatus, recording medium, and information processing method | |
| JP2014048894A (en) | Display control device and program | |
| JP2013084257A (en) | Database visualization system | |
| JP2010033184A (en) | Information processor, information processing method and program | |
| JP4212396B2 (en) | Graphic element selection program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07738438 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| NENP | Non-entry into the national phase |
Ref country code: RU |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 07738438 Country of ref document: EP Kind code of ref document: A1 |