JP4441685B2 - Image information search / display apparatus, method, and image information search / display program - Google Patents

Description

  The present invention relates to an image information search / display apparatus, method, and image information search / display program. More specifically, when a user searches for desired information such as an image using a computer and a recording medium, the user can specify a search condition so that the search condition can be fine-tuned via a single graphical user interface. The present invention relates to a technique for browsing and displaying search result information in an intuitive and visual manner.

  In an information search using a computer, a keyword search is generally used when a discrete quantity such as a language is specified as a search condition. In this keyword search, a keyword serving as a search condition is input from a keyboard or the like via a search engine or the like, and data matching the search condition is output to the screen as a result of filtering processing.

  On the other hand, in the case where an analog value such as size or age, or a continuous amount such as lightness or saturation in a color is designated as a search condition, a search using a slide bar (also called “slider”) shown in FIG. Techniques are known. In the search using this slide bar, the cursor or pointer on the slide bar having both ends as the lower limit value and the upper limit value is adjusted for each search condition using an input device such as a mouse, and this pointer is placed on the slide bar. The key value of the search condition is set by sliding between the lower limit value and the upper limit value. In FIG. 13, in order to search for an image having a desired color, three slide bars having a hue 9a, vividness 9b, and brightness 9c are arranged on the lower side of the screen. An image that matches the search condition set by the slide bar is displayed and output at the top of the screen.

Since the search condition is set by operating the slide bar, it is possible to fine-tune the continuously changing search condition (key value), and the size that cannot be expressed well as a keyword is also used as the search condition. There is an advantage that it is easy to set. Since the slide bar is configured to be slidable only between the lower limit value and the upper limit value of the predetermined search condition, it is possible to eliminate in advance an error operation such as a user entering an incorrect search condition. For example, in the case of a user who does not have detailed knowledge about a digital camera, in keyword search, a camera is searched using a resolution of 20 million pixels that cannot exist, and a camera that hits the search condition is searched. Although there is a risk that it cannot be obtained as a result, according to the search using the slide bar, a search condition value of 20 million pixels cannot be set even if the pointer is moved to the upper limit value at the end of the slide bar. Search is unnecessary.
C. Ahlberg, B.M. Shneiderman, “Visual Information Seeking: Right Coupling of Dynamic Query Filters with Starfield Displays,” SIGCHI '94, pp. 313-317, 1994.

  However, for example, when the search condition is a cyclic continuous quantity such as hue, year-round season, time zone of 24 hours per day, direction, etc., the search condition setting operation using the slide bar is not limited to the following. Has a problem. That is, even though the search condition value data circulates, the data adjacent to the right end of the slide bar in the right direction is arranged at the left end of the slide bar. After sliding the bar all the way to the right, you must move the pointer all the way to the left end of the slide bar. For this reason, the continuity of the operation is impaired and the operation is wasted. That is, it becomes a factor which reduces both operativity and work efficiency.

  The present invention has been made in view of the above problems, and its purpose is to search for desired information through a single graphical user interface (GUI) in which search and browsing are integrated. To provide an image search method and apparatus capable of easily setting a search condition for information such as a desired image by continuous and seamless operation regardless of whether the condition is a continuous amount or a discrete amount. .

  Another object of the present invention is that the user can visually recognize the current search condition in both the setting of the search condition and the display output of the search result, and at the same time intuitively obtain the desired information from the search result. An object of the present invention is to provide an image display method and apparatus capable of being easily selected.

  According to one aspect of the present invention, one or a plurality of key rings are provided for each search category for information search and arranged concentrically on the display screen, and are continuous in the circumferential direction on the key ring. A key ring arrangement unit that displays and outputs a key ring in which a search key of an amount or a discrete amount is arranged, a key ring selection unit that selects one of the key rings in accordance with an operation input from an input device, and the selected key ring A key ring rotating part for independently rotating each key ring clockwise or counterclockwise according to an operation input from the input device while maintaining a relative position on the circumference of each search key, and predetermined on the key ring A search key determining unit for determining a search key for information search based on a rotation amount of the key ring in a circumferential direction from a predetermined position; A search result display unit that sequentially displays and outputs a search result executed using the determined search category and the determined search key inside the key ring as the key ring rotates. A display device is provided.

  According to another feature of the present invention, one or a plurality of key rings are provided for each search category for information search and arranged concentrically on the display screen, and are arranged on the key ring in a circumferential direction. A search key determination unit for determining a search key for information search based on a rotation amount in the circumferential direction of a key ring in which a continuous or discrete search key is arranged and displayed and output, and the rotated key ring Based on the priority assigned to the search key and the determined search key, a weight calculation unit for calculating the weight for each search result obtained by the search execution, and the calculated search result with the large weight are displayed in order. A search result arrangement unit arranged concentrically from the vicinity of the inner center of the key ring in the circumferential direction, and the arranged search results are sequentially moved to the inside of the key ring as the key ring rotates. Information retrieval display device characterized by comprising a search result display unit for displaying the output is provided.

According to another feature of the present invention, one or a plurality of key rings are provided for each search category for information search and arranged concentrically on the display screen, and are arranged on the key ring in a circumferential direction. A search key determination unit for determining a search key for information search based on a rotation amount in a circumferential direction of a key ring in which continuous or discrete search keys are arranged and displayed, and a selected search category And a search unit that executes a search using the determined search key and obtains a search result to be sequentially displayed inside the key ring as the key ring rotates. Is done.

  According to another aspect of the present invention, an information search and display method executed by an information search and display device including a key ring arrangement unit, a key ring selection unit, a key ring rotation unit, a search key determination unit, and a search result display unit. One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, wherein continuous or discrete amounts are circumferentially arranged on the key ring. A step of displaying and outputting a key ring in which a search key is arranged; a step of selecting one of the key rings according to an operation input from an input device; and a circumference of each search key on the selected key ring Rotating each key ring independently clockwise or counterclockwise according to an operation input from the input device while maintaining a relative position; and A step of determining a search key for information search based on a circumferential rotation amount of the key ring from a predetermined position determined in advance, and using the selected search category and the determined search key And a step of sequentially displaying and outputting the retrieved results as the key ring rotates inside the key ring.

  According to another aspect of the present invention, there is provided an information search and display method executed by an information search and display device including a search key determination unit, a weight calculation unit, a search result arrangement unit, and a search result display unit, One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction And a step of determining a search key for information search based on a circumferential rotation amount of the key ring displayed and output, and the priority given to the rotated key ring and the determined search key Based on the step of calculating the weight for each search result obtained by executing the search, and in the circumferential direction from the vicinity of the inner center of the displayed key ring in order from the calculated search result having the large weight. Placing on selfish concentrically, the placed the search result, the information retrieval display method characterized by comprising the step of sequentially displaying the output on the inside of the key ring with the rotation of the key ring is provided.

  According to another aspect of the present invention, there is provided an information search method including a search key determination unit and a search unit, provided for each search category for information search, and arranged concentrically on a display screen. One or a plurality of key rings, on which a search key of continuous amount or discrete amount is arranged in the circumferential direction, and information search is performed based on the rotation amount of the displayed key ring in the circumferential direction Determining a search key for performing a search using the selected search category and the determined search key to obtain a search result to be sequentially displayed inside the key ring as the key ring rotates And an information search method characterized by including a step.

  According to another aspect of the present invention, there is provided an information search / display processing program for causing a computer to execute information search / display processing, the program being provided in the computer for each search category for information search, One or a plurality of key rings arranged concentrically on the display screen, and a key ring arrangement process for displaying and outputting a key ring in which continuous or discrete search keys are arranged in the circumferential direction on the key ring; and A key ring selection process for selecting one of the key rings in accordance with an operation input from the input device, and a relative position on the circumference of each search key on the selected key ring, while maintaining the relative position on the circumference from the input device. A key ring rotation process in which each key ring is rotated clockwise or counterclockwise independently according to an operation input, A search key determination process for determining a search key for information search based on a rotation amount of the key ring in a circumferential direction from a predetermined position, a selected search category, and the determined search key An information search and display program is provided for executing processing including search result display processing for sequentially displaying and outputting search results executed in response to rotation of the key ring. Is done.

  According to another aspect of the present invention, there is provided an information search / display processing program for causing a computer to execute information search / display processing, the program being provided in the computer for each search category for information search, One or a plurality of key rings arranged concentrically on the display screen, and continuous or discrete search keys are arranged in the circumferential direction on the key ring, and the circumferential direction of the key ring displayed and output Obtained by the search execution based on the search key determination process for determining the search key for information search based on the amount of rotation of the key, the priority assigned to the rotated key ring and the determined search key The weight calculation process for calculating the weight for each search result, and the circle from the inner center vicinity of the displayed key ring in order from the calculated search result with the largest weight. A search result arrangement process for arranging the search results on a concentric circle, and a search result display process for sequentially displaying and outputting the arranged search results inside the key ring as the key ring rotates. An information search and display program is provided.

According to another aspect of the present invention, there is provided an information search processing program for causing a computer to execute information search processing, the program being executed by the computer,
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction Search key determination processing for determining a search key for information search based on the amount of rotation of the displayed key ring in the circumferential direction, and a search using the selected search category and the determined search key And a search process for obtaining a search result to be sequentially displayed inside the key ring as the key ring rotates. .

  According to the present invention, whether a search condition for searching for desired information is a continuous amount or a discrete amount through a single graphical user interface (GUI) in which search and browsing are integrated. Regardless, it is possible to easily set a search condition for information such as a desired image by a continuous and seamless operation.

  Furthermore, in both the search condition setting and the search result display output, the user can intuitively and easily select a desired search result while visually recognizing the current search condition.

Embodiments of the present invention will be described below with reference to the drawings.

(1) Configuration of Image Information Retrieval Display Device According to this Embodiment FIG. 1 shows a configuration of an image information retrieval display device according to this embodiment. The image information search and display apparatus 1 according to the present embodiment includes an input control unit 11, a candidate extraction unit 12, a candidate control unit 13, a search processing unit 14, an output control unit 15, attribute definition information 16, and a state. Information 17 and an image attribute database 18 are provided.

  The input control unit 11 receives position information of a cursor or pointer and a ring identifier (for example, a ring name) input from the input unit 2 including an input device such as a mouse. Update the stored key value of the current search condition. In addition, the input control unit 11 performs input / output control such as display output of categorization and key ring (described later) according to the present embodiment, selection input for the categorization and key ring, operation input such as rotation, and the like together with the output control unit 15. Do.

  In this embodiment, the search attribute refers to items for search such as “color” and “image size”, for example, and the search attribute key or search key is a key value of each search attribute ( For example, if the image size is 1,975 bytes, it is referred to as a search condition for searching the image attribute database 18 using this search attribute + key.

  The status information 17 stores key values of search attributes that are currently set as one or more search attributes. As will be described later, this search condition value includes at least the priority set for each key ring (described later) and the center value of the key.

  The candidate extraction unit 12 reads the key value of the currently set search condition (search attribute) stored in the state information 17 and refers to the attribute definition information 16 to determine the search key width (described later). The identifier of the image information that matches the key value of the set search attribute is extracted as a display output candidate with reference to the image attribute database 18 using the key value within the search key width as a key.

  The attribute definition information 16 includes a search attribute name (search category name), a minimum value and a maximum value of key values for each attribute name, and a type of the attribute (whether it is a cyclic continuous quantity, a non-circular continuous quantity, a discrete quantity, etc.) , Including which display color the attribute is displayed in categorization (described later), etc., preferably one record for each search attribute name is configured and referred to as a table stored in the internal memory or internal / external recording medium The

  FIG. 5 shows an example of image attribute information stored in the image attribute database 18. In the image attribute database 18, attribute values of search attributes are recorded for each piece of information to be searched. In the image attribute database 18 shown in FIG. 5, attribute values of color, atmosphere, aspect ratio, and size as search attributes are recorded for each image file name (1.gif, 2.gif, 3.gif,...). Has been. The image attribute database 18 is preferably configured as tabular data such as RDB, for example. However, the present embodiment is not limited to this, and an image that matches with the search key value determined by the candidate extraction unit 12 as a key. Any format can be used as long as the identifier of the information can be searched.

  The search processing unit 14 weights each display output candidate extracted by the candidate extraction unit 12.

  The output control unit 15 determines the display position and size in the display output of each image information according to the weight for each of the image information that is the display output candidate determined by the search processing unit 14. The image information for which the arrangement including the display position and the size is determined is output and displayed on the display device or the like by the display unit 3. Each image to be displayed and output may be stored in a folder or the like, or may be remote data collected and stored in advance by a search robot or the like.

  The candidate control unit 13 enlarges the detected image information when the displayed image information is pointed by a pointing device such as a mouse or the image information touched by the cursor is detected by the input control unit 11. Redisplay.

(2) GUI in this embodiment
FIG. 2 shows an example of the initial screen of the ring display means constituting the GUI for information retrieval and display output in the present embodiment. On the initial search screen, a category ring 20 is displayed in which search attribute identifiers (for example, search attribute names) are arranged in a circumferential direction on the ring. The information search method according to the present embodiment is originally intended to execute a search only by an operation using a single instruction means such as a mouse. For this reason, all or part of the search attributes assigned to each piece of image information defined in the image attribute database 18 is displayed on the category ring 20. In FIG. 2, the image aspect ratio 201, size 202, color 203, and atmosphere 204 are displayed as image search attributes, and the user selects and inputs these search attributes displayed on the ring with an instruction means such as a mouse. To do.

  In the example of the present embodiment shown in FIG. 2, the search attributes to be input by the user are arranged in advance on the category ring 20 and the search attribute names are displayed. The search attribute designation method is not limited to this. For example, a button field that can be selected and input together with the display of the search attribute name may be provided for each search attribute on the search attribute input screen without providing the categorization 20 separately. May be.

  FIG. 3A shows an example of a display screen after a selection instruction is made by clicking the display portion of the aspect ratio on the category ring 20 in FIG. When a selection instruction is made, for example, by clicking on the display portion of the aspect ratio on the category ring 20, the key ring 30 for the search attribute “aspect ratio” is displayed inside the category ring 20. In the key ring 30, search attribute keys are arranged in a circumferential direction on the ring. At the same time, an expression (keyword) that outlines the search key value may be displayed on the key ring 30 so that the key value (search attribute value) of the displayed key ring can be intuitively grasped. In FIG. 3, “square 302”, “horizontal 303”, and “vertical 304” indicating search attribute values of the search attribute “aspect ratio” are displayed, and an image having the key is displayed inside the key ring 30. The The image having the search attribute value closest to the designated search key, that is, the image 30a1 having the highest matching score is displayed at the center of the ring concentric circles.

  Note that the “ring” in the present embodiment is not limited to a circular shape, and includes, for example, a broadly-defined annular body such as an ellipse, and further a member that forms a closed loop with a polygonal shape or the like. A shape that forms a substantially closed loop is particularly suitable for setting a search key for a continuous circulation amount, and can provide the same operation interface as that for a search key for a non-circular continuous amount or a discrete amount.

  The “key” in the present embodiment is a condition value used for search, and the search result image to be displayed and output is filtered by adjusting this by an operation described later. In FIG. 3A, a key value used as a search key for image search is input to the input control unit 11 at a lower portion of the key ring 30, that is, a value at a position 301 at 6 o'clock. Alternatively, any key determined as a search key may be determined as a search key as long as it is a predetermined position on the key ring 30. This key is adjusted by rotating the key ring 30 by an operation input from an input device such as a mouse.

  While each search key previously arranged in the circumferential direction on the key ring 30 is held at the relative position on the circumference, the key ring 30 is independently rotated clockwise or counterclockwise. That is, based on the rotation amount in the circumferential direction from the reference position (the amount of movement from the reference position or the angle with respect to the center) obtained by rotating the key ring 30 with the predetermined position on the key ring 30 as the reference position, The value of the key located at a predetermined position (for example, position 301 at 6 o'clock) is adjusted and determined.

  When the search condition is a discrete amount, the key may be one degree, but when the search condition is a continuous amount, a certain amount of width is given to the left and right of the position 301. When a continuous amount is used as a search condition, slightly different information before and after is also important as a search condition. A user who performs a fuzzy search with a wider search key and browses more extracted image information. Is preferable.

  To adjust the key, after clicking the mouse wheel, the wheel is rotated or the key ring 30 is dragged to rotate. In the present embodiment, the clockwise rotation of the key ring 30 is realized by rotating the wheel forward or by left dragging, and the counterclockwise rotation is set to the reverse operation, but the categorization 20 according to the present invention is set. The operation of the key ring 30 is not limited to this, and may be realized by any operation. Each key ring is configured to be independently rotatable while maintaining the relative position on the circumference of each search key arranged on the key ring 30.

  3B to 3D, the key ring 30 of FIG. 3A is rotated counterclockwise, and an image in which the key of the search condition “aspect ratio” is close to 1: 1, that is, an image having a shape closer to a square is displayed by browsing. Indicates the state that has been performed.

  3E to 3G show a state in which the key ring 30 of FIG. 3D is further rotated counterclockwise, and an image having a more horizontally long shape is displayed as a browse as a key for the search condition “aspect ratio”. In the present embodiment, “browsing display” means display for scanning search, and means that a large number of images are collectively displayed as reduced images on the same screen or sequentially displayed in a short time.

  If a plurality of search attributes on the category ring 20 are selected and specified sequentially, a plurality of keys can be designated. In this case, the key ring that has been instructed for selection is the key ring that has been instructed to be selected in advance. Displayed inside. That is, even when a plurality of keys are designated, only the number of key rings is increased, and a unified display interface is provided.

  In the present embodiment, the first designated key can be determined to be a key having a higher priority in the search, and therefore the keyring located on the outer side is set to have a higher weight in the search. This priority can be changed by changing the display order of the rings. For example, in the present embodiment, when a key ring is right-clicked, the key priority of the key ring is increased by one. By making it possible to select a plurality of keys and to change the priority order set for the plurality of keys, a dynamic hierarchical structure of search keys is generated and information to be extracted is narrowed down.

  By displaying a plurality of key rings, an AND search using a plurality of keys is executed. In this embodiment, when a plurality of keys are specified and the number of keys is continuous, an ambiguous search is executed by appropriately expanding the key width (key range) in proportion to the number of key rings. . For example, when only one key ring is selected, the key width is set to 3 degrees, for example, and when three key rings are selected, the key width is changed to 9 degrees. This is because if the filtering is executed with a certain search condition every time the key ring is increased, the number of display candidates to be displayed inside the ring may become extremely small, and it may be slightly off the key. This is because the user may lose sight of the originally desired information without browsing display.

  As shown in FIGS. 3A to 3G, the image information filtered by the key determined based on the rotation amount of the key ring 30 in the circumferential direction is sequentially displayed inside the key ring as the key ring rotates. The arrangement of a plurality of pieces of image information, that is, the display position and display size of each piece of image information is determined by one-dimensional information arranged by weighting with keys and their priorities. The display image information is arranged concentrically from the inside (preferably near the center of the concentric circle) to the outside, and the display size of the information is inversely proportional to the distance from the center. In the present embodiment, even if a large number of candidates are obtained, all the information filtered by the key is displayed as long as the number is within a predetermined display maximum threshold value (described later). . Thus, the user can intuitively grasp how many candidates are obtained, and can specify another key when there are too many candidates. When a large number of candidates are obtained in this way, each piece of information is displayed very small. In this embodiment, the displayed information (for example, 30a1 to 30a7 in FIG. 3) is displayed. When the cursor is moved, the information is enlarged and displayed, and the user can visually recognize the content of the information.

(3) Details of Image Information Retrieval Display Processing in the Present Embodiment Hereinafter, details of the information retrieval display processing according to the present embodiment will be described using a search for a free material on a Web page as an example. In the following example, the case where the search target is an image file and the search attribute is a cyclic continuous amount will be mainly described. However, information that can be the search display target in the present embodiment is originally limited to the image file. Needless to say, as a search attribute, any of a non-circular continuous quantity and a discrete quantity can be used in addition to a cyclic continuous quantity.

(3-1) Definition of Image Attributes First, the attribute definition information 16 for the attribute that is a key and the image attribute database 18 of the image information that is a search target are defined.

  In an image, the most important element is a color, and an RGB Color Model is generally used. In this embodiment, one color is expressed by the intensity of the basic colors of Red, Green, and Blue. However, in the present embodiment, the HSB Color Model (Hue-Hue, Saturation-Saturation, Brightness) is more natural for human beings. -Brightness) was adopted.

  A system was constructed using this HSB Color Model. Hue, lightness, and saturation have been redesigned to make it more intuitive and easy to understand, with new search attributes “color”, “atmosphere”, “aspect ratio” Created "size". The search attribute can be created with an arbitrary key, and hue, brightness, and saturation may be directly used as a search key. The search attribute “color” is calculated from the hue and brightness in the HSB model, “atmosphere” is calculated from the brightness and saturation, “aspect ratio” is calculated from the width and height of the image, and “size” is the image Calculated from size.

<Color attribute>
FIG. 6 shows a procedure for determining feature colors in each image. First, the RGB (Red, Green, Blue) space is divided into 51 × 51 × 51 (step S81), and each pixel is registered in the corresponding divided space (step S81). Then, the average RGB value in the divided space having the largest number of pixels is set as the characteristic color of the image.

In the present embodiment, it is possible to specify a plurality of characteristic colors. For example, in the image attribute table shown in FIG. 5, the “color” of the file name “1.gif” is 1.13386693 and 0.9375. As described above, color attribute values are defined for two characteristic colors for each image file. In the present embodiment, a color that does not belong to the same color as much as possible is selected as the next feature color so that the feature colors are not similar except for a flat image. First, after the second color, the average RGB value of the divided space to which the next most pixels belong is selected. Here, Table 1 is used.

Table 1 shows as an example what range a human recognizes as the same color.

  In FIG. 6, next, the average RGB value (c) of the divided space (s) in which the most pixels are registered is selected (step S83), and does not match the feature color previously selected in Table 1 (Step S84N), this average RGB value (c) is used as a characteristic color. Then, it returns to step S83 and you may select a characteristic color further. On the other hand, if the feature color matches the previously selected feature color in Table 1 (step S84Y), the next pixel is registered as long as the divided space in which the pixel is registered remains (steps S85Y and S86). The average RGB value (c) of the divided space (s) is selected (step S83), and then the processing from step S84 to step S88 is repeated.

Note that conversion from RGB values to HSB is performed by the following equations (1.1 to 1.8). Here, the values of the three primary colors in the RGB space are r, g, b (0 ≦ r, g, b ≦ 1), and the values of the three elements in the HSB space are H, S, and B, respectively.

Referring to FIG. 5 again, FIG. 5 shows an example of the definition contents of the image attribute database 18 in the present embodiment. Since the hue in HSB does not include black or white, it is difficult for a novice user to use it as a search key. Therefore, in this embodiment, for example, as shown on the left side of the “color” key ring 40 in FIG. did. The color C in the present embodiment has RGB values of characteristic colors as r, g, b (0 ≦ r, g, b ≦ 255), and HSB values as H, S, B (0 ≦ H, S, B ≦ 1). Then, it is calculated | required by the following formula | equation (1.9).

<Atmosphere attributes>
Moreover, the atmosphere M is calculated | required with the following formula | equation.

<Size and aspect ratio attributes>
As the size, the size of the image file is represented by the number of bytes. Also, the aspect ratio V can be obtained by the following equation where the height of the image is H and the width is W.

  By using the aspect ratio, a horizontally long background image can be easily searched. Further, when the size is used, filtering can be performed under the condition of a light image.

  Along with the definition in the image attribute database 18, for each search attribute, the attribute definition information 16, the search attribute name, the maximum and minimum values of the key, and the attribute type (circular continuous quantity, non-circular continuous quantity, discrete The display color when the search attribute is displayed on the categorization 20 is defined.

  In addition, by referring to the search attribute name and the maximum value and the minimum value of the key in the attribute definition information 16 in the information search display device 1 according to the present embodiment, the key ring 30 corresponding to each search attribute name is automatically set. In addition, a key ring generating unit that generates the keys on the key ring 30 in the circumferential direction, that is, in a ring shape may be provided.

(3-2) Extraction Processing of Key Value FIGS. 4, 6 to 9 are examples of programs stored in a ROM or the like as software for executing image information search / display processing according to the present embodiment. It is a flowchart which shows the flow. This program is described in a language such as Java (registered trademark), for example, and the CPU executes image search and browsing display processing according to this program (for example, applet). However, the language or method for describing the program for executing the image information search / display processing according to the present embodiment is not limited to this, and may be described using a high-level language such as C, C ++, or the like. The RAM stores a search key designated and input from the input unit 2, operation type, status information 17 and the like, and a part thereof is used as a display memory.

  In FIG. 4, the input control unit 11 first detects an operation performed by an instruction unit such as a mouse (step S10). If the detected operation is a key ring priority change (for example, by a right click on the key ring), the designated ring is detected (step S11), and the current priority of the key ring is detected and changed ( For example, the priority is incremented by 1) (step S12), and the changed priority of the ring is updated and output to the state information 17 (step S19). If the detected operation is addition of a key ring (for example, a click near the search attribute display location of categorization), the specified search attribute is detected (step S13), and the priority of the key ring corresponding to the search attribute is detected. Degree (step S14), the current center value of the key (for example, the value of the position at 6 o'clock in the key ring) is detected (step S16), the key ring identifier and priority, and the key center value are displayed in the state information 17 Is updated and output (step S19). When the detected operation is rotation of the key ring (for example, wheel rotation of the key ring), the specified key ring is detected (step S15), and the current center value of the key (for example, the position of the clock at 6 o'clock in the key ring) Value) is detected (step S16), and the center value of the key of the key ring is updated and output to the state information 17 (step S19). If the detected operation is deletion of the key ring (for example, an operation of clicking the key ring), the specified key ring is detected (step S17), and the priority of the key ring corresponding to the search attribute is detected (step S17). S14) The current center value of the key (for example, the position value at 6 o'clock in the key ring) is detected (step S16), and the data in the status information 17 regarding the identifier of the ring is deleted (step S19).

(3-3) Display Candidate Extraction Processing In FIG. 7, the candidate extraction unit 12 first selects one key ring to be processed (step S20). If the search attribute set for the selected key ring is a continuous amount (step S21Y), as described above, the width of the key (for example, one ring is displayed according to the number of displayed key rings). 3 degrees and 6 degrees if 2) (step S22). If the search attribute is a continuous amount, after setting the key width, if the search attribute is a discrete amount, the key width is not determined, and the image attribute database 18 is searched using the determined key as a search condition (step S23). The image candidate matching the key is registered in a primary storage memory such as a RAM (step S24). Thereafter, the ring displayed other than the key ring that was the processing target is set as the next processing target, and the processing from step S20 to S24 is repeated (step S25). Note that the processing from step S21 to S24 may be executed in parallel for all the displayed rings, and in this case, the processing of steps S20 and S25 in FIG. 7 is omitted. Finally, when a plurality of keys are designated, candidates with the same number of key rings and the number of registrations are extracted, and candidates that match all the keys are output as a result of the AND search (step S26).

  Note that the flowchart shown in FIG. 7 is an example in which the candidate extraction unit 12 outputs a result of searching all keys with an AND condition (logical product of all keys) when a plurality of search attributes are designated. However, the candidate extraction process in the present embodiment is not limited to this. Depending on the type of search attribute, all keys or some of the keys may be searched with an OR condition (logical sum). For example, when the search key is a discrete quantity, terms with similar concepts etc. Storage means such as a database for storing a dictionary that describes the relation of the search, and by referring to this dictionary, a similar term group is extracted, and a logical sum of these terms and the search key is used to obtain a new search condition. May be generated.

(3-4) Candidate Weight Determination Processing Next, in the present embodiment, when an image is displayed, the arrangement on the display device is determined based on the weighting based on the key and its priority. As described above, the key can be set as follows, for example.

  • For discrete quantities, use the value at the bottom of the ring.

  ・ In the case of continuous quantity, use a value in the range of 5 degrees, 2 degrees from the bottom of the ring.

  ・ When multiple keys are specified, the number of rings and the key angle are proportional to each other only for continuous amounts.

  In FIG. 8, when there are a plurality of displayed key rings (step S41Y), the search processing unit 14 determines a weight W for each ring (step S42). When the number of displayed key rings is one (that is, when there is one search key) (step S41N), the weight W for the ring is set to 1 (step S43). Next, one candidate extracted by the candidate extraction unit 12 is selected, and the weight wgt of the candidate is set to 0 (step S44). Next, for the candidate image information, for each attribute defined in the table in the image attribute database 18 (step S45), the key center value determined at the 6 o'clock position of the key ring in FIG. And a distance d from the attribute value defined for the candidate (step S46). Next, d * w is added to wgt (step S47). The processing from step S45 to S47 is repeated for all the attributes of the candidate (step S48), and then the processing from step S45 to step S48 is repeated until the weight wgt is calculated for all candidates (step S49). ).

That is, the number of key rings is k, the lower value of the j-th ring from the outside is k _j , the value for one degree in a certain key ring R _j is d _j , and the value for the key ring j in a certain image Img _i is d _{i, j.} Then, the weight W _{i of} Img _i can be expressed by the following equation.

  In this embodiment, the key weight arranged on the outer key ring is increased based on the knowledge that the more important search key is selected earlier, but the key arranged on the inner key ring is reversed. The weight of can also be increased. In this case, what is necessary is just to delete-of the right side of said Formula (2).

(3-5) Arrangement Determination Processing on Candidate Display In this embodiment, concentric circles from the inner side to the outer side (circumferential direction) of the ring in order from the candidate having the largest weight wgt calculated by the weight determination processing. And the size of each candidate image is displayed as a size having a reduction ratio that is inversely proportional to the distance from the center. That is, the weight wgt is a score (relevance) calculated by summing up the relevance between the attribute value defined for each candidate and the search key for each search attribute and taking into account the weight w of the keyring corresponding to the search attribute. This means that the user can easily and intuitively view in order from the candidate matched by the search key by displaying the large score in the center of the display screen and in large order. Further, since the adjacent candidate images are similar images in which attribute values similar to each other are defined, the similarity can be grasped by the display position of the images.

  In FIG. 9, the output control unit 15 sorts all candidates by their wgt (step S51). If the total number of candidates extracted by the candidate extraction unit 13 is larger than the predetermined display upper limit number (step S52Y), the number of candidates is further reduced to the display upper limit number (step S53). The display upper limit number may be any number that a normal user can see on the display device, and is set to 250, for example. Next, based on the obtained number of candidates, the display width of each candidate (image) is determined (step S54), and the display position is determined (step S55).

  FIG. 10 shows a method for determining the display width and display position of each candidate in the present embodiment. In FIG. 10, O is the center of the circle, R is the radius of the candidate display area, w is the width of the center image (30a1 to 7 in FIG. 3), m is the width of the outermost image, and a is between the adjacent images in the radial direction. Each white space. The image width changes by a as it is arranged on the outer side from the 0th lap, 1, 2,. The display width of each image is w = m + na (0th lap), w−a = m + (n−1) a (first lap), w−2a = m + (n−2) a (second lap), ... w-na = m (n-th cycle).

From the concentric circle center O, the 0th, 1st,.

From these two formulas,

It becomes.

The display position r _i in the i-th cycle is the distance r _i between the center point of the image and O in the i-th week, and is defined by the following equation.

The number c of images arranged on the concentric circle in the i-th circle (center 0-th) is defined by the following equation and arranged in a honeycomb shape.

The center point (x, y) of the j-th image in the i week is defined by the following equation.

(3-6) Enlarged Display Processing When the cursor approaches the browsing display image in the candidate control unit 13, the position information of the cursor and the image identifier (image file name may be used) of the image displayed in the vicinity of the position are displayed. Based on this, the image is enlarged and redisplayed. In this enlarged display, the reduced display rate may be set to 1, and the current image may be displayed as it is, or may be enlarged at a predetermined magnification. By visually recognizing the enlarged display image, it is possible to easily determine whether the image is a desired image. In addition to the enlarged image, the attribute value in the image attribute database may be displayed as necessary.

(4) Keyring Operation Procedure FIG. 11A shows a state in which the aspect ratio is clicked from the category ring 20 and the aspect ratio key ring 30 is displayed inside the category ring 20. The key value 301 is located in a key value area belonging to the square 302, and images 30a, 30b, 30c and the like having a currently designated key are arranged and displayed concentrically inside the ring. When the key ring 30 is rotated by the wheel and the key value 301 is moved to the vicinity of the key region belonging to the horizontally long 303, the browsing display image changes to a horizontally long shape (FIG. 11B). In the state of FIG. 11B, when a color is further clicked on the category ring 20, a color key ring 40 is displayed inside the aspect ratio key ring 30, and an image having both the aspect ratio key and the color key is displayed inside the ring. Is displayed (FIG. 11C). In the state of FIG. 11C, when “atmosphere” is further clicked on the category ring 20, the atmosphere key ring 50 is displayed inside the color key ring 40, and matches all of the aspect ratio key, color key, and atmosphere key. An image is displayed inside the ring (FIG. 11D). As more categories are selected, the number of displayed key rings increases and the number of candidates displayed for browsing decreases. When the aspect ratio key ring 30 is clicked in the state of FIG. 11D, the aspect ratio key ring 30 is deleted and the candidate search process is executed again by removing the aspect ratio from the key, so that images with various aspect ratios can be browsed. Is displayed (FIG. 11E). When the atmosphere key ring 50 is right-clicked in the state of FIG. 11E, the atmosphere ring 50 is moved and displayed outside the color ring 40, and the candidate search process is executed again by increasing the weight of the atmosphere key. The image as the main search key is displayed by browsing (FIG. 11F).

  FIG. 12 is a block diagram showing the configuration of the image search / display apparatus according to this embodiment. In the image search / display apparatus 100, which is a computer apparatus shown in FIG. 12, the CPU 101 controls the entire system using the RAM 105 as a work memory for primary storage in accordance with a program stored in the ROM 104 and / or the hard disk drive 106. . Further, the CPU 101 executes image search and display processing according to the present embodiment based on a program stored in the hard disk drive 106 in accordance with a user instruction input via the mouse 102 a or the keyboard 102. A display such as a CRT or LCD is connected to the display interface 103, and an input standby screen for image search display processing executed by the CPU 101, processing progress, search results, and the like are displayed. The removable media drive 107 is mainly used when writing a file from the removable medium to the hard disk drive 106 or writing a file read from the hard disk drive 106 to the removable medium. Removable media include floppy disk (FD), CD-ROM, CD-R, CD-R / W, DVD-ROM, DVD-R, DVD-R / W, DVD-RAM and MO, memory card, CF Cards, smart media, SD cards, memory sticks, etc. can be used.

A printer such as a laser beam printer or an ink jet printer is connected to the printer interface 108. The network interface 109 is an interface for connecting a computer device to the network 12.

  Note that the input unit 2 in the image search and display apparatus according to the present embodiment is not limited to the mouse 102a or the keyboard 102, and any pointing device such as a trackball, a trackpad, or a tablet can be used as appropriate. When the portable information terminal is used as the image search / display device according to the present embodiment, the input unit 2 may be configured with a button, a mode dial, or the like.

  Further, the hardware configuration of the image search and display apparatus according to the present embodiment shown in FIG. 12 is merely an example, and it is needless to say that any other hardware configuration can be used.

  In particular, the image search and display processing according to the present embodiment may be realized by the above-described computer terminal device 100 or a portable information terminal device such as a PDA, and the computer terminal device and the server device are connected to Bluetooth (registered trademark) or the like. Internet or any well-known local area network (LAN) interconnected by wired communication lines such as the Internet or the Internet (TCP / IP), public telephone network (PSTN), integrated services digital network (ISDN), etc. Alternatively, it may be realized by a network system composed of a wide area network (WAN). When the image search / display processing according to the present embodiment is realized by a system in which a terminal device and a server device are connected, for example, storage and storage of image information and / or image attribute database, and search processing for these are performed on the server device. A client device equipped with a Web browser may execute only an instruction input for information search from a user and a browsing process of a search result. Alternatively, a portal site program operating on the server device may execute all or part of the image search / display processing according to the present embodiment.

  Using a form on a Web browser running on the computer terminal device 100, the user can transmit data such as search conditions to the server device. Alternatively, an applet such as a Java (registered trademark) applet describing all or part of the image search / display processing according to the present embodiment is downloaded from a server device to a web browser via a network and embedded in a browser window. Can be executed.

  As described above, according to the present embodiment, the search condition for searching for desired information is continuous or discrete through a single graphical user interface (GUI) in which search and browsing are integrated. Regardless of the amount, it is possible to easily set a search condition for information such as a desired image by a continuous (seamless) operation. Furthermore, in both the search condition setting and the search result display output, the user can intuitively and easily select a desired search result while visually recognizing the current search condition. Therefore, it is advantageous in that an intuitive and easy-to-understand search display interface can be provided especially for users who do not have special knowledge about image processing.

The scope of the present invention is not limited to the illustrated and described exemplary embodiments, but includes all embodiments that provide the same effects as those intended by the present invention. Further, the scope of the present invention is not limited to the combination of features of the invention defined by claim 1 but can be defined by any desired combination of specific features among all the disclosed features. .

It is a functional block diagram which shows the structure of the image information search display apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of the search initial screen displayed on the image information search display apparatus which concerns on one Embodiment of this invention. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is rotated. It is a flowchart which shows an example of the process sequence which the input control part in the image information search display apparatus which concerns on one Embodiment of this invention performs. It is a figure which shows an example of the image attribute information stored in the image attribute database in the image information search display apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the characteristic color determination processing procedure in the image attribute information definition of one Embodiment of this invention. It is a flowchart which shows an example of the process sequence which the candidate extraction part in the image information search display apparatus which concerns on one Embodiment of this invention performs. It is a flowchart which shows an example of the process sequence which the search process part in the image information search display apparatus which concerns on one Embodiment of this invention performs. It is a flowchart which shows an example of the process sequence which the output control part in the image information search display apparatus which concerns on one Embodiment of this invention performs. It is a figure explaining an example of the arrangement | positioning determination process on the display of the image information which the output control part in the image information search display apparatus which concerns on one Embodiment of this invention performs. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is variously operated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is variously operated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is variously operated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is variously operated. In the image information search and display device according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when the key ring is variously operated. In the image information search and display apparatus according to an embodiment of the present invention, it is a diagram showing the transition of the search result display when various keyrings are operated. It is a figure which shows an example of the hardware constitutions of the image information search display apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of the search display screen which the information search process using the slide bar in a prior art provides.

Claims (19)

One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction A key ring arrangement for displaying and outputting the key ring
A key ring selection unit that selects one of the key rings in accordance with an operation input from an input device;
A key ring rotating unit that independently rotates each key ring clockwise or counterclockwise according to an operation input from the input device, while maintaining a relative position on the circumference of each search key on the selected key ring;
A search key determination unit that determines a search key for information search based on a circumferential rotation amount of the key ring from a predetermined position on the key ring;
A search result display unit that sequentially displays and outputs search results executed using the selected search category and the determined search key inside the key ring as the key ring rotates. Information retrieval display device. The information search and display device further includes:
A categorization display unit that displays and outputs categorization in which identifiers of search categories indicated by the ring are arranged in a circumferential direction;
A search category selection unit that selects one of the identifiers of search categories arranged in the categorization according to an operation input from an input device;
In response to selection of an identifier of a search category on the categorization by the search category selection unit, the key ring arrangement unit displays and outputs a key ring corresponding to the selected search category inside a concentric circle of the categorization. The information search / display apparatus according to claim 1. When a plurality of search categories are selected by the search category selection unit, the key ring arrangement unit displays and outputs a key ring corresponding to the selected search category inside a concentric circle of the displayed key ring. The information search and display device according to claim 2. The information search and display device further includes:
By referring to the search category identifier and the maximum and minimum values of the key defined for each search category, a key ring corresponding to each search category is generated and the search key is arranged in the circumferential direction on the key ring. The information search and display device according to claim 1, further comprising a key ring generation unit. When a plurality of search categories are selected by the search category selection unit, the search key determination unit determines a priority in searching for a corresponding search category based on the order of key rings displayed concentrically. 5. The information search and display device according to claim 1, wherein The information search and display device further includes:
In accordance with an operation input from an input device, the priority assigned to the instructed key ring is changed, and a priority order changing unit that re-displays the key ring at a position corresponding to the changed priority order is provided. The information search and display device according to claim 5. The search key determination unit is configured so that the search key arranged in the selected key ring has a discrete amount and a continuous amount, and a rotation amount of the key ring in a circumferential direction from a predetermined position predetermined on the key ring. The information search display device according to claim 1, wherein a search key for information search is determined based on the information. One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction A search key determination unit for determining a search key for information search based on the amount of rotation of the displayed key ring in the circumferential direction;
A weight calculating unit that calculates a weight for each search result obtained in the search execution based on the priority given to the rotated key ring and the determined search key;
In order from the calculated search results with a large weight, a search result arrangement unit that arranges concentrically from the vicinity of the center of the displayed key ring toward the circumferential direction,
An information search and display device comprising: a search result display unit that sequentially displays and outputs the arranged search results inside the key ring as the key ring rotates. The search result arrangement unit determines the size at the time of display output of each search result so that the reduction rate is in inverse proportion to the distance from the center of the concentric circle in order from the search result with the largest weight. Item 9. The information search and display device according to Item 8. The information search display device according to claim 8 or 9, wherein the search result display unit enlarges and redisplays the search result in response to the proximity of the cursor to the displayed search result. One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction A search key determination unit for determining a search key for information search based on the amount of rotation of the displayed key ring in the circumferential direction;
A search unit that executes a search using the selected search category and the determined search key, and obtains a search result to be sequentially displayed inside the key ring as the key ring rotates. Information retrieval device. When the determined search key is a continuous amount, the search unit redefines a search key group close to a predetermined range as the determined search key as a search key for information search, and the selected search The information search apparatus according to claim 11, wherein a search is executed using a category and the redefined search key. The information search device according to claim 11 or 12, wherein, when a plurality of search keys are determined, the search unit executes a search using a logical product of the plurality of search keys. An information search and display method executed by an information search and display device including a key ring arrangement unit, a key ring selection unit, a key ring rotation unit, a search key determination unit, and a search result display unit,
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction Displaying and outputting the key ring
Selecting one of the key rings according to an operation input from an input device;
Rotating each key ring independently clockwise or counterclockwise according to an operation input from the input device, while maintaining the relative position on the circumference of each search key on the selected key ring;
Determining a search key for information search based on a circumferential rotation amount of the key ring from a predetermined position on the key ring;
And a step of sequentially displaying and outputting a search result executed by using the selected search category and the determined search key inside the key ring as the key ring rotates. . An information search and display method executed by an information search and display device comprising a search key determination unit, a weight calculation unit, a search result arrangement unit, and a search result display unit,
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction Determining a search key for information search based on a circumferential rotation amount of the key ring displayed and output;
Calculating a weight for each search result obtained in the search execution based on the priority assigned to the rotated key ring and the determined search key;
In order from the calculated search results with a large weight, arranging the concentric circles in the circumferential direction from the inner center vicinity of the displayed key ring;
And a step of sequentially displaying and outputting the arranged search results inside the key ring as the key ring rotates. An information search method comprising a search key determination unit and a search unit,
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction Determining a search key for information search based on a circumferential rotation amount of the key ring displayed and output;
Performing a search using the selected search category and the determined search key, and obtaining a search result to be sequentially displayed inside the key ring as the key ring rotates. Method. An information search / display processing program for causing a computer to execute information search / display processing, wherein the program
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction A key ring arrangement process for displaying and outputting the generated key ring;
A key ring selection process for selecting one of the key rings in accordance with an operation input from an input device;
A key ring rotation process for independently rotating each key ring clockwise or counterclockwise according to an operation input from the input device, while maintaining a relative position on the circumference of each search key on the selected key ring;
A search key determination process for determining a search key for information search based on a rotation amount of the key ring in a circumferential direction from a predetermined position on the key ring;
A search result display process that sequentially displays and outputs a search result executed using the selected search category and the determined search key inside the key ring as the key ring rotates. An information search and display program characterized by being a thing. An information search / display processing program for causing a computer to execute information search / display processing, wherein the program
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction A search key determination process for determining a search key for information search based on the amount of rotation in the circumferential direction of the key ring displayed and output;
A weight calculation process for calculating a weight for each search result obtained in the search execution based on the priority given to the rotated key ring and the determined search key;
A search result arrangement process that arranges concentrically from the vicinity of the inner center of the displayed key ring in the circumferential direction in order from the calculated search result having the larger weight,
An information search and display program for executing a process including a search result display process for sequentially displaying and outputting the arranged search results inside the key ring as the key ring rotates. An information search processing program for causing a computer to execute information search processing, wherein the program
One or a plurality of key rings provided for each search category for information search and arranged concentrically on the display screen, and continuous or discrete search keys are arranged on the key ring in the circumferential direction A search key determination process for determining a search key for information search based on the amount of rotation in the circumferential direction of the key ring displayed and output;
A search process that executes a search using the selected search category and the determined search key, and obtains a search result to be sequentially displayed inside the key ring as the key ring rotates. An information retrieval program characterized by being a thing.