JP2005275738A - Image search system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image retrieval system that achieves both reliability and randomness when retrieving image data.
An image search system searches and inputs a data storage unit storing image data, time information of the image data, and additional information of the image data, and the data storage unit. The image data that most closely matches the search condition is found and displayed as a central image in the center of the display unit. The central image search unit and the data storage unit are searched and time information of the image data displayed as the central image The image data having continuous time information is found and displayed in a first direction centered on the central image of the display unit. The first image search unit and the data storage unit are searched for as the central image. Image data having additional information similar to the additional information of the displayed image data is found and displayed side by side in the second direction centering on the central image of the display unit. And a second image search unit.
[Selection] Figure 2

Description

  The present invention relates to an image search system, and more particularly to an image search system capable of searching image data having both certainty and randomness.

  With the spread of digital cameras and image scanners, users are increasingly handling large amounts of image data. That is, it is increasing that a plurality of image data is stored in an image search system such as a computer having a hard disk and the user searches the hard disk as necessary.

  In this way, when searching for image data stored in the hard disk to find a target image, the search is often performed based on time information such as a date taken by a digital camera. That is, the date and time taken by the user are input to the computer, and the computer extracts the corresponding image data based on the time information attached to the image data. This time information may not be the date and time when the image was taken, but the date and time when the image data was saved.

In some cases, text information such as a user's comment or impression is held as additional information along with the image data. Japanese Patent Laying-Open No. 2003-6227 (Patent Document 1) discloses an image search system that searches image data based on such additional information.
JP 2003-6227 A

  When searching for image data based on the time information as described above, although there is certainty in the search result, the user needs to input the time information accurately to the image search system, and the user must accurately input the time information. If you don't remember, there was a problem that you couldn't find the target image.

  Further, when searching for image data based on additional information, there is a possibility that the target image data can be found even if there is an accidental search result and even when accurate time information and character information are not remembered. On the contrary, there is a possibility that the target image data cannot be found no matter how many times the search is performed.

  That is, in the conventional image search system, only the certainty or randomness is the main focus, and there is no one that makes both compatible.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide an image search system that achieves both reliability and randomness when searching for image data.

In order to solve the above problems, an image search system according to the present invention includes:
A data storage unit storing image data, time information of the image data, and additional information of the image data;
Search the data storage unit, find the image data that best matches the input search conditions, and display as a central image in the center of the display unit, a central image search unit,
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. A first image search unit;
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. A second image search unit;
It is characterized by providing.

  In this case, the data storage unit is searched to find image data having time information continuous to the time information of the image data found by the second direction image search unit, and the second direction image search unit of the display unit A third image search unit may be further provided that displays the image of the image data found by the image data arranged in the first direction.

In this case, when an input for moving an image other than the central image among the images displayed on the display unit to the center of the display unit is made, an image that has been input to move to the center Is further provided with a central image moving unit for displaying as a central image in the display unit,
The first image search unit, the second image search unit, and the third image search unit search the data storage unit again based on the new central image displayed by the central image moving unit, An image may be displayed on the display unit.

  The input search condition may be time information, and the central image search unit may display an image of image data having time information closest to the input time information as the central image.

  The input search condition may be a keyword, and the central image search unit may display an image of image data having additional information closest to the input keyword as the central image.

  The first direction may be one of a horizontal direction and a vertical direction of the display unit, and the second direction may be the other of the horizontal direction and the vertical direction of the display unit.

The control method of the image search system according to the present invention includes:
A control method for an image search system having a data storage unit, in which image data, time information of the image data, and additional information of the image data are stored,
Searching the data storage unit, finding image data that best matches the input search condition, and displaying it as a central image in the center of the display unit;
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. Steps,
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. Steps,
It is characterized by providing.

The program according to the present invention is:
In an image search system having a data storage unit in which image data, time information of the image data, and additional information of the image data are stored,
Searching the data storage unit, finding image data that best matches the input search condition, and displaying it as a central image in the center of the display unit;
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. Steps,
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. Steps,
Is executed.

The recording medium according to the present invention is
In an image search system having a data storage unit in which image data, time information of the image data, and additional information of the image data are stored,
Searching the data storage unit, finding image data that best matches the input search condition, and displaying it as a central image in the center of the display unit;
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. Steps,
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. Steps,
A program for executing is recorded.

[First Embodiment]
When searching for image data, the image search system according to the present embodiment arranges the image data detected based on the time information and the additional information in a matrix on the display unit, thereby ensuring certainty and chance. The present invention provides an image data search method that combines the above. More details will be described below.

  FIG. 1 is a block diagram illustrating a configuration of an image search system 10 according to the present embodiment. The image search system 10 includes, for example, a computer, a small image storage / display device, a mobile phone, a DVD player, and the like. As shown in FIG. 1, the image search system 10 according to this embodiment includes a search execution unit 12, a display unit 14, an input unit 16, and a data storage unit 18.

  When the user searches for image data, a search condition is input from the input unit 14. In the present embodiment, the input unit 14 includes a pointing device such as a mouse and a keyboard. The data storage unit 18 holds a plurality of image data, time information of this image data, and additional information. The time information is, for example, the date and time when the image was taken with a digital camera, or the date and time when the image data was stored in the data storage unit 18. The additional information is character information such as comments and impressions input by the user with respect to the image data. Note that the time information and the additional information may be held separately from the image data, or may be held as one piece of data integrated with the image data. In the present embodiment, the data storage unit 18 in which these pieces of information are stored is configured from a hard disk.

  The search execution unit 12 searches the data storage unit 18 based on the input search condition, and finds image data that matches the search condition. In this embodiment, this search execution part 12 is comprised from hardware devices, such as ASIC. Then, the display unit 14 displays the found image data. In the present embodiment, the display unit 14 includes a CRT or a liquid crystal display device.

  FIG. 2 is a block diagram illustrating the internal configuration of the search execution unit 12. As shown in FIG. 2, the search execution unit 12 includes a central image search unit 30, a horizontal image search unit 32, and a vertical image search unit 34.

  First, an operation when the user inputs time information from the input unit 16 as a search condition will be described. When time information (for example, 13:45 on February 25, 2004) is input as a search condition, the central image search unit 30 has time information closest to the input time information from the data storage unit 18. Image data is found and displayed as a central image IM1 in the center of the display unit 14 (FIG. 3).

  Next, the horizontal image search unit 32 searches for image data to be displayed in the horizontal direction of the central image IM1 found by the search by the central image search unit 30. In the present embodiment, the horizontal image search unit 32 searches the data storage unit 18 to find image data in which the time information is continuous with the central image IM1 and the image data IM2 in the horizontal direction of the central image IM1 on the display unit 14. , IM3 are displayed side by side (FIG. 4).

  In the example of FIG. 4, on the left side of the central image IM1, an image of image data that is older than the time information of the central image IM1 and has the closest time information is displayed. On the other hand, on the right side of the central image IM1, an image of image data that is newer than the time information of the central image IM1 and has the closest time information is displayed.

  Next, the vertical image search unit 34 searches for image data to be displayed in the vertical direction of the central image IM1 searched and found by the central image search unit 30. In the present embodiment, the vertical image search unit 34 searches the data storage unit 18 to find image data having additional information similar to the additional information of the central image IM1, and in the display unit 14 in the vertical direction of the central image IM1. Images IM4 and IM5 are displayed side by side (FIG. 5).

  In the example of FIG. 5, an image of image data that is older than the time information of the central image IM1 and has the closest additional information is displayed on the upper side of the central image IM1. On the other hand, below the center image IM1, an image of image data that is newer than the time information of the center image IM1 and has the closest additional information is displayed.

  Next, the horizontal image search unit 32 searches for image data to be displayed in the horizontal direction of the images IM4 and IM5 found by the vertical image search unit 34. In the present embodiment, the horizontal image search unit 32 searches the data storage unit 18 to find image data in which the time information is continuous with the images IM4 and IM5, and in the display unit 14 in the horizontal direction of the images IM4 and IM5. These images are displayed side by side as images IM6 and IM7 and images IM8 and IM9, respectively (FIG. 6).

  In the example of FIG. 6, an image of image data that is older than the time information of the image IM4 and has the time information closest to the time information of the image IM4 is displayed on the left side of the image IM4. On the other hand, on the right side of the image IM4, an image of image data that is newer than the time information of the image IM4 and has the time information closest to the time information of the image IM4 is displayed.

  Further, on the left side of the image IM5, an image of image data that is older than the time information of the image IM5 and has time information closest to the time information of the image IM5 is displayed. On the other hand, on the right side of the image IM5, an image of image data that is newer than the time information of the image IM5 and has the time information closest to the time information of the image IM5 is displayed.

  Next, an operation when the user inputs a search keyword as a search condition from the input unit 16 will be described. When a keyword (for example, “daughter event”) is input as a search condition, the central image search unit 30 finds image data having additional information closest to the input keyword from the data storage unit 18 and displays it. A central image IM1 is displayed at the center of the unit 14 (FIG. 7).

  Next, the vertical image search unit 34 searches for image data to be displayed in the vertical direction of the central image IM1 searched by the central image search unit 30. In the present embodiment, the vertical image search unit 34 searches the data storage unit 18 to find image data having additional information similar to the additional information included in the image data of the central image. The images IM2 and IM3 are displayed side by side in the vertical direction (FIG. 8).

  In the example of FIG. 8, on the upper side of the central image IM1, an image of image data that is older than the time information of the central image IM1 and has additional information similar to the additional information of the central image is displayed. On the other hand, below the central image IM1, an image of image data that is newer than the time information of the central image IM1 and has additional information similar to the additional information of the central image is displayed. For example, in the example of FIG. 8, the additional information associated with the image IM2 is “event” and “the daughter of President XX”, and the additional information associated with the image IM3 is “event” and “district athletic meet”. , “Daughter”, “competition”.

  Next, the horizontal image search unit 32 searches for image data to be displayed in the horizontal direction of the central image IM1 found by the search by the central image search unit 30. In the present embodiment, the horizontal image search unit 32 searches the data storage unit 18 to find image data in which the time information is continuous with the central image IM1, and the display unit 14 displays the image IM4 in the horizontal direction of the central image IM1. , IM5 are displayed side by side (FIG. 9).

  In the example of FIG. 9, an image of image data that is older than the time information of the center image IM1 and has the closest time information is displayed on the left side of the center image IM1. On the other hand, on the right side of the central image IM1, an image of image data that is newer than the time information of the central image IM1 and has the closest time information is displayed.

  Next, the horizontal image search unit 32 searches for image data to be displayed in the horizontal direction of the images IM2 and IM3 found by the vertical image search unit 34. In the present embodiment, the horizontal image search unit 32 searches the data storage unit 18 to find image data in which the time information is continuous with the images IM2 and IM3, and in the display unit 14 in the horizontal direction of the images IM2 and IM3. These images are displayed side by side as images IM6 and IM7 and images IM8 and IM9, respectively (FIG. 10).

  In the example of FIG. 10, on the left side of the image IM2, an image of image data that is older than the time information of the image IM2 and has time information closest to the time information of the image IM2 is displayed. On the other hand, on the right side of the image IM2, an image of image data that is newer than the time information of the image IM2 and has the time information closest to the time information of the image IM2 is displayed.

  Furthermore, on the left side of the image IM3, an image of image data that is older than the time information of the image IM3 and has time information closest to the time information of the image IM3 is displayed. On the other hand, on the right side of the image IM3, an image of image data that is newer than the time information of the image IM3 and has the time information closest to the time information of the image IM3 is displayed.

  As described above, according to the image search system 10 according to the present embodiment, when the user inputs time information as a search condition, an image of image data having time information closest to the input time information is In addition to being displayed at the center of the display unit 14, images are displayed side by side in the horizontal direction in time series with the image at the center as the center. In addition, images of image data having additional information similar to the additional information accompanying the central image are displayed side by side in the vertical direction centering on the central image, and time-series centering on the images displayed above and below The images are displayed side by side in the horizontal direction.

  On the other hand, when the user inputs a keyword as a search condition, an image of image data having additional information closest to the input keyword is displayed at the center of the display unit 14 and the center image is the center. Images are displayed side by side in the horizontal direction in time series. In addition, images of image data having additional information similar to the additional information accompanying the central image are displayed side by side in the vertical direction centering on the central image, and time-series centering on the images displayed above and below The images are displayed side by side in the horizontal direction.

  For this reason, when the time information of the image data that the user wants to search is input correctly or when the keyword of the image that the user wants to search is input correctly, the target image can be displayed at the center of the display unit 14. it can. Even when time information and keywords cannot be input correctly, a plurality of images combining the time information time series and the similarity of the additional information are displayed on the display unit 14 in a matrix form. A target image can be found from images displayed in a matrix on the display unit 14. In other words, according to the present embodiment, it is possible to provide the image search system 10 that has high coincidence while maintaining high certainty in image search.

[Second Embodiment]
In the second embodiment of the present invention, a re-search function is added to the image search system 10 according to the first embodiment described above. More details will be described below.

  FIG. 11 is a block diagram illustrating an internal configuration of the search execution unit 12 according to the present embodiment. As can be seen from FIG. 11, the search execution unit 12 according to the present embodiment is configured by adding a central image moving unit 36 to the above-described first embodiment.

  FIG. 12 is a diagram illustrating an example of the display unit 12 that displays a search result when the user inputs time information as a search condition. Here, it is assumed that the user moves the image IM7 at the upper right of the screen to the center of the screen in the state of FIG.

  Such movement of the image is performed from the input unit 16 by the user. For example, the user inputs the image IM7 from the upper right of the screen to the center of the screen using a pointing device such as a mouse.

  When such image movement is input, the central image moving unit 36 displays the image IM7 moved to the center at the center of the display unit 14, as shown in FIG. Then, the horizontal image search unit 32 searches the data storage unit 18 again, and displays the previous and next images in time series with the image IM7 as the center.

  In the example of FIG. 13, an image IM4 of image data that is older than the time information of the center image IM7 and has the closest time information is displayed on the left side of the center image IM7. On the other hand, on the right side of the center image IM7, an image IM10 of image data that is newer than the time information of the center image IM7 and has the closest time information is displayed.

  Next, the vertical image search unit 34 searches for image data to be displayed in the vertical direction of the central image IM7. In the present embodiment, the vertical image search unit 34 searches the data storage unit 18 to find image data having additional information similar to the additional information of the central image IM7, and in the display unit 14 in the vertical direction of the central image IM7. The images IM11 and IM12 are displayed side by side.

  In the example of FIG. 13, an image IM11 of image data having additional information that is older than the time information of the central image IM7 and closest to the additional information of the central image IM7 is displayed above the central image IM7. On the other hand, below the central image IM7, an image IM12 of image data that is newer than the time information of the central image IM7 and has additional information closest to the additional information of the central image IM7 is displayed.

  Next, the horizontal image search unit 32 searches the image data to be displayed in the horizontal direction of the images IM11 and IM12 found by the vertical image search unit 34 searching. In the present embodiment, the horizontal image search unit 32 searches the data storage unit 18 to find image data in which the time information is continuous with the images IM11 and IM12, and in the display unit 14 in the horizontal direction of the images IM11 and IM12. Are displayed side by side as images IM13 and IM14, and images IM15 and IM16, respectively.

  In the example of FIG. 13, on the left side of the image IM11, an image IM13 of image data that is older than the time information of the image IM11 and has time information closest to the time information of the image IM11 is displayed. On the other hand, on the right side of the image IM11, an image IM14 of image data that is newer than the time information of the image IM11 and has the time information closest to the time information of the image IM11 is displayed.

  Further, on the left side of the image IM12, an image IM15 of image data that is older than the time information of the image IM12 and has time information closest to the time information of the image IM12 is displayed. On the other hand, on the right side of the image IM12, an image IM16 of image data that is newer than the time information of the image IM12 and has the time information closest to the time information of the image IM12 is displayed.

  As described above, according to the image search system 10 according to the present embodiment, since the re-search function is added to the image search system 10 of the first embodiment described above, the search having both certainty and contingency is repeated. It can be carried out. For this reason, it becomes possible to find image data that cannot be found by ordinary time information search or normal keyword search by a simple operation of moving the displayed image to the center. .

  In addition, this invention is not limited to the said embodiment, A various deformation | transformation is possible. For example, in the above-described image search system 10, a function that prevents overlapping images from being displayed on one screen may be further added. When realizing such a function, the image search system 10 (1) searches for image data in a time series in the horizontal direction after finding the central image even when a keyword is input as a search condition. Prioritize processing to postpone searching for image data similar to the keyword, and (2) image data within a predetermined range of time information from the time information of the central image is similar to the keyword displayed in the vertical direction. This can be realized by removing the image data from the target.

  In the above-described embodiment, the first direction in which images are arranged based on the time information is set to the horizontal direction, and the second direction in which images are arranged based on the additional information is set to the vertical direction. The first direction in which the images are arranged based on the vertical direction may be the vertical direction, and the second direction in which the images are arranged based on the additional information may be the horizontal direction.

  In the embodiment described above, an image is displayed on the display unit 14 in a 3 × 3 layout, but the displayed image layout is 5 × 5, 7 × 7, Other formats such as 3 × 5 may be used. In the above-described embodiment, the display state of the display unit 14 has been described step by step in order to explain the contents of the image search display process. However, the final search result screen is actually displayed in an instant. There is also.

  In addition, each process described in the above-described embodiment may be implemented by a program that is software, and the program of the image search system 10 may be read by the program. That is, a program for executing each of these processes can be recorded on a recording medium such as a flexible disk, a CD-ROM (Compact Disc-Read Only Memory), a ROM, a memory card, and distributed in the form of a recording medium. It is. In this case, the above-described embodiment can be realized by causing the image search system 10 to read and execute the recording medium on which the program is recorded.

  The image search system 10 may include other programs such as an operating system and another application program. In this case, another program provided in the image search system 10 is utilized, and an instruction for calling a program that realizes processing equivalent to the above-described embodiment from among the programs provided in the image search system 10 on the recording medium. You may make it record.

  Furthermore, such a program can be distributed not as a recording medium but as a carrier wave through a network. The program transmitted in the form of a carrier wave on the network is taken into the image search system 10, and the above-described embodiment can be realized by executing this program.

  Also, when a program is recorded on a recording medium or transmitted as a carrier wave on a network, the program may be encrypted or compressed. In this case, the image search system 10 that has read the program from these recording media or carrier waves needs to be executed after the program is decoded or expanded.

1 is a block diagram illustrating a configuration of an image search system according to a first embodiment. The block diagram explaining the internal structure of the search execution part in FIG. The figure which shows the display of the image in the display part for demonstrating the content of the image search display process (when time information is input) which concerns on 1st Embodiment (the 1). The figure which shows the display of the image in the display part for demonstrating the content of the image search display process (when time information is input) which concerns on 1st Embodiment (the 2). The figure which shows the display of the image in the display part for demonstrating the content of the image search display process (when time information is input) which concerns on 1st Embodiment (the 3). FIG. 14 is a diagram showing an image display on a display unit for explaining the content of image search display processing (when time information is input) according to the first embodiment (part 4); The figure which shows the display of the image in the display part for demonstrating the content of the image search display process (when a keyword is input) which concerns on 1st Embodiment (the 1). FIG. 6 is a diagram (part 2) illustrating image display on a display unit for explaining the contents of image search display processing (when a keyword is input) according to the first embodiment; FIG. 9 is a diagram (No. 3) illustrating display of an image on a display unit for describing the contents of image search display processing (when a keyword is input) according to the first embodiment; FIG. 14 is a diagram (No. 4) illustrating the display of an image on the display unit for describing the contents of the image search display process (when a keyword is input) according to the first embodiment; The block diagram explaining the internal structure of the search execution part which concerns on 2nd Embodiment. The figure which shows an example of input operation in which the user moves the upper right image to the center in the display part in 2nd Embodiment. The figure which shows the display state of the display part after performing re-search in 2nd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image search system 12 Search execution part 14 Display part 16 Input part 18 Data storage part 30 Central image search part 32 Horizontal direction image search part 34 Vertical direction image search part

Claims (9)

A data storage unit storing image data, time information of the image data, and additional information of the image data;
Search the data storage unit, find the image data that best matches the input search conditions, and display as a central image in the center of the display unit, a central image search unit,
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. A first image search unit;
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. A second image search unit;
An image search system comprising:   The data storage unit is searched to find image data having time information continuous to the time information of the image data found by the second direction image search unit, and the second direction image search unit of the display unit finds 2. The image search system according to claim 1, further comprising a third image search unit configured to display the image of the image data side by side in the first direction. When an input to move an image other than the central image among the images displayed on the display unit to the center of the display unit is made, the image that has been input to move to the center is displayed on the display unit. And further comprising a central image moving unit for displaying as a central image in the unit,
The first image search unit, the second image search unit, and the third image search unit search the data storage unit again based on the new central image displayed by the central image moving unit, Displaying an image on the display unit;
The image search system according to claim 2.   The input search condition is time information, and the central image search unit displays an image of image data having time information closest to the input time information as the central image. The image search system according to any one of claims 1 to 3.   The input search condition is a keyword, and the central image search unit displays an image of image data having additional information closest to the input keyword as the central image. The image search system according to claim 4.   6. The first direction is one of a horizontal direction and a vertical direction of the display unit, and the second direction is the other of a horizontal direction and a vertical direction of the display unit. The image search system according to any of the above. A control method for an image search system having a data storage unit, in which image data, time information of the image data, and additional information of the image data are stored,
Searching the data storage unit, finding image data that best matches the input search condition, and displaying it as a central image in the center of the display unit;
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. Steps,
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. Steps,
An image search system control method comprising: In an image search system having a data storage unit in which image data, time information of the image data, and additional information of the image data are stored,
Searching the data storage unit, finding image data that best matches the input search condition, and displaying it as a central image in the center of the display unit;
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. Steps,
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. Steps,
A program that executes In an image search system having a data storage unit in which image data, time information of the image data, and additional information of the image data are stored,
Searching the data storage unit, finding image data that best matches the input search condition, and displaying it as a central image in the center of the display unit;
The data storage unit is searched to find image data having time information continuous to the time information of the image data displayed as the central image, and displayed side by side in the first direction around the central image of the display unit. Steps,
The data storage unit is searched to find image data having additional information similar to the additional information of the image data displayed as the central image, and displayed side by side in the second direction around the central image of the display unit. Steps,
A recording medium on which a program for executing is recorded.

Images