JP2012023580A - Retrieved image display method and retrieved image reproduction device - Google Patents

Abstract

[PROBLEMS] To reduce a user's burden in reproducing an image retrieved from moving image data.
A retrieval image reproduction device starts reproduction of a moving image from before the current time when the retrieved image appears. By displaying information about the appearance of the searched image such as the remaining time, appearance position, and appearance size of the searched image along with the video, the searched image appears when, where, and in what size I understand. After the appearance of the searched image, information regarding the appearance of the searched image is output so as to be erased at the present time so that viewing of the moving image is not disturbed.
[Selection] Figure 1

Description

  The present invention relates to a mechanism for reproducing an image retrieved from moving image data.

  In recent years, digital video equipment using digital media such as HD (Hard Disk) and DVD (Digital Versatile Disk) is increasing. Compared with conventional analog video equipment using analog media such as videotapes, these digital equipment can easily search for video from moving image data and quickly reproduce the relevant part of the search. Here, when a moving image including the searched image is played back and viewed, since the connection from the searched image to the previous image cannot be correctly understood in the playback from the searched image, the search is performed. It is necessary to reproduce the moving image not only while the image appears but also before the searched image appears.

  Patent Document 1 discloses that a search can be performed based on a frame image arbitrarily designated by a user, and not only the designated image but also the entire scene including the designated image can be reproduced.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses that reproduction is performed slightly before the searched image.

JP 2007-20195 A (paragraph 0028, FIG. 16) JP 2003-289487 A (paragraph 0020)

  However, in the above-mentioned patent document, the user can display the corresponding image without knowing when, where, and in what size the image retrieved from the moving image reproduced from before the current retrieval of the retrieved image appears. I have to keep looking.

  Moreover, although it can recognize if the searched image is highlighted after the present appearance time of the searched image, viewing of a moving image will be disturbed.

  In view of the above problems, the present invention is configured as described in the claims as an example. In this configuration, information on the appearance of the searched image so that it can be understood when, where, and in what size the searched image appears in the moving image reproduced from before the current point of the searched image. Is displayed. In addition, after the current appearance of the searched image, the information related to the appearance of the searched image is deleted so that the viewing of the moving image is not disturbed.

  According to the present invention, a user can foresee and watch information such as the remaining time, appearance position, appearance size, etc. up to the current point in time for a moving image reproduced from before the current point of the searched image. it can. In addition, after the current appearance of the searched image, information regarding the appearance of the searched image is not displayed, and viewing of the moving image is not disturbed.

1 is a diagram illustrating a schematic configuration of a search image reproduction device 1. FIG. It is the figure which showed the example of the appearance information database 1224. FIG. It is the flowchart which showed operation | movement of the search image reproduction apparatus 1 at the time of execution of a search image reproduction function. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example of moving image data and appearance information. It is a display example figure of moving image data and appearance information.

  Hereinafter, modes for carrying out the present invention will be described. First, a schematic configuration of the search image reproduction device 1 in the present embodiment will be described with reference to FIG.

  As shown in FIG. 1, the search image reproduction device 1 of this embodiment includes a control device 11, a recording device 12, a communication device 13, an input device 14, an output device 15, a display device 16, and a moving image reproduction. Device 17.

  The control device 11 executes a processing program held by the recording device 12 and controls the operation of the entire device.

  The recording device 12 records a processing program for controlling the operation of the search image reproduction device 1, a database for managing data, moving image data, and the like. Examples of the recording device 12 include a disk, a tape, and a semiconductor. The processing program stored in the recording device 12 includes a device control processing unit 121, a search result management processing unit 122, an outgoing current acquisition processing unit 1221, an appearance position acquisition processing unit 1222, an appearance dimension acquisition processing unit 1223, A reproduction start time determination processing unit 123, an appearance remaining time calculation processing unit 124, an integrated display processing unit 125, an appearance remaining time display processing unit 1251, an appearance position display processing unit 1252, and an appearance dimension display processing unit 1253, And a search processing unit 126. The recording device 12 also has an appearance information database 1224 that manages appearance information that is information about the appearance of the searched image. Further, the recording device 12 has moving image data 127 as a search target.

  The device control processing unit 121 causes each device of the search image playback device 1 to cooperate and operate as a search image playback device. For example, an image search function that searches a part of moving image data that has a feature that matches a specific image or a part that includes an image related to a keyword, or a part of moving image data that includes the searched image is displayed as appearance information. A search image playback function for playback while displaying is realized.

  The search processing unit 126 searches the moving image data 127 for a portion having a feature that matches a specific image or a portion that includes an image related to a keyword.

  The search result management processing unit 122 manages information related to the search results, and manages an outgoing current acquisition processing unit 1221, an appearance position acquisition processing unit 1222, an appearance dimension acquisition processing unit 1223, and an appearance information database 1224. The outgoing current acquisition processing unit 1221 acquires the outgoing current time when the searched image appears. The appearance position acquisition processing unit 1222 acquires an appearance position that is a position where the searched image appears. The appearance dimension acquisition processing unit 1223 acquires an appearance dimension that is a dimension at which the searched image appears.

  In the present embodiment, the time point refers to a certain moment in the moving image data.

  The playback start time determination processing unit 123 derives a time earlier than the current start time by a predetermined method and determines it as a moving image playback start time.

  The remaining appearance time calculation processing unit 124 calculates the remaining appearance time that is the remaining time from the current time point to the current time point of the moving image data being reproduced.

  The integrated display processing unit 125 manages an appearance remaining time display processing unit 1251, an appearance position display processing unit 1252, and an appearance dimension display processing unit 1253 so as to display appearance information. The remaining appearance time display processing unit 1251 performs display processing of the remaining appearance time. The appearance position display processing unit 1252 performs an appearance position display process. The appearance dimension display processing unit 1253 performs an appearance dimension display process.

  In the present embodiment, display processing performed by various display processing units is processing for outputting image data to the output device 15 so that a desired image is displayed on the display device 16.

  In the present embodiment, the remaining appearance time display process is a display process for showing how the remaining appearance time decreases.

  The communication device 13 communicates with other devices via a network. Examples of communication methods include USB (Universal Serial Bus), IEEE1394 (Institute of Electrical and Electronic Engineers 1394), Ethernet (registered trademark), wireless LAN (Local Area Network), and HDMI (High-Definition Multimedia Interface). .

  The input device 14 is an interface device with which a user operates the search image playback device 1. Examples of the input device 14 include buttons, switches, keys, dials, sticks, mice, remote controllers, and touch panels.

  The output device 15 outputs image data to be provided to the user.

  The display device 16 displays a moving image playback screen and a device operation screen to the user. Examples of the display device 17 include a liquid crystal panel, a plasma display panel, and an organic EL panel. Note that the display device 17 may be used via the output device 16 by being externally connected to a device such as a PC or an HDD recorder, even if the display device 17 is not provided in the search image playback device 1.

  The moving image reproduction device 17 performs reproduction processing of the moving image data 127 and causes the display device 16 to display a moving image reproduction screen via the output device 15.

  Next, an example of the appearance information database 1224 in the embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 2, the appearance information database 1224 of the present embodiment stores the search ID 12241, the current time 12242, the appearance position 12243, and the appearance size 12244 in association with each other.

  In FIG. 2, as a search result with the search ID no. 1, the horizontal axis coordinate 120 and the vertical axis coordinate 465 are located at the upper left corner when 1 hour 37 minutes 28 seconds have elapsed from the beginning of the moving image data. It is shown that the searched image appears in the rectangular area indicated by the vertical width 200.

  Also, as a search result with a search ID of No. 2, the radius 100 centered on the position where the horizontal axis coordinate is 300 and the vertical axis coordinate is 600 when 2 minutes and 17 seconds elapse from the beginning of chapter 4 of the moving image data. It is shown that the searched images appear in two places: a circular area with a radius of 150 centered at a position where the horizontal coordinate is 500 and the vertical coordinate is 800.

  Also, as a search result with search ID no.3, the searched image appeared at 18:19:28 on January 17, 2010, as shown by the image data of the image file abcde.jpg. It has been shown.

  A description will be given using an example in which a star-shaped figure is searched from moving image data. (a) shows a display screen of moving image data at the time when the searched image appears. The search is applicable because it contains star-shaped figures, but non-star figures are also included. (b) is display screen data obtained by extracting only a star-shaped figure from (a). If (b) is managed as an image file in the appearance information database 1224, not only the appearance position and appearance size of the star-shaped figure, but also the color and inclination of the star-shaped figure when the star-shaped figure appears. Can also be obtained.

  Next, FIG. 3 shows the operation of the search image reproduction device 1 when executing the search image reproduction function for reproducing a part of moving image data including the searched image while displaying appearance information in the embodiment of the present invention. It explains using.

  In FIG. 3, the operation from a state in which the search processing unit 126 has finished searching the moving image data 127 for a portion whose characteristics match a specific image or a portion including an image related to a keyword in accordance with a user instruction. Is shown. For example, in the search for an image having a feature that matches a specific image, the feature amount of the search image designated by the user is examined, and an image having a similar feature amount among the images in the moving image data is searched. When searching for an image related to a keyword, an image related to the keyword is extracted from the moving image based on information other than the image such as the name, color, shape, and size indicated by the keyword specified by the user and the metadata of the moving image. Search for.

  When the user instructs the reproduction of the search image, first, the search result management processing unit 122 acquires information on the appearance of the searched image from the result of the search process performed by the search processing unit 126, and the appearance information The data is stored in the database 1224 (step 1001). For example, the outgoing current acquisition processing unit 1221 acquires the outgoing current time when the searched image appears, and the appearance position acquisition processing unit 1222 acquires the appearance position as the position where the searched image appears, The appearance dimension acquisition processing unit 1223 acquires an appearance dimension that is a dimension at which the searched image appears.

  Next, the playback start time determination processing unit 123 derives a time earlier than the current start time by a predetermined method and determines it as a moving image playback start time (step 1002). Examples of the method for deriving the playback start time include a method for calculating a time point a certain number of seconds before the current time point (for example, 30 seconds), a method using the start time point of the scene that includes the current time point, and the current time point For example, there is a method of using the beginning time of the chapter to be read. It does not matter if it is obtained by another derivation method.

  Next, the moving image reproduction device 17 starts reproduction of the moving image data 127 with the start time determined in step 1002 as the head (step 1003).

  Next, the remaining appearance time calculation processing unit 124 calculates the remaining appearance time, which is the remaining time from the current playback time point to the current time point of the moving image data 127 being played, at regular intervals (for example, every 1 second) ( Step 1004).

  The device control processing unit 121 determines whether or not to display the appearance information including the remaining appearance time calculated in Step 1004 (Step 1005), and determines that the appearance information should be displayed (Step 1005). Yes), the integrated display processing unit 125 is caused to update the display of the appearance information (step 1006). At this time, if the appearance information is not displayed, the integrated display processing unit 125 starts displaying the appearance information.

  If it is determined in step 1005 that the appearance information should not be displayed (No in step 1005), the device control processing unit 121 causes the integrated display processing unit 125 to delete the appearance information (step 1007). At this time, if the display of the appearance information has already been erased, the integrated display processing unit 125 does nothing.

  Here, examples of how to determine whether or not to display the appearance information include a method for stopping the display when the remaining appearance time becomes 0, a method for stopping the display when the remaining appearance time becomes 1 second or less, etc. There is a method to stop the display based on the remaining appearance time. Since the searched image appears when the remaining appearance time becomes 0, by stopping the display of the appearance information from that time or a few seconds before that, it does not disturb the searched image in the playback display of moving images An effect is obtained. Even if the appearance information at the moment when the remaining appearance time becomes 0 is not displayed, the user can see the searched image from the change in appearance information including the appearance remaining time until a few seconds before that. It is possible to grasp the approximate time, position, dimensions, etc. Other determination methods may be used.

  As another example of a method for determining whether or not to display appearance information, there is a method according to a display instruction or deletion instruction for appearance information by a user. In this case, the deleted appearance information is displayed according to the user's instruction, or the displayed appearance information is deleted according to the user's instruction. FIG. 3 shows an example in which an instruction by the user is given between step 1004 and step 1005, but other timings may be used as long as the steps 1004 to 1008 are repeated.

  You may use combining the method of stopping a display based on appearance remaining time, and the method according to the display instruction | indication or deletion instruction | indication of appearance information by a user. In this case, for example, it is possible to delete the appearance information when the remaining appearance time becomes 1 second or less, and then detect that the user has made a display instruction and display the appearance information again. It becomes.

  In addition, the integrated display processing unit 125 performs the remaining appearance time display processing by the remaining appearance time display processing unit 1251, the appearance position display processing by the appearance position display processing unit 1252, and the appearance dimension display by the appearance dimension display processing unit 1253. It is realized by processing or a combination thereof.

  Next, if the device control processing unit 121 determines whether or not to end the reproduction of the moving image (step 1008) and determines that the reproduction of the moving image should not be ended (No in step 1008), the step Return to 1004. If it is determined that the playback of the moving image should be terminated (Yes in step 1008), the moving image playback device 17 stops the playback of the moving image data 127 (step 1009), and the search image playback function ends.

  Here, as an example of a method for determining whether or not to end the reproduction of the moving image, there are a method of ending when the reproduction of the moving image data is completed, or a reproduction of the moving image data until the end of the scene including the current time There are a method of ending and a method of ending when a user gives an instruction to stop playback. Other determination methods may be used. FIG. 3 shows an example in which an instruction by the user is given immediately before step 1008, but other timings may be used as long as steps 1004 to 1008 are repeated.

  Hereinafter, a first embodiment for carrying out the present invention will be described. In this embodiment, an example in which a star-shaped figure is searched from moving image data in which a triangular figure changes to a star-shaped figure and the remaining appearance time is displayed as numbers as appearance information will be described with reference to FIG. To do.

  (a) is the figure which showed the example of a mode that a part of original moving image data was arranged in time series, and the display of moving image data changes. (b) is a diagram showing an example of a state in which the display of the appearance information added by the integrated display processing unit 125 is updated by repeating Step 1004, Step 1005, Step 1006, and Step 1008. In both (a) and (b), the upper row is when 0 hour, 1 minute, and 13 seconds have elapsed from the beginning of the moving image data, the middle row is when 0 hour, 1 minute, and 15 seconds have elapsed from the beginning of the moving image data, and the lower row These are examples of display screens when 0 hour, 1 minute, and 20 seconds have elapsed from the beginning of the moving image data (the time when the searched image appears).

  In FIG. 4, numbers are displayed as appearance information on the upper left of each image of (b). The number indicates the remaining time (seconds) until the present time, and decreases with the passage of time. At the time of departure, the number is zero.

  With this appearance information, the user can grasp the remaining time up to the current point of departure.

  Note that the appearance information may be displayed in other manners as long as the numbers decrease with the passage of time, and the numbers are reduced at a speed at which the number becomes zero at the present time. For example, the number unit of the appearance information may not be seconds, and the display position may be arbitrary.

  The second embodiment for carrying out the present invention will be described below. In this embodiment, an image in which a filled star shape is displayed is searched from moving image data in which a white star shape moves from left to right and changes to a filled star shape. An example in which the remaining appearance time is displayed as a belt-like graph will be described with reference to FIG. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 5, a band-shaped graph is displayed as appearance information at the upper left of each image of (b). The width of the painted band indicates the elapsed time from the start of reproduction, and the width of the white band indicates the remaining time up to the present time. As time passes, the width of the painted band increases and the width of the white band decreases. At the time of departure, the white band disappears.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases.

  Note that the appearance information may be displayed in other manners. For example, the color of the band may be arbitrary, and a bar or a line may be used instead of the band.

  Hereinafter, a third mode for carrying out the present invention will be described. In this embodiment, an example in which a star-shaped figure is searched from moving image data in which a triangular figure changes to a star-shaped figure and the remaining appearance time is displayed as a circular graph as appearance information is shown in FIG. It explains using. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 6, a circular graph is displayed as appearance information at the upper left of each image of (b). The area of the white portion indicates the elapsed time from the start of reproduction, and the area of the painted portion indicates the remaining time up to the present time. As time passes, the area of the white portion increases and the area of the painted portion decreases. At the present time, the painted area disappears.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases.

  Note that the appearance information may be displayed in other manners. For example, the color of the circular graph may be arbitrary, may be displayed using an analog clock instead of the circular graph, or may be displayed so that only the line rotates.

  Hereinafter, a fourth embodiment for carrying out the present invention will be described. In this embodiment, an example in which a star-shaped figure is searched from moving image data in which a triangular figure changes to a star-shaped figure and the remaining appearance time is displayed as an arcuate line as appearance information is shown in FIG. I will explain. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 7, an arc-shaped line is displayed as appearance information at the upper left of each image of (b). The line shows the time remaining until the present time. With the passage of time, the length of the arcuate line becomes shorter, and at the present time the arcuate line disappears.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases.

  Note that the appearance information may be displayed in another manner as long as a line that is reduced with the passage of time is displayed, and the line is reduced at a speed at which the line disappears at the present time. For example, a straight line may be used instead of an arcuate line, or a dotted line may be used instead of a solid line.

  The fifth embodiment for carrying out the present invention will be described below. In this embodiment, a star-shaped figure is searched from moving image data in which a star-shaped figure appears next to a triangular figure, and the remaining appearance time, appearance position, and appearance size are displayed as double figures as appearance information. An example will be described with reference to FIGS. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 8, a double circle is displayed as appearance information on the right side of each image of (b). The distance between the boundary line of the outer circular area and the boundary line of the inner circular area indicates the remaining time up to the present time. The inner circle becomes larger as time passes, and the inner and outer circular regions coincide at the start. The outer circle indicates the appearance position and the appearance dimension.

  In FIG. 9, a double rounded rectangle is displayed as appearance information on the right side of each image of (b). The distance between the boundary line of the outer rounded rectangular area and the boundary line of the inner rounded rectangular area indicates the remaining time until the current point of departure. As the time elapses, the outer rounded rectangle becomes smaller, and the inner and outer rounded rectangular regions coincide with each other at the present time. Further, the inner rounded rectangle indicates the appearance position and the appearance size.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases. In addition, the user can grasp the approximate appearance position and appearance size from before the present time.

  In addition, if the display area showing the appearance position and the appearance size and the remaining time display area that changes in size with the passage of time are displayed so that the remaining time display area disappears at the present time, other Appearance information may be displayed in the following manner.

  The sixth embodiment for carrying out the present invention will be described below. In this embodiment, an example in which a star-shaped figure is searched from moving image data in which a star-shaped figure appears next to a triangular figure, and the remaining appearance time and the appearance position are displayed as appearance information with four marks. This will be described with reference to FIG. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 10, four marks are displayed as appearance information on the right side of each image of (b). The distance between the four marks indicates the remaining time until the present time. The four marks move toward one point with the passage of time so that the four marks overlap at the time of departure. One point to which the four marks go indicates the appearance position. In addition, the appearance information display is erased in the current figure on the lower stage.

  That is, the area indicated by the four marks is a remaining appearance time display area and a display area indicating the appearance position. The remaining appearance time display area changes in size with the passage of time, and disappears at the time of appearance.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases. In addition, the user can grasp the approximate appearance position from before the current departure time. Further, since the appearance information disappears at the present time, the searched image can be viewed without being disturbed by the display of the appearance information.

  Note that the appearance information may be displayed in other manners. For example, the number of marks may be two or more, and the marks are not limited to triangles.

  The seventh embodiment for carrying out the present invention will be described below. In this embodiment, a star-shaped figure is searched from moving image data in which a star-shaped figure appears next to a triangular figure, and the remaining appearance time, appearance position, and appearance size are displayed as rounded rectangles as appearance information. An example will be described with reference to FIG. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 11, a rounded rectangle is displayed as appearance information on the right side of each image of (b). The size of the rounded rectangle indicates the remaining time up to the present time. The rounded rectangle shrinks with the passage of time so that the rounded rectangle disappears at the start time. The center of the rounded rectangle that shrinks indicates the appearance position. The position and size of the rounded rectangle displayed first indicate the appearance position and the appearance size. In addition, the appearance information display is erased in the current figure on the lower stage.

  That is, the area indicated by the rounded rectangle is the remaining appearance time display area, and the remaining appearance time display area displayed first is a display area indicating the appearance position and the appearance size. The remaining appearance time display area changes in size with the passage of time, and disappears at the time of appearance.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases. In addition, the user can grasp the approximate appearance position and appearance size from before the present time. Further, since the appearance information disappears at the present time, the searched image can be viewed without being disturbed by the display of the appearance information.

  Note that the appearance information may be displayed in other manners. For example, the shape may be a circle that is not a rounded rectangle, or a dotted line that is not a solid line.

  Hereinafter, an eighth embodiment for carrying out the present invention will be described. In this embodiment, a star-shaped figure is searched from moving image data in which two star-shaped figures appear from a state where nothing is displayed, and the remaining appearance time is displayed as a band-like graph as appearance information. An example of displaying an appearance position and an appearance dimension as information as an image using image data at the time of appearance will be described with reference to FIG. Note that description of portions that are the same as those in the first embodiment is omitted.

  In FIG. 12, a band-shaped graph is displayed as appearance information at the upper left of each image of (b). The description of the strip-shaped graph is the same as that in the second embodiment, and is omitted.

  In the center and the right side of each image of (b), an image obtained by extracting a star-shaped figure frame line from the image at the time of appearance is displayed as other appearance information. The image extracted from the image at the time of appearance accurately indicates the position of appearance and the size of the appearance, and matches the figure that appears at the time of appearance. Up to the present time, blinking is repeated as time passes with only the frame line extracted.

  From this appearance information, the user can grasp the degree to which the remaining time until the departure time decreases. Moreover, the user can grasp | ascertain an exact appearance position and appearance dimension. The user can also grasp the exact shape of the searched image. Further, since the image of only the frame line blinks, the user can grasp that the actual moving image data is not yet displayed at the time of reproduction.

  If an image obtained by processing moving image data at the time of appearance is displayed, the appearance information may be displayed in another manner. For example, an image with a thin color may be used instead of an image from which a frame line is extracted, or the color may be changed without blinking.

  In the embodiment of the present invention described above, an example in which the search image reproduction device 1 includes the search processing unit 126 and the appearance information obtained by executing the image search function is stored in the appearance information database 1224 will be described. However, the appearance information obtained via the communication device 13 may be stored in the appearance information database 1224 by causing another external device to execute the image search function.

  In this case, the search image playback device 1 does not need to have the search processing unit 126, so that the processing load on the search image playback device 1 can be reduced. In addition, since the search process can be completed in a short time by another external device capable of higher-speed calculation, the burden on the user due to the waiting time is reduced.

  Moreover, you may implement combining each embodiment of this invention.

  According to the embodiment of the present invention, the search image playback device starts playback of a moving image from the time when the searched image is displayed, and displays it together with information such as the remaining time until the current output time, the appearance position, and the appearance size. To output. For this reason, in the reproduction of the image retrieved from the moving image data, the user can reproduce the moving image reproduced from before the current retrieval time of the retrieved image, such as the remaining time until the current time of appearance, the appearance position, the appearance size, etc. Since the information can be foreseen and viewed, the burden on the user is reduced.

  For example, it is assumed that the user searches for an image including the character string “ABC” from the movie content having a length of 2 hours. Playing from the beginning of the retrieved image, it is difficult to understand how "ABC" is used, so it is played from the beginning of the chapter that includes that point. The viewer knows that the string “ABC” will appear somewhere in the chapter, but if there ’s no information about the appearance, the viewer will watch the video throughout the chapter (for example, 20 minutes) You have to keep looking for the string "ABC" without knowing when and where on the screen and how big it will appear. According to the embodiment of the present invention, it is possible to foresee and view information such as the remaining time, appearance position, appearance size, etc. up to the present time, so the burden on the user is reduced.

  Also, for example, it is assumed that one person who does not know his face but knows his name from a music program in which a group of 20 people appeared is searched by person name. Searching is possible by using a database that associates names and face images, but it is difficult for the user to know who the 20 people are by simply playing the part containing the searched image. If the corresponding person is highlighted, it can be known who corresponds to it, but the viewing of the video is disturbed. According to the embodiment of the present invention, the user can grasp the appearance information such as the remaining time, the appearance position, the appearance size, etc. until the present time while viewing from before the present time, and the appearance information is present at the present time. Since it disappears, it is not disturbed when viewing the image of the searched person. In addition, the user can confirm the appearance position by displaying the appearance information again by issuing an instruction to display the appearance information.

DESCRIPTION OF SYMBOLS 1 ... Search image reproduction apparatus, 11 ... Control apparatus, 12 ... Recording apparatus, 13 ... Communication apparatus, 14 ... Input device, 15 ... Output device, 16 ... Display apparatus, 17 ... Moving image reproduction apparatus.

Claims (12)

A search image display method for displaying an image searched from moving image data,
Starting the reproduction of the moving image data from before the current time point at which the searched image appears;
And a step of displaying the passage of the remaining appearance time which is the remaining time up to the present time.   2. The search image display method according to claim 1, wherein the step of displaying the passage of the remaining appearance time displays an appearance position that is a position where the searched image appears.   3. The search image display method according to claim 2, wherein the step of displaying the passage of the remaining appearance time displays the appearance position together with an appearance dimension that is a dimension at which the searched image appears. .   The search image display method according to any one of claims 1 to 3, wherein the appearance remaining time is displayed by changing a number or a figure with the passage of time.   The search image display method according to claim 2, wherein the appearance remaining time is displayed together with a display area indicating the appearance position by a remaining time display area whose size changes with the passage of time.   The search image according to claim 3, wherein the appearance remaining time is displayed together with a display area indicating the appearance position and the appearance size by a remaining time display area whose size changes with the passage of time. Display method.   The search image display method according to claim 4, wherein the display of the appearance remaining time disappears at the time of the appearance.   The said remaining time display area turns into a display area which shows the said appearance position, The said appearance remaining time display area changes a magnitude | size with progress of time, and disappears at the time of starting. Search image display method.   The remaining appearance time display area that is displayed first becomes a display area that indicates the appearance position and the appearance size, and the appearance remaining time display area changes in size with the passage of time and disappears at the time of appearance. The search image display method according to claim 6. A retrieval image reproduction device for reproducing an image retrieved from moving image data,
An outgoing current time acquisition means for acquiring an outgoing current time when the searched image appears;
Moving image reproduction means for starting reproduction of the moving image data before the current time point,
A remaining appearance time calculating means for calculating a remaining appearance time which is a remaining time until the current time point,
A search image reproduction device comprising: a remaining appearance time display means for displaying the passage of the remaining appearance time. Appearance position acquisition means for acquiring an appearance position that is a position where the searched image appears;
It further has an appearance position display means for displaying the appearance position,
The search image reproduction device according to claim 10, wherein the elapsed appearance time and the appearance position are displayed together. Appearance dimension acquisition means for acquiring an appearance dimension that is a dimension in which the searched image appears;
And further having an appearance dimension display means for displaying the appearance dimension,
The search image reproduction device according to claim 11, wherein the elapsed appearance time, the appearance position, and the appearance size are displayed together.

Images