JP2012134864A - Information processor, processing method of the same and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism of facilitating browsing of moving images, when still images are photographed during moving image photographing, by imparting management information during the moving image photographing to the still images, and presenting moving images associated with the still images when the still images are browsed.SOLUTION: A still image file to be displayed is decided, and it is determined whether or not moving image identification information to be stored in the case of being photographed during moving image photographing is present in the accessory information of the determined still image file. When determined that the moving image identification information is present, a moving image file during photographing when the still image is photographed, that corresponds to the moving image identification information, is acquired, an associated moving image file is acquired according to the accessory information of the determined still image file, and the acquired moving image file during photographing and the associated moving image file are displayed together with the still image file.

Description

  The present invention relates to an information processing apparatus that manages still image files and moving image files, a processing method thereof, and a program.

  In recent years, as home video cameras have been digitized and data has been digitized, it has become possible to take pictures more easily, and the number of moving pictures that have been taken tends to increase dramatically.

  Therefore, there is a need to more easily search for a captured moving image, and a technique for easily searching is disclosed.

  As one of them, Patent Document 1 discloses an image search method and a management method for moving images and still images. In particular, the present invention provides a method that makes it easy for a user to check a large number of moving images and still images taken by one or more digital cameras. In this system, from the shooting date and time of a video, search for still images taken in the vicinity of the shooting date and time, find a still image with high similarity to each scene of the video, and associate the video with the still image Yes.

JP 2006-135394 A

  In Patent Document 1, although management is performed by associating, since it is not assumed to be used after taking a captured still image or moving image in a personal computer, it is not actually a convenient browsing mechanism.

  In general, there are few opportunities to watch videos, and there are many ways to watch videos only when they are needed. On the other hand, still images are often viewed daily compared to moving images, as digital photo frames are popular, and moving images and still images are different in nature for users, and moving images are buried. There was a thing.

  For this reason, it is desired to present an associated moving image when browsing a still image, but a mechanism that is convenient for the user has not been disclosed.

  Therefore, the present invention, when a still image is shot during movie shooting, provides management information during movie shooting to the still image, and presents a movie related to the still image when browsing the still image. Therefore, an object is to provide a mechanism that facilitates browsing of moving images.

  An information processing apparatus for storing a still image file and a moving image file for achieving the object of the present invention, wherein the still image file determining means for determining a still image file to be displayed is determined by the still image file determining means. The moving image determination means for determining whether or not the attached information of the still image file includes moving image identification information stored when the moving image is shot, and the moving image determination means determines that there is moving image identification information. The first moving image file acquiring means for acquiring the moving image file being shot when the still image is shot, and the additional information of the still image file determined by the still image file determining means, corresponding to the moving image identification information The second moving image file acquiring means for acquiring the related moving image file, the moving image file acquired by the first moving image file acquiring means, and the second moving image file Video files acquired by Le acquisition means, characterized in that it comprises a display means for displaying together with the still picture file.

  A storage unit for storing the still image file and the movie file acquired from the imaging apparatus; and a management information registration unit for registering the movie file management information including the identification information of the movie file stored by the storage unit. One moving image file acquisition means acquires a moving image file according to moving image file management information that matches the moving image identification information.

  The moving image file management information includes shooting date / time and position information, and the second moving image file acquisition unit acquires a related moving image file according to the shooting date / time and position information.

  The moving image identification information is identification information of a moving image being shot that is acquired when a still image is shot during moving image shooting by the imaging apparatus.

  Further, the display means includes a first area for displaying the moving picture file acquired by the first moving picture file acquisition means, and a second area for displaying the moving picture file acquired by the second moving picture file acquisition means. A preview area for previewing the still image file, and when displaying the preview of the still image file, the moving image file acquired by the first moving image file acquisition means is displayed in the first area, The moving image file acquired by the second moving image file acquiring means is displayed in the second area.

  According to the present invention, when a still image is shot during moving image shooting, management information during moving image shooting is given to the still image, and the moving image associated with the still image is presented when viewing the still image. This makes it easy to view videos.

1 is a system configuration diagram illustrating an example of a configuration of a moving image still image capturing system to which an imaging device 100 and an information processing device can be applied. 2 is a block diagram illustrating a hardware configuration of the imaging apparatus 100. FIG. 2 is a block diagram illustrating a hardware configuration of an information processing apparatus 200. FIG. 3 is a flowchart illustrating overall processing of the imaging apparatus 100 and the information processing apparatus 200. 6 is a flowchart illustrating recording processing of a moving image and a still image of the imaging apparatus 100. 4 is a flowchart illustrating a moving image and still image registration process of the information processing apparatus 200. 4 is a flowchart illustrating still image and moving image browsing processing of the information processing apparatus 200. 5 is a flowchart showing related video search processing of the information processing apparatus 200. It is a screen image that displays a still image and a candidate video. It is a figure which shows an example of the Exif information of a still image. It is a figure which shows an example of the metadata information of a moving image. It is a figure which shows an example of the index data table which registers index data. It is a figure which shows an example of the moving image candidate data table which manages the simultaneous video recording corresponding to a still image, and a related moving image. It is a figure which shows an example of the related moving image candidate list | wrist 1300. FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system configuration diagram illustrating an example of a configuration of a moving image still image capturing system to which an imaging apparatus 100 and an information processing apparatus of the present invention can be applied.

  The imaging apparatus 100 captures a moving image / still image and records the moving image / still image. The imaging apparatus 100 is configured to be connectable to the information processing apparatus 200 using a USB cable or the like, and transmits a moving image / still image to the information processing apparatus 200 via a communication medium such as a USB cable.

  Further, the information processing apparatus 200 receives a moving image / still image from the imaging apparatus 100 via a communication medium such as a USB cable and stores the moving image / still image in a hard disk or the like. Further, the information processing apparatus 200 searches for a stored moving image or still image and displays it on the display.

  Hereinafter, the hardware configuration of the imaging apparatus 100 illustrated in FIG. 1 will be described with reference to FIG. 2A.

  FIG. 2A is a schematic block diagram of the imaging apparatus 100 of the present invention.

  The camera unit 12 includes a photographic lens 14, an image sensor 16, an A / D converter 18, and a camera signal processing device 20. The taking lens 14 has an optical zoom function and a focusing function. The image pickup device 16 includes, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The image sensor 16 converts an optical image of a subject by the photographing lens 14 into an electric image signal. The A / D converter 18 converts the analog image signal from the image sensor 16 into a digital image signal. The camera signal processing device 20 performs processing such as γ correction and white balance on the digital image signal from the A / D converter 18 and outputs a video signal in a predetermined format.

  The moving image encoding device 22 compresses and encodes the video signal from the camera unit 12 as a moving image at the encoding rate controlled by the encoding rate control device 24. The moving image recording device 26 records the moving image data encoded by the moving image encoding device 22 on a recording medium. The moving image recording device 26 adds the recording time to moving image data as incidental information of the moving image and records it.

  On the other hand, the still image encoding device 28 compresses and encodes one frame of the video signal output from the camera unit 12 as a still image. The still image recording device 30 records the still image data encoded by the still image encoding device 28 on a recording medium. The still image recording device 30 adds the recording time to the still image data as incidental information of the still image and records it. The recording medium on which the still image recording device 30 records still image data may be the same as or different from the recording medium on which the moving image recording device 26 records moving image data.

  The moving image encoding device 22, the coding rate control device 24, and the moving image recording device 26 constitute a moving image recording system, and the still image encoding device 28 and the still image recording device 30 constitute a still image recording system.

  The system control device 32 starts or stops moving image recording by the moving image recording system in accordance with the operation of the moving image recording / stop switch 34. The system control device 32 also causes the still image recording system to execute still image recording in accordance with the operation of the release switch 36.

  In response to a still image recording operation by the release switch 36 during moving image recording, the system control device 32 controls the encoding rate of moving image compression via the encoding rate control device 24 to temporarily increase the moving image being recorded. Use image quality.

  The release switch 36 used for still image shooting is a two-stage switch. As is well known, the exposure and focus of the camera unit 12 are adjusted in the half-pressed state (still image shooting preparation operation or first pressing step). Control is performed, and still image shooting is executed when the button is fully pressed (second pressing stage). In response to the release switch 36 being fully pressed, the still image encoding device 28 takes in the output video signal of the camera unit 12 and compresses it, and the still image recording device 30 records the compressed still image data on the recording medium. To do. In the case of shooting only a still image, the camera unit 12 may output an image signal having a larger number of pixels than when shooting a moving image.

  Moreover, it has the GPS communication part 38 and the system control part 32 acquires position information according to the information obtained from a GPS communication part.

  Hereinafter, the hardware configuration of the information processing apparatus 200 illustrated in FIG. 1 will be described with reference to FIG. 2B.

  FIG. 2B is a block diagram illustrating a hardware configuration of the information processing apparatus 200 illustrated in FIG.

  In FIG. 2B, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs to be described later are stored.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display device such as a CRT display (CRT) 210. In FIG. 3, although described as CRT 210, the display device may be not only the CRT but also other display devices such as a liquid crystal display. These are used by the administrator as needed.

  A memory controller 207 is connected to the hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, etc. via an adapter. The access to the external memory 211 such as a compact flash (registered trademark) memory is controlled.

  A communication I / F controller 208 is connected to and communicates with an external device via a network (for example, the LAN 600 shown in FIG. 1), and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

  Next, detailed description of the present embodiment will be described with reference to the flowcharts of FIGS.

  FIG. 3 is a flowchart showing overall processing of the imaging apparatus 100 and the information processing apparatus 200 in the present embodiment.

  In step S301, the imaging apparatus 100 records a moving image and a still image. Details of this processing will be described with reference to FIG.

  In step S302, the recorded moving image and still image are stored in the information processing apparatus 200. Details of this processing will be described with reference to FIG.

  In step S303, the information processing apparatus 200 browses the stored still image. Details of this processing will be described with reference to FIG.

  Next, the moving image and still image recording processing of the imaging apparatus 100 will be described with reference to FIG.

  FIG. 4 is a flowchart showing the moving image and still image recording processing of the imaging apparatus 100.

  In step S401, the imaging apparatus 100 receives a shooting instruction.

  In step S402, it is determined whether the shooting instruction is a moving image shooting instruction or a still image shooting instruction. In the case of a moving image shooting instruction, the pressing of the moving image recording / stop SW 34 is detected. In the case of a still image shooting instruction, pressing of the release switch 36 is detected. If it is a moving image shooting instruction, the process proceeds to step S404. If it is a still image shooting instruction, the process proceeds to step S403.

  In step S403, since it is a still image shooting instruction, a still image is shot and a still image is recorded.

  In step S404, since it is a moving image shooting instruction, the shooting start time is acquired from the system time managed by the imaging apparatus 100. In addition, position information is acquired according to information obtained from the GPS communication unit 38 of the imaging apparatus 100. The acquired time and position information are held in the memory of the system control unit 32. In addition, a movie is taken and a movie is recorded. When recording a moving image, identification information for managing the moving image is given. This identification information is attached information of the moving image file after the moving image shooting is completed.

  In step S405, by detecting that the release switch 36 is pressed during moving image shooting, it is determined whether a still image has been shot during moving image shooting. If the pressing of the release switch 36 is detected during moving image shooting, the process proceeds to step S406. If the pressing of the release switch 36 is not detected during moving image shooting, the process proceeds to step S408.

  In step S406, a still image is captured and the still image is recorded. The attached information (for example, Exif information) is stored in the file when the still image is recorded. The outline of Exif information is shown in FIG. 9, but Exif information can store various attached information such as shooting date and time, image resolution, shooting conditions (such as shutter speed and aperture value), and position information. Here, it is possible to store shooting date / time, position information (latitude, longitude), person information (person 1, person 2, person 3, person 4), and simultaneous shooting moving picture information.

  In step S407, in order to associate a moving image with the captured still image, moving image identification information is added to the Exif information 908 of the still image data in FIG.

  In step S408, it is detected whether or not the moving image recording / stop SW 34 has been pressed, and it is determined whether or not the moving image recording has ended. If it is detected that the moving image recording / stop SW 34 has been pressed, it is determined that the moving image recording has ended, and the process proceeds to step S409. If it is not detected that the moving image recording / stop SW 34 has been pressed, step S409 is performed. The process returns to S405, and the moving image shooting is continued.

  In step S409, a person is identified from the single frame image of the still image captured in step S406 or the moving image at the timing when the still image was captured, and the image of the identified person (face image) and the person registered in advance are identified. Match images and get person's name. Since matching of images is a well-known technique, description thereof is omitted, but an image having a high similarity is determined from the similarity of images, and a person name assigned to the image is acquired.

  In step S410, the data (shooting start date / time and position information) acquired in step S404 and the data (person name) acquired in step S409 are attached to the moving image as metadata in FIG.

  In step S411, the imaging in the imaging device 100 ends.

  Note that the flowchart of FIG. 4 is repeated for the number of times of shooting.

  Next, Exif information of a still image will be described with reference to FIG. FIG. 9 is a diagram illustrating an example of Exif information of a still image. Exif information is information stored in a still image file (image file).

  In the Exif information, in addition to basic data such as shooting date / time 901, latitude 902, and longitude 903, personal information such as a person name (904, 905, 906, 907), simultaneous shooting moving image that is identification information of the simultaneous shooting moving image It has an area for storing 908.

  The Exif information item 901 registers the shooting date and time acquired from the clock in the imaging apparatus 100 at the time of shooting.

  The Exif information item 902 registers the latitude of position information obtained based on information acquired from the GPS communication unit 38 in the imaging device 100 at the time of shooting. Also, the longitude of the position information is registered for the Exif information item 903.

  In the Exif information item 904, the Exif information item 905, the Exif information item 906, and the Exif information item 907, the names of persons acquired in step S409 are registered. Here, four data are defined so that data of four people can be stored, but the number of registered persons is not limited to four.

  In the Exif information item 908, when the image capturing apparatus 100 is a still image shot during moving image shooting, moving image identification information is registered.

  The moving image identification information is determined from, for example, the shooting start date and time of the moving image in the imaging apparatus 100. For example, when the shooting start date and time of the moving image is December 3, 2010 at 12:34:02, the numerical data 2010101203123402 is registered. In addition, it is not registered in the still image image | photographed during video recording.

  Next, moving picture metadata information will be described with reference to FIG. FIG. 10 is a diagram showing an example of moving picture metadata information. In the moving image metadata information, shooting start date and time 1001, position information (latitude 902, longitude 903), and person 1004 (1005, 1006, 1007) are registered. It is assumed that metadata information is managed in a file associated with the movie file. However, if there is an area for managing metadata as the file format of the movie file, the metadata area in the movie file is used. Information may be managed.

  The video metadata item 1001 registers a shooting start date and time acquired from a clock in the imaging apparatus 100 at the time of shooting.

  The moving image metadata item 1002 registers the latitude of the position information determined according to the information obtained from the GPS communication unit 38 of the imaging apparatus 100 at the time of shooting. In the metadata item 1003, the longitude of the position information is registered.

  In the moving picture metadata items 1004, 1005, 1006, and 1007, names of persons existing in the moving picture are registered. The person identification method is the same as that for a still image. Here, four data are defined so that data of four people can be stored, but the number of registered persons is not limited to this.

  Next, processing for registering still images and moving images in the information processing apparatus 200 will be described with reference to FIG.

  FIG. 5 is a flowchart showing the moving image and still image registration processing of the information processing apparatus 200.

  In step S501, the information processing apparatus 200 starts capturing data (moving image, still image) captured from the imaging apparatus 100 via a communication medium such as a USB cable.

  In step S502, it is determined whether the data to be captured is a moving image. If the data to be captured is a moving image, the process proceeds to step S503. If the data to be captured is a still image, the process proceeds to step S504.

  In step S503, the moving image is stored in the external memory 211. In step S504, the still image is stored in the external memory 211.

  In step S505, the metadata (FIG. 10) given to the moving image is acquired, the moving image index shown in FIG. 11 is created, and registered in the index data table shown in FIG. When the metadata is managed as a separate file, it is assumed that the image data is transferred from the imaging device 100 to the information processing device 200 together with the moving image data.

  Here, the index data will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of an index data table for registering index data.

  The index data table in FIG. 11 is a data table for managing shooting information about a moving image stored in the information processing apparatus 200, and includes an identification ID 1101, a file path 1102, a shooting date and time 1103, a place 1104, and a person 1105.

  The index data 1101 registers moving image identification information determined from the shooting start date and time 1001 of the metadata (FIG. 10). For example, when the shooting start date and time of the moving image is December 3, 2010 at 12:34:02, the numerical data 2010101203123402 is registered.

  The index data 1102 registers an access path to the moving image file when it is stored in the external memory 211 of the information processing apparatus 200.

  The index data 1103 registers shooting start date / time information acquired from shooting start date / time 1001 of metadata (FIG. 10) as shooting date / time information.

  In the latitude of the index data 1104, data acquired from the latitude 1002 of the metadata (FIG. 10) is registered as shooting location information. Similarly, in the longitude of the index data 1104, data acquired from the longitude 1003 of the metadata (FIG. 10) is registered.

  The index data 1105 registers person name data acquired from the persons 1 to 4 (1004 to 1007) of the metadata (FIG. 10).

  Returning to the description of the flowchart of FIG. 5, in step S <b> 506, it is determined whether or not all the data captured from the imaging apparatus 100 has been saved. If all data has been saved, the process ends. If all data has not been saved (if importing continues). The process returns to step S501, and the data capture and storage process is continued.

  Next, still image and moving image browsing processing in the information processing apparatus 200 will be described with reference to FIG.

  FIG. 6 is a flowchart showing still image and moving image browsing processing of the information processing apparatus 200.

  Note that the browsing process is a process executed by the image browsing application of the information processing apparatus 200, and the processing of this flowchart starts when the user starts the image browsing application.

  In step S601, a screen for searching and browsing still images is displayed. At this time, a list of still images (thumbnail images) is displayed. The thumbnail image uses data stored in the Exif information. Note that still images can be searched by receiving a keyword and displayed in a list.

  In step S602, a still image to be browsed is selected from a still image list screen according to the user's designation.

  In step S603, the item 908 of the Exif information (FIG. 9) of the selected still image is referred to.

  In step S <b> 604, it is determined whether the item 908 stores a simultaneously shot moving image (moving image identification information). If no moving image identification information is registered, “no simultaneous shooting video”. If the moving image identification information is registered, it is determined that “simultaneously shot moving image exists”. If there is a simultaneous shooting moving image, the process proceeds to step S605. If there is no simultaneous shooting moving image, the process proceeds to step S606.

  In step S605, the identification ID 1101 having the same value as the identification information stored in the data item 908 of the Exif information is specified from the index data table 1100 in FIG. Data (1 record) of the identified identification ID is acquired. In order to register the acquired data as a moving image candidate, it is registered as “simultaneously shot moving image” in the moving image attribute 1201 of the moving image candidate data table 1200 of FIG. 12, and the file path 1202, shooting date 1203, latitude 1204, longitude 1205, person 1206 ( 1207, 1208, and 1209), data corresponding to the acquired item is registered.

  In step S606, the related moving image is searched. Details of the related moving image search processing will be described with reference to FIG.

  In step S607, the moving image candidates registered in the moving image candidate data table 1200 of FIG. 12 are displayed as a list, such as 802, 803, and 804 of FIG.

  More specifically, in the simultaneous shooting moving image area 802 in FIG. 8, data registered as “simultaneously shooting moving image” in the data item 1201 moving image attribute is acquired from the moving image candidate data table 1200, and the thumbnail of the target moving image, the shooting date and time Is displayed. Further, in the related video area 803 in FIG. 8, data registered as “related video” in the data item 1201 video attribute is acquired from the video candidate data table 1200, and the thumbnail of the target video and the shooting date and time are displayed. In 804 of FIG. 8, the index data of the moving image selected by the user is acquired from the moving image candidate data table 1200 and displayed.

  In step S608, it is determined whether a moving image is selected from the candidate moving image list by a user operation and an execution instruction is given. If an instruction to execute a moving image is issued, the process proceeds to step S609, and if an end instruction is issued, the process proceeds to step S610.

  In step S609, the moving image file for which execution has been instructed is acquired according to the file path 1202 and reproduced. In step S610, the still image browsing screen is terminated and the browsing process is terminated.

  Here, the moving image candidate data table will be described with reference to FIG. FIG. 12 is a diagram illustrating an example of a moving image candidate data table for managing simultaneously recorded moving images and related moving images corresponding to displayed still images.

  The moving image candidate data table 1200 includes a moving image type 1201, a file path 1202, a latitude 1203, a longitude 1204, and a person 1205 (1206, 1207, 1208).

  The data item 1201 of the moving image candidate data table 1200 registers moving image attributes (simultaneously shot moving images and related moving images) that become moving image candidates when the moving image candidates are registered.

  The data item 1202 of the moving image candidate data table 1200 registers the file path acquired from the data item 1102 of the index data table 1100. The data item 1203 of the moving image candidate data table 1200 registers the shooting date and time acquired from the data item 1103 of the index data table 1100.

  The data item 1204 of the moving image candidate data table 1200 registers the latitude acquired from the data item 1104 of the index data table 1100. The data item 1205 of the moving image candidate data table 1200 registers the longitude acquired from the data item 1105 of the index data table 1100.

  The data items 1206, 1207, 1208, and 1209 of the moving image candidate data table 1200 register the person acquired from the data item 1105 of the index data table 1100.

  Next, the related moving image search process in the information processing apparatus 200 will be described with reference to FIG.

  FIG. 7 is a flowchart showing related video search processing of the information processing apparatus 200.

  In step S701, indexes of all moving images are obtained from the index data table 1100.

  In step S702, a related moving image candidate list 1300 (FIG. 13) for registering the score of each moving image is created. At this time, the simultaneous shooting moving image added in step S605 is excluded.

  In step S703, the “year / month / day” of the Exif information data item 901 “shooting date / time” of the displayed still image and the “year / month / day” set in the moving image index data item 1103 “shooting date / time” are the same ( It is determined whether or not the same date is within ± 12 hours from the photographing start time). In step S704, 10 points are added to a score when it determines with it being the same.

  In step S705, if the determination in step S703 is NO, the “year” set in the “year / month” of the data item 901 “shooting date / time” of the Exif information of the still image and the data item 1103 “shooting date / time” of the moving image index are set. It is determined whether the “month” is the same. If it is determined in step S706 that they are the same, 8 points are added to the score.

  In step S707, if the determination in step S705 is NO, the image browsing application is set to the data item 901 “shooting date” “month” of the still image Exif information and the data item 1103 “shooting date” of the moving image index. It is determined whether the “months” are the same. If it is determined in step S708 that they are the same, 7 points are added to the score.

  In step S709, the Exif information data items 902 and 903 “latitude” and “longitude” of the still image are the same as the video index data items 1104 “latitude” and “longitude” (* latitude ± 1.000321%, longitude ± 1.000098). If it is within%, it may be regarded as the same place.) In step S710, 5 points are added to the score when it is determined that they are the same.

  In step S711, the Exif information data items 1004 to 1007 “person 1”, “person 2”, “person 3”, and “person 4” for the still image and the data items 1105 “person 1”, “person 2”, and “person 3” for the moving image index. It is determined whether “person 4” is the same. In step S712, two points are added to the score when determined to be the same.

  If the score of the scored video is not 0 in step S713, the score is registered in the video identification ID 1301 of the data item of the related video candidate list 1300, the identification ID of the scored target video, and the score 1302 of the data item To do.

  In step S714, it is determined whether there is a moving image that has not been scored, and if it exists, the score is calculated again (YES in step S714).

  In step S715, the top three highest scores are extracted from the related video candidate list 1300. The number of cases to be extracted is not limited to this. Then, the index data of each of the top three scores is acquired from the index data table 1100 acquired in step S701, and the file path 1202, the shooting date / time 1203, the latitude 1204, the longitude 1205, and the person 1206 (1207, 1208) of the moving image candidate data table 1200 are acquired. , 1209).

  In step S716, when the moving image candidate is registered, the related moving image ends the search.

  Here, the related moving image candidate list 1300 will be described with reference to FIG. FIG. 13 is a diagram illustrating an example of the related moving image candidate list 1300. The related moving image candidate list 1300 has a moving image identification ID 1301 and a score 1302.

  The data item 1301 of the related moving image candidate list 1300 acquires the moving image identification ID of the moving image to be scored from the index 1100 and registers it. The data item 1302 of the related video candidate list 1300 registers the score of the scoring target video.

  FIG. 8 shows an example of a screen after the processing of FIGS. 6 and 7 is performed. It is composed of a still image display area 801, a simultaneous shooting moving image display area 802, a related moving image display area 803, and a moving image metadata display area.

  The still image display area of the screen example 801 is an area for displaying a selected still image, and is displayed in accordance with an instruction from a user viewing the image.

  The simultaneous shooting moving image display area in the screen example 802 is an area for displaying a moving image shot at the same time as the still image being displayed, and displays a thumbnail of the moving image and a shooting date and time. The simultaneously shot moving image acquired by the process shown in FIG. 6 is displayed. It should be noted that no display is performed when there is no moving image taken at the same time as the still image being displayed.

  The related moving image display area of the screen example 803 is an area for displaying a moving image related to the still image being displayed. Here, thumbnails of three moving images and respective shooting dates and times are displayed. The related moving image acquired by the processing of FIGS. 6 and 7 is displayed. If the number of videos acquired as related videos is less than 3, only the number of videos acquired is displayed.

  The moving image metadata display area of the screen example 804 is a metadata list displayed when the user selects a moving image displayed in the simultaneous shooting moving image display area 802 or the related moving image display area 803. Displays the shooting date, location (latitude, longitude), and person. It is not displayed when no video is selected.

  As described above, the present embodiment is a system including the information processing apparatus 200 that stores still image files and moving image files. The information processing apparatus 200 determines a still image file to be displayed in step S602 (still image). File determination), it is determined whether or not the attached information of the still image file determined in step S604 includes moving image identification information stored when the moving image is captured (moving image determination), and moving image identification is performed in step S607. When it is determined that there is information, the video file being shot when a still image is shot corresponding to the video identification information is acquired, and the related video file is acquired according to the attached information of the still image file ( (Acquisition of moving image file) As shown in FIG. 8, the simultaneous shooting moving image file and the related moving image file are displayed together with the still image file.

  According to the present embodiment, when a still image is shot during moving image shooting, management information during moving image shooting is given to the still image, and a moving image associated with the still image is presented when viewing the still image. In this way, it is possible to easily browse the moving image.

  In addition, when viewing a still image, an associated moving image is presented, so that it is possible to reduce the moving image that is buried without being viewed (reproduced).

  It should be noted that the configuration and contents of the various data described above are not limited to this, and it goes without saying that the various data and configurations are configured according to the application and purpose.

  Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, program, or recording medium, and specifically includes a plurality of devices. The present invention may be applied to a system including a single device.

  Further, the program according to the present invention is a program that allows a computer to execute the processing methods of the flowcharts shown in FIGS. 4 to 7, and the storage medium according to the present invention is a program that allows the computer to execute the processing methods of FIGS. Is remembered. Note that the program in the present invention may be a program for each processing method of each apparatus shown in FIGS.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing the reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk, solid state drive, or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Imaging device 200 Information processing device 26 Movie recording 30 Still image recording 34 Movie recording / stop SW
36 Release switch 38 GPS communication unit 201 CPU
202 RAM
211 External memory

Claims (7)

An information processing apparatus for storing still image files and moving image files,
A still image file determining means for determining a still image file to be displayed;
A moving image determining means for determining whether or not the attached information of the still image file determined by the still image file determining means includes moving image identification information stored when the moving image is captured;
A first moving image file acquiring unit that acquires a moving image file being shot when a still image is shot, corresponding to the moving image identification information, when the moving image determining unit determines that there is moving image identification information;
Second moving image file acquiring means for acquiring a related moving image file according to the attached information of the still image file determined by the still image file determining means;
An information processing apparatus comprising: a moving image file acquired by the first moving image file acquisition unit; and a display unit that displays the moving image file acquired by the second moving image file acquisition unit together with the still image file. . Storage means for storing still image files and moving image files acquired from the imaging device;
Management information registration means for registering video file management information including identification information of a video file to be stored by the storage means,
The information processing apparatus according to claim 1, wherein the first moving image file acquisition unit acquires a moving image file according to moving image file management information that matches the moving image identification information. The video file management information includes shooting date and time, location information,
The information processing apparatus according to claim 1, wherein the second moving image file acquisition unit acquires a related moving image file according to the shooting date and time and position information.   4. The moving image identification information according to claim 1, wherein the moving image identification information is identification information of a moving image being shot that is acquired when a still image is shot during moving image shooting by the imaging apparatus. 5. The information processing apparatus described.   The display means includes a first area for displaying the video file acquired by the first video file acquisition means, a second area for displaying the video file acquired by the second video file acquisition means, A preview area for previewing a still image file; when displaying the preview of the still image file, the movie file acquired by the first movie file acquisition means is displayed in the first area; 5. The information processing apparatus according to claim 1, wherein the moving image file acquired by the second moving image file acquiring unit is displayed in the area. A processing method of an information processing apparatus for storing still image files and moving image files,
The information processing apparatus is
A still image file determining step for determining a still image file to be displayed;
A moving image determination step for determining whether or not the attached information of the still image file determined in the still image file determination step includes moving image identification information stored when the moving image is captured;
A first moving image file acquiring step for acquiring a moving image file being shot when a still image is shot, corresponding to the moving image identification information, when the moving image determining step determines that there is moving image identification information;
A second moving image file acquiring step of acquiring a related moving image file according to the attached information of the still image file determined in the still image file determining step;
A processing method comprising: executing the moving image file acquired in the first moving image file acquisition step and the displaying step of displaying the moving image file acquired in the second moving image file acquisition step together with the still image file. . A program that can be executed by an information processing apparatus that stores still image files and moving image files,
The information processing apparatus;
A still image file determining means for determining a still image file to be displayed;
A moving image determining means for determining whether or not the attached information of the still image file determined by the still image file determining means includes moving image identification information stored when the moving image is captured;
A first moving image file acquiring unit that acquires a moving image file being shot when a still image is shot, corresponding to the moving image identification information, when the moving image determining unit determines that there is moving image identification information;
Second moving image file acquiring means for acquiring a related moving image file according to the attached information of the still image file determined by the still image file determining means;
A program for causing a moving image file acquired by the first moving image file acquisition means and a moving image file acquired by the second moving image file acquisition means to function as display means for displaying together with the still image file.

Images