JP2010020567A - Image reproducing device, image reproduction method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image reproducing device, an image reproduction method, and a program for reproducing by combining images provided by others with a self moving image. <P>SOLUTION: The image reproducing device includes: a reproduction control unit 11a, wherein with respect to two kinds of images, user moving images A, B, and C photographed by general users and provided images a1 and a2 which are provided by a business dealer and are photographed near a photograph position the same as a user image, one of the two is set as a main image 51 and the other is set as a subsidiary image 52 according to a click instruction on a screen and the two kinds of images are reproduced in combination; and a display control unit 16 for forming a composite image by combining a reduced image of the image set as the subsidiary image 52 with the other image set as the main image 51 and displaying the composite image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image reproduction device, an image reproduction method, and a program. More specifically, the present invention relates to an image reproduction device, an image reproduction method, and an image reproduction method for reproducing and displaying an image taken by a general user and an image provided from the outside of a business operator. And program.

  When there is a trip or various events, it is photographed as a memorial or memory with a photographing device such as a camera that I brought. Conventionally, the only way to enjoy a photographed image is to print a still image and play it on a television if it is a moving image. However, now that images have been digitized, complex processing is possible, and various services and image devices have been proposed that provide an unprecedented viewing method using digital image technology even for individual captured images. Has been.

For example, if it is a still image of a trip, a travel album is automatically created from the captured images so that there is no need to perform the troublesome work of organizing the images obtained during the trip after returning. A service is proposed in Patent Document 1.
JP 2004-259006 A

In addition, a system that provides image information of sightseeing spots as data has also been proposed for those who feel that there is little memorial that they only have their own captured images even when they travel. For example, there is a patent on an electronic album creation device that provides a recording medium that records material data for texts, images, and maps of sightseeing spots, and can create original electronic albums by combining these materials with your shot images It is proposed in Document 2.
JP 2005-128785 A

  As a big problem when the captured image is a moving image, a moving image shot by an individual tends to be redundant as compared to a movie or television image that is generally shot by a professional photographer and edited carefully. For this reason, it is rarely viewed as often as a still image, and even if it is an image taken at a special trip or event, it is often the case that it is reproduced only once or twice. If the captured moving image is too long or redundant, editing processing is likely to be performed, but there are many users who think that the operation of editing the moving image is troublesome.

  On the other hand, images provided by tourist sites and businesses as proposed in Patent Document 1 are often superior in terms of shooting technology compared to images taken by individuals. In addition, if such images can be combined well, there is a possibility that the above-described redundancy problem can be solved and image reproduction with excellent appreciation can be realized.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image playback device, an image playback method, and a program that play back a combination of images provided by others in its own moving image. .

  In order to achieve the above object, an image reproduction apparatus according to a first aspect of the present invention corresponds to a first image captured by a general user and an image provided by a business operator and corresponds to a position where the first image is captured. A reproduction control unit that reproduces a combination of the two types of images by setting one of the two types of second images taken at the shooting position as a main image and the other as an auxiliary image according to an instruction. A reduced image or an identification mark of the other image set as the auxiliary image is combined with one image set as the main image to create a composite image and display the composite image Is provided.

  According to a second aspect of the present invention, in the image reproduction apparatus according to the first aspect, the display control unit is configured such that the second image is set as an auxiliary image by the reproduction control unit and is used as the auxiliary image. When there are a plurality of images, a plurality of reduced images obtained by reducing at least two or more second images or a plurality of corresponding identification marks are combined with the main image to create and display the composite image. When the selection is made on the composite screen, the reproduction control unit sets the first reduced image or the second image corresponding to the identification mark as the main image and reproduces it.

  According to a third aspect of the present invention, in the second aspect, the reproduction control unit sets the first image as the main image when the reproduction of the second image set as the main image is completed. The composite image is switched and displayed, and the display control unit does not display the reduced image or the identification mark of the second image that has finished reproduction on the composite image after the end of the reproduction.

In the image reproduction device according to a fourth aspect of the present invention, in the first or second aspect, the reproduction control unit displays the auxiliary image as a still image obtained by extracting a part of the auxiliary image.
According to a fifth aspect of the present invention, there is provided an image reproduction apparatus according to the first aspect, further comprising an operation unit that instructs switching of the main image, and the reproduction control unit sets the main image based on an instruction from the operation unit.

According to a sixth aspect of the present invention, in the first aspect, the reproduction control unit is configured to display the main image as the main image when the first image as the main image has been reproduced for a predetermined time. Switching from the first image to the second image is set and reproduced.
According to a seventh aspect of the present invention, there is provided an image reproduction apparatus according to the first aspect, comprising: a storage unit that stores the first image and the second image; and the second image corresponding to the first image. The apparatus further includes a search unit that searches from the storage unit based on the shooting position of the first image.

  According to an eighth aspect of the present invention, there is provided an image reproduction method according to a first image photographed by a general user and an image provided by an operator and photographed at a photographing position corresponding to the photographing position of the first image. A step of setting one of the two images of the second image as a main image and the other as an auxiliary image according to an instruction, and a reduced image or an identification mark of the other image set as the auxiliary image. Are combined with one image set as the main image to generate a combined image, and the combined image is displayed and reproduced by combining the two types of images.

  A program according to a ninth invention is a program for controlling image reproduction by a computer, and is a first image photographed by a general user and an image provided by a business operator, which is a photograph of the first image. A step of setting one of the two images of the second image shot at the shooting position corresponding to the position as a main image and the other as an auxiliary image according to an instruction, and one of the two images set as the auxiliary image And a step of generating a combined image and displaying the combined image and reproducing the two kinds of images in combination.

  A program according to a tenth aspect of the present invention is a first image captured as a moving image by a general user, and a second image captured from the outside and captured at a capturing position corresponding to the capturing position of the first image. A step of storing the two types of images, and setting one of the stored first and second images as a main image and the other as an auxiliary image, and combining the two types of images Reproducing the synthesized image, and causing the computer to execute.

According to an eleventh aspect of the invention, in the tenth aspect, the auxiliary image is displayed as a still image, and when the reproduction start of the auxiliary image is instructed, the auxiliary image is reproduced as a main image.
According to a twelfth aspect of the invention, in the tenth aspect of the invention, the second image is reproduced and displayed as a main image at predetermined time intervals.

An image reproduction device according to a thirteenth aspect of the present invention is a first image captured by a general user as a moving image, and a moving image obtained from the outside and captured at a shooting position corresponding to the shooting position of the first image. Combining a storage unit that stores two types of images of the second image, a first image stored in the storage unit, and a second image captured at a capturing position corresponding to the first image, And a playback display unit for continuous playback.
According to a fourteenth aspect of the present invention, in the thirteenth aspect, when the reproduction of the second image taken at the photographing position corresponding to the first image is completed, the next first image is reproduced. To do.

  ADVANTAGE OF THE INVENTION According to this invention, the image reproduction apparatus, the image reproduction method, and program which reproduce | regenerate combining the image provided from others with an own moving image can be provided.

  In particular, according to the first, eighth, and ninth inventions, an image provided from a business operator is reproduced in addition to its own image, so that a wide reproduction can be achieved, and reproduction that is not boring when viewed is possible. Further, according to the second invention, when there are a plurality of provisions, it is understood that there are a plurality of provision images, and a provision image to be viewed can be arbitrarily selected. Furthermore, according to the third aspect of the present invention, the provided image that has been viewed is not displayed, thereby confirming that the viewing has been completed. It should be noted that a provided image that is no longer viewed during viewing may be regarded as being viewed and not displayed.

  According to the fourth aspect of the invention, the auxiliary image is prevented from moving, so that the main image is not disturbed. Also, auxiliary images that are less necessary to reproduce moving images can be displayed as still images to simplify image processing. According to the fifth aspect, since the main image can be set by operating the operation unit, the main image can be selected in accordance with the intention of the viewer. According to the sixth aspect, since the main image is automatically switched at a fixed timing, it is possible to save the operator from switching. According to the seventh aspect, since the second image is temporarily stored in the storage unit in the image reproduction device and searched based on the shooting position, it takes more time than directly searching an external database. It can be shortened.

  According to the tenth aspect of the invention, since a moving image obtained from the outside is combined with its own moving image and reproduced, reproduction can be performed with a wide range and reproduction without being bored when viewed. According to the eleventh aspect, the auxiliary image is displayed as a still image, and when it becomes the main image, the reproduction of the moving image is started. Therefore, the main image is not disturbed. According to the twelfth aspect, since the reproduction is automatically performed at predetermined time intervals, the trouble of switching can be saved. According to the thirteenth aspect of the present invention, the self-moving image whose shooting position is in the vicinity and the moving image obtained from the outside are continuously reproduced. According to the fourteenth aspect, the moving image is continuously played back in units of shooting positions, and when these images are finished, the moving image at the next shooting position is played back, so that the trouble of switching can be saved.

  Hereinafter, a preferred embodiment will be described using a playback apparatus (image playback apparatus) to which the present invention is applied according to the drawings. The playback apparatus according to the embodiment of the present invention can be connected to a network such as the Internet, can acquire material information from an external database, and can store moving images and still images taken by a user personally. The playback apparatus has an image display unit and a playback function for these images.

  FIG. 1 is a block diagram showing a configuration of a playback apparatus 10 according to the first embodiment of the present invention. The playback apparatus 10 includes a control unit 11 including a CPU (Central Processing Unit), a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a data reading unit 14, a storage unit 15, a display control unit 16, and a display unit. 17, an audio control unit 18, a speaker unit 19, an operation unit 20, a recording unit 21, a communication unit 22, and a data bus 23.

  The control unit 11, ROM 12, RAM 13, data reading unit 14, storage unit 15, display control unit 16, audio control unit 18, recording unit 21, and communication unit 22 in the playback apparatus 10 are connected by a data bus 23. The playback apparatus 10 is connected to the provided image database 102 via a communication network such as the communication unit 22 and the network 101.

  A control unit 11 in the playback apparatus 10 performs overall control of the playback apparatus 10 according to a control program stored in a ROM 12 configured with a flash memory, a hard disk, or the like. The control unit 11 is provided with a playback control unit 11a and a search unit 11b as processing functions, which are substantially executed by a control program, but may be configured by dedicated hardware.

  The search unit 11b reads the management information of the user image selected at the start of reproduction by the data reading unit 14 from the image file in the storage unit 15, and uses the user information from the position information (for example, GPS data) recorded in the management information. Determine the shooting position. Then, the storage unit 15 is searched for a provided image from a business operator at a position that is the same as or close to the shooting position of the user image. If there is a corresponding provided image, the data reading unit 14 decompresses it and reads it. The provided image is not limited to one and may be a plurality.

  In addition, the search unit 11b searches for a provided image with one file of the selected user image as a unit. Therefore, when the shooting position moves within one file, a plurality of provided images from the same company or a plurality of provided images of a plurality of companies are searched.

  The reproduction control unit 11a controls switching between the main image and the auxiliary image in accordance with an instruction from the operation unit 20 or the timer. From the retrieved auxiliary images, the provided images corresponding to the shooting positions of the main images are appropriately combined and reproduced. Note that the control unit 11 has a built-in timer function.

  As described above, the ROM 12 is composed of a memory such as a hard disk, and stores a control program of the control unit 11 and the like. The RAM 13 is composed of an electrically rewritable volatile memory such as a DRAM, and is a temporary storage unit. Here, temporary storage of the image data when the display image is generated is performed. The data reading unit 14 is a reading unit for data stored in the storage unit 15 or the like.

  The storage unit 15 stores a user still image and user moving image (first image) taken by the user, and a provided still image and provided moving image (second image) acquired from the database 102 of an external company or the like via the network 101. Remember. Here, the shooting position and the shooting date / time are stored in association with each image of the first image stored, and the shooting location is stored in association with each image of the second image.

  FIG. 2 shows an example of image data stored in the storage unit 15. In this example, user moving images A to C... Are stored as the first image, and shooting times and shooting locations PA to PC and shooting dates and times TA to TC are associated with each of the user moving images A to C. ing. Further, provided moving images a1, a2, c1, c2 to c8,... Are stored as second images, and the shooting time, shooting location PA, PC1, PC2 to PC8 are associated with each provided moving image. .

  The display control unit 16 is connected to a display unit 17 constituted by a display monitor such as a liquid crystal monitor, and controls the creation of a display image in the RAM 13 under the control of the reproduction control unit 11a. The audio control unit 18 is connected to the speaker 19, generates an audio signal based on audio data attached to the user moving image or the provided moving image, and outputs the sound signal to the speaker 19.

  The operation unit 20 includes a user interface such as a keyboard and a mouse, and inputs various operation commands to the control unit 11. The recording unit 21 compresses various data such as image information and text information captured by the user and records them in the storage unit 15. The communication unit 22 transmits and receives the provided image data 102 and the like through a network such as the Internet.

  The database 102 is a database operated by an external company or the like, and the provided moving image in which accompanying information such as a shooting location is recorded is stored in the database 102. The playback apparatus 10 stores the provided moving image acquired from the database 102 in the storage unit 15.

  The playback apparatus according to the first embodiment of the present invention may be a playback-only machine or a commercially available personal computer, and can be connected to the external database 102 via the network 101 or the like. Good.

  The reproducing apparatus 10 stores a program for executing an operation described below in the ROM 12. Before explaining the flowchart related to this program, the reproduction display operation in the reproduction apparatus 10 will be described with reference to FIG. Note that the storage unit 15 of the playback apparatus 10 will be described assuming that the first and second images shown in FIG. 2 are stored.

  FIG. 3A shows a timing chart of the main image and the auxiliary image displayed on the display unit 17, and FIG. 3B shows a display state on the display unit 17 at each timing. Prior to viewing an image, first, an image file to be viewed is selected, and related provided images are searched using the shooting location as a key.

  When the preparation for viewing the image is complete, the operation unit 20 instructs to start moving image reproduction at time t1. Initially, the user image A photographed by the user is the main image 51, and the provided images a1 and a2 acquired from the database 102 are the auxiliary images 52, as shown in (T1) of FIG. Is displayed. Here, the user moving image A is reproduced as a moving image on the parent screen (large screen). On the other hand, the provided images a1 and a2 are displayed as still images on a sub-screen (small screen). A thumbnail is displayed as a still image.

  When the user moves the cursor or the like to the provided image a1 and clicks (time t2) during the reproduction of the moving image of the user moving image A, the provided moving image a1 is displayed on the main image 51 (parent screen) as shown in (T2) of FIG. ) Starts playing the moving image, and the user moving image A is displayed as a still image as the auxiliary image 52 (child screen). Here, the still image is a thumbnail image of the user moving image A stopped at time t2.

  At time t2, moving image playback of the provided image a1 is started, and at time t3, the moving image playback time is completed, and playback of the provided moving image a1 ends. At the same time, as shown in (T3) of FIG. 3, the reproduction of the moving image of the user image A is resumed. At this time, as shown in (T3), the thumbnail of the provided moving image a2 is displayed on the auxiliary image 52 (sub-screen), but the provided moving image a1 is not displayed because the reproduction has already been completed.

  While the user image A is being reproduced, if the user moves the cursor or the like to the provided image a2 displayed on the auxiliary image 52 (child screen) and clicks (time t4), the provided image is provided as shown in (T4) of FIG. The image a2 starts to be played back as a moving image on the main image 51 (parent screen), and the user image A is displayed as a still image as the auxiliary image 52 (child screen). Here, the still image is a thumbnail image of the user image A at time t4.

  When the user moves the cursor or the like to the user image A displayed on the auxiliary image 52 (sub-screen) and clicks (time t5) during the reproduction of the provided image a2, the user as shown in (T5) of FIG. The reproduction of the image A is resumed as a moving image on the main image 51 (parent screen). Since the provided image a2 has not been reproduced, the provided image a2 is displayed as a still image as the auxiliary image 52 (child screen). Here, the still image is a thumbnail image at time t5.

  While the user image A is being reproduced, when the user moves the cursor or the like to the provided image a2 displayed on the auxiliary image 52 (child screen) and clicks (time t6), the provided image is provided as shown in (T6) of FIG. The image a2 resumes reproduction as a moving image on the main image 51 (parent screen), and the user image A is displayed as a still image as the auxiliary image 52 (child screen). Here, the still image is a thumbnail image at time t6.

  When the user moves the cursor or the like to the user image A displayed on the child screen at the timing when the moving image reproduction of the provided image a2 is finished, and clicks (time t7), as shown in (T7) of FIG. The user image A is resumed as a moving image in the main image 51 (parent screen). The provided image a <b> 2 is not displayed as a thumbnail on the child screen of the display unit 17 when the reproduction ends. In this example, there are only two auxiliary images related to the user image A, the provided images a1 and a2. When the provided image a2 is reproduced, the provided image is not displayed.

  When the moving image reproduction of the user image A ends (time t8), the user image B is automatically reproduced as a main image 51 as shown in (T8) of FIG. In this example, since the provided image having the same shooting location as the user image B has not been searched, the provided image is not displayed as a thumbnail on the child screen during the reproduction of the moving image of the user image B.

  When the moving image reproduction of the user image B ends (time t9), the user moving image C is automatically reproduced as the main image 51 as shown in (T9) of FIG. In this example, eight provided images having the same shooting location as the user image C are searched and there are a large number of images. For example, the triangle mark 54 may be displayed without displaying all of them. When the user wants to view the provided image, the provided image is displayed as a thumbnail sequentially by clicking the triangle mark 54.

  Next, the operation in the first embodiment of the present invention will be described using the flowchart shown in FIG. When the playback mode is entered, it is first determined whether or not a user image to be played back has been selected (S11). In this step, an image to be reproduced this time is selected from a plurality of user images stored in the storage unit 15. In the example shown in FIG. 2, three user images A, B, and C are selected.

  In the determination in step S11, it waits for image selection, and when a user image is selected, next, a provided image corresponding to the user image is searched (S12). In this step, the search unit 11b searches the database 102 provided by one or a plurality of businesses for the provided image at the same or close location where the shooting location or the like is. The retrieved provided image is stored in the storage unit 15. Of course, if the provided image is already stored in the storage unit 15, it may be used.

  Subsequently, it is determined whether or not there is a provided image corresponding to the selected user image (S13). This determination is made because the provided image is not always searched. If the result of determination in step S13 is that there is a provided image, the first user image and the corresponding provided image are read (S14). In this step, in the example shown in FIG. 2, the user image A and the provided images a1 and a2 corresponding to the user image A are read from the storage unit 15.

  Subsequently, it is determined whether or not the user image is displayed as a main image (S15). At first, the user image is set as the main image as a default, but as described above, the main image can be changed based on the user's operation. In this step, whether or not this operation is performed is determined. Make a decision.

  If the result of determination in step S15 is that the user image is the main image, the user image is displayed as the main image 51 (S16). Subsequently, it is determined whether or not an instruction to switch the provided image has been issued from the user image (S17). In the example of FIG. 3 described above, an instruction to switch to a provided image is given at times t2, t4, and t6.

  If the result of determination in step S17 is that there has been no switching instruction, it is determined whether or not an off operation has been performed (S18). When the user forcibly ends the playback mode, the operation unit 20 clicks the end icon or the like, so in this step, it is determined whether or not the off operation has been performed.

  If the result of determination in step S18 is that an off operation has been made, this playback mode is terminated. On the other hand, if the result of determination is that an off operation has not been performed, it is determined whether or not user image reproduction has ended (S19). In step S11, a plurality of user images can be selected. In this step, it is determined whether or not the reproduction of one user image among the plurality of user images is finished. In the example of FIG. 3 described above, this corresponds to the timing at time t8.

  If the result of determination in step S19 is that playback of user images has not ended, processing returns to step S15. On the other hand, when the user image has been reproduced, the next user image is selected (S20). In the example of FIG. 3 described above, when the reproduction of the user image A is completed (time t8), the user image B is reproduced. When the next user image is selected, the process returns to step S12.

  If the user image is not the main image in step S15 or if there is an instruction to switch to the provided image, the provided image is displayed as the main image (S22). In the example of FIG. 3 described above, this corresponds to the timings T2, T4, and T6. Subsequently, as in step S18, it is determined whether or not an off operation has been performed (S23).

  If the result of this determination is that an off operation has been performed, playback mode termination processing is performed to terminate this playback mode. On the other hand, if the off operation has not been performed, it is determined whether or not there is an instruction to switch the user image from the provided image (S24).

  If the result of determination in step S24 is that there has been no switching instruction, it is determined whether or not reproduction of the provided image has ended (S25). If the result of this determination is that playback of the provided image has not been completed, processing returns to step S22 and playback of the provided image is continued.

  If the result of determination in step S24 is that an instruction to switch to a user image has been given, or if the result of determination in step S25 is that reproduction of the provided image has ended, step S16 is performed to reproduce the user image. Jump. When the reproduction of the provided image is finished in step S25, the reproduction of the main image is resumed at the timing of time t3 in the example of FIG.

  As a result of the determination in step S13, if there is no provided image corresponding to the selected user image, the image is reproduced without the provided image. First, the selected user image is read (S30), and the read user image is reproduced (S31).

  Subsequently, as in steps S18 and S23, it is determined whether or not an off operation has been performed (S32). If the result of this determination is that an off operation has been made, processing for ending the playback mode is performed, and then the playback mode is ended. On the other hand, if the result of determination is that an off operation has not been performed, it is determined whether or not the shooting position has moved (S33). This determination is performed based on the shooting position information recorded together with the user image.

  If the result of determination in step S33 is that the shooting position has moved, processing returns to step S12. When the shooting position changes, there is a possibility that the provided image may exist. Therefore, the process returns to step S12 and the provided image is searched. On the other hand, if the result of determination in step S33 is that the shooting position has not moved, it is determined whether or not the reproduction of the user image has been completed as in step S19 (S34).

  If the result of determination in step S34 is that playback of the user image has not ended, the process returns to step S30, and playback of the user image is continued. On the other hand, if the reproduction of the user image is completed as a result of the determination, the next user image is selected as in step S20 (S35). When the next user image is selected, the process returns to step S12.

  Thus, in the flow of the reproduction mode, the user image and the provided image can be switched and displayed based on the user switching instruction. Note that when the next user image is selected in steps S20 and S35, if the reproduction of the last user image has been completed, a reproduction mode end process may be performed to end the reproduction mode. .

  As described above, in the present embodiment, the provided image photographed at the same position as the photographing position photographed by the user (including the vicinity of the same position unless otherwise specified) is retrieved and the provided image is stored. When the user image is stored in the unit 15 and the user image is reproduced, one of the images is set as the main image 51 and the other is set as the auxiliary image 52 in accordance with the user's instruction so that both images are reproduced and displayed. Yes. Further, when displaying and reproducing, the reduced image of the other image set as the auxiliary image 52 is combined with the one image set as the main image 51 and displayed.

  For this reason, compared with the case of only a user image, there is no possibility of redundancy and it is possible to realize image reproduction with excellent appreciation. Further, since the image set as the auxiliary image is displayed as a reduced image, the contents of the auxiliary image can be intuitively understood.

  Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, the shooting position is discontinuous, but in the second embodiment, the shooting position changes continuously. For example, in a department store, a building or the like, a moving image shot while searching for each area is reproduced and displayed.

  Since the configuration of the second embodiment is the same as that of the playback apparatus 10 shown in FIG. 1, detailed description thereof is omitted.

  FIG. 5 shows a state in which the user has moved in the building. The building is divided into areas E1 to E8, and the user has moved along the movement routes R1 to R9. At this time, the user takes a user moving image C, which is stored in the playback device 10. Moreover, about the image | video (moving image) in this building, it is stored in the external database 102, and the reproducing | regenerating apparatus 10 acquires this, and memorize | stores it as provision animation c1-c5. The provided moving images c1 to c5 are provided with shooting position information as in the first embodiment.

  When reproduction is started, on the route R1 in the area E1, the user moving image C is displayed on the display unit 17 as the main image 51 and the provided moving image c1 is displayed as the auxiliary image 52 (T11 in FIG. 6). Subsequently, even when the route R2 in the area E2 is reached, the user moving image C is displayed as the main image 51 and the provided moving image c2 is displayed as the auxiliary image 52 (T12 in FIG. 6). Similarly, in the area E5 and the route R3, the user moving image C is displayed as the main image 51, and the provided moving image c5 is displayed as the auxiliary image 52 (T13 in FIG. 6).

  When the provided moving image c5 is clicked by the operation unit 20 during the reproduction of the provided moving image c5, the provided moving image c5 is switched to the main image 51, and the user moving image C is switched to the auxiliary image 52 and displayed (FIG. 6). T14). Subsequently, when moving to the route R7 in the area E5, since the reproduction and display of the provided image c5 is completed, the reproduction of the user moving image c5 is completed, and the user moving image C is reproduced and displayed as the main image 51 (FIG. 6). T15). At this time, since the reproduction of the provided moving image c5 is completed, the thumbnail of the provided moving image c5 is not displayed.

  Subsequently, when moving to the route R9 in the area E1, the user moving image C is displayed as the main image 51, and the provided moving image c1 is displayed as the auxiliary image 52 (T16 in FIG. 6). If the reproduction of the provided moving image c1 is completed at T11, the thumbnail is not displayed.

  The flowchart in the present embodiment also serves as the flowchart shown in FIG. However, in the flowchart shown in FIG. 4, it is not detected that the photographing position has moved in steps S15 to S19. If the shooting position has moved, it is sufficient to return to step S12 and search for a provided image, as in step S33.

  Thus, in the present embodiment, the provided image is switched according to the shooting position of the user image being reproduced. For this reason, the provided images are sequentially switched along the shooting position so that the images are not redundant, and the moving image is excellent in appreciation.

  Next, a third embodiment of the present invention will be described with reference to FIG. In the first and second embodiments of the present invention, the user image and the provided image are switched by performing an operation such as clicking the auxiliary image 52. In the third embodiment, the user image and the provided image are automatically switched at a preset time interval.

  Since the configuration of the third embodiment is the same as that of the playback device 10 shown in FIG. 1, detailed description thereof is omitted.

  FIG. 7 shows the time change from the start of reproduction and the reproduction display on the display unit 17 at that time. Here, it is an example in which switching between the user moving image and the provided moving image is performed at intervals of 3 minutes. When the playback mode is entered and playback is started, playback of the user moving image A is first started (T21 in FIG. 7). At this time, the main image 51 is the user moving image A, and the auxiliary image 52 is the provided moving image a1.

  When 3 minutes have elapsed from the start of the reproduction, the reproduction of the provided moving image a1 is automatically started (T21). At this time, the provided moving image a1 becomes the main image 51, the user moving image A becomes the auxiliary image 52, and a thumbnail is displayed as a still image. When the reproduction of the provided moving image a1 is finished, the reproduction of the user moving image A is resumed (T23 in FIG. 7). At this time, the user moving image A becomes the main image 51, and the provided image a2 is displayed as a thumbnail as a supplementary image 52 as a still image.

  When the provided moving image c1 and the user moving image A are combined and reproduced for 3 minutes (that is, when 6 minutes have elapsed from the beginning), the provided moving image a2 is reproduced (T24 in FIG. 7). At this time, the provided moving image a2 becomes the main image 51, and the user moving image A becomes the auxiliary image 52.

  As described above, in the third embodiment, the provided image interrupts the user image at a predetermined time interval (3 minutes in the example of FIG. 7), and the image is automatically switched. For this reason, since the user is automatically switched without switching between the provided image and the user image, it is convenient to save time and effort.

  In the present embodiment, the provided image is played back within a predetermined time, and the user video is played back during the remaining time (T22, T24). Various changes may be made to the time distribution, such as playing and then playing the provided moving image.

  The flowchart for executing the third embodiment is a flowchart shown in FIG. 4, such as determining whether a predetermined time has elapsed by a timer in the playback apparatus 10 instead of determining the switching instruction in step S <b> 17. In addition, it may be modified or changed as appropriate.

  Next, a modification of the auxiliary image in the first to third embodiments of the present invention will be described with reference to FIG. In the first to third embodiments, the still image (thumbnail) of the main image or the provided image is displayed as the auxiliary image.

  However, in addition to the thumbnail display, for example, provided video icons 31 and 32 may be displayed as shown in FIG. 8A, and personal video icons may be displayed as shown in FIG. 8B. 33 may be displayed. Further, it may be a mark that can be identified, not an icon.

  Next, a fourth embodiment of the present invention will be described with reference to FIG. In the first to third embodiments, the main image 51 and the auxiliary image 52 are simultaneously displayed on the parent-child screen. In the fourth embodiment, the provided image is automatically displayed on the display unit 17 after the reproduction of the user moving image is completed.

  FIG. 9 shows the time change from the start of reproduction and the reproduction display on the display unit 17 at that time. As shown in the figure, first, the user moving image A is reproduced and displayed (T31), and when the reproduction of the user moving image A is completed, the reproduction of the provided moving image a1 corresponding to the shooting location A is started (T32). When the reproduction of the provided moving image a1 is completed, the provided moving image a2 corresponding to the shooting location A is also reproduced (T33). When the reproduction of the provided moving image a2 is completed, the reproduction of the user moving image B is started since all the provided moving images corresponding to the shooting location A of the user moving image A have been reproduced (T34).

  The flowchart shown in FIG. 9 is modified as appropriate to the flowchart shown in FIG. 4, such as determining whether or not the reproduction of the user image has ended instead of determining the switching instruction in step S17. Change it.

  As described above, in the present embodiment, first, a user image is reproduced, and when the reproduction of the user image is completed, the provided image is reproduced sequentially. When the reproduction of the provided image is completed, the next user image is reproduced. Move.

  Therefore, in this embodiment, the user image and the provided image are sequentially reproduced, so that the user moving image does not become redundant and the user can enjoy and appreciate the image. Further, in the present embodiment, all user images and all provided images can be viewed serially and never missed.

  In the present embodiment, the provided moving image is reproduced after the user moving image is reproduced. However, this order may be reversed.

  As described above, in each embodiment of the present invention, a user moving image shot by an individual is not reproduced as it is, but a provided image is searched from the outside based on information such as a shooting location. The user image is reproduced while weaving. For this reason, compared with the case where only the user moving image is reproduced, it is possible to enjoy viewing without being redundant.

  In the first and second embodiments described above, the provided image can be displayed as an auxiliary image, and can be reproduced and displayed as a main image as appropriate according to the user's preference. In the third and fourth embodiments, the user image and the provided image can be automatically switched and reproduced and displayed, and it is not necessary to manually switch the images one by one.

  In each embodiment of the present invention, the user images are limited to those taken by the user himself / herself, but it is of course possible to include images taken personally such as friends who traveled together. It doesn't matter.

  In each embodiment, moving image reproduction has been described. However, the present invention is not limited to this, and the present invention can also be applied to a case where still images are reproduced continuously as in a slide show. In this case, the first to fourth embodiments are used while searching for a provided image as a still image based on information such as the shooting location and shooting date / time of the user's still image and reproducing the user's still image as a slide show. The provided image may be reproduced as described above.

  Furthermore, in each embodiment of the present invention, the provided image is acquired from the external database 102 via the network 101. However, the present invention is not limited to this, and it may be obtained from various external devices other than the playback device 10 according to the present embodiment, such as a camera, a personal computer, an image editing device, an external memory such as a CD or a DVD.

  Furthermore, each process of the control unit 11 is not limited to being realized by software such as an image reproduction program, and a part or all of the processing may be configured by hardware. Further, the display control unit 16 described as hardware may be configured by software. These configurations are design matters.

  Furthermore, as a recording medium, besides a flash memory, an optical recording medium such as a CD-ROM or DVD, a magnetic recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Furthermore, in each embodiment of the present invention, an example in which the present invention is applied to an image reproduction device has been described.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a block diagram which shows the structure of the reproducing | regenerating apparatus concerning 1st Embodiment of this invention. It is a figure which shows the image data stored in the memory | storage part 15 of the reproducing | regenerating apparatus concerning 1st Embodiment of this invention. In the first embodiment of the present invention, it is a diagram for explaining the image reproduction operation, (A) is a time chart of the display of the main image and the auxiliary image, (B) shows the reproduction display state in the display unit. FIG. It is a flowchart which shows operation | movement of the reproduction | regeneration mode of the reproducing | regenerating apparatus concerning 1st Embodiment of this invention. In the second embodiment of the present invention, it is a diagram for explaining the operation of image reproduction, showing the movement route of the user. In 2nd Embodiment of this invention, it is a figure which shows the reproduction | regeneration display state in a display part. In the third embodiment of the present invention, it is a diagram for explaining an image reproduction operation, and is a diagram showing a time chart for displaying a main image and an auxiliary image, and a reproduction display state on a display unit. In 1st thru | or 3rd embodiment of this invention, the modification of an auxiliary image is shown, (A) shows the icon of a provided moving image, (B) is a figure which shows the icon of a personal moving image. In the fourth embodiment of the present invention, it is a diagram for explaining the image reproduction operation, and is a diagram showing a time chart for displaying the main image and the auxiliary image and a reproduction display state on the display unit.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Playback apparatus, 11 ... Control part, 11a ... Reproduction control part, 11b ... Search part, 12 ... ROM, 13 ... RAM, 14 ... Data reading part, 15 ... Storage unit, 16 ... Display control unit, 17 ... Display unit, 18 ... Audio control unit, 19 ... Speaker, 20 ... Operation unit, 21 ... Recording unit, 22 ... Communication part, 31-33 ... icon, 51 ... main image, 52 ... auxiliary image, 54 ... triangle mark, 101 ... network, 102 ... database

Claims (14)

For two types of images, a first image shot by a general user and an image provided by a business operator and a second image shot at a shooting position corresponding to the shooting position of the first image, A reproduction control unit configured to set one of the main images and the other as an auxiliary image according to the instruction, and reproduce the combination of the two types of images;
A display control unit that creates a composite image by combining the reduced image or identification mark of the other image set as the auxiliary image with the one image set as the main image, and displays the composite image;
An image reproducing apparatus comprising: The display control unit displays at least two or more second images when the reproduction control unit sets the second image as an auxiliary image and there are a plurality of second images to be the auxiliary image. A plurality of reduced images each reduced or a plurality of corresponding identification marks are combined with the main image to create and display the combined image,
2. The reproduction control unit according to claim 1, wherein, when selected on the composite screen, the reproduction control unit sets and reproduces one reduced image or a second image corresponding to the identification mark as a main image. Image playback device. The reproduction control unit switches and displays a composite image having the first image as the main image at the end of reproduction of the second image set as the main image,
3. The image reproduction device according to claim 2, wherein the display control unit does not display the reduced image or the identification mark of the second image for which reproduction has ended after completion of the reproduction in the composite image. .   The reproduction apparatus according to claim 1 or 2, wherein the reproduction control unit displays the auxiliary image as a still image obtained by extracting a part of the auxiliary image from a moving image. An operation unit for instructing switching of the main image;
The image reproduction apparatus according to claim 1, wherein the reproduction control unit sets a main image based on an instruction from the operation unit.   The reproduction control unit switches and sets the main image from the first image to the second image when the first image as the main image has been reproduced for a predetermined time. The image reproducing apparatus according to claim 1, wherein: A storage unit for storing the first image and the second image;
A search unit that searches the storage unit for the second image corresponding to the first image based on the shooting position of the first image;
The image reproducing apparatus according to claim 1, further comprising: For two types of images, a first image shot by a general user and an image provided by a business operator and a second image shot at a shooting position corresponding to the shooting position of the first image, In accordance with an instruction, setting one of the images as a main image and the other as an auxiliary image;
Combining the reduced image or the identification mark of the other image set as the auxiliary image with the one image set as the main image to create a combined image;
An image reproduction method comprising the step of displaying the composite image and reproducing the two kinds of images in combination. In a program for controlling image reproduction by a computer,
For two types of images, a first image shot by a general user and an image provided by a business operator and a second image shot at a shooting position corresponding to the shooting position of the first image, Setting one of the images as a main image and the other as an auxiliary image according to an instruction;
Creating a composite image by synthesizing with one of the images set as the auxiliary image;
A program characterized by including a step of displaying the composite image and reproducing the two kinds of images in combination. Two types of images are stored: a first image captured by a general user as a moving image and a second image captured from the outside and captured at a shooting position corresponding to the shooting position of the first image. And steps to
A step of setting one of the stored first and second images as a main image and the other as an auxiliary image, and reproducing a combined image obtained by combining the two types of images;
A program that causes a computer to execute.   11. The program according to claim 10, wherein the auxiliary image is displayed as a still image, and is reproduced as a moving image as a main image when an instruction to start reproduction of the auxiliary image is given.   The program according to claim 10, wherein the second image is reproduced and displayed as a main image at a predetermined time interval. Two types of images are stored: a first image captured by a general user as a moving image and a second image captured from the outside and captured at a shooting position corresponding to the shooting position of the first image. A storage unit to
A reproduction display unit that combines the first image stored in the storage unit and the second image captured at the imaging position corresponding to the first image, and continuously reproduces the two,
An image reproducing apparatus comprising:   14. The image reproducing apparatus according to claim 13, wherein when the reproduction of the second image photographed at the photographing position corresponding to the first image is finished, the next first image is reproduced.