JP2020074041A - Imaging device for gaming, image processing device, and image processing method - Google Patents

Abstract

To provide an imaging device for gaming and an image processing method with which it is possible to image and edit a moving-image following a simple procedure, with the time and effort of a user eliminated.SOLUTION: In an imaging device 100 for gaming, a display control unit 135 displays a sample moving-image on a screen for showing a sample of subject motion during imaging of a moving-image to a user, and after terminating the display of the sample moving-image and switching to the real-time display of a user's video imaged by an imaging unit 132, an image acquisition unit 133 images the moving-image of the user and repeats a series of processes of displaying the sample moving-image and imaging the moving-image of the user, thereby acquiring a plurality of moving-images. A moving-image processing unit 144 sets, to a template moving-image in which a three-dimensional object is displayed, a moving-image for display with which a plurality of moving-image frames are buried in each of a plurality of frame shapes included in the three-dimensional object and reproduced.SELECTED DRAWING: Figure 8

Description

  The present invention relates to a game shooting device for games and an image processing method, and more particularly to a device and method for processing shooting and editing of a moving image.

  Conventionally, an image capturing device for amusement and a game device for amusement in which an object including a plurality of users can be photographed by a camera a plurality of times Photography services are known. Many of such amusement photographing devices have been proposed that can perform the following editing processing according to the user's preference. First, chroma key processing is performed on the captured image of the subject to generate a subject image in which the subject portion is extracted. Then, after the background image selected by the user is combined with this subject image, editing processing such as correction of eye color and size, skin color, face outline, and superimposing characters and patterns It goes through (generally called “graffiti”) to produce the final image for printing. In addition, by providing such editing functions so that multiple users who shoot together can operate them with a touch pen at the same time, friends can enjoy themselves from shooting to editing, which is becoming popular.

JP, 2005-55838, A

  In the above-described game shooting device for play, a device capable of shooting not only still images but also moving images has been developed in recent years (see, for example, Patent Document 1). However, in the case of a moving image, unlike a still image, shooting does not end in an instant, so the present inventor has realized that more efficient procedures and effective procedures are required to reduce waiting time and shooting failures. ..

  The present invention has been made in view of these problems, and an object of the present invention is to provide a game shooting device and an image processing method capable of shooting a moving image and editing the moving image by a simple procedure without the user's effort. ..

  In order to solve the above-mentioned problems, a game shooting apparatus according to an aspect of the present invention includes a shooting space in which shooting is performed with a user as a subject, an image pickup unit that picks up an image including the user as a subject in the shooting space, and an image pickup unit. An image acquisition unit that acquires a moving image of the user captured by the unit, a display control unit that displays a model moving image on the screen to show the user a model of subject motion during moving image shooting, and an editing process for the moving image And a video processing unit that executes the output process of the moving image. The display control unit switches to real-time display of the user image captured by the imaging unit after the display of the model moving image, and the image acquisition unit captures the moving image of the user after switching to the real-time display, and the display control is performed. The image acquisition unit and the image acquisition unit acquire a plurality of moving images by repeating the process from displaying the model moving image to capturing the moving image of the user. Sets a display moving image to be reproduced by embedding a plurality of moving image frames in each of a plurality of frame shapes included in the three-dimensional object, and the output processing unit displays the set display moving image on the screen. .

  Here, the “output processing” may include displaying the moving image on the screen and uploading the moving image to a server for allowing the user to download the moving image. According to this aspect, a moving image can be shot while the user has a model of the operation memorized, and the shooting can be repeated multiple times by keeping the time interval from the provision of the model to the shooting as close as possible, thereby making it possible to perform an ideal multiple times. It is possible for the user to easily acquire a moving image in which moving images obtained by shooting a moving image are combined.

  Another aspect of the present invention is also a game-playing device. This apparatus includes a shooting space in which shooting is performed with a user as a subject, an image capturing unit that captures an image including the user as a subject in the shooting space, and an image capturing unit that captures a moving image of the user captured by the image capturing unit. A moving image processing unit that executes an editing process on a moving image, and an output processing unit that executes an output process on a moving image. The image acquisition unit captures a moving image at a first frame rate, and the moving image processing unit sets the captured moving image as a display moving image to be reproduced at a second frame rate higher than the first frame rate. Then, the output processing unit displays the set display moving image on the screen.

The first frame rate can be lower than normal.
Here, “lower than normal” may mean lower than the frame rate of general moving image shooting, or at least lower than “second frame rate”. According to this aspect, the image is reproduced like fast-forward, which is faster than the actual operation speed of the object to be photographed, so that a moving image in which the user's awkward motion is made inconspicuous can be easily created in the game-playing device. Can be provided. Also, by shooting at a frame rate lower than the frame rate during playback, it is possible to shoot in a form in which unnecessary frames are removed from the beginning, the data size of the moving image can be reduced, and the processing load on the device can be reduced. The efficiency of processing can be improved.

  Yet another aspect of the present invention is an image processing method. This method includes the steps of capturing an image including the user as a subject in a predetermined capturing space provided in the game capturing device as a space in which the user is captured as a subject, and obtaining a moving image of the captured user. The step of setting the moving image to be played back by embedding the frame of the moving image acquired in the image frame included in the predetermined template moving image as the moving image for display, and embedding the frame of the moving image in the template moving image and this moving image in the first frame And a step of setting a moving image in which an image showing the characteristics of the image is inserted as a moving image for transmission.

  As the "image showing the characteristics of this moving image", a character string including the name of the template moving image or the moving image theme or an image in which a motif such as a pattern or a picture symbolizing the moving image theme is displayed may be used. A frame in which a person is detected by person detection in a moving image may be used. The process of “embedding the frame of the moving image acquired in the image frame included in the predetermined template moving image” may be executed by the amusement device for amusement, or by the management server that allows the user to download the moving image. It may be executed by the user's mobile terminal. According to this aspect, since the first frame of the moving image includes the image showing the characteristics of the moving image, the first frame is displayed when the moving images are displayed as a list or when thumbnails are displayed in SNS (Social Networking Service). It is automatically displayed as a thumbnail still image. This allows you to see what the moving image will look like when it is displayed in thumbnail format, for example, an image with no features will be the first frame, or an image with nothing in black will be the first frame. It is possible to avoid a situation in which a clue as to whether the moving image is a proper moving image is not displayed. Further, it is possible to easily present the information that makes the person who views the thumbnail want to reproduce it.

  It should be noted that any combination of the above constituent elements, and the expression of the present invention converted between a method, a device, a system, a computer program, a data structure, a recording medium, etc. are also effective as an aspect of the present invention.

  According to the present invention, it is possible to provide an amusement photographing device and an image processing method capable of photographing a moving image and editing the same in a simple procedure without a user's effort.

It is a figure which shows typically the whole structure of a photography system. It is the perspective view which looked at the imaging device for games from the left front side. It is the top view which looked at the imaging device for games shown in FIG. 2 from the top. It is a perspective view of an imaging housing. It is a perspective view of an edit case. It is a front view of an output housing. It is a block diagram which shows typically the hardware constitutions of the imaging device for games. It is a functional block diagram which shows typically the functional structure of the imaging device for games. 6 is a flowchart showing a process from presetting to actual shooting. It is a flowchart which shows the process of correction and edit. It is a flowchart which shows the process of an output process. It is a figure which shows the example of a screen which allows a user to select the content of video recording in preset. It is a figure which shows the example of the guidance screen displayed before the start of video recording. It is a figure which shows the screen transition of the first half of a video recording process. It is a figure which shows the screen transition of the latter half of a video recording process. It is a figure which shows the example of the template moving image using the frame image of a three-dimensional object. It is a figure which shows the example of the guidance screen which guides provision of an edited moving image. It is a figure which shows the example of the initial state of the edit screen displayed on an edit monitor. It is a figure which shows the example of the state in which the moving image edit was started in the edit screen. It is a figure which shows the example of the state which selected the still image embedded in a template moving image on an edit screen. It is a figure which shows the example which implements graffiti on a template animation on an edit screen.

(First embodiment)
<Outline of photography system>
FIG. 1 is a diagram schematically showing the overall configuration of a photography system 600. The photography system 600 includes an amusement photography device 100, a management server 300, an SNS server 400, and a plurality of terminal devices 500 connected via a network 200 such as the Internet. In this figure, two terminal devices, that is, the terminal device 500a and the terminal device 500b are illustrated, but the number of the terminal devices 500 is not limited to two and may be three or more. Hereinafter, in the present specification, each terminal device 500 will be simply referred to as a “terminal device 500” unless otherwise specified.

  The game-playing device 100 is a device including a camera that photographs a subject including a user and an electronic device that includes a user interface for editing the photographed image. When the user takes a picture with the amusement photography device 100, the amusement photography device 100 associates the photograph image group including the user as a subject, the play ID, and the mail address entered in the amusement photography device 100 with each other. It is transmitted to the management server 300. The play ID is identification information uniquely assigned to each play, and is unique identification information for identifying the model and play in the store where the play is performed. The photographic image group refers to a plurality of photographed images created and grouped in a predetermined one play. Hereinafter, in this specification, data in which a play ID, a photographic image group, and a mail address are associated with each other will be referred to as “content data”. Further, in the present specification, the term “captured image” includes not only an image obtained by capturing, but also an image that has been corrected or edited after capturing, and has been resized or image quality changed for output. There may be. Similarly, the term "output image" may include an image for screen display, an image for printing, and an image for transmission. Depending on each hardware specification, software specification, communication specification, etc., It may include all that have been resized or image quality changed.

The management server 300 is a server that manages user information such as content data (play ID, photo image group, e-mail address entered in the game shooting device 100 for play) acquired from the game shooting device 100 for play, and usage history of the photo shooting service. Is. The management server 300 transmits the content access information for accessing the photo image group included in the content data to the mail address included in the content data. As a result, the terminal 500 possessed by each user can acquire the mail in which the content access information is described. The content access information is, for example, a URL (Uniform Resource Locator) for accessing the management server 300, and the play ID is included in this URL.
The mobile terminal 500 can acquire the photograph image group associated with the play ID included in the URL by accessing the URL of this email.

  The user accesses the management server 300 based on the content access information by using a dedicated information presenting application designed for the user of the amusement photography device 100 and installed in the user's own terminal device 500, and the user's own terminal. Download a set of photographic images to the device 500. The user can also edit the photographic image group on the terminal device 500. The information presentation application can be downloaded from the management server 300 via the network 200. To the management server 300, a moving image taken by the user with the game shooting device 100 for uploading is uploaded and saved. The user can share the moving image stored in the management server 300 on the SNS provided by the SNS server 400. That is, the URL of the moving image stored in the management server 300 is shared on the SNS server 400, or the user once downloads the moving image from the management server 300 to his / her mobile terminal or computer and then downloads it. The moving image may be posted by being transmitted to the SNS server 400 and shared with other users. At this time, the head frame of this moving image is automatically selected and displayed as a thumbnail on the SNS.

<Appearance of a game machine for playing>
FIG. 2 is a perspective view of the game shooting device 100 for play as seen from the left front side. FIG. 3 is a plan view of the game photographing device 100 shown in FIG. 2 seen from above. In the following, other drawings will be described based on the front, rear, left, and right directions shown in FIG. As shown in FIGS. 2 and 3, the game shooting device 100 for play includes a front shooting unit 50 and a rear editing unit 51, and has a substantially rectangular parallelepiped shape that is long in the front-rear direction. On the left side or the right side of the photographing unit 50, a presetting unit 40 for presetting shooting contents including coin insertion and the number of photographers is provided, and at the rear end of the editing unit 51, output of the edited photo etc. An output unit 52 for performing the operation is provided.

  The image capturing unit 50 includes an image capturing housing 11 having a built-in camera for capturing an image of the user, and a background wall portion 12 arranged behind the image capturing housing 11 via the image capturing space 10. The gap between the side surface of the photographing housing 11 and the side surface of the background wall portion 12 constitutes first entrances 101a and 101b which are entrances to the photographing space 10. The presetting unit 40 has a touch panel 41 that displays setting items of shooting contents including the number of users to receive instructions from the user, and a coin inserting unit 42 that includes a coin insertion slot and a return slot. The case of the presetting unit 40 is detachably attached to the left side surface of the photographing unit 50 in the figure. Good. The user enters the shooting space 10 through the entrance on the side where the presetting unit 40 is attached. The editing unit 51 has an editing housing 21 that is arranged adjacent to the rear of the background wall 12. The editing housing 21 is provided with a pair of operation surfaces facing left and right. The user can enter the editing space 20a, 20b for inputting work on each operation surface through the second entrance 201a, 201b. The output unit 52 has an output housing 31 that is in contact with the rear end surface of the editing housing 21. The operation surface of the output housing 31 faces the rear end side so that the user operates the rear side of the game photographing device 100. Therefore, the space on the rear end side of the output housing 31 becomes the output space 30 for the user to perform the output operation. As a modified example, the game shooting device 100 may be configured without the preset unit 40, or the game shooting device 100 may be configured without the editing unit 51 or the editing space 20. Good.

  Side surfaces of upper ends of the photographing housing 11 and the background wall 12 are connected to each other by a ceiling frame 13 extending in the front-rear direction. A ceiling lighting unit 14 that covers the photographing space 10 from above and illuminates and irradiates a flash is provided inside the ceiling frame 13. On the left side or the right side of the photographic housing 11, there is provided a notice space 15 for demonstrating instructions including how to use the game photographing device 100 for amusement. A display unit 16 that indicates whether or not the imaging housing 11 is in use is provided above the bulletin space 15.

  The display unit 16 includes an indicator light (not shown) that emits light or goes out. The display unit 16 indicates to the user that the photographing unit 50 is in use by the light emission of the indicator lamp, and indicates to the user that the photographing unit 50 has become empty by turning off the light. In the game-taking device 100 for play, the display unit 16 is formed in a triangular shape in plan view protruding outward in the left-right direction, but the shape thereof is not particularly limited and may be another shape such as a convex curve. ..

  The background wall portion 12 is formed by a plate-shaped member having substantially the same width and height as the photographing housing 11, and extends from the main body plate 121 facing the front of the photographing housing 11 and the left and right ends of the main body plate 121 to the front. And a pair of side plates 122 provided. For this reason, the background wall portion 12 is formed in a U shape in a plan view as a whole. On the surface of the body plate 121 facing the photographing housing 11, a single color (for example, blue or green) for chroma key processing is colored. Regarding coloring, the body plate 121 may be directly colored with paint or the like, or colored cloth, plate or the like may be attached. Although not shown, the floor surface of the photographing space 10 is colored with a single color for chroma key processing so as to be continuous with the main body plate 121. As described above, the rear edge of the photographing housing 11, the lower edge of the ceiling frame 13, and the front edge of the side plate 122 form the first entrances 101a and 101b for entering and exiting the photographing space 10. ..

  The editing housing 21 is a face-to-face type that allows two sets of users to edit at the same time from the left and right sides, and an operation surface is provided on each of the left and right sides. The length of the editing housing 21 in the left-right direction is shorter than the width of the background wall portion 12 in the same direction. The editing housing 21 has its front end surface connected to the central portion of the back surface of the background wall portion 12. Spaces on the left and right sides of the editing housing 21 are editing spaces 20a and 20b in which two sets of users perform editing work, respectively. A curtain frame 22 having a substantially U shape in a plan view is provided above the editing housing 21. The curtain frame 22 is composed of a pair of side frames 221 extending in the front-rear direction, and a rear frame 222 extending in the left-right direction connecting rear ends of the side frames 221. Although not shown, a computer including a CPU (Central Processing Unit) such as a PC (Personal Computer) is installed inside the editing housing 21.

  A front end of each side frame 221 is connected to a rear end of the ceiling frame 13 so as to extend in the front-rear direction, and a central portion of the rear frame 222 is supported by a support member 23 provided at a rear upper end of the editing housing 21. To be done. The left and right side frames 221 and the substantially half length of the rear frame 222 constitute the upper frame of the second entrances 201a and 201b for entering and exiting the editing spaces 20a and 20b.

<Shooting case>
FIG. 4 is a perspective view of the photographing housing. A front illumination unit 115 that brightly illuminates the photographing space 10 from the front and irradiates a flash is provided on the indoor side surface of the photographing casing 11. The front lighting unit 115 includes a central upper unit portion 115A and a central lower unit portion 115B. The unit portion 115A and the unit portion 115B on the upper center side are integrally connected and formed in a concave curved shape. At the center of the unit portion 115A, a front camera 111 for mainly taking a close-up image of a subject is mounted. A touch panel type front monitor 113 is provided below the front camera 111, and an image captured by the front camera 111 and guidance of a photographing method are displayed and a user's touch operation input according to the guidance is accepted. On the right side of the front monitor 113, a side camera 112 for taking a wide-angle image of the entire body of the user as a subject is mounted. Below the side camera 112, a side monitor 114 on which an image captured by the side camera 112 is displayed is provided. As a modified example, in the case where the preset unit 40 is not installed outside the shooting space 10, the coin insertion unit 42 may be provided below the front monitor 113 or the side monitor 114. Further, the side camera 112 is not of a touch panel type, but in a modified example, it may be of a touch panel type similarly to the front monitor 113.

<Editing case>
FIG. 5 is a perspective view of the editing housing. The edit housing 21 has a control box 211 on the lower side and an edit table section 212 provided on the control box 211. Inside the control box 211, various control devices such as a main computer unit and an I / O controller are built in, and this control device controls the entire operation of the game shooting device 100 for play.

  The editing table portion 212 is formed by a mountain-shaped inclined surface facing in the left-right direction, and an operation surface for performing editing work is installed on each inclined surface. Specifically, each operation surface is provided with an editing monitor 213 composed of a liquid crystal monitor incorporating a tablet, and two touch pens 214A and 214B are connected to the left and right sides of each editing monitor 213. The editing monitor 213 is a touch panel, and the user touches the pen tips of the touch pens 214A and 214B to the screen of the editing monitor 213 to select an input to select an icon displayed on the screen, and to perform a scribble of characters or drawings. You can enter handwriting when you do. Although the editing monitor 213 on the left side is shown in FIG. 5, the editing monitor 213 on the right side has the same structure as the left side. Further, the control device of the control box 211 can individually perform parallel processing of the processing corresponding to the input information to the editing monitors 213 on the left and right sides.

<Output housing>
FIG. 6 is a front view of the output housing. The output housing 31 is a rectangular housing that is in contact with the rear end of the editing housing 21, and has an operation surface on the surface facing the rear end. A touch-panel type liquid crystal monitor 311 is provided at the center of the upper part of the operation surface, and an explanation of the output is displayed on the liquid crystal monitor 311.

  A non-contact communication unit 312 is provided below the liquid crystal monitor 311 and reads data from or writes data to the non-contact type IC by communicating with a non-contact type IC (Integrated Circuit) adjacent thereto. . For example, FeliCa (registered trademark) or the like can be used. A sticker sheet outlet 313 is provided below the non-contact communication unit 312. A photo print sheet on which an image created by performing an editing process in the editing unit is printed is discharged to the sticker sheet discharge port 313. Therefore, a printer is built in the output housing 31, and the printer prints the photo print sheet. A speaker 314 is provided below the sticker sheet discharge port 313, and outputs sounds such as guide voice, BGM, and sound effects in the output processing. Although the output housing 31 is separate from the editing housing 21 in the present embodiment, these may be integrated into a single housing.

<Hardware configuration of the shooting device for play>
FIG. 7 is a block diagram schematically showing the hardware configuration of the game shooting device 100 for play. In the game shooting device 100 for play, the control unit 53, the storage unit 54, the shooting unit 50, the presetting unit 40, the editing unit 51, and the output unit 52 are electrically connected via the bus X. The control unit 53 includes a known CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory). The control unit 53 executes the program stored in the storage unit 54 and controls the overall operation of the game shooting device 100 for play. A communication unit 55 and an external drive 56 are also connected to the bus X. The control unit 53, the storage unit 54, the communication unit 55, and the external drive 56 may be configured by a known computer, and such a computer is built in the control box 211 of the editing housing 21 described above.

  The storage unit 54 is composed of a nonvolatile storage medium such as a hard disk or a flash memory, and stores various setting information transmitted from the control unit 53. The information stored in the storage unit 54 is appropriately read by the control unit 53. The storage unit 54 stores various image data used for combining and editing images and data for image processing. For example, background image data that is the background of the captured image is stored. The ROM of the control unit 53 stores programs such as firmware and data such as setting information, and the RAM temporarily stores data and programs to be processed by the control unit 53. Hereinafter, the RAM and the ROM may be collectively referred to as a memory.

  The communication unit 55 is an interface for connecting to a network such as the Internet, and communicates with an external device under the control of the control unit 53. The external drive 56 executes reading and writing to removable media such as an optical disk and a semiconductor memory. For example, the computer program or data read from the removable medium by the external drive 56 is transmitted to the control unit 53, stored in the storage unit 54, or installed as a program.

  The presetting unit 40 is a device for receiving preset instructions such as shooting conditions and shooting contents including the number of users from the user prior to shooting, and includes a touch panel 41 and a coin insertion unit 42. The touch panel 41 is a well-known touch panel, and displays guidance to the user as a display device and receives an instruction based on the touch operation of the user. The coin insertion unit 42 detects insertion of a coin into the coin insertion slot. When the coin insertion unit 42 detects that a predetermined amount of coins required for play (play fee) has been inserted, it outputs an activation signal indicating this to the control unit 53. Instead of the coin insertion unit 42, a device that receives payment of a play fee by electronic money or a credit card and outputs the activation signal to the control unit 53 may be provided.

  The image capturing unit 50 includes an illumination control unit 18, a front camera 111, a side camera 112, a front monitor 113, a side monitor 114, and a speaker 19 in order to perform a photographing process in the photographing space 10.

  The front camera 111 and the side camera 112 capture an object under the control of the control unit 53. The front camera 111 and the side camera 112 output to the control unit 53 a dynamic image of the subject obtained by imaging or a still image of the subject obtained by photographing. As described above, the front camera 111 is for mainly shooting up still images and moving images of the subject from the front, and the side camera 112 is for shooting the whole body of the user, who is the subject, from the side in a wide angle. It is for. Therefore, each of the cameras 111 and 112 is set in advance with an ideal focal length, an angle of view, a trimming range, and the like, which differ depending on the number of photographed persons, in order to obtain an optimum image. Each of the cameras 111 and 112 outputs the image of the subject as an image signal in real time. The image signals output from the cameras 111 and 112 are input to the control unit 53 and temporarily stored in the internal memory thereof. In the above-described example, the front camera 111 is used for the individual authentication photographing described later and for photographing in the close-up, and therefore, a zoom lens whose focal length can be changed within a range in which the whole body of the user who is the subject is not reflected is used. In a modification, a zoom lens including a focal length on the wider angle side in the range may be used as the lens of the front camera 111, and both up-shooting and whole-body shooting may be performed by changing the focal length. .. When shooting whole body, the focal length of the zoom lens may be shorter than that in close-up shooting.

  The control unit 53 functions as a display control unit, transmits an image signal of a subject image captured by the front camera 111 to the front monitor 113, receives a user operation input to the front monitor 113 as a touch panel, and receives the side camera. The image signal of the subject video imaged at 112 is transmitted to the side monitor 114. At this time, the control unit 53 may send a video obtained by combining a subject image with a background image by chroma key composition or a still image to the front monitor 113 or the side monitor 114, or a correction process for changing the size or contour of the eyes. The captured video or still image may be transmitted to the front monitor 113 or the side monitor 114. Note that the captured image data (hereinafter, simply referred to as “captured image”) stored as a still image is high-resolution still image data, and the captured image data for displaying live video (“through image data”). Is also low-resolution moving image data in many cases, but may be high-resolution moving image data.

  The front monitor 113 displays the live image being captured by the front camera 111 in real time. The front monitor 113 also displays a captured image as a still image captured by the front camera 111 and the side camera 112. The side monitor 114 is a monitor that displays live images being captured by the side camera 112 in real time and is not a touch panel type unlike the front monitor 113, but may be a touch panel type monitor. Further, the side camera 112 and the side monitor 114 are not indispensable components, and only the front camera 111 and the front monitor 113 may be used.

  The illumination control unit 18 controls the flash emitted by the front illumination unit 115 in the imaging space 10 according to the illumination control signal supplied from the control unit 53. The illumination control unit 18 controls the electric lights (LED, fluorescent light, etc.) provided inside the ceiling illumination unit 14 and the front illumination unit 115, so that the brightness in the imaging space 10 is adjusted according to the stage of the imaging process by the user. Adjust. The speaker 19 outputs a sound according to the stage of the photographing process by the user.

  The editing units 51a and 51b are provided for editing processing in the editing spaces 20a and 20b, respectively. Since the functions and configurations of the editing unit 51a and the editing unit 51b are the same, only the editing unit 51a will be described below, and the description of the editing unit 51b will be omitted.

  The editing unit 51a includes an editing monitor 213 as a tablet built-in monitor, two touch pens 214A and 214B, and a speaker 215. The edit monitor 213 displays an edit screen under the control of the control unit 53, and detects a user's edit operation or the like on the edit screen. That is, when the user touches the edit monitor 213 with the touch pens 214A and 214B, the operation and which of the touch pens 214A and 214B is touched is detected, and is transmitted to the control unit 53 as an operation signal. As a result, the user edits the composite image to be edited. Specifically, so-called graffiti such as characters, patterns, and figures is input to the image displayed on the editing monitor 213 with an input device such as the touch pens 214A and 214B. As a result, an output image in which graffiti is superimposed on the composite image is generated. The image data based on the output image thus generated is transmitted to the output unit 52.

  The output unit 52 executes output processing in the output space 30. The output unit 52 includes a touch panel type liquid crystal monitor 311, a non-contact communication unit 312, and a speaker 314. In addition, a printer 34 for printing an output image and a sticker paper unit 35 are also provided. The printer 34 prints the composite image or the output image obtained by the correction process or the editing process on the sticker paper housed in the sticker paper unit 35 attached to the printer 34, and discharges it to the sticker paper discharge port 313. To do. The contactless communication unit 312 is a wireless communication unit that receives and transmits data with a mobile terminal, and includes, for example, a short-range wireless communication module such as Bluetooth (trademark) or NFC, or a wireless network communication module such as a wireless LAN. included. The image data created by the editing unit 51 is transmitted to the external image storage server via the network by the communication unit 55.

<Functional configuration of the shooting device for play>
FIG. 8 is a functional block diagram schematically showing the functional configuration of the game shooting device 100 for play. The game shooting device 100 for play includes a presetting unit 40, a shooting processing unit 130, a display control unit 135, a data generation unit 140, a data storage unit 150, and an output processing unit 160.

  This figure shows a functional configuration for realizing the game shooting device 100 for play, and other configurations are omitted. In the figure, each element described as a functional block that performs various processes can be configured by a hardware, a camera, a CPU, a main memory, and other LSI (Large Scale Integrated circuit) shown in FIG. 7. In terms of software, it is realized by the CPU executing a program or the like loaded in the RAM. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by only hardware, only software, or a combination thereof, and the present invention is not limited to them.

  Prior to photographing, the presetting unit 40 presets photographing contents such as the number of photographed users, names and group names of subjects, favorite content sets, and favorite moving image themes based on the user's instructions. As the number of persons to be photographed preset by the presetting unit 40, any one of “2 persons”, “3 persons” and “number of adults” is set by the user.

  The image capturing processing unit 130 includes an individual authentication unit 131, an image capturing unit 132, and an image acquisition unit 133. Based on the instruction to start the play received from the presetting unit 40, the image capturing unit 132 follows the control by the individual authentication unit 131 or the image acquisition unit 133, and uses the front camera 111 or the side camera 112 as one or more users as subjects. Take an image. The individual authentication unit 131 executes acquisition of a captured image for authentication, person detection and person authentication for the acquired captured image for authentication. The individual authentication unit 131 executes person detection to detect a person from the acquired photographed image for authentication. The person detection in the present embodiment is, for example, face detection. The individual authentication unit 131 detects a face area by extracting skin color areas and organs such as eyes and noses from a captured image for authentication. The individual authentication unit 131 detects a feature amount such as the distance, arrangement, and size of organs such as eyes and nose from the detected face area, and executes person authentication for identifying the feature of each person based on the feature amount. .. The individual authentication unit 131 temporarily stores the captured image for authentication in the data storage unit 150.

  The image acquisition unit 133 acquires a captured image for the main shooting of the user by capturing the captured image by the imaging unit 132 a plurality of times. In this example, the image acquisition unit 133 executes the main photographing at least five times to generate five photographed images. The image acquisition unit 133 causes the data storage unit 150 to store the acquired plurality of captured images for main imaging as a group of photographic images. More specifically, the image acquisition unit 133 adds the same play ID to the acquired multiple shot images for main shooting, and assigns a unique image identifier to each shot image in order to identify the shot images. To do.

  The image acquisition unit 133 acquires a moving image of the user by capturing a moving image of the subject captured by the imaging unit 132 multiple times. The image acquisition unit 133 executes, for example, moving image shooting three times to acquire three moving images.

  The display control unit 135 causes the image being captured by the image capturing unit 132 (hereinafter referred to as “live view”) to be displayed on the screen of the front monitor 113 or the side monitor 114 in real time. Prior to the start of moving image shooting, the display control unit 135 causes the screen of the front monitor 113 to display a model moving image for showing the user an example of subject movement during moving image shooting. After ending the display of the model moving image, the display control unit 135 switches to the live view of the image of the user captured by the image capturing unit 132. After switching to the live view, the image acquisition unit 133 captures a moving image of the user. Three moving images are acquired by repeating the process from the display of the model moving image to the shooting of the moving image of the user three times. The image acquisition unit 133 stores the acquired moving image in the data storage unit 150 in association with the play ID. The procedure for shooting a moving image will be described later.

  The data generation unit 140 includes a background processing unit 141, a correction processing unit 142, an editing processing unit 143, and a moving image processing unit 144. The background processing unit 141 synthesizes a subject and a background image for each of the authentication captured image, the plurality of main captured images, and the plurality of moving images stored in the data storage unit 150 by a known chroma key composition technique. To do. That is, the background processing unit 141 uses a binarized image or a grayscale image of background information (chroma key mask) for distinguishing a subject in a captured image from a background region that is the other region, or data obtained by compressing them. And obtains an image in which the subject is extracted from the background using the background information. Regarding the captured image for authentication, the background processing unit 141 combines the image of only the subject with a predetermined background image, for example, a background image in which a single achromatic color such as white, gray, or black is applied to one surface. The background processing unit 141 synthesizes the image of only the subject with the preset background image of the user's preference with respect to the captured image for the main shooting. The image of only the subject and the composite image combined with the background image are stored in the data storage unit 150. Regarding the shot image for the main shooting, it is possible to regenerate a new combined image by combining another background image with the image of only the subject in the later editing process. The background processing unit 141 may perform a process of extracting a subject in real time from the live view image being captured by the image capturing unit 132, combining the background images, and displaying the combined image by the display control unit 135. In addition, the background processing unit 141 similarly processes the above-described chroma key composition for the moving image acquired by the image acquisition unit 133 to generate a combined moving image.

  The correction processing unit 142 executes person detection and person authentication in a shot image for main shooting, and also performs correction on the shot image for main shooting. The person detection in the shot image for main shooting is, for example, the same face detection as the person detection in the shot image for authentication. The correction processing unit 142 detects a face area by extracting skin color areas and organs such as eyes and nose from the captured image for main imaging. The person authentication in the shot image for main shooting includes the same processing as the person authentication in the shot image for authentication and the person specifying processing. More specifically, first, the feature amount of each person such as the distance, arrangement, and size of organs such as eyes and nose is detected from the face area detected by the person detection in the shot image for main shooting. The feature amount for each person is collated with the feature amount for each user, which is previously identified by the person authentication in the captured image for authentication and temporarily stored in the data storage unit 150, and based on the comparison result, the main image capturing is performed. The process of identifying which user the person included in the captured image is is "person identification". For example, if there are two pieces of information of the characteristic amount for each user that are specified and stored in advance, A and B, the characteristic amount for each person specified from the photographed image for the main photographing is relative to either A or B. To see if it is close to. As a result, which user is specified for each person included in the shot image for main shooting.

  The correction for the captured image for the main shooting is the process of changing the eye color and size, the contour of the face, the skin color and texture, etc. It is executed for a photographed image for photographing. The method of the correction process differs depending on the number of persons to be photographed and also depending on whether the image is an image obtained by close-up photography or an image obtained by whole body photography. When the preset number of persons to be photographed is within three, individual correction is performed for each person by a correction method selected according to the preference preset for each user. When the number of photographed persons exceeds three, the correction processing unit 142 performs the same correction on all the persons included in the photographed image for the main photographing.

  The edit processing unit 143 executes an edit process called graffiti, and at the same time, a play image for identifying a photo image group including a plurality of photographed images stored in the data storage unit 150 and a user specified by the individual authentication unit 131. The content data associated with the ID is generated. The content data may include the background information acquired by the background processing unit 141 and the identification information of the game shooting device 100 for amusement. The edit processing unit 143 generates content data every time the image acquisition unit 133 captures a series of photographic image groups (for each play). The content data can be uniquely specified by using the play ID generated by the image acquisition unit 133.

  The edit processing unit 143 sets the captured image subjected to the combination of the background images by the background processing unit 141 and the correction processing by the correction processing unit 142 as the edit target image, and executes the edit process on the edit target image. The editing process can be executed individually for a plurality of editing target images and simultaneously for a plurality of editing target images based on respective instructions from a plurality of users. Instructions from a plurality of users specify positions with respect to an edit target image that is a target of edit operation of the user on the edit monitor 213 using the touch pen 214, for example, selection operation to select an edit function to be used or edit input. It is input by the input operation. The edit processing unit 143 executes graffiti processing for superimposing stamp images and characters and determination of print layout on the image to be edited according to a user's instruction, generates a plurality of output images, and outputs the images for output. Store in 150.

  The moving image processing unit 144 executes an editing process on the plurality of moving images acquired by the image acquisition unit 133 and stored in the data storage unit 150, and generates a display moving image and a transmission moving image to be output. First, the moving image processing unit 144 reads a template moving image corresponding to a moving image theme selected by the user in advance from the data storage unit 150, and the three captured images are included in each of the three or more image frames included in the template moving image. The edited moving image is set by embedding each of the moving images of 1 time or multiple times. The edited moving image is also set as a display moving image or a transmission moving image. The three image frames included in the template moving image may be arranged two-dimensionally or three-dimensionally. In the latter case, a three-dimensional object is displayed in the template moving image, a plurality of frame shapes included in the three-dimensional object form a screen frame, and a plurality of moving image frames are embedded in each screen frame for reproduction. To set the edited video. At this time, the moving image processing unit 144 merely sets the template moving image and the embedded moving image to be simultaneously reproduced in a state where a plurality of moving images are embedded in the template moving image. However, as a modification, the moving image may be embedded in the template moving image and converted into new moving image data.

  When converting the edited moving image into the data of a new moving image, the moving image processing unit 144 inserts the image showing the characteristics of this moving image in the first frame. When displaying a list of moving images in a thumbnail format on an application on a mobile terminal or a PC or on a screen on an SNS, in general, the first frame is often automatically set as a thumbnail in order to show the contents of the moving image as an image. However, when creating a moving image, for example, when the title or the main part is faded in, the head frame may be black or white. Alternatively, in many cases, an image having non-characteristic content such as a title or a part of the subject is displayed as the top frame. Therefore, a characteristic image is inserted as a head frame so that the contents can be grasped to some extent at a glance and the information that makes the thumbnail viewer want to reproduce can be easily presented. As the "image showing the characteristics of this moving image", a character string such as the name of the template moving image or its moving image theme, the model name of this game shooting apparatus 100, the user's name, or a pattern or a picture symbolizing the moving image theme, etc. Use the image that displays the motif. Alternatively, person detection may be performed on the edited moving image, the frame in which the image of the user is detected may be extracted, and the frame may be inserted as the first frame.

  The output processing unit 160 includes a print processing unit 161, a wireless output unit 162, and a transmission output unit 163. The print processing unit 161 causes the printer 34 to print the plurality of output images stored in the data storage unit 150 on the sticker paper. The wireless output unit 162 transmits a plurality of output images to the user's terminal via the non-contact communication unit 312. The transmission output unit 163 transmits all output images to the management server 300 via the network. The transmission output unit 163 receives information for identifying an individual such as a mail address input by the user on a keyboard displayed on the touch panel after the play is finished. The transmission output unit 163 can upload the output image to the management server 300 in association with the input mail address and play ID, and allow the user to download the output image later. The transmission output unit 163 transmits the display moving image set by the moving image processing unit 144 to the display control unit 135 to display the display moving image on a display device such as the liquid crystal monitor 311. The transmission output unit 163 uploads the moving image for transmission or the captured moving image set by the moving image processing unit 144 to the management server 300 in association with the input mail address and play ID, and allows the user to download it later. be able to. The management server 300 stores the output image and the transmission moving image (or the captured moving image) in the form of being associated with the email address and the play ID, and the play ID associated with the email address is assigned to the email address. A URL including as a parameter is transmitted as content access information. By accessing the URL of the received content access information with the terminal device 500 such as a mobile phone, the user can open a page in the predetermined image acquisition website where the output image and the transmission moving image can be downloaded. Yes, you can download. In addition, the play ID is printed on the sticker along with the output image, and the user can also download the output image and the transmission moving image of his / her own by inputting the play ID into a predetermined image acquisition website. Can be opened and can be downloaded. In addition, when the user has registered the email address as a free member, it is possible to open a page from which the image selected by the user can be acquired from the plurality of output images uploaded to the management server 300. When the user has registered a mail address as a paying member, it is possible to open a page from which all of the plurality of output images uploaded to the management server 300 can be acquired. In the case where the transmission output unit 163 uploads the captured moving image instead of the transmission moving image to the management server 300, the information indicating the moving image theme selected by the user is uploaded together with the captured moving image. Accordingly, by embedding the moving image in the template moving image corresponding to the moving image theme selected by the user, the managing server 300 or the dedicated information presenting application on the terminal device 500 that acquires information from the managing server 300 can A display moving image can be configured. In that case, the management server 300 or a dedicated information presentation application on the terminal device 500 that acquires information from the management server 300 stores data such as template moving images and background music corresponding to each moving image theme in advance.

  FIG. 9 is a flowchart showing a process from presetting to actual photographing. First, the user starts a touch operation on the touch panel 41 of the presetting unit 40, and the user inputs the selection of the number of persons to be photographed, the selection of the name, the background image, and the selection of the moving image theme by the touch operation as preset (S100). .. When the "two-person course" is selected (S101), a guide to the two users for performing the photographing for authentication is displayed on the front monitor 113 (S104), and the two-user operation of the front camera 111 is performed. Authentication shooting is executed (S105). When the “three-person course” is selected (S102), a guide to the three users for performing the authentication shooting is displayed on the front monitor 113 (S107), and the three-user operation of the front camera 111 is performed. Authentication shooting is executed (S108). When the "large number of people course" is selected (S103), the photographing for authentication is not performed (S104, S105, S107, S108 are skipped). After presetting and authentication shooting, the front camera 111 shoots up images three times as main shooting (S106).

  After the close-up photographing, the guide for guiding to the side monitor 114 beside is displayed on the front monitor 113 to orient the user in the direction of the side monitor 114 (S110), and the guide for the standing position of the user is displayed on the side monitor 114. (S111) and the side camera 112 captures a full-body image of the user twice as a main image capture (S112). A guide for guiding the user to the front monitor 113 again is displayed on the side monitor 114 to orient the user in the direction of the front monitor 113 (S113), and guidance regarding movie shooting is displayed on the front monitor 113 (S114). After displaying a sample moving image as a tutorial as a tutorial, a series of processes of shooting a movie by the front camera 111 is repeated three times (S116). This series of processes will be described later using a screen example.

  With reference to the remaining time of the play at this point (S120), if there is the remaining time (S121), the user is provided with bonus shot photography, the process returns to S120 (S122), and if there is not the remaining time (S123), A guide for guiding to the graffiti booth (editing space 20) is displayed on the front monitor 113 (S124), guidance is given to which of the two editing spaces 20a and 20b should be moved (S125), and the graffiti booth is moved to (S126). ).

  FIG. 10 is a flowchart showing the process of correction and editing. After displaying the correction (also referred to as "retouch") guidance screen on the editing monitor 213 (S200), if a two-person course has been selected in advance (S201), "taste selection" (S202), " The user can select his / her preference for the three items of “finishing selection” (S203) and “brightness selection” (S204), displaying “preparing for graffiti” and performing correction based on the selection of the preference for the main image (S106). It is applied to the three up-captured images acquired in step S1 and the two whole-body imaged images acquired in step S107) (S205). If the three-person course has been selected in advance (S210), the user can select his / her preference for two items of "taste selection" (S211) and "brightness selection" (S212), and "preparing for graffiti" is selected. The captured image for main photographing is displayed and corrected based on the selection of preference (S205). In the case of three people, it takes more time to select individual preferences than in the case of two people, so the number of correction items is reduced compared to the two-person course. When the large number of people course has been selected in advance (S220), the user can select his / her preference for only one item of "selection of eye size and brightness" (S221) and display "preparing graffiti". At the same time, the correction based on the preference selection is applied to all the shot images for main shooting (S205). In the case of a large number of people course, there is not enough time to select the preferences for the number of people, so it is intended to select only one item that can be designated collectively for all users, not for each user individually.

  After shifting from "preparing for graffiti" to the main part of graffiti (S230), the editing process is performed on a plurality of corrected shot images for main shooting based on an instruction from the user, and then as a print layout. The division layout selection and the selection of a photograph to be printed large are set based on the user's instruction (S232), the movement guide to the output space 30 is displayed on the editing monitor 213 (S233), and the output space 30 (“exit corner”) is displayed. (Also called) (S234).

  FIG. 11 is a flowchart showing the steps of the output process. A screen (transmission image selection screen) that allows the first user to select one from the plurality of output images is displayed (S302). Then, a screen (mail address input screen) for inputting the mail address of the first user is displayed (S303). Then, the transmission image selection screen for the second user is displayed (S304), and the mail address input screen for the second user is displayed (S305). If there is a third user (Y of S306), the mail address input screen for the third user is displayed (S307). If there is a fourth user (Y in S308), the mail address input screen for the fourth user is displayed (S309). If there is no third person, the steps from S307 to S309 are skipped (N of S306), and if there is no fourth person, S309 is skipped (N of S308).

  After selecting the image for transmission and inputting the mail address, the SP movie is presented on the liquid crystal monitor 311 and transmitted to the management server 300 (S310). Is printed on the sticker paper (S311). At this time, the photograph image group of all the photographed images for the main photographing that have been edited is uploaded to the management server 300. Finally, the completion of printing is displayed on the liquid crystal monitor 311 and the process is terminated (S312).

  FIG. 12 shows an example of a screen that allows the user to select the content of moving image shooting in the preset settings. FIG. 12A is a guide screen for explaining that the user is about to move to the moving image theme selection screen. The presetting unit 40 displays thumbnails of two sample movies in two sample movie frames 640 displayed on the touch panel 41. Are displayed respectively. FIG. 12B is a moving image theme selection screen, in which the preset unit 40 displays six movie candidate frames 641 on the touch panel 41. Thumbnails of different sample movies are reproduced and displayed in each of the six movie candidate frames 641 as options of the moving image theme. The sample movie was created by embedding a model video, which is a video of the model action at the time of shooting, in a template video that includes a background video, background music, and a frame image to be combined with the subject in a moving image to be shot later. It is a thing. The types and model actions of template videos such as background video, background music, and frame images are different for each video theme. The user simply selects one of the sample movies as he / she likes, and shooting and editing are performed according to the moving image theme corresponding to the sample movie, and a moving image for output according to the moving image theme can be easily created. The movie candidate frame 641 serves as a selection button that displays thumbnails of sample movies created in advance based on six types of moving image themes. The thumbnail of the sample movie is for reducing the display size of the sample movie to display a part of the content, and may be reproduced once or repeatedly for the first few seconds of the movie. Further, while skipping frames at predetermined intervals, all of the contents may be fast-forwarded and reproduced. Note that the entire content may be reproduced without skipping.

  The presetting unit 40 simultaneously previews and reproduces the thumbnails of the six types of sample movies displayed in the six movie candidate frames 641. As a result, it is possible to save the trouble of switching the selection while confirming the preview, as compared with the case where the preview frame is separately provided and only the sample movies of the thumbnail selected by the user are reproduced one by one in the preview frame. In addition, the time required for pre-setting can be shortened and the setting can be simplified. The presetting unit 40 superimposes the selection frame 642 on the movie candidate frame 641 of the thumbnail selected by the user through the touch operation, and indicates that this thumbnail is currently selected. When the user selects one of the movie candidate frames 641, the presetting unit 40 causes the speaker installed near the entrance to output the background music included in the sample movie corresponding to the selected thumbnail. At this time, the presetting unit 40 reduces the volume of the normal background music that is normally output from the speaker near the entrance, and outputs the background music of the sample movie at a volume higher than that of the normal background music. When the user switches the selection of the movie candidate frame 641, the presetting unit 40 reproduces only the newly selected sample movie from the beginning, and switches to the output of the background music of this sample movie and reproduces it from the beginning. At the time of the switching, the presetting unit 40 stores the time position where the sample movie before switching and the time position where the background music is playing are stored, and when the same sample movie is selected again. Restarts playback of the sample movie and background music from the stored time position. When the screen shifts to the selection screen of FIG. 12B, a predetermined movie candidate frame 641 is initially selected, for example, the selection frame 642 is superimposed on the movie candidate frame 641 at the upper left, and the selected state is selected. When any of the movie candidate frames 641 including the movie candidate frame 641 is selected and the OK button is touched, the selection of the moving image theme is confirmed. When the selection of the moving image theme is confirmed by touching the OK button, the presetting unit 40 stops the reproduction of the selected sample movie and the background music, and restores the volume of the normal background music to the original volume.

  FIG. 13 shows an example of a guide screen displayed before the start of moving image shooting. The display control unit 135 displays and reproduces the three model videos 645a to 645c as guide screens and the sample movie 676 created using them side by side, and displays "I will shoot a movie like this! A brief explanation of the subsequent shooting procedure will be given using a character string such as "Try it!". The moving image shooting is performed three times, and the models of the three shot moving images are displayed as the first to third model moving images 645a to 645c, and the sample of the edited moving image is displayed as the sample movie 676. These three model moving images and sample movies are moving images prepared in advance based on the moving image theme selected by the user in advance setting. In the actual shooting stage described later, the first moving image is shot after displaying the first model moving image 645a, and the second moving image is shot after displaying the second model moving image 645b. The third moving image is captured after the third model moving image 645c is displayed. In the guide screen of FIG. 13, three model moving images 645a to 645c corresponding to the respective shootings are sequentially played back in the same order as the shooting order, and finally the sample movie 676 is played back.

  The model video, which serves as a model for the three shooting videos, is a fast-forward video showing how each character behaves differently in each video. For example, a professional fashion model or talent is used as the character. It is a video that makes you act like a model. Here, the moving image captured after this is finally embedded in the template moving image in a form of being played back in fast forward. The fast-forward playback is performed so that the motion of the user becomes less noticeable by making the video faster than the actual motion of the person as the subject. The user, who is the subject, is an ordinary person, and is not usually a professional model. Therefore, even if you make a motion like a model, you can easily make an image like a professional model by making the awkwardness inconspicuous. Can be made easier. In order to shorten the explanation time while reproducing such a fast-forward image to the user, the model video displayed in FIG. 13 is also reproduced in the form of fast-forwarding characters. The edited moving image sample displayed as the sample movie 676 is a moving image sample created by performing an edit in which three model moving images are embedded in the template moving image. The edited moving image shown is a moving image obtained by rotating a frame image of a cubic three-dimensional object with a predetermined image as a background, and the first to third model moving images 645a are provided on three of the six faces of the cube. It is constituted by embedding ~ c. The template moving image using the frame image of the three-dimensional object will be described later with reference to FIG.

  As a modified example, a model moving image synthesized by using the face image of the user may be displayed on the guidance screen and a model screen described later. The face image of the user is a face image extracted from the captured image for authentication, and may be combined with the face portion of the person included in the model moving image of the face image and created as a model moving image dedicated to the user. . Alternatively, a model moving image may be created in the form of a so-called avatar, in which the motion of the model is reproduced by using an animation or a three-dimensional model doll to which the user's face image is attached. Further, the model video of the avatar thus created may be uploaded to the management server 300 and may be downloaded by the user together with other captured images and captured videos.

  FIG. 14 shows screen transitions in the first half of the moving image shooting process. First, the display control unit 135 displays the start screen 650 on the front monitor 113 for 4 seconds, displays a character string explaining that the moving image shooting is about to start and the number of scheduled shootings on this screen, and reads the description aloud. Is output. However, in the modification, the screen display itself of the start screen 650 is omitted, and when the model screen 651 that is the next screen or the screen of FIG. 13 that is the previous screen is displayed, only the audio is output, May be shortened.

  Next, the display control unit 135 displays the model screen 651 for 3 seconds and displays the first model moving image 645a in a large size in the upper center of the screen. While displaying a character string such as "Let's imitate a model pose!" On the screen, the voice of the explanation is output to reproduce the first model video 645a before the reproduction starts. In order to imitate the motion of the person shown in the first model video 645a, the user is urged to see and store the motion. The model video displayed here is one of the three types of captured video prepared based on the video theme selected by the user, and is a still image in which the frame at the beginning of the movie is paused. Display with. By displaying small thumbnails of the second model video 645b and the third model video 645c on the right side of the first model video 645a, the thumbnails of the first model video 645c are currently displayed, and the remaining images are the models of the first shooting. It suggests that two shots are being held. In this way, the three model moving images 645 are arranged in the horizontal direction, and the thumbnail of the movie currently being shot is displayed relatively large. On the model screen 651, the first thumbnail from the left showing the first thumbnail is enlarged, and the thumbnails are displayed so as to be gradually reduced to the second and third thumbnails.

  Next, the display control unit 135 displays the model screen 652 for 3 seconds and reproduces and displays the first model video 645a on the screen for 3 seconds. At this time, the background music corresponding to the moving image theme selected by the user also flows along with the image of the first model moving image 645a. The first model video 645a is the same as the first model video 645a reproduced on the guide screen of FIG. 13, but is reproduced at a frame rate of less than 3 seconds by fast-forward on the guide screen. The model screen 652 is played back at a frame rate of 3 seconds, which is the same as the shooting time, according to the actual shooting time. The user sees the motion of the person included in the first model video 645a and temporarily stores the video. The first model video 645a reproduced at this time is basically the same as the first model video 645a displayed on the guide screen of FIG. 13, but it is set to be less than 3 seconds on the guide screen. While it was reproduced at fast forward, it is reproduced at a relatively slow speed on the model screen 652. For example, the model screen 652 is reproduced so that the actual shooting time is set to 3 seconds, which is the same as the shooting time. Both may be displayed with different frame rates of the same movie, or may be prepared as separate movies with different frame rates. May be prepared separately. The action that actually prompts the user is an action at a normal speed or a slow speed that can be easily reproduced as a human action, and the action is shot at a frame rate of 10 fps and fast-forwarded. For example, what is played back at 24 fps is a model video that is fast-forwarded and played on the guide screen. The movie finally provided to the user is also a movie that is fast-forwarded and reproduced at a frame rate of 24 fps, and the awkwardness of the user's operation can be made inconspicuous.

  After the reproduction of the first model video 645a on the model screen 652 is completed, the display control unit 135 shifts the display area of the first model video 645a that has been displayed until then to the first shooting screen 653. The image of the user as the subject is displayed on the shooting screen 653 in real time by switching to the image of the live view 646a. Also at this time, the background music corresponding to the moving image theme selected by the user is still playing. Further, when a moving image shot according to the moving image theme selected by the user is set as a video in which the user is fitted in a predetermined image frame, the image in the image frame is set as the foreground of the first live view 646a. Is displayed. On the other hand, if the setting is such that a moving image shot according to the video theme selected by the user displays decorative objects such as characters and pictures in the foreground in the form of overlapping the person, the live view will overlap the user's image and the user himself / herself. Such a foreground may be hidden to avoid obscuring the image of. Here, a character string such as "Ready? Shoot!" Is displayed to inform the user that recording is about to start. After 3 seconds from the display of the shooting screen 653, the display control unit 135 displays a countdown time until the start of recording on the screen as in the shooting screen 654 and displays the image of the opened clapperboard 648 to indicate that it is about to be recorded. Suggest.

  Next, an image in which the clapperboard 648 is closed is displayed as in the shooting screen 655, and a sound "recording start" is output to notify the start of recording. Then, the recording of the moving image is started while the first live view 646a is displayed on the screen. Also during the recording, the background music corresponding to the video theme selected by the user continues to play. The image acquisition unit 133 acquires a moving image by shooting with a frame rate of 10 fps. That is, the frame rate is lower than that of normal moving image shooting, and if this frame rate is played back at the frame rate of 10 fps, the moving image becomes a frame interval with a frame interval slightly longer than that of a normal speed moving image. .. A frame of 30 frames is taken by shooting for 3 seconds. Three seconds after the start of recording, a voice "cut" is output to notify the end of recording. Then, as in the shooting screen 656, a message indicating that the recording has been successfully completed and that two more recordings are remaining are displayed in a character string. At this time, the still image stopped at the frame at the time of the end of recording is displayed on the shooting screen 656 instead of the first live view 646a that has been displayed so far. Since this frame is the same as the final frame of the first shot movie 647a that has just been recorded, the thumbnail of the first shot movie 647a should be displayed in the form of a still image that is substantially stopped at the last frame. be equivalent to.

  Next, in the second recording, the display control unit 135 switches to the model screen 657. The thumbnail of the first shot movie 647a displayed on the previous shot screen 656 is reduced and moved to the left, and the second model movie 645b is enlarged and moved from the right to the center to be displayed. . At this point, the second model moving image 645b is displayed in the form of a still image of the first frame. On the model screen 658, the reproduction of the second model moving image 645b is started similarly to the model screen 652.

  FIG. 15 shows a screen transition in the latter half of the moving image shooting process. After the reproduction of the second model video 645b on the last model screen 658 of FIG. 14 is completed, the process moves to the shooting screen 659 of FIG. 15, and the display control unit 135 switches to the display of the second live view 646b. A countdown until the start of recording is displayed, and an image of the opened clapperboard 648 is displayed to indicate that recording is approaching. On the shooting screen 660, an image in which the clapperboard 648 is closed is displayed, and a sound "recording start" is output to notify the start of recording. Then, video recording is started while the second live view 646b is displayed.

After the second recording ends, the third recording starts. On the model screen 661, the thumbnails of the first and second shooting movies 647a and 647b are displayed small on the left side and the third model video 645c is displayed in the center. Display a large thumbnail of. After playing the third model video 645c on the model screen 662, the third live view 646c is displayed on the shooting screen 663 to display the countdown until the start of recording, and the image of the opened clapperboard 648 is displayed to be recorded soon. Suggest that. On the shooting screen 664, an image in which the clapperboard 648 is closed is displayed, and a sound “recording start” is output to notify the start of recording. Then, the moving image is recorded while the third live view 646c is displayed. After the recording is completed, the final frame of the third captured movie 647c is displayed as a thumbnail on the captured screen 665. As described above, the process from the reproduction of the model moving image to the display and recording of the live view is repeated three times. That is, it is possible to easily shoot three ideal moving images by repeatedly performing the process of showing a user a model operation and recording the moving image while storing it. You can
It should be noted that during recording of a moving image, a red character string or mark such as “REC” indicating that the moving image is being recorded may be displayed on or near the live view 646.

  FIG. 16 shows an example of a template moving image using a frame image of a three-dimensional object. The edited moving image also illustrated in FIG. 13 is a moving image in which a predetermined image corresponding to the moving image theme is reproduced as the background image 675 and the frame image of the cubic object 670 that is a three-dimensional object is rotated as the foreground. Further, a video displaying characters and patterns may be displayed as a foreground layer in an overlapping manner. The six faces forming the cube object 670 are transparent, and have a skeleton shape with only a skeleton. By embedding and playing the first to third captured moving images on three of the six faces, the moving images for output are set. As illustrated, the captured moving image is embedded in each of the first surface 671, the second surface 672, and the third surface 673. To embed a moving image on each surface, for example, a technique such as motion tracking or match move is used. In this case, the feature points at the four corners of the surface are specified as tracking points in order to specify the surface to be tracked, and while tracking the tracking points, the screen of the moving image is also deformed according to the shape change of the surface. By fitting and synthesizing, a moving image can be embedded in each surface of the cube object 670. However, the three moving images embedded in the first surface 671, the second surface 672, and the third surface 673 are moving images of only the subject whose background has been removed by the background processing unit 141 by using the chroma key mask. As a result, even if a moving image is embedded in the three surfaces of the cube object 670, the image on each surface is transparent to the portion other than the subject and the back is visible. It should be noted that in the example of the template moving image shown, parts other than the subject are transparent. A template moving image to be combined with a part other than the subject may be used.

  In the illustrated template moving image, the cube object 670 rotates to the left, and when each side faces the front side, the playback of the moving image embedded in that side starts, and the other side faces start to play. The playback of the embedded moving image is stopped with the initial frame displayed. That is, first, when the first surface 671 faces the front side, the embedded moving image of the surface starts to be reproduced, and two seconds after the reproduction of the embedded moving image ends, the second surface 672 approaches the front side. The cube object 670 rotates to the left. The reproduction of the moving image of the second surface 672 is started at the timing when the reproduction of the moving image of the first surface 671 ends and the second surface 672 approaches the front side. Similarly, when the reproduction of the second surface 672 ends and the third surface 673 approaches the front side, the reproduction of the moving image of the third surface 673 is started. In this way, three moving images that are each fast forwarded for 2 seconds are reproduced in a chained manner to form a video of about 6 seconds, and an edited video of about 15 seconds including the preceding and following videos is created. Here, an example in which a moving image is embedded on the surface of a three-dimensional object such as a cube has been described, but as another moving image theme, an edited image configured by embedding the moving image in an image frame arranged two-dimensionally is used. A template movie for the movie is also prepared.

  FIG. 17 shows an example of a guide screen for guiding the provision of the edited video. This guide screen is displayed on the liquid crystal monitor 311 of the output housing 31 while the output image is printed, and displays a character string explaining that the edited moving image is completed and a method of providing the edited moving image. The voice reading the explanation is output. In the center of the screen, a part of the edited video and background music corresponding to that part are played as a digest version of the edited video. However, as a modification, all parts of the edited moving image and all parts of the background music may be played. As a method of providing the edited video, a method of causing a user to download a dedicated application and playing the edited video in the management server 300 through the application may be used. Alternatively, a method of providing a URL for downloading the edited moving image itself from the management server 300 by displaying a character string or a two-dimensional code may be used. Also, a button for downloading a dedicated application may be displayed on this screen. When this button is pressed, an e-mail containing the URL for downloading the dedicated application is sent to the input e-mail address.

(Second embodiment)
The game-taking device according to the present embodiment differs from that according to the first embodiment in that it has an editing function capable of performing graffiti on not only still images but also moving images. Hereinafter, the differences from the first embodiment will be mainly described, and the description of common points will be omitted.

  The game device for play according to the present embodiment, in the “main part of graffiti” (S230 of FIG. 10), not only the graffiti for the captured image as the still image but also the captured image to be embedded in the template moving image selected in advance in FIG. It has the function of selecting and performing graffiti on the photographed image or movie. The template video illustrated below is pre-made with the premise that the users who shoot together will present the video to each other or present the video to other friends. It can be inserted into the video in the form of a stamp or text.

  In the present embodiment, the image acquisition unit acquires the moving image and still image of the user captured by the image capturing unit. The moving image processing unit embeds a moving image in the moving image frame shape included in the template moving image that is held in advance and reproduces it, and also embeds the still image in the still image frame shape included in the template moving image and reproduces it as a moving image. Set a moving image. The display control unit presents a plurality of template moving images as options as the template moving image. The display control unit presents a plurality of still images to be embedded in the still image frame shape as options. The display control unit presents only still images that can fit in the aspect ratio of the still image frame shape included in the template moving image selected by the user as options to be embedded in the still image frame shape. The moving image processing unit embeds a still image selected by the user in each of the still image frame shapes on a plurality of frames included in the template moving image, thereby embedding the still image in the template moving image. The display control unit displays a play button image on the screen together with a frame of a portion to be edited in the template moving image. When the user operates the reproduction button image, the display control unit reproduces and displays the moving image for a predetermined number of frames positioned before and after the frame of the editing target portion.

  FIG. 18 shows an example of the initial state of the edit screen displayed on the edit monitor 213. The editing screen of this figure is an example of a screen displayed in the “main part of graffiti” (S230 of FIG. 10), and not only the editing process for the still image taken by the user but also the editing process of the moving image using the template moving image. It can be carried out. First, as a premise, normal graffiti for a captured still image will be described.

  The edit screen is divided into a pair of left and right edit spaces so that two users can use it in parallel at the same time. In the editing space on the left side of the editing monitor 213, input can be accepted by the touch pen 214A on the left side. Similarly, in the editing space on the right side, input can be accepted by the touch pen 214B on the right side. In the center of the upper part of the editing space, there is provided a rectangular omission area 810 in which an image to be edited can be displayed and edited. Thumbnails 812 of five editing target images are displayed above the omission area 810, and one editing image selected from this is displayed in the omission area 810. The five editing target images here are based on three up-captured images and five whole-body captured images. More specifically, three up shot images are combined with three types of up background images included in the background image set selected in advance, and two whole body shot images are This corresponds to an image in which two types of background images for the whole body included in the background set are combined. It should be noted that edits made by the user in the omission area 810 are reflected in the corresponding thumbnail 812. An image to be edited in which the background image selected in advance by the preset unit 40 is combined is initially displayed in the omission area 810 and the thumbnail 812.

  One image selected by the user from the thumbnails 812 of the five images to be edited is highlighted by being surrounded by a thick selection frame 812 ', and the image to be edited corresponding to the thumbnail is displayed in the postscript region 810. .. The user can change the image to be edited displayed in the omission area 810 by selecting any one of the thumbnails 812 of the image to be edited using the touch pens 214A and 214B. The user can also change the image to be edited displayed in the omission area 810 by moving the selection frame 812 'by a drag operation using the touch pens 214A and 214B. In this case, the edit target image corresponding to the thumbnail 812 surrounded by the selected frame 812 ′ after the movement is displayed in the omission area 810.

  An “end” button 814 is arranged at the upper center of the edit screen. In addition, an eraser button 816, a “forward” button 818, and a “return” button 820 are arranged from the top in the center of the edit screen. The “end” button 814 is a button for ending the editing. When the “end” button 814 is pressed, the editing process voluntarily ends and the output process is started. Four types of eraser buttons 816 are arranged. Eraser buttons of three sizes and an "all erase" button for erasing all written letters are arranged. For example, when one of the size eraser buttons is pressed with the touch pens 214A and 214B, the size eraser is set. In this state, when the traced area 810 is traced with the touch pens 214A and 214B, the traced portion of the traced portion is erased. It is like this. Further, when the “all erase” button is pressed, all the omissions made for the edit target image displayed in the omission area 810 are erased.

  The “return” button 820 is a so-called undo button for canceling and returning to the original omission processing performed immediately before. On the contrary, the “forward” button 818 is a so-called redo button for resuming the omission processing just before the “return” button 820 is pressed.

  A timer 822 for countdown is provided between the "end" buttons 814 at the upper center of the edit screen. The timer 822 can be set in various ways. For example, a basic time limit (for example, 300 seconds) for editing a registered letter is set in advance, the countdown is started at the same time when the edited letter is started, and the timer 822 is displayed. It can be configured to forcibly end the editing process and shift to the output process when it becomes zero. Alternatively, when there is no user in the image capturing unit 50, that is, when there is no subsequent user waiting for the editing work, the editing work may be performed without limitation without performing the countdown, or the maximum time limit (for example, 20 minutes). May be set so that the editing work can be performed up to the maximum time limit. However, in such a state, when a shooting process by a new user is started in a state where there is a subsequent user in the other editing unit 51, it is set in advance in accordance with the start of the shooting process. It is preferable to start the countdown from the time (for example, 60 seconds). The timer 822 is common to the left and right users, and the editing processing time of both users is managed by one timer 822.

  Below the omission area 810, a palette area 828 for selecting an editing tool for editing the image to be edited is arranged. In the palette area 828, a tool for omission of letters is displayed. A pen pallet area 830 is arranged outside the omitted area 810 and the pallet area 828. In the pen palette area 830, buttons used to select the line type, thickness, and color of the pen image used for handwriting input are displayed.

  The user scribbles until the remaining time of the timer 822 becomes 0 (or the user voluntarily ends). Then, when the remaining time of the timer becomes 0, or when the user touches the “end” button 814 to voluntarily end the graffiti, the editing monitor 213 displays the message “end of omission”. Then, at that time, the image to be edited being edited on the editing screen is set as the output image (edited image), this output image is stored in the data storage unit 150, and the editing process ends. In this way, when the user voluntarily touches the “end” button 814, the editing performed by the user on the image to be edited is confirmed. In this sense, the above-mentioned omission area 810 and thumbnail 812 are previews of editing.

  When the user on the right selects the leftmost thumbnail from the five thumbnails 812 arranged in the upper right with the touch pen 214B, the leftmost thumbnail is highlighted by being surrounded by a thick selection frame 812 'and corresponds to the thumbnail. The edit target image to be edited is enlarged and displayed in the right handwritten area 810. Further, a character string such as "It is being enlarged" is superimposed on the thumbnail highlighted in the selection frame 812 ', which indicates that the user on the right side is currently performing the editing process. The superposed character strings may be combined with transparency such that the thumbnail is transparent. At this time, of the five thumbnails 812 arranged at the upper part of the editing space on the left side, a character string such as “the right person is expanding” is superimposed on the leftmost thumbnail being edited by the user on the right side. , Indicates that the user on the right side is currently in the process of editing. When the user on the left selects the second thumbnail from the right out of the five thumbnails 812 arranged in the upper left with the touch pen 214A, the thumbnail is highlighted by being surrounded by a thick selection frame 812 ', and the corresponding edit is performed. The target image is enlarged and displayed in the left hand-written letter region 810. A character string such as "Enlargement in progress" is superimposed on the thumbnail highlighted in the selection frame 812 ', indicating that the editing process is being performed. Of the five thumbnails 812 arranged at the upper part of the editing space on the right side, the character string such as “The person on the left is expanding” is superimposed on the thumbnail being edited by the user on the left side and is currently edited by the user on the left side. Indicates that it is in process.

  At the top of the edit screen, a moving image edit start button 840, which is an icon image in which a character string such as “make movie” is written, is displayed between the thumbnail 812 and the “end” button 814. When the user presses the moving picture editing start button 840, the moving picture editing process using the template moving picture is started.

  FIG. 19 shows an example of a state where moving image editing has started on the editing screen. In the example of the figure, a state in which the left-side video editing start button 840 is pressed by the user on the left side and the video editing is started in the left-side editing space is shown. While the video is being edited in one of the left and right editing spaces, the video editing start button 840 displayed in FIG. Erase both left and right sides. As a modified example, the moving image edit start button 840 may be grayed out and not pressed without being erased. As another modified example, at the stage of FIG. 18, only one moving image edit start button 840 may be provided in one of the left and right editing spaces so that the moving image can be edited. As a modified example, two users on the left and right sides may be allowed to simultaneously process moving image edits in the left and right editing spaces, respectively. In that case, one moving image may be edited at the same time, or separate moving images may be created. Even when a single moving image is created, the respective play IDs of the two users are given, and when separate moving images are created, the respective play IDs are given to the created moving images. Note that while the user on the left side edits the moving image, the user on the right side can continue scribble on the still image as in the state of FIG. If the right-side user presses the right-side video editing start button 840, the video editing is started in the right-side editing space, while the left-side user can continue graffiti on the still image in the left-side editing space.

  A vertically long template area 842 having the appearance of a movie film is displayed on the outer side of the left editing space, and characteristic frames included in the template moving image are vertically arranged and displayed. The template moving image displayed in the template area 842 is the template moving image of the design selected by the user in the preset of FIG. 12B. However, in the specification that allows the user to select and display multiple types of template videos as options for template videos, a template video with a design corresponding to the background image selected in advance should be automatically selected as the default setting. Good. Alternatively, only the template moving image of the design corresponding to the background image selected in advance may be selected.

  The movie film type template area 842 is configured to include images of eight frames arranged in the vertical direction, and a selection frame indicating selection is displayed only on the frame to be edited in the editing space. In the example of FIG. 19, only the lower three frames (first editing target frame 843, second editing target frame 844, third editing target frame 845) of the eight frames are the frames in which the selection frame can be displayed as the editing target. , The selection frame is not displayed in the top 5 frames that are not edited. Characteristic frames in the template moving image and frames included in the first to third shot movies that have been shot are displayed as thumbnails on the frames that are not edited.

  In the illustrated template moving image, three video portions can be edited. Corresponding to the three editable portions, the first edit target frame 843, the second edit target frame 844, and the third edit target frame 845 are displayed. Thumbnails are displayed below the template area 842. The first edit target frame 843, the second edit target frame 844, and the third edit target frame 845 correspond to the first edit button 846, the second edit button 847, and the third edit button 848, respectively. When the user presses the first edit button 846, the first edit target frame 843 becomes the edit target and the selection frame is displayed. When the user presses the second edit button 847, the second edit target frame 844 becomes the edit target and the selection frame. Is displayed and the third edit button 848 is pressed, the third edit target frame 845 becomes the edit target and the selection frame is displayed.

  Initially, the first edit target frame 843 becomes the edit target, the selection frame is displayed, and the first edit target frame 843 is associated with the first edit button 846. Is indicated by an arrow connected to the first editing object frame 843. In addition, the frame of the video portion corresponding to the first frame to be edited 843 is displayed in the edited moving image display area 850 in the center of the editing space. Similarly, when the second edit button 847 is pressed, an arrow is displayed from the second edit button 847 to the second edit target frame 844, a selection frame is displayed on the second edit target frame 844, and the edit video display area 850 is displayed. Shows the frame of the video portion corresponding to the second frame to be edited 844. When the third edit button 848 is pressed, an arrow is displayed from the third edit button 848 to the third edit target frame 845, a selection frame is displayed on the third edit target frame 845, and the third frame is displayed in the edit moving image display area 850. The frame of the video portion corresponding to the edit target frame 845 is displayed.

  In the example of FIG. 19, a still image taken by the user may be embedded in the frame of the background image prepared as the template as the image portion corresponding to the first edit target frame 843 displayed in the edited moving image display area 850. A possible image frame 851 is displayed. Initially, the image frame 851 is displayed as a black rectangular frame, and displaying a camera mark icon in the rectangular frame suggests that a captured image can be embedded in this portion. Below the edited moving image display area 850, embedded thumbnails 854 of a plurality of still images captured by the user are displayed as options of still images to be embedded in the image frame 851 displayed in the edited moving image display area 850. Here, the embedding thumbnails 854 of three up-photographed images and two whole-body photographed images, which are images to be edited for normal graffiti, are displayed. When the user selects any of the images, the selected photographed image is It is embedded in the image frame 851 and displayed. Depending on the template moving image, a plurality of image frames 851 may be provided in one video portion. In that case, the user selects the captured images to be embedded by the number of image frames 851 and specifies the positions to be embedded.

  Here, since the aspect ratio of the up-captured image is different from that of the whole-body captured image, when a captured image that does not match the aspect ratio of the image frame 851 is selected, the image frame 851 for each frame of the selected image is selected. Processing such as deformation and trimming may be added according to the aspect ratio, shape, size, and the like. Alternatively, a process of changing the aspect ratio of the image frame 851 or changing the design itself of the image frame 851 may be executed according to the aspect ratio of the selected image. When trimming the selected image, the face may be detected from the image and the trimming position may be adjusted so that a part of the face is not deleted. As a modified example, only the embedded thumbnails 854 of captured images that match the aspect ratio of the image frame 851 are displayed as options, and the embedded thumbnails 854 of captured images that do not match the aspect ratio of the image frame 851 are not displayed. Good. In that case, the screen configuration is switched so that only the close-up photographed image or only the whole body photographed image is displayed as an option, and the image selected there can be embedded in the image frame 851 without performing processing such as deformation or trimming. it can. As another modification, the specification may be such that the selected image is moved (panned or slid) so as to flow in a certain direction while being enlarged or reduced with the range of the image frame 851 as the center and displayed. In this case, it is not necessary for the aspect ratio of the image frame 851 and the aspect ratio of the image to match, and the entire image is displayed by making the selected image slightly larger than the image frame 851 and displaying the image while shifting it. be able to.

  At the center right below the edited moving image display area 850, a moving image playback button 852 is displayed. When the user presses the moving image reproduction button 852, the image parts before and after the frame currently displayed in the edited moving image display area 850 are reproduced and displayed as a preview. That is, with the frame displayed in the edited moving image display area 850 as one editing point, the 24 frames before and after the editing point are reproduced once as a preview moving image for 2 seconds at 12 fps, and the original image is returned. An image frame 851 is provided in each of the 24 frames, and the position, size, and shape of the image frame 851 may be slightly different depending on the frame. When the user selects any image from the embedding thumbnail 854, the image is embedded in all the image frames 851 in all 24 frames. The frame displayed in the first frame to be edited 843 is reflected in real time, and the frame in which the selected captured image is embedded is displayed. When the shape, position, and size of the image frames 851 of the 24 frames are different, the selected captured image is deformed, scaled, or the like and embedded in each image frame 851 so as to fit the image frames 851. Be done. The preview moving image is only a part of the whole moving image created by the template moving image, and since it contains only 24 frames in a shorter image than the entire moving image, each frame is combined while adjusting to fit the image frame 851. Even so, the processing load is relatively small. The preview moving image is generated in the background in the form of reflecting the editing contents at that point in the process of editing the moving image, and is displayed in the first editing target frame 843 and the second editing target frame 844 even if the moving image playback button 852 is not pressed. It may be designed to be loop-played.

  Until one of the captured images is selected, the preview moving image is reproduced in a form in which the captured image is not combined in the image frame 851 and the initial image of the predetermined design is inserted. As a modified example, once the moving image playback button 852 is pressed, the preview moving image may be repeatedly looped and the moving image playback button 852 may be replaced with a stop button or a pause button during that period. In that case, when the user presses the stop button or the pause button, the loop reproduction is stopped and the original moving picture reproduction button 852 is restored. As a modified example, the specification may be such that the movie playback button 852 is not displayed, and the preview movie is repeatedly loop-played in the edited movie display area 850 without the user pressing such a button. Here, in the case where the specification is such that the stop button is replaced after the moving image playback button 852 is pressed, the frame at the initial editing point (the captured image being selected is displayed in the edited moving image display area 850 when the stop button is pressed). The embedded frame) is displayed. On the other hand, if the specification is such that the pause button is replaced after the movie playback button 852 is pressed, the edited movie display area 850 when the pause button is pressed shows the frame at the time of pressing (the captured image being selected is The embedded frame) is displayed. Whether the stop button or the pause button is displayed, the user can reselect the captured image after pressing the button. However, especially when reselecting a captured image in a frame other than the initial edit point, such as after pressing the pause button, the captured image is embedded with an aspect ratio, shape, position, or size different from the initial edit point. It may be displayed in the edited moving image display area 850.

  On the side of the embedding thumbnail 854, a no-photo button 856 for selecting not to embed any captured image in the image frame 851 is displayed. As a setting of the template moving image, an initial image is prepared for embedding an image to be embedded in the image frame 851 instead or to replace the image frame 851 when the user does not specify the image. When the user presses the no-photograph button 856, or when the time limit elapses without the user selecting an image, or when the editing process is voluntarily ended, the initial image is embedded in the image frame 851. Or replaced.

  Like the thumbnail 812, the image of the embedded thumbnail 854 displayed as an option is an image in which a background image selected in advance by the user and a captured image are combined. As a modified example, if a button image for erasing the background, such as “no background button”, is displayed and the user presses the “no background button”, all of the plurality of images displayed as the embedded thumbnail 854 are displayed. The background image is deleted, that is, the background is replaced with the default background and recombined, or the background image is replaced with the captured image before chroma key composition. As a modified example, the background image may be deleted only for the captured image selected by the user, instead of all the embedded thumbnails 854 being displayed. After deleting the background image, replace the "no background button" with the "background button" and press the button image to restore the background image, that is, the background image and the captured image selected in advance. You may perform the process which replaces with the image which combined. In this way, when the user feels that the background image does not match the design of the template moving image when the captured image combined with the background image is embedded in the image frame 851, the background can be erased according to the user's preference. it can.

  FIG. 20 shows an example of a state where a still image to be embedded in the template moving image is selected on the edit screen. When the user selects one of the embedding thumbnails 854, the selected image is immediately displayed as a preview embedded in the frame of the image frame 851. A thick selection frame 854 'for highlighting is displayed around the selected embedding thumbnail 854 to clearly indicate that the image is being selected. When the user reselects another embedding thumbnail 854, the image embedded in the image frame 851 is immediately switched to the reselected image, and the position at which the selection frame 854 'is displayed is also the thumbnail selected by the user. Switch to. When the specification is such that the moving image is repeatedly loop-reproduced in the edited moving image display area 850, the selection result of the embedded thumbnail 854 and the no-photo button 856 may be reflected in the loop-reproduced image in real time. When the graffiti is executed in the editing space on the opposite side, the result of the graffiti is reflected in the thumbnail 812 at the upper part of the editing space, but in the embedded thumbnail 854 and the image frame 851 below the edited moving image display area 850. It is not reflected in the embedded image. This is because embedding a graffiti process, which is still being edited and is undetermined, in a video at the same time may complicate the editing process and the compositing process. However, as a modification, the content of the graffiti drawn by the other user may be immediately reflected on the embedded thumbnail 854 below the edited moving image display area 850 and the image embedded in the image frame 851.

  Here, when the user presses the no-photograph button 856, the selection frame 854 'is erased, and the image frame 851 is embedded with an initial image for the case where no captured image is selected. As a modified example, when the time limit elapses without the user selecting an image or when the editing process is voluntarily ended, a captured image is randomly selected or the first captured image is automatically selected. The specifications may be embedded in the image frame 851, or the initial image may be embedded without embedding the captured image.

  While the video is being edited in the editing space on the left, the user on the left does not change the screen at all even if he or she selects the thumbnail 812 arranged at the top of the editing space, and does not switch to graffiti of a still image. . Therefore, the thumbnails 812 arranged in the upper part of the editing space in which the moving image is being edited may be displayed as a dark image with their lightness and saturation reduced to indicate that the thumbnails cannot be selected. .

  Below the embedding thumbnail 854, there are displayed a save button 858 for instructing to retain the editing process up to that point and a cancel button 859 for instructing to discard the editing process up to that point. A character string such as “stop editing” is displayed on the cancel button 859. When the save button 858 is pressed by the user, the edited contents up to that point are saved. At this time, the thumbnail 812 is returned to a selectable state so that the graffiti processing on the captured image as the still image as illustrated in FIG. 18 can be performed. However, as a modified example, the specification may be such that the screen of FIG. 18 does not return and the state of FIG. The specification may be such that the processing is switched to the stage of editing the video portion corresponding to the second frame to be edited 844. When the first user saves the edited contents of the moving image and returns to the screen of FIG. 18, when the second user edits the moving image, the editing of the edited contents is performed based on the edited contents saved by the first user. Subsequently, the second user makes further edits.

  On the other hand, when the cancel button 859 is pressed by the user, the edited contents up to that point are discarded, and the edited contents are returned to the initial state or the saved state when the save button 858 was previously pressed. As a modified example, when the user presses the cancel button 859, a process of switching to a state similar to the editing space on the right side, that is, a state of performing scribbling on a still image may be further executed.

  When the user presses the second edit button 847, the video part of the edit target corresponding to the second edit target frame 844 included in the template video is displayed in the edit video display area 850 and corresponds to the first edit target frame 843. Similarly to the video portion to be edited, the selection and embedding of the captured image are processed. When the user presses the third edit button 848, the video portion of the editing target corresponding to the third editing target frame 845 included in the template moving image is displayed in the editing moving image display area 850. However, in the template moving image illustrated here, the image frame 851 in which the captured image is embedded is not provided in the third editing target frame 845, and an image for accepting graffiti by the user is prepared.

  FIG. 21 shows an example of performing graffiti on a template moving image on the edit screen. The third edit button 848 is pressed by the user and the third edit button 848 is highlighted, and the third edit button 848 is connected to the corresponding third edit target frame 845 by an arrow. In the edited moving image display area 850, a video frame corresponding to the third edit target frame 845 is displayed. The video edited here is designed on the premise that a stamp image or characters as a message to the person who presents the edited video as a gift is inserted, or handwritten characters or pictures input by the user with the touch pen are inserted. Is. For example, it is an image of a design with a letter as a motif, and the user can directly apply graffiti to the image of the template moving image.

  Since the design differs depending on the template moving image selected by the user, the types of stamp images, character strings, etc. that can be input are limited so as to match the design of the template moving image. By displaying the template editing tool corresponding to the template moving image selected by the user in the palette area 828, the user can edit the template moving image by designing the template moving image. It should be noted that the user can select a stamp image from the displayed letter-writing tool and touch the position in the edited moving image display area 850 where the stamp image is to be attached with a touch pen to synthesize the stamp image at that position. .

  Here, the position or range in which graffiti can be drawn is limited to a certain range according to the tool that the user is selecting. For example, while the user is selecting a pen, the range that can be input with the pen is limited to a certain range on the screen, for example, the ruled line part 861 (letter message field) in the illustration of a letter, and the design of the other part is limited. Can be harmonized with. On the contrary, when the user selects a stamp image, by limiting the range in which the stamp images can be combined to a certain range on the screen, for example, in the design portion 860 other than the message field of the letter, overlapping with the text of the message is possible. Can be avoided. On the other hand, if no characters are entered in the message field of the letter, a basic message or image prepared in advance is automatically inserted as an initial setting, and the design looks bad like a blank letter. Try not to be. For example, in the case of a design that assumes that the name of the person is inserted after the beginning of the letter or message field, such as "HAPPY BIRTHDAY TO", whichever of the two names the user has entered in advance Alternatively, the specification may be made by selecting or inputting. When the third edit button 848 is pressed, the template area 842 may be displayed in place of the template area 842 instead of the template area 842.

  A video playback button 852 is displayed in the center right below the edited video display area 850. When the user presses the video playback button 852, a preview video in which the graffiti entered by the user is combined is once displayed in the edited video display area 850. It is only displayed for playback and returns to the original. The preview moving image in which the graffiti is combined is composed of 24 frames like the preview moving image when the captured image is embedded in FIGS. The design included in the 24 frames may differ slightly from frame to frame. The position where the graffiti such as the stamp image and pen input is combined and the size, shape, color etc. of the graffiti to match the design of each frame are specified. You may adjust. For example, the position and shape of the graffiti may be changed for each frame so that the content of the graffiti appears to rotate in the preview moving image, or the content of the graffiti may be transformed so as to appear as a three-dimensional shape. By reproducing 24 frames including the frame in which the graffiti is combined in this manner at 12 fps, a preview moving image of 2 seconds is obtained. By adjusting and combining graffiti for each of a plurality of frames, a moving graffiti moving image can be generated. In addition, the preview movie is only a part of the whole movie created by the template movie, and since it contains only 24 frames that are shorter than the whole movie, the graffiti can be adjusted for each frame during composition. However, the processing load is relatively small. The preview moving image is generated in the background in the form of reflecting the edited contents at that point in the process of the graffiti, and even if the moving image reproducing button 852 is not pressed, the preview moving image is loop-reproduced on the third edition target frame 845. Good.

  When the specification is such that the stop button is replaced after the moving picture playback button 852 is pressed, the frame at the initial editing point (frame in which graffiti is reflected) is displayed in the edited moving picture display area 850 when the stop button is pressed. The user can also re-edit the graffiti. On the other hand, when the specification is such that the pause button is replaced after the movie playback button 852 is pressed, the edited movie display area 850 when the pause button is pressed shows the frame at the time of pressing (the frame in which graffiti is reflected. ) Is displayed to regulate the re-editing of graffiti at the time of the suspension. This is because the graffiti may be deformed and displayed at a position, size, shape, color, etc. different from the initial editing point at the time of the temporary stop, and re-editing is difficult in that state.

  As described above, each video portion can be edited by selecting one of the first edit button 846, the second edit button 847, and the third edit button 848. During the editing of any of the video parts, any one of the first edit button 846, the second edit button 847, and the third edit button 848 can be selected at any time until the "end" button 814 is pressed to finish the editing. You can fix it and switch to editing other video parts. That is, it is possible to switch back and forth between the editing screens of the respective video portions, and it is also possible to check the editing results by switching the respective editing results. This is different from the step-up method in which the first edit button 846, the second edit button 847, and the third edit button 848 are sequentially edited one step at a time and then confirmed in order. In addition, even when the graffiti processing on the still image as shown in FIG. 18 is performed after pressing the save button 858, the moving image editing can be resumed by pressing the moving image editing start button 840 again.

  For the moving image embedded in the template moving image, the foreground image may be superimposed on a layer on the front side of the moving image depending on the design of the template moving image. The user may be prompted to adjust the standing position by displaying the foreground on the front monitor 113 in advance at the time of shooting or in the model moving image so that such a design and the moving image are well integrated in terms of design.

  When the “end” button 814 is pressed and the editing process ends, the information indicating the template moving image, the editing content instructed by the user in the editing process, and the captured still image and moving image are transmitted to the management server 300. . The management server 300 embeds the captured still image and moving image in the specified template moving image based on the editing content instructed by the user and the editing rule set for each template moving image, and allows the user to download the image. Create a video for. However, as a modification, the specification may be such that a dedicated information presentation application installed in the user's mobile terminal, instead of the management server 300 side, creates a moving image. In that case, the dedicated information presentation application acquires the template moving image, the editing content instructed by the user, the captured still image and the moving image from the management server 300, and the still image and the moving image captured based on them. Create a video by embedding the image in the template video. In the case of the specification in which the moving image is created on the application side, the load of the moving image creation processing can be distributed to a plurality of terminals as compared with the case where the moving image is created on the server side. That is, when the management server 300 is created, the processing is concentrated on the server, so that if any failure occurs in the server processing, it may affect all users. On the other hand, when it is created by the application side, even if a problem occurs in the processing of the application, it affects only the user and is advantageous in that it does not affect other users. Also, when a new type of game shooting device is released, it is sufficient to update the application.

  The photography system 600 according to the embodiment of the present invention has been described above. The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the invention.

  10 shooting space, 100 shooting device for play, 132 image pickup unit, 133 image acquisition unit, 144 moving image processing unit, 160 output processing unit

Claims (4)

A shooting unit that shoots a user and obtains a shot image,
A moving image processing unit that reads one of a plurality of template moving images based on a user's selection, and generates an output moving image in which the captured image is embedded in the read template moving image,
Equipped with
The moving image processing unit generates the output moving image so that the characteristic portion of the output moving image appears in the initial state when the output moving image is displayed on the display unit. .. An image acquisition unit that acquires images,
A moving image processing unit that reads one of a plurality of template moving images based on a user's selection and generates an output moving image in which the image is embedded in the read template moving image,
Equipped with
The image processing apparatus, wherein the moving image processing unit generates the output moving image so that a characteristic portion of the output moving image appears in an initial state in which the output moving image is displayed on a display unit. A step of acquiring an image,
Reading one of multiple template videos based on user selection,
A step of generating an output moving image in which the image is embedded in the read template moving image;
Equipped with
The image generating method, wherein the step of generating generates the moving image for output so that a characteristic portion of the moving image for output appears in an initial state in which the moving image for output is displayed on a display unit. A function to acquire images,
A function of reading one of a plurality of template moving images based on a user's selection, and generating an output moving image in which the image is embedded in the read template moving image;
To the computer,
The computer program characterized in that the generating function generates the output moving image so that a characteristic portion of the output moving image appears in an initial state in which the output moving image is displayed on a display unit.

Images