JP2019049960A - Image providing system, image providing program and video providing system - Google Patents

Abstract

To provide a system and a program that allow an audience of an event to provide close-up images and videos either individually or with companions.SOLUTION: The image providing system according to an embodiment includes at least one camera 6. The camera 6 is installed at a position where a large audience fits in a frame. An image processing server 10-1 cuts out a partial image for each person or several persons in the audience from an image captured by the camera 6. A plurality of partial images are published in the form of thumbnails on an image providing website. Data of one or more partial images selected by an external information processing terminal that has accessed the image providing website is transmitted to the external information processing terminal.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image providing system, an image providing program, and a moving image providing system.

  Conventionally, in various events such as sports and concerts, a business has been conducted which sells an image obtained by randomly photographing an audience seat as data or a print.

  Many spectators will want images of their own close-ups and images with friends and family who accompany the event. However, it is rare for images to be provided in such a composition that the audience wants. On the other hand, it is practically impossible to shoot all the spectators individually or with their companions. Therefore, sales of event images are not active at present.

  The purpose is to provide a system and program that allows the audience of the event to provide close-up images and videos either individually or with companions.

  The image providing system according to the present embodiment comprises at least one camera. The camera is placed at a position where a large number of spectators fit in the frame. A partial image is cut out for each one or several spectators from the image taken by the camera. Partial images are uploaded to the image providing website in thumbnails. Data of one or a plurality of partial images selected by an external information processing terminal that has accessed the image providing website is transmitted to the external information processing terminal.

FIG. 1 is a system configuration diagram of an image providing system in the first embodiment. FIG. 2 is a block diagram showing the configuration of the image processing apparatus according to the first embodiment. FIG. 3 is a flowchart showing image processing of the image processing server according to the first embodiment. FIG. 4 is a view showing an example of trimming range setting data. FIG. 5 is a diagram showing an example of cutting out an image according to the trimming range of trimming by number of people. FIG. 6 is a diagram showing an example of cutting out an image according to a trimming range of trimming by number of people. FIG. 7 is a view showing an example of an image captured by the camera in a state where the spectator is in a non-regular position. FIG. 8 is a diagram showing an example of image data stored in the storage device by image processing. FIG. 9 is a flowchart showing the image sales process of the image providing server in the first embodiment. FIG. 10 is a diagram showing an example of an image selection page in which images are displayed as a list. FIG. 11 is a diagram showing an example of the selected image confirmation page SP2. FIG. 12 is a flowchart showing the self trimming process. FIG. 13 is a diagram for explaining the self-trimming process. FIG. 14 is a system configuration diagram of an entire system including the moving picture providing system according to the second embodiment. FIG. 15 is a diagram showing an example of moving image data stored in the moving image database system of FIG. FIG. 16 is a flowchart showing generation processing of a moving image sales page by the moving image providing system according to the second embodiment. FIG. 17 is a diagram showing an example of a video sale page. FIG. 18 is a flowchart showing moving image sales processing by the moving image providing system according to the second embodiment. FIG. 19 is a flowchart for explaining the individual mode of FIG. FIG. 20 is a flowchart for explaining the interlocking mode in FIG. FIG. 21 is a supplementary explanatory view of the individual mode of FIG. FIG. 22 is a supplementary explanatory view of the interlocking mode of FIG. FIG. 23 is a diagram showing an example of the purchase confirmation page. FIG. 24 is a diagram for explaining the mosaic process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First Embodiment
FIG. 1 is a system configuration diagram of an image providing system in the first embodiment. The image providing system is applied to a facility that accommodates a large number of spectators, for example, sports stadiums such as baseball, soccer, rugby and motor sports, entertainment venues such as concerts, and various event venues such as festivals. The image providing system has a high resolution camera such as 8K. The camera is installed at a position where a large number of spectators sitting in the spectator seat can fit in one frame. A partial image is cut out for one or several spectators from the high resolution image taken by the camera. In any of the partial images, the spectators are close-up with one person or with a companion. Partial images are provided through a website for image sales (broadly, for image provision). It is assumed that a large number of spectators show a high purchasing intention for the image (partial image) that is close up with themselves or with a companion. Therefore, active image sales are expected.

  FIG. 1 shows an example in which an image providing system is applied to a baseball stadium. The image providing system in the first embodiment includes a plurality of cameras 6 (6-1, 6-2,..., 6-N), a camera control device 8, an image processing device 10 (image processing server 10-1, image provision Server 10-2). A plurality of cameras 6 (6-1, 6-2,..., 6 -N) are dispersedly installed at a plurality of places in the stadium. All cameras 6 are directed to the spectators' seat of the baseball stadium. All the cameras 6 have an angle of view capable of photographing a large number of spectators in one shot. The positions where the plurality of cameras 6 are installed are different from each other. Preferably, the positions and the shooting directions of the plurality of cameras 6 are different such that the plurality of cameras 6 substantially cover the entire area of the audience seat. The camera 6 is a high resolution specification such as 4K, 8K, 16K. Even when one camera 6 shoots a wide area including a large number of spectators including the entire infield stand, half of the outfield stand, for example, one person or an image taken by the camera 6 (referred to as an original image) An image (referred to as a partial image) cut out for each of several spectators can ensure a resolution that is acceptable for viewing. The camera 6 may capture a moving image or may capture a still image. As well known, a moving image is composed of a series of still images. When capturing a moving image with the camera 6, a specific still image to be sold is selected automatically or manually from a series of still images. The installation position of the camera 6, the photographing direction and the angle of view are fixed. As a result, the position on the frame of the original image photographed by the camera 6 can be associated with the position of the actual audience seat.

  The camera control device 8 controls the cameras 6 (6-1, 6-2,..., 6 -N), and also controls the camera 6 (6-1, 6-2,..., 6 -N) The image is transmitted to the image processing apparatus 10 (image processing server 10-1) through the network 12. The network 12 includes various communication networks such as the Internet and mobile communication systems (4G, 5G).

  The image processing apparatus 10 cuts out a plurality of partial images from an original image captured by a large number of spectators by the camera 6. Each partial image contains one or two or more spectators. A plurality of partial images are provided through a website selling images. The image processing apparatus 10 is realized by cooperation of an image processing server 10-1 and an image providing server 10-2 connected via the network 12. The image processing apparatus 10 may be realized by one server (computer) or may be realized by cooperation of three or more servers (computers).

  The image processing server 10-1 arranges a plurality of trimming ranges on the original image captured by the camera 6. The position of the trimming range is set according to the position of the audience. A plurality of partial images are cut out from the original image according to a plurality of trimming ranges. The trimming range is determined in advance according to the number of people who can fit in the partial image to be cut out.

  The image providing server 10-2 establishes, for example, a Web site for selling images on the Internet (network 12). Partial image data is uploaded to this website. A list of multiple partial images is published in thumbnails. A request for purchasing a partial image is received from the information processing terminal 14 of the purchase candidate via the website. The information processing terminal 14 is used to access a website for image sales established by the image providing server 10-2. The information processing terminal 14 has a processing function such as image display, and is typically a portable information processing terminal represented by a smartphone.

  The image providing server 10-2 restricts an object to access a website. The image providing server 10-2 performs login authentication using the ticket number received from the information processing terminal 14. The image providing server 10-2 requests the external ticket sales system to transmit a seat number corresponding to the ticket number. From the seat number, the position in the frame by the camera 6, that is, the position in the frame of the original image can be specified. The image providing server 10-2 can extract one or several partial images corresponding to the seat number from the plurality of partial images cut out from the original image. Only one or a few partial images corresponding to the extracted seat number can be disclosed to the purchaser to protect the privacy of others. Of course, the image providing server 10-2 may disclose all partial images cut out from the original image to the purchaser.

  FIG. 2 is a block diagram showing the configuration of the image processing server 10-1 in the first embodiment. The image processing server 10-1 illustrated in FIG. 1 is realized by, for example, a computer, and includes a processor 201, a RAM 202, a ROM 203, an input controller 204, a video controller 205, an I / O controller 206, a communication controller 207, and an input device 210. It has a display 211 and a storage device 212.

  The processor 201 centrally controls devices and controllers connected to the system bus. The processor 201 can be configured by, for example, a central processing unit (CPU) and a graphics processing unit (GPU). The processor 201 executes programs stored in the RAM 202 to implement various functions. The processor 201 executes the image providing program according to the first embodiment to obtain a partial image in which one or two or more persons are contained from the original image captured by the plurality of spectators shot by the camera 6 Execute processing to cut out

  The RAM 202 functions as a main memory, a work area, and the like of the processor 201. The processor 201 loads programs necessary for execution of processing from the ROM 203 or the storage device 212 into the RAM 202, and executes the loaded programs to realize various operations.

  The ROM 203 or the storage device 212 is various programs necessary to realize various functions such as a BIOS (Basic Input Output System) executed by the processor 201, an operating system program (OS), and various application programs including an image providing program. Various files processed by various programs, various data, etc. are stored.

  The input controller 204 controls an input from an input device 210 such as a keyboard (KB) and a pointing device such as a mouse and a touch panel.

  The video controller 205 controls the display of a display such as an LCD (Liquid Crystal Display) under the control of the processor 201.

  The I / O controller 206 controls access to the storage device 212. In the storage device 212, for example, a file of an original image captured by the camera 6, setting data of a trimming range for cutting out a partial image to be sold from the original image captured by the camera 6 (see FIG. 4), trimming range A data file (see FIG. 8) of a partial image cut out based on the setting data of is stored. Files and data stored in the storage device 212 are read out as needed and stored in the RAM 202 as the image providing program is executed. The communication controller 207 controls communication with an external information processing terminal 14 via the network 12.

  The image providing server 10-2 has a configuration similar to that of the image processing server 10-1 shown in FIG. 2 and will not be described in detail. The processor 201 of the image providing server 10-2 executes the image sales processing program to execute the image sales processing of selling the partial image cut out by the image processing server 10-1 through the website.

  Next, the operation of the image providing system in the first embodiment will be described. The camera control device 8 operates a plurality of cameras 6 (6-1, 6-2,..., 6-N) installed in a baseball stadium at a predetermined timing, and the high-resolution cameras 6 Input the original image. In the photographing by the camera 6, the photographing is repeated intermittently at fixed intervals during the period from the start to the end of the game. Preferably, the imaging is performed as soon as the event occurs. For example, the game is shot at the start of the game, at the end of the game, at the time of occurrence of home run, at the time of occurrence of fine play, at the time of home-in. The occurrence of these events may be detected automatically by detecting a volume change due to, for example, the spectator's delight, or may be manually specified by the operator. The camera control device 8 transmits the file of the original image captured by the camera 6 to the image processing device 10 (image processing server 10-1) through the network 12.

  FIG. 3 is a flowchart showing the image processing of the image processing server 10-1 in the first embodiment. The image processing server 10-1 stores the file of the original image PG <b> 1 (FIG. 5) received from the camera control device 8. The processor 201 of the image processing server 10-1 activates the image providing program and starts image processing on the original image captured by the camera 6.

  The processor 201 reads the file of the original image from the storage unit (step S1). The processor 201 refers to the trimming range setting data and sets one of the trimming ranges (step S2). FIG. 4 shows an example of trimming range setting data. The size of the trimming range is predetermined for each person. The trimming range by number indicates the number of spectators who fit in the partial image. The trimming range of “one person” is set to a size that cuts out a partial image that one spectator takes as a large image. The trimming range of “two people” is set to a size that cuts out a partial image that two spectators take as a close-up. The group trimming range is set, for example, to a size corresponding to the number of adjacently purchased seats purchased, the number of seats in the box seat, and the number of seats in a range such as a cheering party seat.

  In image identification trimming, the expression of the audience is recognized from the original image. A partial image is cut out centering on the audience recognized as smiling. Note that other emotions (excitation, anger, etc.) may be authenticated. In color identification, an area including a wide range of preset colors is detected, and the corresponding range is cut out. For example, in the cheering party, an image corresponding to an area including many clothes and flags of team colors is cut out. In the motion identification, when it is detected that the subject is largely moved by comparison of images having different photographing times, an image in which the subject is enlarged is cut out. Note that the trimming range described above is an example, and information indicating other image clipping ranges may be set.

  The processor 201 cuts out a partial image from the original image according to the trimming range (step S3), and stores the file of the partial image in the storage device 212 (step S4). The processor 201 repeats the process until cutout of the partial image is completed for the entire original image (step S5, No).

  In order to cut out the partial image, it is necessary to determine the position of the trimming range as well as the size of the trimming range. As a method of positioning the trimming area for one person, typically, the face area of the spectator is recognized from the original image as illustrated in FIG. 6A, and the center of the trimming area is aligned with the center of the face area. As a method of positioning the trimming range for two people, as illustrated in FIG. 6B, the face area of the spectator is recognized, and the center of the trimming range is located at the center of the line connecting the centers of the face areas of two adjacent people. Make a match. As a method of positioning a trimming range for three or more persons, the center of the trimming range is made to coincide with the center of gravity of a polygon connecting the centers of a plurality of face areas nearby. Of course, the trimming range may have a variable size, and the positioning method does not deny other methods.

  As shown in FIG. 6C, partial images PP1, PP2, PP3, and PP4 are cut out in various sizes according to the trimming range for each person. A trimming range for three or more persons is applied when tickets for three or more seats are purchased at one time.

  As shown in FIGS. 7A and 7B, when applying a trimming range for two people, a trimming range for three people, or a trimming range for a larger number of people, the trimming range is 1 in the horizontal direction. A partial image is cut out from the original image in all combinations while shifting by each person. Wherever the companions are seated in any arrangement, it is possible to provide a partial image in which all the companions fit.

  When the cutting out of the partial image by the trimming range for one person is completed for the entire original image (Yes in step S5), the processor 201 starts the cutting out of the partial images by the trimming range for two people, The cutout process of the partial image by the trimming range is repeated (step S6, No). When the clipping of the images based on all the trimming ranges set in the trimming range setting data is completed (Yes in step S6), the processor 201 ends the clipping process of the partial image with respect to the original image.

  Likewise, the processor 201 cuts out an image to be processed from an image captured by the camera 6 at a plurality of arbitrary timings, and executes the above-described image processing to cut out an image.

  FIG. 8 is a diagram showing a management table of partial images stored in the storage device 212 by image processing. The image number of the partial image is associated with the shooting range such as the infield stand and the outfield stand as the attributes thereof, the shooting time, the position (seat), and the number of people.

  Next, the operation of the image providing server 10-2 will be described. FIG. 9 is a raw chart showing the image sales process of the image providing server 10-2 in the first embodiment. The image providing server 10-2 publishes, for example, a website (hereinafter, an image selling site) for selling an image through the network 12. The image providing server 10-2 executes login processing when the image sales site is accessed by the information processing terminal 14 through the network 12 (step B1). For example, the user is prompted to enter a watching ticket number, thereby authenticating. In the login process, not only the ticket number but also the password (printed on the ticket) set at the time of ticket issuance, the password distributed only to the visitors set for each seat, etc. may be used.

  When it is confirmed by the login authentication processing that the access from the spectator using the baseball stadium is confirmed by the login authentication process, the image providing server 10-2 displays a page for determining the image selection method on the information processing terminal 14 and is used The image selection method to be input is input (step B2). In the image providing server 10-2 according to the first embodiment, for example, as an image selection method, a "Gallery method" for selecting partial images to be purchased from a plurality of partial images displayed in a list by thumbnails; There is a “self-trimming method” in which a range to be sold is arbitrarily trimmed from the original image including the image by the operation of the purchaser.

  First, when the "Gallery system" is selected (Step B3, Yes), the image providing server 10-2 acquires the seat number corresponding to the ticket number input in the login process from the ticket sales system (Step B4). .

  The image providing server 10-2 reads a partial image file corresponding to the seat number specified from the management table from the storage device 212 (step B5). In this way, it is possible to narrow down and disclose one or several partial images in which the purchaser (the spectator sitting in the seat of the ticket number) is photographed from among a large number of partial images.

  Further, the image providing server 10-2 inputs the number of trimming persons from the information processing terminal 143 as the condition (image condition) of the partial image to be displayed as a list of sales targets (step B6). For example, by specifying “two” of trimming by number of people, partial images captured with a friend sitting next to it can be displayed as a list. In addition, by designating “seat registration” of group trimming, it is possible to display a list of partial images corresponding to seat registration information (seats purchased in a group, etc.) including the seat position corresponding to the ticket number. The image conditions can be specified by combining a plurality. In this way, by designating the image conditions, it is possible to display a list by limiting only partial images of the composition to be purchased from a large number of partial images cut out in the image processing server 10-1. Note that all partial images can be displayed in a list by not inputting the image conditions.

  The image providing server 10-2 causes the information processing terminal 14 to display a page for image selection, provides partial images corresponding to the image condition, and displays the partial images in the page (step B7).

  FIG. 10 is a diagram showing an example of an image selection page SP1 in which partial images are displayed as a list in thumbnails. A page SP1 for image selection shown in FIG. 10 includes a previous page button 30 for instructing switching to the previous page, a next page button 31 for instructing switching to the next page, and partial images to be purchased A selection completion button 32 for instructing selection completion is provided. In the image selection page SP1, the partial images 35 are arranged and displayed, and the selection button 36 (radio button) is displayed in the vicinity of each partial image.

  The partial images to be displayed in a list are preferably displayed by performing predetermined processing on the partial images to be sold. For example, the image quality (resolution) is lowered and displayed as thumbnails, the watermark (watermark) such as “sample” is superimposed and displayed, and a mosaic is added to the human face portion and displayed. It can be applied. That is, in the system according to the first embodiment, since it is possible to provide an image of a composition including not only the purchaser but also other spectators in the vicinity, the page SP1 for image selection is high considering the privacy of the other spectators etc. Do not provide quality images. Furthermore, in the page SP1 for image selection, it is possible to protect privacy by limiting the viewing authority for the image, the available time, the available area, and the like.

  The image providing server 10-2 executes an image selection process according to each button operation on the page SP1 for image selection (step B8). In the page SP1 for image selection, selection can be made by selecting the selection button 36. The example shown in FIG. 10 indicates that reference numbers A1, A3, A7, A8, A10, and A14 are in a selected state.

  When the image providing server 10-2 detects an operation of selecting the selection completion button 32 (step B9: Yes), the image providing server 10-2 causes the information processing terminal 14 to display a page for confirming the selected image.

  FIG. 11 shows an example of the selected image confirmation page SP2. On the selected image confirmation page SP2, a “go to checkout button” (settlement button) 40 for instructing the execution of settlement processing, and a button for making an album for instructing the use of the extension service for the purchased partial image (Service button) 41 is provided. When the service button 41 is selected, the image providing server 10-2 accesses the information processing terminal 14 to another web site that provides a service for printing (for example, processing into an album) and printing partial images. Make a jump. Further, not only printing and selling of partial images but also other services using partial images may be provided.

  In addition, in the selected image confirmation page SP2, the partial images 42 selected in the image selection page SP1 are displayed in a list, and the total number 45 is displayed. The purchaser confirms the partial image selected on the selected image confirmation page SP2, and when there is a shortage, instructs the user to return to the image selection page SP1, and the partial image to be purchased in the same manner as described above Can be selected or canceled. Further, the purchaser operates the settlement button 40 when the partial image to be purchased is determined.

  When the image providing server 10-2 detects an operation on the settlement button 40 (Yes in step B10), the image providing server 10-2 executes settlement processing (step B11). The settlement process will not be described in detail, assuming that an existing method such as credit settlement is used.

  When the settlement process is completed, the image providing server 10-2 transmits the data of the high definition partial image in the predetermined image format (for example, JPG) to the information processing terminal 14 (download) (step B12).

  Thus, in the image selection method of "Gallery", only the partial images related to the purchaser are cut out and displayed in a list from the large number of partial images cut out in the image processing server 10-1, and the partial images to be purchased from them are displayed. It can be selected. Further, in the image processing server 10-1, partial images of various compositions are cut out based on a plurality of different trimming ranges. Therefore, in the system according to the first embodiment, it is possible for the purchaser to select and purchase an image of a composition that meets the request with a simple operation.

  Next, the case where “self trimming” is selected as the image selection method will be described. When "self-trimming" is selected as the image selection method (No in step B3), the image providing server 10-2 executes self-trimming processing (step B13). FIG. 12 is a flowchart showing the self trimming process.

  When “self trimming” is selected, the image providing server 10-2 obtains the seat number of the purchaser. For example, when a ticket number is input in the login process, a seat number corresponding to the ticket number is obtained (step C1).

  The image providing server 10-2 causes the information processing terminal 14 to display the self-trimming page, provides the image read from the storage device 212, and displays the image in the page (step C2).

  FIG. 13A shows an example of an image displayed on the page SP3 for self-trimming. On the page SP3 for self-trimming, a rectangular frame 50 for designating a trimming range is displayed. The purchaser can designate the range to be trimmed by the instruction to change the display position and the size of the rectangular frame 50 (specifying the enlargement / reduction ratio). When the determination of the display position and the size with respect to the rectangular frame 50 is instructed (Step C3, Yes), the image providing server 10-2 magnifies and displays the image specified by the rectangular frame 50 (Step C4).

  FIG. 13B shows an example of the self-trimming page SP4 in which the image in the range designated by the rectangular frame 50 is enlarged. On the page SP4 for self-trimming, a rectangular frame 51 for designating a trimming range is displayed. The rectangular frame 51 has a frame shape of a prescribed shape / size corresponding to the vertical and horizontal sizes of the image to be sold. The purchaser can change the display position by operating the rectangular frame 51, and can specify a trimming range to be trimmed as an image. When the determination of the position with respect to the rectangular frame 51 is instructed (Step C5, Yes), the image providing server 10-2 enlarges and displays the image specified by the rectangular frame 51 as shown in FIG. To provide an image SP5 (step C6).

  The purchaser can confirm the image SP5, and if not satisfied, gives an instruction to return to the page SP4 for self-trimming, and can perform an operation of designating a specific range in the same manner as described above. Further, the purchaser operates the settlement button 40 when the image SP5 to be purchased is determined.

  When the image providing server 10-2 detects an operation on the settlement button 40 (Yes in step B10), the image providing server 10-2 executes settlement processing (step B11). The settlement process will not be described in detail, assuming that an existing method such as credit settlement is used.

  Thus, in the self-trimming, the purchaser can cut out an image by designating an arbitrary range from the image of the relatively wide area specified based on the position specification information of the spectator. Thus, a buyer can purchase an image that includes any range of spectators.

  The image processing method described in the embodiment may be stored as a program that can be executed by a computer, for example, in a recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, or may be transmitted via a communication medium and distributed. it can. A computer for realizing the image processing apparatus reads a program recorded on a recording medium, and executes the above-described processing by controlling the operation by the program. The recording medium is not limited to the distribution medium, but includes a storage medium such as a magnetic disk or a semiconductor memory provided in an apparatus connected to the inside of a computer or via a network.

Second Embodiment
The image providing system according to the first embodiment can be applied to partial sale of moving pictures. Hereinafter, a moving image providing system 60 according to the second embodiment will be described. Here, an example in which the moving image providing system 60 is applied to a baseball game performed at a baseball stadium will be described. Of course, the moving image providing system 60 according to the second embodiment can be applied to sports games, concerts and other performances.

  As shown in FIG. 14, a moving image providing system 6060 according to the second embodiment is connected to a ticket order link system 64 and a moving image database system 63 via a network 62 such as the Internet.

  The ticket order link system 64 performs various processes related to ticket purchase for a baseball game, such as ticket issue processing and ticket settlement processing. In the ticket order link system 64, a baseball game ticket number is managed by a game ID identifying the baseball game. The ticket number is associated with a seat number and a password for authenticating a user who has purchased a ticket. This password can be arbitrarily set by the user who has purchased the ticket. Of course, the password may be printed in advance on the ticket because it may be information that only the user who purchased the ticket can know. This password is used when logging in to the video sales site provided by the video providing system 60.

  A plurality of cameras 66 (66-1, 66-2, 66-3) are connected to the moving image database system 63 via a network 65 such as a LAN. As in the first embodiment, all the cameras 66 are directed to the audience seats of the baseball stadium. The moving image database system 63 stores data of moving images (hereinafter referred to as spectator moving images) captured by a plurality of cameras 66. The data of the audience moving image is accompanied by metadata including an ID for identifying the camera 66, data of a seat number fit to the angle of view of the camera 66, and the like. The video database system 63 stores, in addition to the audience video, data of a video (hereinafter referred to as a game video) regarding a baseball game played in the baseball field. The game video data is typically provided from a company that has the right to broadcast the game. Of course, some of the plurality of cameras 66 connected to the moving image database system 63 can be used for shooting a match moving image.

  In the moving image database system 63, data of a match animation related to a baseball game and data of an audience animation related to a spectator watching the baseball match are managed by a common match ID. Metadata is attached to the data of the match animation. The metadata includes not only information specifying the moving image such as a moving image title, file capacity, shooting date and time, etc., but also index information on the contents of each time of the moving image. The index information is player information, scene information, inning information, and the like. For example, player information is batter name, pitcher name, fielder name, runner name, etc., scene information is home run, fine play, strikeout, etc., and inning information is once table 2B1S0O, once back 1B2S2O etc. . Ideally, index information is attached to each of a plurality of frames constituting a match animation, but for example, index information may be associated with shooting time. Since a time code is attached to each of the plurality of frames constituting the match animation, the frame corresponding to the scene indicated by the index information can be specified according to the photographing time. This index information is used not only as an index when searching for a frame desired by the user, but also when determining the unit price of each moving image. Here, the index information is attached to the data of the match animation, but the same index information may be attached to the data of the audience animation. Most of the index information is common because the match video and the audience video are shot on the same time axis.

  A moving image providing system 60 according to the second embodiment includes a web server 602 and an information processing apparatus 601. The web server 602 stores data of files relating to a video sales site including a login page, a video sales page, a purchase confirmation page and the like, and publishes the video sales site on the network 62. The video selling site functions as an interface between the information processing apparatus 601 and the information processing terminal 67.

  The information processing apparatus 601 acquires information on the partial period designated by the user via the video sales page, generates partial moving image data on the partial period, and generates the generated partial moving image data to the user. Provide various functions to provide Specifically, the information processing apparatus 601 includes a control unit 611, a storage unit 612, a transmission / reception unit 613, an authentication processing unit 614, an image processing unit 615, a partial moving image generation unit 616, and a unit price determination unit 617. , A price calculation unit 618, and a settlement processing unit 619. The server function and the information processing function included in the moving image providing system 60 according to the second embodiment may be realized by a single device, or these functions may be distributed to each device on the network 62. . In addition, the moving image providing system 60 may not have the server function as long as the user's input information can be acquired through the moving image sales site. In this case, the web server 602 is connected to the information processing apparatus 601 via the network 62.

  The control unit 611 controls the moving picture providing system 60 in a centralized manner. The storage unit 612 stores the data of the match animation received from the animation database system 63 and the data of the audience animation. In addition, the data of the local audience moving image generated by the image processing unit 615 described later is stored. The storage unit 612 stores various setting data in addition to the moving image data. The transmission / reception unit 613 transmits / receives data to / from an external device, here, the moving image database system 63, the ticket order link system 64, and the information processing terminal 67 according to the control of the control unit 611. Also, it receives information input by the user through the video sales site. The authentication processing unit 614 executes an authentication process of the user who has accessed the login page of the video sales site. The settlement processing unit 619 performs settlement processing of a partial moving image regarding a partial period designated by the user in accordance with the fact that the settlement button is operated on the purchase confirmation page. The settlement process can use an existing method such as credit settlement.

  The image processing unit (position identifying unit) 615 identifies the viewing position of the user in the frame of the audience moving image based on the seat number, and localizes the viewing position of the user for each of a plurality of frames constituting the audience moving image. Execute trimming processing to remove the area other than the area. The spectator video after trimming is called a local spectator video. This local audience animation is an animation close-up of the user. The local region is set to a predetermined range centered on the user's viewing position. However, the local region can be appropriately changed by the same method as the setting of the trimming range described above. For example, the local region can be set arbitrarily by the user. In the case where the user arbitrarily sets, the local region is set by the user operation on the viewing window of the audience moving image described later. Also, based on a plurality of seat numbers, it is possible to identify the viewing position of the group in the frame of the audience video, and generate data of local audience video on a local area including the viewing position of the group.

  The partial animation generation unit 616 generates partial audience animation data on a first partial period designated by the user from the local audience animation data. Also, partial match animation data regarding a second partial period specified by the user is generated from the match animation data. Specifically, the partial moving image generation unit 616 identifies the start frame according to the information on the start position of the first partial period, and identifies the end frame according to the information on the end position. Then, frames between the start frame and the end frame are extracted from a plurality of frames (images) constituting the local audience moving image, and partial audience moving image data aligned according to the time code is generated.

  The unit price determination unit 617 determines the unit price of each time of each moving image based on the index information attached to the data of the match moving image. The unit price determination unit 617 determines the hourly unit price of each match animation based on the index information of the match animation, and determines the unit price of each time of the audience animation according to the hour unit price of each match animation. The hourly unit price is determined for a predetermined period, for example, every second. Of course, the unit price may be determined not every predetermined time but every predetermined frame, for example, every frame. The time unit price of the match video is determined so that the price of a scene where the popular player appeared, hit a home run, was hit by a batter, was stolen, the start of a match, the end of a match, etc. was increased. Weights are set for each player, each inning, and each scene, and the unit price determination unit 617 calculates weights at each time using one or a combination of player information, scene information, and inning information included in the index information. , Determine the hourly unit price according to its weight. The hourly unit price of the spectator video typically corresponds to the hourly unit price of the match video. The unit price of each of the match video and the audience video thus determined is uneven along the time axis of the video. Of course, it does not deny that the unit price of each movie is uniform.

  The price calculator 618 calculates the price of the partial audience animation for the first partial period by integrating the time unit price of the audience animation over the first partial period specified by the user. Similarly, the price of the partial match animation for the second partial period is calculated by integrating the time unit price of the match animation over the second partial period specified by the user.

  FIG. 16 is a flowchart showing an initial process of generating a video sale page. The information processing apparatus 601 executes login authentication processing of the information processing terminal 67 that accesses the login page of the video sales site via the network 62 (step D1). In the login authentication process, the user is made to input a ticket number and a password on the information processing terminal 67. The information processing apparatus 601 acquires a password registered for the ticket number input by the user from the ticket order link system 64, and collates the password input by the user with the acquired password. As a result of checking, if it is confirmed that the user has purchased a ticket (watched a baseball game), the information processing apparatus 601 acquires a game ID and a seat number corresponding to the ticket number from the ticket order link system 64. (Step D2). These pieces of information are used by the information processing apparatus 601 to acquire game animation data and audience animation data from the animation database system 63.

  The information processing apparatus 601 acquires, from the moving image database system 63, data of a match moving image corresponding to a match ID and data of a match moving image having a seat number in a frame (angle of view) among a plurality of audience moving images corresponding to the match ID. (Step D3). The information processing apparatus 601 trims the audience moving image according to the seat number in order to generate the data of the local audience moving image in which the user is closed up. Low resolution processing is performed on the local audience moving image after the trimming processing (step D4). The information processing device 601 executes the low resolution process on the match animation (step D5). The low resolution processing in step D4 and step D5 is performed to reproduce these moving pictures smoothly on the information processing terminal 67 and can be omitted. The information processing apparatus 601 acquires index information from the data of the match moving image (step D6), and determines a unit price for each predetermined period of the match moving image, for example, every second based on the index information (step D7). The information processing device 601 determines a time unit price for each predetermined period of the audience moving image based on the determined time unit price of the match moving image (step D8).

  The information processing apparatus 601 holds data of a plurality of types of templates related to the video sale page. The information processing apparatus 601 identifies that the type of box office is baseball based on the metadata of the match moving image and the like, and reads out the data of the moving image sales page template for the baseball from the storage unit 612. Generate the data of the initial moving image sales page in which the low resolution processed match moving image and the local audience moving image are embedded in the read out template (step D9), and transmit the generated moving image sales page data to the information processing terminal 67 (Step D10).

  FIG. 17 is a diagram showing an example of the initial video sale page SP3. A search condition input area 73, a support information selection area 74, an audience moving image viewing window 71, a match moving image viewing window 72, and a purchase list display window 75 are provided in the moving image sale page SP3 shown in FIG.

  In the search condition input area 73, a search button for start of search is disposed along with an inning input field, a batter name input field, a pitcher name input field, and a free keyword input field. In the support information selection area 74, a price display button 741 for switching the display mode of the timeline between the normal mode and the price display mode, and a designation mode of a partial period by the user are shown between the individual mode and the interlocked mode. A link button 742 for switching is arranged.

  Below the audience moving image viewing window 71, a control box 710 necessary for the audience moving image reproduction operation and a snap button 711 for registering an image displayed in the audience moving image viewing window 71 in the purchase list are arranged. Here, the control box 710 has a play button, a pause button, a fast forward button and a rewind button. Adjacent to the audience animation viewing window 71, a audience animation seek bar 712 is arranged to assist the user in inputting the first partial period of the audience animation. The spectator movie seek bar 712 has a spectator movie timeline 713 representing the spectator movie time axis graphically, a start slider 715 indicating the start position of the first partial period on the spectator movie timeline 713, and an end position And an end slider 716 representing Below the start slider 715, a start position registration button 717 for registering the start position in the record being edited is disposed. Below the end slider 716, an end position registration button 718 for registering the end position in the record being edited is disposed.

  A control box 720 and a snap button 721 are disposed below the match animation viewing window 72. A match video seek bar 722 is arranged in addition to the match animation viewing window 72. The detailed description of these is omitted.

  If the playback time of the audience video is the same as the playback time of the match video, the audience video timeline 713 is represented by the same length as the match video timeline 723. Of course, it is also assumed that the reproduction time of one moving picture is longer than the reproduction time of the other moving picture. In this case, typically, the timeline for a moving image with a longer playback time is represented longer by the extension time than the other timeline. This allows the user to operate both timelines on the same timeline. However, in the case where the reproduction times are extremely different, both timelines may be represented by the same length. As a result, since the width of one timeline does not become extremely short, the operability of the timeline by the user can be maintained.

  The purchase list display window 75 displays a purchase list registered by the user. One record includes the thumbnail of the image corresponding to the start position of the partial animation, the start time of the partial period, the end time, the animation time, the sale price of the partial audience animation, and the sale price of the partial match animation . Also, a new button 751 for starting registration of partial videos newly, a correction button 752 for correcting partial videos registered in the purchase list, and a delete button 753 for deleting partial videos registered in the purchase list Is placed. The user can delete the list corresponding to the check box 750 by checking the check box 750 and tapping the delete button 753. Further, when registration of the purchase list is completed, a confirmation button 754 for proceeding to the purchase confirmation page is arranged.

  In the initial state, "home run" is input in the free keyword input field. The information processing device 601 appends a balloon 743 to the audience moving image timeline 713 and the match moving image timeline 723. In the balloon 743, information on the time when the home run was hit and inning information are displayed in text. The balloon 743 is arranged at the position of the frame corresponding to the home run scene. The frame corresponding to the home run scene is identified based on the index information of the audience video. In this manner, appending index information to the timeline simplifies the confirmation of the position of the desired scene by the user or the scene where his favorite player appeared, and supports the input of a partial period.

  In the initial state, the price display button 741 is turned on. The information processing apparatus 601 changes the display mode of the game moving image timeline 723 along the time axis, according to the time unit price of the game moving image. Similarly, the information processing apparatus 601 changes the display mode of the audience moving image timeline 713 along the time axis according to the time unit price of the audience moving image. In each timeline, legends 744 and 745 indicating the relationship between the time unit price and the aspect are arranged. As described above, by changing the display mode of the timeline according to the time unit price, the user can specify a partial period while considering the time unit cost. In addition, a period with a high hourly unit price often corresponds to an important scene of a moving image. Therefore, the user can easily find out an important scene from the display mode of the timeline.

  FIG. 18 is a flowchart showing the procedure of the video sales process. The information processing apparatus 601 executes various processes in accordance with the user operation on the video selling site. As shown in FIG. 18, the information processing apparatus 601 switches the designation mode of the partial period between the individual mode and the interlocking mode in accordance with the on / off operation on the link button 742. Specifically, when the on operation of the link button 742 is detected (step E1, Yes), the partial period designation mode is set to the interlocking mode (step E2). When the information processing apparatus 601 detects the OFF operation on the link button 742 (Step E1, No), the partial period designation mode is set to the individual mode (Step E3). Details of the individual mode and the interlocking mode will be described later. A partial period is designated by the user by the process of step E2 or step E3.

  When the information processing apparatus 601 detects an operation on the confirmation button 754 (Yes in step E4), the information processing apparatus 601 transmits a purchase confirmation page to the information processing terminal 67. Thus, a purchase confirmation page is displayed on the information processing terminal 67 (step E5). FIG. 23 is a diagram showing an example of the purchase confirmation page SP4. In purchase confirmation page SP4 shown in FIG. 23, partial moving images and still images registered by the user are displayed as a list. Here, a record 81 is displayed which includes items relating to the contents of the partial animation, specifically, the thumbnail, the start time, the end time, the animation time, the sales price of the partial audience animation and the sales price of the partial match animation. A delete button 83 is also written in the record 81. A thumbnail 82 indicating a still image is displayed. A delete button 83 is also written on the thumbnail. When the information processing device 601 detects an operation on the delete button 93, the information processing device 601 deletes the corresponding partial moving image or still image from the purchase list. The purchase confirmation page SP4 is provided with a return button 84 for returning to the video sale page SP3 and a settlement button 85 for proceeding to the settlement process. When the information processing apparatus 601 detects an operation on the settlement button 85 (Yes in step E6), the information processing apparatus 601 executes settlement processing (step E8).

  When the settlement process is completed, the information processing apparatus 601 generates data of a partial moving image purchased by the user (step E9). Specifically, partial spectator animation data relating to a partial period designated by the user of the entire spectator animation period is generated from the local spectator animation data. From the match animation data, partial match animation data relating to a partial period designated by the user during the entire match animation period is generated.

  Note that mosaic processing may be performed on each frame of the partial audience moving image purchased by the user. As shown in FIG. 24, a mosaic area ME1 is set in addition to the user's viewing position in the frame Fr1 and its neighboring area, and mosaic processing is performed on the mosaic area ME1. Mosaicing is applied strongly towards the outside of the frame. The information processing apparatus 601 transmits partial moving image and still image data to the information processing terminal 67 in a predetermined format (step E10).

(Individual mode)
The individual mode will be described below with reference to FIGS. 19 and 21. The individual mode is a mode corresponding to partial sale of one of the spectator video and the match video. In the individual mode, the audience moving picture seek bar 712 and the match moving picture seek bar 722 do not interlock with each other. This allows the user to individually specify the partial period of the audience animation and the partial period of the match animation. Here, a procedure for registering a partial period of the audience video will be described. Partial periods of match videos can be registered according to the same procedure.

  As shown in FIG. 21, when the start slider 715 and the end slider 716 of the audience moving image seek bar 712 are moved according to the user operation on the information processing terminal 67 (step E31a), the opening on the audience moving image timeline 713 The position information of the slider 715 and the position information of the end slider 716 are input to the information processing apparatus 601, respectively. The information processing device 601 identifies the start frame based on the position information of the start slider 715 (step E32a), and identifies the end frame based on the position information of the end slider 716 (step E33a). The start time and end time of the partial period designated by the user are specified according to the time code of the start frame and the time code of the end frame. Information on the specified start time and end time is appended to the audience moving image timeline 713. Further, the specified start frame is displayed in the audience moving image viewing window 71 (step E34a). The information processing apparatus 601 integrates the time unit price of the period between the start frame and the end frame to calculate the selling price of the partial audience moving image (step E35a). Information on the partial audience animation specified by the user, for example, the start time, the end time, the period, and the sales price is displayed in the purchase list 75 being edited. According to the start position registration button 717 and the end position registration button 718 being tapped (Step E36a, Yes), the record being edited is confirmed, the partial period of the audience video is registered, and the purchase list display window 75 is updated. Step E37a).

(Linking mode)
The interlocking mode will be described below with reference to FIGS. 20 and 22. The interlocking mode is a mode corresponding to a combination of partial audience animation and partial match animation for the same partial period. In the interlocking mode, the audience moving picture seek bar 712 and the match moving picture seek bar 722 interlock. This allows the user to easily specify the same partial period.

  As shown in FIG. 22, when the start slider 725 and the end slider 726 of the match movie seek bar 722 are moved according to the user operation on the information processing terminal 67 (Yes in step E21), the match movie seek bar 722 is displayed. Following the slider operation, the start slider 715 and the end slider 716 on the spectator movie seek bar 712 are respectively moved (step E22). Similarly, when the start slider 715 and the end slider 716 of the audience moving image seek bar 712 are moved according to the user operation on the information processing terminal 67 (Yes in step E23), the slider operation of the audience moving image seek bar 712 is followed. Then, the start slider 725 and the end slider 726 of the match movie seek bar 722 are moved (step E24). Thus, the positions of the start slider 725 and the end slider 726 with respect to the total length of the game moving image timeline 723 correspond to the positions of the start slider 715 and the end slider 716 with respect to the total length of the audience moving image timeline 713.

  Information on the position of the start slider 715 on the audience moving image timeline 713 and information on the position of the end slider 716 are input to the information processing apparatus 601 as information on the first partial period desired by the user of the audience moving image. . Similarly, the information on the position of the start slider 725 on the game animation timeline 723 and the information on the position of the end slider 726 are provided to the information processing apparatus 601 as information on the second partial period desired by the user of the game animation. It is input. The information processing device 601 identifies the start frame of the partial audience moving image based on the information on the position of the start slider 715 on the audience moving image timeline 713, and information on the position of the starting slider 725 on the match moving image timeline 723 The start frame of the partial match animation is specified based on (step E25). Similarly, the information processing apparatus 601 identifies the end frame of the partial audience moving image based on the information on the position of the end slider 716 on the audience moving image timeline 713, and sets the end slider 726 on the match moving image timeline 723. The end frame of the partial match animation is specified based on the information on the position (step E26).

  The viewing windows 71 and 72 of each video are updated, the start frame of the partial audience video is displayed in the audience video viewing window 71, and the start frame of the partial match video is displayed in the match video viewing window 72 (step E27). The information processing apparatus 601 integrates the time unit price of the partial period between the start frame and the end frame, and calculates the sales price of the partial audience video and the sales price of the partial match video (step E28). ). Information on the partial audience animation specified by the user, such as the start time, the end time, the period, and the sales price, is displayed in the editing record in the purchase list display window 75. According to the start position registration button 717 (or 727) and the end position registration button 718 (or 728) being tapped (Yes in step E29), the record being edited is confirmed, each partial moving image is registered, and the purchase is made. The list display window 75 is updated (step E30).

  In the above, the match moving image data is data provided by a company having the right to broadcast the match, which is captured by the camera 66 and stored in the moving image database system 63. The resolution of the match moving image is reduced to spectator moving image Along with the video sale page SP3. On the animation sale page SP3, the match animation has significance as support information for searching for a desired partial period of the audience animation. In the application of achieving the significance, the match moving image displayed together with the audience moving image on the moving image sales page SP3 is not limited to the data stored in the moving image database system 63. For example, the game video data of the video sales page SP3 is imported to the information processing terminal 67 as the game video displayed together with the audience video on the video sales page SP3, for the purpose of personal audition from the live broadcast of the television It may be fitted in the viewing window 72 of the moving image. Of course, since the time code representing the time is attached to the imported match movie, the timeline 723 of the imported match movie is aligned with the timeline 713 of the audience movie.

  While certain embodiments of the present invention have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. These embodiments can be implemented in other various forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

  DESCRIPTION OF SYMBOLS 10 ... Image processing apparatus, 10-1 ... Image processing server, 10-2 ... Image provision server, 12 ... Network, 14 ... Information processing terminal, 201 ... Processor, 202 ... RAM, 203 ... ROM, 204 ... Input controller, 205 ... video controller, 206 ... I / O controller, 207 ... communication controller, 210 ... input device, 211 ... display, 212 ... storage device.

Claims (16)

At least one camera installed at a position where a large number of spectators fit in the frame,
An image cutting unit for cutting out a partial image for each of one or several spectators from the image photographed by the camera;
Uploading means for uploading the partial image to an image providing website for publishing the partial image as a thumbnail;
An image providing system comprising: means for transmitting data of one or more partial images selected by an external information processing terminal accessing the image providing website to the external information processing terminal.   The image providing system according to claim 1, further comprising an authentication unit configured to authenticate using a ticket number received from the external information processing terminal in order to restrict access to the image providing Web site.   Based on the seat number specified by the ticket number received from the external information processing terminal, the thumbnails thereof are limited to one or a few partial images narrowed down from the partial image and the external information processing terminal is disclosed The image providing system according to claim 2.   The image providing system according to claim 1, further comprising means for extracting a specific one from the series of images taken by the camera based on a change in loudness of the cheers of the audience. At least one camera installed at a position where a large number of spectators fit in the frame,
Uploading means for uploading the image taken by the camera to the image providing website;
A unit for cutting out a partial image of a range designated by an external information processing terminal that has accessed the image providing website from the image;
Means for transmitting data of the clipped partial image to the external information processing terminal. Computer,
An image cutting means for cutting out a partial image for each one or several spectators from an image that a large number of spectators fit in a frame;
Uploading means for uploading the partial image as a thumbnail to an image providing website;
An image providing program for causing data of one or a plurality of partial images selected by an external information processing terminal that has accessed the image providing website to function as means for transmitting the data to the external information processing terminal. A storage unit for storing data of an entertainment video related to sports games, concerts and other performances and data of audience video related to the audience of the performance;
A first partial period desired by the video purchase applicant among the entire period of the entertainment video, a second partial period desired by the video purchase candidate among the entire period of the audience video, a seat for the audience seat A receiver for receiving information on each of the numbers from the external device;
A position specifying unit which specifies a position within the frame of the audience video based on the seat number;
A trimming processing unit that executes a trimming process for removing areas other than the local region on each of the images constituting the audience moving image in order to generate a local audience moving image related to the local region including the specified position from the audience moving image; ,
Generating a partial audience animation for the first partial period from the local audience animation, and generating a partial animation video for the second partial period from the entertainment video. Movie offer system.   The system according to claim 7, wherein the first partial period and the second partial period are individually set.   The system according to claim 7, wherein the first partial period and the second partial period are set in conjunction with each other.   The time unit price of each of the on-the-fly moving image and the audience moving image is set unevenly along the time axis, and the time unit price is integrated by integrating the first unit period and the second unit period. The system according to claim 7, wherein the price of the partial entertainment video and the price of the partial audience video are respectively determined. In a video providing system connected to an external information processing terminal via a network,
A storage unit for storing video data;
A server that creates a Web page for providing moving images in response to a request from the information processing terminal and transmits the Web page to the information processing terminal;
Partially generating partial animation data of a partial period between the start position and the end position from the data of the animation according to any start position and any end position specified via the web page Equipped with a video generator,
The web page has a preview window of the moving image, a timeline in which a time axis of the moving image is represented by a chart is additionally provided in the preview window, and a start slider and an end indicating the start position are displayed in the timeline. An animation providing system with an end slider indicating the position. The unit price of the video is uneven along the time axis,
The moving picture providing system according to claim 11, wherein the display mode of the timeline is changed along a time axis according to the unit price of time. An index of each time is attached to the data of the moving image,
The moving image providing system according to claim 11, further comprising a unit price determination unit that determines a time unit price of each of the moving images based on the index. An index of each time is attached to the data of the moving image,
The system of claim 11, wherein the index is attached to the timeline. In a video providing system connected to an external information processing terminal via a network,
Partial moving image data of a partial period is generated from moving image data according to an instruction from the information processing terminal and provided to the information processing terminal, and the price of the partial moving image data is generated based on the time length of the partial period Video providing system to decide. In a video providing system connected to an external information processing terminal via a network,
Partial moving image data of a partial period is generated from moving image data according to an instruction from the information processing terminal and provided to the information processing terminal, and the uneven unit price is partially divided along the time axis of the moving image An animation providing system which determines the price of the partial animation data by integrating over a period.