JP2013175988A - Video transmission device, terminal device, video transmission method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To spontaneously deliver, to a viewer, a video material created from a recommended view point, among plural video materials created from different view points.SOLUTION: A video transmission device comprises: first transmission means 101 which transmits to one or more terminal devices 100 the plural video materials created from different view points; collection means 102 which collects viewing information from the one or more terminal devices 100; storage means 103 which stores the collected viewing information; selection means 104 which selects, from among the plural video materials, one video material which is viewed most frequently by the one or more terminal devices 100 on the basis of the viewing information stored in the storage means 103; and second transmission means 106 which transmits the one video material selected by the selection means 104 as a recommended video material, to another terminal device 105.

Description

  The present invention relates to a video transmission device, a terminal device, a video transmission method, and a program, and in particular, a video transmission device, a terminal device, and a video transmission capable of transmitting a plurality of videos created from various viewpoints (also referred to as angles). The present invention relates to a method and a program.

  In recent years, video content such as television broadcasting has been developed from a stereoscopic image (also referred to as a 2D image) displayed in a plane on a display screen, as well as a stereoscopic image (3D image) having information in the depth direction of the screen. However, since the data size of the 3D image is considerably larger than the data size of the 2D image, for example, there is a problem that the data cannot be normally played back by a receiving terminal having a low capability (hereinafter, The first problem) may occur.

As a conventional technique for dealing with the first problem, for example, there is a technique described in Patent Document 1 below. According to this, since the 3D image is distributed as it is according to the capability of the terminal, or the image is distributed after being converted into a 2D image, the above first problem can be solved.
However, in this technique, a 3D image is converted into a 2D image and distributed to a low-capacity terminal, and the 2D image is arbitrarily created by the distribution source, that is, a 2D image from a specific viewpoint. Therefore, there is a problem (hereinafter, the second problem) that it does not necessarily meet the viewer's wishes.

In this regard, for example, the following Patent Document 2 describes a technique related to angle switching (viewpoint switching) of stereoscopic processing in 3D video. According to this, according to a change in angle number by a user operation, It is said that a recording medium capable of supplying a video stream from various stream files to a decoder can be provided.
However, this technology relates to a playback device such as an optical disk, and in particular is a technology that enables playback without distinguishing between playback of 3D video and 2D video. It cannot be solved.

  Therefore, since a technique (see Patent Document 3 below) that collects viewer's viewing information at a distribution source using the bidirectionality of data broadcasting is known, the viewer can use the viewer information based on the viewer information. It is conceivable to convert a desired viewpoint (angle) into a 2D image.

  For example, in Patent Document 4 below, when a user designates a shooting angle, a technique for selecting and displaying a video material (one of a plurality of video materials created from different viewpoints) according to the shooting angle. Therefore, the second problem described above can be solved by applying this.

JP 2003-346183 A JP 2011-019228 A JP 2010-206447 A JP-A-9-55920

  However, the technique disclosed in Patent Document 4 has an advantage that video materials corresponding to the shooting angle can be displayed, but the user has to specify the shooting angle one by one, resulting in poor operability. There is. This problem cannot be overlooked especially when the number of angles is large. For example, when the number of shooting angles is n, in order to find an image with the optimum shooting angle, the angle designation must be repeated n times. The larger the number of n, the worse the operability. Because it invites.

  Accordingly, an object of the present invention is to provide a video transmission device, a terminal device, and a video that can spontaneously deliver a video material created from a recommended viewpoint to a viewer among a plurality of video materials created from different viewpoints. It is to provide a transmission method and a program.

The video transmission apparatus of the present invention includes a first transmission unit that transmits a plurality of video materials created from different viewpoints to one or a plurality of terminal devices, and viewing information from the one or a plurality of terminal devices. Collecting means for collecting the received viewing information, storage means for storing the collected viewing information, and one video that is most often viewed on the one or more terminal devices based on the viewing information stored in the storing means Selection means for selecting a material from the plurality of video materials, and second transmission means for transmitting one video material selected by the selection means to another terminal device as a recommended video material It is characterized by that.
The terminal device of the present invention includes a first receiving unit that receives a plurality of video materials created from different viewpoints, and a transmission unit that transmits viewing information indicating which of the plurality of video materials has been viewed. And a second receiving means for receiving a recommended video material corresponding to one of the plurality of video materials.
The video transmission method of the present invention includes a first transmission step of transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices, and viewing information from the one or a plurality of terminal devices. A collection process for collecting the viewing information, a storage process for storing the collected viewing information, and one video material that is most often viewed on the one or more terminal devices based on the viewing information stored in the storage process Selecting from among the plurality of video materials, and a second transmission step of transmitting one video material selected in the selection step to another terminal device as a recommended video material. Features.
The program of the present invention is a first transmission means for transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices, viewing information from the one or a plurality of terminal devices. Collecting means for collecting the viewing information, storage means for storing the collected viewing information, and one video material most often viewed on the one or more terminal devices based on the viewing information stored in the storage means. A selection means for selecting from among the plurality of video materials, and a function as a second transmission means for transmitting one video material selected by the selection means to another terminal device as a recommended video material. Features.

  According to the present invention, among a plurality of video materials created from different viewpoints, a video transmission device, a terminal device, and a video transmission method that can spontaneously deliver a video material created from a recommended viewpoint to a viewer And programs can be provided.

It is a system configuration figure of an embodiment. It is a figure which shows the display screen 14 of the portable terminal 2. FIG. 3 is a diagram illustrating an example of viewing on a mobile terminal 2. FIG. It is a figure which shows an example of the best angle transmission from the server. It is a figure which shows the timeline of embodiment. It is a block diagram of the supplementary note 1 and the supplementary note 2.

Embodiments of the present invention will be described below with reference to the drawings.
First, the configuration will be described.
FIG. 1 is a system configuration diagram of the embodiment. In this figure, the main elements of the system are firstly a server 1 (video transmission device) for video transmission, and secondly, from one unit that visualizes and displays the video transmitted from the server 1. A plurality of portable terminals 2 (terminal devices).

  The server 1 and the terminal device 2 can be connected using a wireless or wired communication medium in a state where bidirectional data communication is possible. There are no particular limitations on the type of communication medium, communication method, and the like. For example, it may include a public telephone line network, a mobile phone line network, a wide area network such as the Internet, a terrestrial digital broadcasting network such as one segment or full segment, a satellite communication line, and the like. It is sufficient that data can be transmitted from the server 1 to the portable terminal 2 and data can be transmitted from the terminal 2 to the server 1 as well. That is, it is only necessary that bidirectional data communication is possible.

  When the data communication path from the server 1 to the portable terminal 2 is referred to as “downlink” and the data communication path from the portable terminal 2 to the server 1 is referred to as “uplink”, the downlink and uplink paths are set separately. Also good. For example, the downlink may be a terrestrial wave or a satellite, and the uplink may be the Internet. An appropriate line may be used according to the communication traffic volume.

  The server 1 and the portable terminal 2 are both computer application devices, and both have a similar configuration except for scale. In accordance with general common sense, the server 1 uses a server-dedicated computer having excellent fault tolerance, and the mobile terminal 2 uses a small electronic device having excellent portability, for example, a mobile phone such as a smartphone. And However, it is not limited to these. The server 1 may be configured by a general-purpose computer, and the mobile terminal 2 is not limited to a mobile phone. It may be a fixed or portable video viewing device (such as a television receiver).

The server 1 and the portable terminal 2 have the following functions, respectively.
<Server 1>
The server 1 has a one-segment digital broadcast transmission function 3. One-segment digital broadcasting refers to broadcasting for mobile objects such as mobile phones that is performed by terrestrial digital broadcasting. It is also simply called 1Seg broadcasting. However, it is not limited to one-segment broadcasting. It may be full-segment broadcasting (high-quality broadcasting for fixed television among terrestrial digital broadcasting).

  The one-segment digital broadcast transmission function 3 provides a service for selectively transmitting a plurality of video materials created from different viewpoints (angles) of the same program. In other words, for example, when broadcasting a soccer game, the main video material (hereinafter referred to as the main video material) selected on the station side is transmitted, and a plurality of video materials (hereinafter referred to as sub-images) taken from various viewpoints are transmitted. Select one of the video materials) and send it. Such a service is called an omnidirectional broadcasting service. In addition, a mode in which only the sub-video material is transmitted without transmitting the main video material may be employed.

  The server 1 further includes a viewing information collection function 4, a viewing information storage unit 5, an angle information analysis function 6, and a best angle transmission function 7. The viewing information collection function 4 collects viewing information sent from one or a plurality of portable terminals 2, and the viewing information storage unit 5 stores and saves the collected viewing information. The angle information analysis function 6 analyzes the stored viewing information to determine which angle (viewpoint) from which the sub-video material is most viewed on each mobile terminal 2, and transmits the best angle. The function 7 transmits the most viewed sub-picture material, that is, the best-angle sub-picture material, to the mobile terminal 2 according to the determination result of the angle information analysis function 6.

<Mobile terminal 2>
The mobile terminal 2 includes a one-segment digital broadcast reception function 8, a touch panel operation function 9, a touch gesture history information generation function 10, a touch gesture history information storage unit 11, a viewing information transmission function 12, and a best angle viewer function 13. Is provided.

  The one-segment digital broadcast reception function 8 receives the one-segment broadcast of the omnidirectional broadcast service transmitted from the server 1 and displays it on a display unit (not shown) such as a liquid crystal display. The touch panel operation function 9 detects a touch gesture of a user (viewer) on a touch panel (not shown) provided in front of the display unit, determines the content of the touch gesture, and at least according to the determination result Thus, an operation of changing the viewpoint of the omnidirectional broadcasting service being received, that is, an operation of switching the sub-picture material is executed.

  The touch gesture refers to a special touch operation performed by one or more fingers among touch operations performed on the touch panel (touch operations using a part of a human body such as a fingertip). More specifically, it refers to input that a device or operating system interprets in response to one or more touch events. For example, if the user rotates two fingers simultaneously, the device or operating system interprets the touch input as a rotation gesture. A gesture may be performed with one finger or a single touch point, or it may require multiple touch points. The device or operating system determines the type of gesture and assigns it to the input. In addition to the rotation gesture described above, the touch gesture may be, for example, a two-finger scroll (an operation for moving a portion displayed on the screen in the vertical direction or the horizontal direction), a flick (an operation for sliding the fingertip), a pinch-in (for two Move the operation target on the screen with your finger to reduce the screen), pinch out (operation to release the two fingers to expand the operation target on the screen and enlarge the screen), 3 There are various types such as finger swipe (operation to slide a finger while touching the screen), three-finger pinch, four-finger swipe, and press-and-hold (operation to keep touching).

  The touch gesture history information generation function 10 generates touch gesture history information indicating which sub-picture material has been switched to at least when the content of the touch gesture relates to an operation for switching the sub-picture material. The gesture history information storage unit 11 stores and saves the touch gesture history information. The viewing information transmission function 12 transmits the stored touch gesture history information to the server 1 as viewing information of the mobile terminal 2. The best angle viewer function 13 displays the best angle (sub-picture material having the most viewed angle) transmitted from the server 1 as appropriate on the display unit.

  Note that the above functions of the server 1 and the portable terminal 2 are functionally realized by organic connection of hardware resources of a computer and software resources (basic programs, application programs, etc.) executed on the computer. Although it is a thing and does not exist as an entity, it is not limited to this. All or some of the functions of the server 1 and the mobile terminal 2 may be configured with an entity such as hard logic.

  FIG. 2 is a diagram showing the display screen 14 of the mobile terminal 2. In this figure, the display screen 14 has a main screen area 15 having a large size and a sub-screen area 16 having a small size. One-seg broadcasting received by the one-seg digital broadcast receiving function 8 is displayed in the main screen area 15. The best-angle sub-video material output from the best-angle viewer function 13 is displayed in the sub-screen area 16.

  Here, as described above, a touch panel (not shown) is provided on the display screen 14, and the viewpoint of the video material in the main screen area 15 is switched by performing a predetermined touch gesture on the touch panel. ing. For example, when a touch gesture such as tracing the main screen area 15 from left to right is performed, the viewpoint of the video material in the main screen area 15 is switched from left to right (pan video to the right). Alternatively, when a touch gesture that traces the main screen area 15 from the bottom to the top is performed, the viewpoint of the video material in the main screen area 15 is switched from the bottom to the top (overhead view image from above).

  Video switching information associated with such a touch gesture is stored and saved in the touch gesture history information storage unit 11 as touch gesture history information, and is transmitted as viewing information of the mobile terminal 2 by the viewing information transmission function 12 at an appropriate timing. 1 is transmitted.

Next, the operation will be described.
FIG. 3 is a diagram illustrating an example of viewing on the mobile terminal 2. This figure shows a state in which one user (hereinafter referred to as user A) is watching an omnidirectional one-segment broadcast transmitted from the server 1 using his / her mobile terminal 2. In the main screen area 15 of the portable terminal 2, for example, a state of a soccer goal scene (hereinafter, scene 1) is displayed.

  User A can perform a touch gesture on the display screen 14 to switch the video displayed in the main screen area 15 to an arbitrary sub-video material with a different viewpoint. On the left side of the drawing, examples of some sub-picture materials switched by the user A (hereinafter, angles 1 to 3) are shown. Angles 1 to 3 are all images that capture the moment of shooting with telephoto, but the viewpoints are different. That is, the viewpoint of angle 1 is in the direction in which the back side of the player to be shot can be seen, the viewpoint of angle 2 is in the direction in which the chest side of the player can be seen, and the viewpoint of angle 3 is in the direction in which the right side of the player's body can be seen. It is in. Information related to these sub-picture materials (angles 1 to 3) is stored and stored in the touch gesture history information storage unit 11 as user A's touch gesture history information, and the viewing information transmission function as user A's viewing information at an appropriate timing. 12 to the server 1.

  FIG. 4 is a diagram illustrating an example of the best angle transmission from the server 1. In this figure, the user B, the user C, and the user D are watching the omnidirectional one-segment broadcasting transmitted from the server 1 using their mobile terminals 2, similarly to the user A. Furthermore, as with user A, these users B, C, and D can switch to any sub-video material with a different viewpoint by performing a touch gesture on the display screen 14. The mobile terminals 2 of the user B, the user C, and the user D generate and store touch gesture history information for each user, and transmit it to the server 1 as viewing information.

  Here, it is assumed that user B, user C, and user D have all watched the same sub-video material (angle 2 for convenience). That is, the viewing information transmitted from the mobile terminals 2 of the users B, C, and D to the server 1 is information indicating viewing of the angle 2.

  The server 1 collects and analyzes the viewing information transmitted from the terminal device 2 of each user, and determines the best angle (sub-picture material having the most viewed angle) based on the analysis result. In other words, when the user B, the user C, and the user D are all viewing the same sub-picture material (angle 2), the angle 2 is determined as the best angle. Then, by the best angle transmission function 7, the sub-picture material of the angle 2 is transmitted to the mobile terminal 2 of another user (here, user E) who is viewing.

  The mobile terminal 2 of the user E displays the video material of the best angle (that is, angle 2) sent from the server 1 in the sub screen area 16 of the display screen 14 by using the best angle viewer function 13 of the user E. In this example, the sub-screen area 16 is displayed. However, the sub-screen area 16 may be displayed.

FIG. 5 is a diagram illustrating a timeline of the embodiment.
(A) The server 1 transmits the one-segment broadcasting to the mobile terminals 2 of the users A to D.
(B) The mobile terminals 2 of the users A to D generate and store touch gesture history information indicating which sub-video material is switched when the content of the touch gesture relates to an operation for switching the sub-video material. To do.
(C) The mobile terminals 2 of the users A to D transmit the stored touch gesture history information to the server 1 at appropriate timing as viewing information of each user.
(D) The server 1 collects and stores the viewing information transmitted from each mobile terminal 2, and based on the stored information, selects the best angle (sub-picture material having the most viewed angle). decide.
(E) The server 1 transmits the one seg broadcast to the portable terminal 2 in response to the one seg broadcast transmission request from the portable terminal 2 of another user (here, the user E).
(F) The server 1 voluntarily transmits the best angle determined in (d) to the mobile terminal 2 of the user E at a required timing.

  Since it is as above, embodiment can have the following effects. That is, the user E who is viewing the one-segment broadcast can view the best angle (the sub-video material having the most viewed angle) without performing any operation on his / her own. This is because the server 1 of the embodiment voluntarily selects a video material created from a recommended viewpoint (best angle) among a plurality of video materials created from different viewpoints (angles) for the same program. This is because no operation is requested to the user who views the best angle.

  Therefore, since the user E can view the best angle without performing a troublesome operation (touch gesture), it is possible to provide a technique that is extremely advantageous for a user who is not familiar with the operation. Moreover, since a troublesome operation (touch gesture) is not required, it is possible to improve the usability of a small portable terminal that is forced to be operated with one hand like a smartphone.

  In the embodiment, how to determine the best angle in the server 1 is performed based on the number of times each user views (for example, in the example of FIG. 4, the angle 2 is viewed a total of three times by the users B to D). However, it is not limited to this. For example, not only the number of viewing times but also viewing time may be taken into account.

  For example, in the case of viewing only, if the viewing count of angle 1 is 5, the viewing count of angle 2 is 5, and the viewing count of angle 3 is 6, the best angle in this case is the angle with the largest viewing count. It becomes 3.

  On the other hand, when viewing time is also taken into account, for example, viewing time of angle 1 is 5 times and viewing time is “long”, viewing time of angle 2 is 5 times and viewing time is “short”, viewing time of angle 3 is 6 times If the viewing time is "short", the best angle is either angle 1 or angle 3, but generally the user's attention (interest) is high when the viewing time is "long". In this case, it can be said that it is appropriate to determine the angle 1 as the best angle.

  In other words, if the best angle is determined only by the number of times of viewing, the angle that is viewed for a moment is also included in the number of times, and as a result, the accuracy of determining the best angle is deteriorated. It is possible to make the best angle determination with high reliability without causing deterioration.

The features of the present invention will be described below.
A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.
FIG. 6 is a configuration diagram of Appendix 1 and Appendix 2.
(Appendix 1)
Appendix 1 shows a first transmission unit 101 (one-segment digital broadcasting of the embodiment) for transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices 100 (corresponding to the portable terminal 2 of the embodiment). Equivalent to transmission function 3),
A collecting means 102 (corresponding to the viewing information collecting function 4 of the embodiment) for collecting viewing information from the one or a plurality of terminal devices 100;
Storage means 103 (corresponding to the viewing information storage unit 5 of the embodiment) for storing the collected viewing information;
Based on viewing information stored in the storage means 103, a selection means 104 (selecting one video material most often viewed on the one or more terminal devices 100 from the plurality of video materials) Equivalent to the angle information analysis function 6 of the embodiment),
Second transmission means 106 (best angle transmission of the embodiment) for transmitting one video material selected by the selection means 104 as a recommended video material to another terminal device 105 (corresponding to the mobile terminal 2 of the embodiment). And a video transmission device 107 (corresponding to the server 1 of the embodiment).
(Appendix 2)
Appendix 2 shows a first receiving means 108 (corresponding to the one-segment digital broadcast receiving function 8 of the embodiment) for receiving a plurality of video materials created from different viewpoints;
Transmission means 109 (corresponding to the viewing information transmission function 12 of the embodiment) for transmitting viewing information indicating which of the plurality of video materials has been viewed;
A terminal device 100, comprising: a second receiving unit 110 (corresponding to the best angle viewer function 13 of the embodiment) for receiving a recommended video material corresponding to one of the plurality of video materials; 105 (corresponding to the portable terminal 2 of the embodiment).
(Appendix 3)
Appendix 3 is a first transmission step of transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices;
A collection step of collecting viewing information from the one or more terminal devices;
A storage process for storing the collected viewing information;
A selection step of selecting, from among the plurality of video materials, one video material that is most frequently viewed on the one or more terminal devices based on the viewing information stored in the storage step;
And a second transmission step of transmitting the one video material selected in the selection step as a recommended video material to another terminal device.
(Appendix 4)
Appendix 4
First transmission means for transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices;
A collecting means for collecting viewing information from the one or more terminal devices;
Storage means for storing the collected viewing information;
Selection means for selecting, from the plurality of video materials, one video material most often viewed on the one or more terminal devices based on viewing information stored in the storage means;
The program is characterized in that it provides a function as a second transmission means for transmitting one video material selected by the selection means to another terminal device as a recommended video material.
(Appendix 5)
Appendix 5 is characterized in that the viewing information includes one or both of information indicating the number of times of viewing of each of a plurality of video materials and information indicating a viewing time in the one or a plurality of terminal devices. The video transmission device according to attachment 1.

DESCRIPTION OF SYMBOLS 100 Terminal apparatus 101 1st transmission means 102 Collection means 103 Storage means 104 Selection means 105 Terminal apparatus 106 2nd transmission means 107 Image | video transmission apparatus 108 1st reception means 109 Transmission means 110 2nd reception means

Claims (5)

First transmission means for transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices;
Collection means for collecting viewing information from the one or more terminal devices;
Storage means for storing the collected viewing information;
Selection means for selecting, from among the plurality of video materials, one video material that is most often viewed on the one or more terminal devices based on viewing information stored in the storage means;
A video transmission device comprising: a second transmission unit configured to transmit one video material selected by the selection unit to another terminal device as a recommended video material. First receiving means for receiving a plurality of video materials created from different viewpoints;
Transmitting means for transmitting viewing information indicating which of the plurality of video materials has been viewed;
And a second receiving means for receiving a recommended video material corresponding to one of the plurality of video materials. A first transmission step of transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices;
A collection step of collecting viewing information from the one or more terminal devices;
A storage process for storing the collected viewing information;
A selection step of selecting, from among the plurality of video materials, one video material that is most frequently viewed on the one or more terminal devices based on the viewing information stored in the storage step;
A second transmission step of transmitting the one video material selected in the selection step as another recommended video material to another terminal device. On the computer,
First transmission means for transmitting a plurality of video materials created from different viewpoints to one or a plurality of terminal devices;
A collecting means for collecting viewing information from the one or more terminal devices;
Storage means for storing the collected viewing information;
Selection means for selecting, from the plurality of video materials, one video material most often viewed on the one or more terminal devices based on viewing information stored in the storage means;
A program that provides a function as a second transmission unit that transmits one video material selected by the selection unit as a recommended video material to another terminal device.   2. The viewing information includes one or both of information indicating the number of times of viewing each of a plurality of video materials in the one or a plurality of terminal devices and information indicating a viewing time. The video transmission device described.

Images