JP2011130323A - Broadcast receiver and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve user convenience by reproducing appropriate arbitrary viewpoint video when viewing of program content of arbitrary viewpoint video is resumed after temporarily stopping viewing of the program content of arbitrary viewpoint video. Provided is a broadcast receiving apparatus capable of performing the same and a control method thereof.
An arbitrary viewpoint video generation unit 105 synthesizes multi-viewpoint video content for generating an arbitrary viewpoint video, and generates an arbitrary viewpoint video of a viewpoint that automatically follows a set specific object. When program content other than the arbitrary viewpoint video is selected as the program content to be displayed, the system control unit 107 performs control to store information on the set specific object in the storage unit 108. When program content of an arbitrary viewpoint video is selected again as the program content to be displayed, the arbitrary viewpoint video generation unit 105 generates an arbitrary viewpoint video of a viewpoint that automatically follows a set specific object.
[Selection] Figure 1

Description

  The present invention relates to a broadcast receiving apparatus capable of generating an arbitrary viewpoint video corresponding to an arbitrary viewpoint position from a plurality of video contents having different viewpoint positions that constitute program content, and a control method thereof.

  In recent years, research has been conducted on generating arbitrary viewpoint videos at arbitrarily specified viewpoint positions from multi-viewpoint video contents (multiple video contents with different viewpoint positions) shot by a large number of cameras arranged to surround an object. Has been done. By synthesizing, interpolating and reconstructing a large number of video contents each having a different viewpoint position, it is possible to obtain an arbitrary viewpoint video at a virtual viewpoint position that is not originally photographed.

  Patent Document 1 below discloses a technique for seamlessly switching from a standard video of a broadcast program to an arbitrary video in a service that provides an arbitrary video in cooperation with the standard video of a broadcast program. By using the viewpoint information extracted from the broadcast stream as the initial viewpoint value of the arbitrary viewpoint video, when switching from the standard video to the arbitrary viewpoint video, the arbitrary viewpoint video of the same viewpoint as the standard video is the first arbitrary viewpoint video. Can be used as

  Also, the following Patent Document 2 discloses a technique for restoring the final image state of the data broadcast when the channel is selected again while viewing the data broadcast and then returns to the data broadcast of the original channel again. Has been.

JP 2007-150747 A JP 2007-043335 A

  When a broadcast service that provides program content of an arbitrary viewpoint video is started, the following problems occur when the program content to be displayed is switched between the program content of the arbitrary viewpoint video and another program content. . Here, it is assumed that the user sets the desired viewpoint position of the arbitrary viewpoint video by operating the remote controller or the like while viewing the program content of the arbitrary viewpoint video. When another program content is selected after the program content of an arbitrary viewpoint video is selected as the program content to be displayed, information on the set viewpoint position is stored. When the program content of an arbitrary viewpoint video is selected again as the program content to be displayed, the stored information on the viewpoint position is read out, and the arbitrary viewpoint video at the set viewpoint position is generated.

  In this case, if the time interval until the program content of the arbitrary viewpoint video is selected again is long, the object (subject) that the user wants to see is not reflected even if the arbitrary viewpoint video at the set viewpoint position is generated. It is possible. As described above, there is a problem that even if information on the set viewpoint position is simply stored, an arbitrary viewpoint video in which an object (subject) that the user wants to see cannot be reproduced. For this reason, a troublesome operation is required in which the user operates the remote controller or the like to reset the viewpoint position of the desired arbitrary viewpoint video.

  Therefore, the present invention reproduces an appropriate arbitrary viewpoint video when the viewing of the program content of the arbitrary viewpoint video is resumed after temporarily stopping the viewing of the program content of the arbitrary viewpoint video. An object of the present invention is to provide a broadcast receiving apparatus and a control method thereof that can be improved.

  In order to solve the above-described problems, the broadcast receiving apparatus according to the present invention can generate an arbitrary viewpoint video corresponding to an arbitrary viewpoint position from a plurality of video contents each having a different viewpoint position, which constitute program content. A broadcast receiving apparatus, wherein a selection means for selecting a program content to be displayed from a plurality of program contents transmitted via a broadcast signal, and a program content of an arbitrary viewpoint video is selected by the selection means A setting unit for setting a specific object to be tracked, and a plurality of video contents constituting the program content of the arbitrary viewpoint video when the selection unit selects the program content of the arbitrary viewpoint video To generate an arbitrary viewpoint video of the viewpoint that follows the specific object set by the setting means. When a program content of an arbitrary viewpoint video is selected by the generating unit and the selecting unit, and another program content is selected, information related to the specific object set by the setting unit is stored in the storage unit Storage means. When the program content of the arbitrary viewpoint video is selected again after the other program content is selected by the selection unit, the generation unit uses information on the specific object stored in the storage unit. Then, an arbitrary viewpoint video of a viewpoint that follows the specific object is generated from a plurality of video contents constituting the program content of the arbitrary viewpoint video.

  According to the present invention, when the viewing of the program content of the arbitrary viewpoint video is resumed after temporarily stopping the viewing of the program content of the arbitrary viewpoint video, the appropriate arbitrary viewpoint video is reproduced and the convenience of the user is improved. It becomes possible to be able to improve.

It is a block diagram which shows the structure of the broadcast receiver which concerns on Embodiment 1 of this invention. It is a flowchart for demonstrating a process when the program content of a display object is switched. It is a figure which shows the example of a display screen of the arbitrary viewpoint videos in automatic viewpoint follow-up mode. It is a figure for demonstrating the process which produces | generates arbitrary viewpoint videos from the multi-view video content of arbitrary viewpoint video generation. It is a block diagram which shows the structure of the broadcast receiver which concerns on Embodiment 2 of this invention. It is a flowchart for demonstrating a process when the program content of a display object is switched.

(Embodiment 1)
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of broadcast receiving apparatus 100 according to Embodiment 1 of the present invention. It is assumed that normal digital broadcast program content and arbitrary viewpoint video program content are provided via a digital broadcast signal. As program content of an arbitrary viewpoint video, for example, multi-view video content (multi-view video content for generating an arbitrary viewpoint video) captured by a number of cameras arranged so as to surround an object is distributed. The broadcast receiving apparatus 100 has a function of generating an arbitrary viewpoint video by synthesizing the received multi-view video content for generating an arbitrary viewpoint video.

  The broadcast receiving apparatus 100 includes a tuner module 101, a TS decoder 102, a video processing unit 103, a video output unit 104, an arbitrary viewpoint video generation unit 105, a tracking object setting unit 106, a system control unit 107, and a storage unit 108. The broadcast receiving apparatus 100 includes a remote control receiving unit 109, and receives a remote control code signal transmitted from the remote control 200 via infrared rays or the like.

  A tuner module (tuner unit) 101 receives program content transmitted via a digital broadcast signal such as terrestrial digital broadcast, and extracts (selects) a signal having a frequency corresponding to a channel selected by the user. Further, the tuner module 101 performs demodulation processing, error correction processing, and the like on the extracted signal, and extracts a transport stream (TS). The remote control receiving unit 109 receives a remote control code signal from the remote control 200 and transmits it to the system control unit 107. The system control unit 107 interprets the remote control code received by the remote control receiving unit 109 and transmits various instructions to each functional block in the broadcast receiving apparatus. When the user operates the remote controller 200 to select a desired channel, information on the selected channel is transmitted to the tuner module 101.

  The TS decoder 102 separates (DEMUX) the transport stream from the tuner module 101 into a video signal, an audio signal, a data signal (program information, data for data broadcasting, etc.), and the like. The video signal separated by the TS decoder 102 is output to the video processing unit 103 or the arbitrary viewpoint video generation unit 105, and the audio signal and the data signal are output to an audio processing unit and a data processing unit (not shown). When the user operates the remote controller 200 and selects a normal digital broadcast program content as the program content to be displayed, the video signal separated by the TS decoder 102 is output to the video processing unit 103. On the other hand, when the program content of an arbitrary viewpoint video is selected as the program content to be displayed, the video signal separated by the TS decoder 102 is output to the arbitrary viewpoint video generation unit 105. Note that the user can select the program content to be displayed by pressing the channel key of the remote controller 200 to select a channel, or selecting the program content to be viewed from the electronic program guide with the cursor key. Etc.

  The video processing unit 103 performs a decoding process on the video signal from the TS decoder 102 and outputs it to the video output unit 104. The video output unit 104 converts the decoded video signal into a display resolution, a display color number, and a refresh rate suitable for the display unit, and outputs them to the display unit. In addition, as a display part, display panels, such as a liquid crystal display panel, a plasma display panel, and an organic electroluminescent display panel, are assumed.

  When the user operates the remote controller 200 and selects a program content of an arbitrary viewpoint video as a program content to be displayed, a multi-view video content for generating an arbitrary viewpoint video and its program information are sent from the TS decoder 102 to an arbitrary viewpoint video generation unit. 105. The program information given to the arbitrary viewpoint video generation unit 105 includes identification information indicating that the program content is an arbitrary viewpoint video. Further, the program information includes viewpoint information of a plurality of video contents having different viewpoints that constitute multi-view video contents for generating arbitrary viewpoint videos. The viewpoint information of each video content includes the viewpoint position (three-dimensional coordinates of x, y, z) of the camera in which each video content was shot, the viewing direction (three-dimensional direction vector), and the viewing angle (horizontal and vertical directions). Information for specifying the angle of view defined by the viewing angle). The program information also includes recommended viewpoint information (default viewpoint information) designated by the creator of the program content of the arbitrary viewpoint video.

  The arbitrary viewpoint video generation unit 105 generates an arbitrary viewpoint video corresponding to an arbitrary viewpoint position using the multi-view video content for generating an arbitrary viewpoint video from the TS decoder 102 and its program information. The arbitrary viewpoint video generation unit 105 has a manual viewpoint mode and an automatic viewpoint tracking mode. In the manual viewpoint mode, when the user operates the remote controller 200 to specify a desired viewpoint, the arbitrary viewpoint video generation unit 105 synthesizes and interpolates multi-viewpoint video content for generating arbitrary viewpoint video, and specifies the specified viewpoint. An arbitrary viewpoint video of (viewpoint position, line-of-sight direction, viewing angle) is generated. The arbitrary viewpoint video generated by the arbitrary viewpoint video generation unit 105 is subjected to necessary processing by the video processing unit 103 and is output to the video output unit 104.

  In the automatic viewpoint tracking mode, the tracking object setting unit 106 sets a specific object to be tracked. For example, in the case of a video in which an object of interest (subject) such as a sports program moves every few seconds, in manual viewpoint mode, it is troublesome for the user to follow the moving object of interest and operate the remote controller 200. Therefore, an automatic viewpoint tracking mode for automatically following a specific object to be tracked is provided. For example, the user selects an object of interest while watching the video, and sets a specific object to be tracked. However, the program content creator adds information on the object that can be tracked to the program content in advance, and the user selects from the list of objects that can be tracked to set a specific object to be tracked. Also good. In addition, a specific object to be followed may be set by inputting a keyword (player name or the like) of an object that the user pays attention to.

  In the automatic viewpoint tracking mode, the arbitrary viewpoint video generation unit 105 synthesizes and interpolates multi-viewpoint video content for generating arbitrary viewpoint videos, and automatically follows a set specific object (viewpoint position, line of sight). (Arbitrary viewpoint video of direction and viewing angle) is generated. The arbitrary viewpoint video generation processing in the automatic viewpoint tracking mode will be described in detail later.

  The system control unit 107 controls each functional block in the broadcast receiving apparatus. Various control commands from the system control unit 107 are transmitted to the functional block to be controlled through the common bus. The common bus transmits various data and control commands (information related to control) exchanged between the functional blocks.

  In addition, the system control unit 107 displays information on a specific object set as a tracking target in response to switching of the program content to be displayed between the program content of an arbitrary viewpoint video and other program content. , Control to store in the storage unit 108 is performed. Specifically, information indicating a specific object set as the tracking target and program content identification information (such as a title name) set in the automatic viewpoint tracking mode are associated with each other and stored in the storage unit 108. Is done.

  FIG. 2 is a flowchart for explaining processing when the program content to be displayed is switched between the program content of the arbitrary viewpoint video and the other program content. It is assumed that the user starts viewing the program content of an arbitrary viewpoint video in the automatic viewpoint tracking mode.

  In step S101, the arbitrary viewpoint video generation unit 105 synthesizes and interpolates multi-viewpoint video content for arbitrary viewpoint video generation, and automatically selects a viewpoint that automatically follows the specific object set by the tracking object setting unit 106. Arbitrary viewpoint video is generated. Here, processing for generating an arbitrary viewpoint video will be described with reference to FIGS. 3 and 4.

  FIG. 3 is a diagram illustrating a display screen example of an arbitrary viewpoint video in the automatic viewpoint tracking mode. In the viewpoint map display area, the viewpoint positions of the cameras C1 to C8 that have captured multi-view video content (a plurality of video content with different viewpoints) for generating an arbitrary viewpoint video are displayed. Also, a camera icon of a virtual viewpoint that automatically follows the set specific object is drawn. Here, an arbitrary viewpoint video of a soccer program is illustrated. This viewpoint map screen is created using information such as the viewpoint position, line-of-sight direction, viewing angle, etc. of the camera where each video content of the arbitrary viewpoint video generation was transmitted as program information of the program content of the arbitrary viewpoint video. The

  FIG. 4 is a diagram for explaining processing for generating an arbitrary viewpoint video from multi-view video content for generating an arbitrary viewpoint video. The arbitrary viewpoint video generation unit 105 acquires the viewpoint information of the multi-view video contents V1, V2, V3,. The viewpoint information includes information for specifying the viewpoint position, the line-of-sight direction, and the viewing angle.

  In addition, the arbitrary viewpoint video generation unit 105 analyzes each video of the multi-view video content V1, V2, V3,... For generating arbitrary viewpoint video, and the specific object set by the following object setting unit 106. Is detected. For example, when a specific soccer player is set as a specific object to be tracked, a virtual viewpoint (viewpoint position, line-of-sight direction, viewing angle) from which the player's activity can be best viewed, It is automatically calculated (determined) using a predetermined algorithm. Then, the arbitrary viewpoint video generation unit 105 synthesizes and interpolates multi-viewpoint video contents V1, V2, V3,... For generating arbitrary viewpoint videos, and automatically follows a specific soccer player. Arbitrary viewpoint video (position, line-of-sight direction, viewing angle) is generated. For example, the viewpoint position, line-of-sight direction, and viewing angle for capturing the soccer player's face from the front are automatically calculated (determined) by analyzing the video and using a predetermined algorithm. Then, by analyzing the video to detect the movement of the soccer player and updating the viewpoint as needed according to the analysis result, an arbitrary viewpoint video with a viewpoint that automatically follows a specific soccer player is generated. This tracking method is an application of a conventional method of automatically tracking a person's face to an arbitrary viewpoint video. As a specific method of the composition processing, for example, the video content that captures the face of a specific soccer player from the front is determined from among the multi-view video content V1, V2, V3,. Combining other video content with the content at the center. The number of video contents to be combined / interpolated may be, for example, three video contents that are the sum of the video content that captures the face of a specific soccer player from the front and the two neighboring video contents. It may be four or more.

  In addition, when object metadata is added to the program content, a specific object can be tracked using the object metadata. In addition, when inputting a keyword of an object of interest by the user, it is possible to follow a specific object by obtaining the degree of coincidence between the input keyword and object metadata. Also, it may be a mode that follows the viewpoint from a specific person. For example, the gaze direction of a person such as a referee of a sports program is automatically calculated from the video, and an arbitrary viewpoint video according to the change of the viewpoint of the referee May be generated.

  Returning to FIG. 2 again, in step S102, the system control unit 107 determines whether or not program content other than the arbitrary viewpoint video has been selected by the user as the program content to be displayed. The program content other than the arbitrary viewpoint video is, for example, normal digital broadcast program content. However, it may be program content input from a video input unit (not shown), for example, program content received via the Internet line, or program content input from an external recorder or the like. In that case, the video output unit 104 switches from the video signal input from the video processing unit 103 to the video signal of the program content input from the outside, and outputs it to the display unit.

  When it is determined that other program content other than the arbitrary viewpoint video is selected as the program content to be displayed, the process proceeds from step S102 to step S103. In step S <b> 103, the system control unit 107 performs control to store, in the storage unit 108, information regarding a specific object set as a tracking target in the program content of the arbitrary viewpoint video. Specifically, information indicating a specific object set as the tracking target and program content identification information (such as a title name) set in the automatic viewpoint tracking mode are associated with each other and stored in the storage unit 108. Is done.

  Next, in step S <b> 104, the video signal of the program content other than the arbitrary viewpoint video selected as the program content to be displayed is separated by the TS decoder 102 and output to the video processing unit 103. The video signals of other program contents are subjected to necessary processing by the video processing unit 103 and the video output unit 104 and displayed on the display unit.

  In step S <b> 105, the system control unit 107 determines whether or not a program content of an arbitrary viewpoint video is selected again as a display target program content by the user. If it is determined that the program content of the arbitrary viewpoint video is selected again as the program content to be displayed, the process proceeds from step S105 to step S106. If the user operates the channel key of the remote controller 200 to select the original channel again and the program content of the arbitrary viewpoint video has been completed, the process does not proceed from step S105 to step S106.

  In step S <b> 106, the system control unit 107 reads information about a specific object set as a tracking target in the program content of the arbitrary viewpoint video from the storage unit 108 and passes the information to the arbitrary viewpoint video generation unit 105. Subsequently, in step S107, the arbitrary viewpoint video generation unit 105 analyzes each video of the multi-view video content for generating the arbitrary viewpoint video and performs a process of detecting the set specific object, and the process proceeds to step S108. move on.

  If the set specific object is detected from the multi-view video content for generating arbitrary viewpoint video, the process proceeds from step S108 to step S109. In step S109, the arbitrary viewpoint video generation unit 105 synthesizes / interpolates multi-viewpoint video content for generating arbitrary viewpoint video, and automatically follows a set specific object (viewpoint position, line-of-sight direction, (Viewing angle) arbitrary viewpoint video is generated. The generated arbitrary viewpoint video is subjected to necessary processing by the video processing unit 103 and the video output unit 104 and displayed on the display unit.

  On the other hand, when the set specific object is not detected from the multi-view video content for generating arbitrary viewpoint video, the process proceeds from step S108 to step S110. In step S110, the arbitrary viewpoint video generation unit 105 synthesizes and interpolates multi-view video content for generating arbitrary viewpoint video, and generates an arbitrary viewpoint video of a predetermined default viewpoint. Specifically, using the recommended viewpoint information (default viewpoint information) specified by the producer of the program content of the arbitrary viewpoint video included in the program information acquired from the TS decoder 102, a predetermined default viewpoint is selected. Arbitrary viewpoint video is generated.

  As described above, in the first embodiment, after the viewing of the program content of the arbitrary viewpoint video is temporarily interrupted, the appropriate arbitrary viewpoint video is reproduced when the viewing of the program content of the arbitrary viewpoint video is resumed. User convenience can be improved. For example, when an arbitrary viewpoint video program content is selected as a display target program content, another program content is selected, and an arbitrary viewpoint video program content is selected again, and an appropriate arbitrary viewpoint video is reproduced. be able to. In particular, when a user views program content of an arbitrary viewpoint video in the automatic viewpoint tracking mode, an arbitrary viewpoint video of a viewpoint (viewpoint position, line-of-sight direction, viewing angle) that automatically follows a set specific object is displayed. Can be reproduced. Therefore, when resuming viewing of the program content of the arbitrary viewpoint video, a troublesome operation of resetting the viewpoint position of the arbitrary viewpoint video desired by the user becomes unnecessary.

(Embodiment 2)
In the first embodiment, since only one tuner module is provided in the broadcast receiving apparatus, the generation processing of the arbitrary viewpoint video is stopped when program content other than the arbitrary viewpoint video is selected as the program content to be displayed. . For this reason, generation of an arbitrary viewpoint video is interrupted when another program content is selected after the program content of an arbitrary viewpoint video is selected as the program content to be displayed. When the program content of the arbitrary viewpoint video is selected again, the generation processing of the arbitrary viewpoint video is resumed. In this case, if the system processing capability is not sufficiently high, it is assumed that it takes time to generate an arbitrary viewpoint video. That is, there may be a case where the arbitrary viewpoint video cannot be displayed immediately when the viewing of the program content of the arbitrary viewpoint video is resumed after temporarily stopping the viewing of the program content of the arbitrary viewpoint video.

  Therefore, in the second embodiment, two tuner modules are provided in the broadcast receiving apparatus so that the arbitrary viewpoint video can be displayed immediately when the viewing of the program content of the arbitrary viewpoint video is resumed.

  FIG. 5 is a block diagram showing a configuration of broadcast receiving apparatus 300 according to Embodiment 2 of the present invention. Referring to the broadcast receiving apparatus 300 in FIG. 5, the difference from the broadcast receiving apparatus 100 in FIG. 1 is that a tuner module 301, a TS decoder 302, and a video processing unit 303 are added, and the video output unit 104 outputs video. This is the point that the part (selector) 304 is replaced and the storage part 108 is deleted. 5, the same components as those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof will not be repeated.

  The tuner module 301 receives program content transmitted via a digital broadcast signal such as terrestrial digital broadcast, and extracts (selects) a signal having a frequency corresponding to the channel selected by the user. In addition, the tuner module 301 performs demodulation processing, error correction processing, and the like on the extracted signal, and extracts a transport stream (TS). When the user operates the remote controller 200 to select a desired channel, information on the selected channel is transmitted from the system control unit 107 to the tuner module 301.

  In the second embodiment, the tuner module (second tuner unit) 101 receives normal digital broadcast program content other than the arbitrary viewpoint video, and the tuner module (first tuner unit) 301 is optional. It is assumed that the program content of the viewpoint video is received.

  The TS decoder 302 separates (DEMUX) the transport stream from the tuner module 301 into a video signal, an audio signal, a data signal (program information, data for data broadcasting, etc.), and the like. The video signal and program information separated by the TS decoder 302 are output to the arbitrary viewpoint video generation unit 105. Specifically, multi-view video content for generating an arbitrary viewpoint video and its program information are provided from the TS decoder 102 to the arbitrary viewpoint video generation unit 105. As described in the first embodiment, the program information includes identification information indicating that the program content is an arbitrary viewpoint video and viewpoint information of multi-view video content for generating an arbitrary viewpoint video. The viewpoint information of each video content includes the viewpoint position (three-dimensional coordinates of x, y, z) of the camera in which each video content was shot, the viewing direction (three-dimensional direction vector), and the viewing angle (horizontal and vertical directions). Information for specifying the angle of view defined by the viewing angle). The program information also includes recommended viewpoint information (default viewpoint information) designated by the creator of the program content of the arbitrary viewpoint video.

  The arbitrary viewpoint video generation unit 105 generates an arbitrary viewpoint video corresponding to an arbitrary viewpoint position using the multi-view video content for generating an arbitrary viewpoint video from the TS decoder 102 and its program information. The arbitrary viewpoint video generation unit 105 has a manual viewpoint mode and an automatic viewpoint tracking mode. The arbitrary viewpoint video generated by the arbitrary viewpoint video generation unit 105 is output to the video processing unit 303. The video processing unit 103 performs necessary processing on the arbitrary viewpoint video generated by the arbitrary viewpoint video generation unit 105 and outputs the processed video to the video output unit 304.

  The video output unit 304 converts the video signal decoded by the video processing unit 103 or the signal subjected to various processes by the video processing unit 303 into a display resolution, display color number, and refresh rate suitable for the display unit. Output to the display. When the user operates the remote controller 200 and selects a normal digital broadcast program content other than the arbitrary viewpoint video as the program content to be displayed, the video output unit 304 selects and displays the video signal from the video processing unit 103. To the output. That is, the video signal of the normal digital broadcast program content received by the tuner module 101 is output to the display unit. On the other hand, when the user operates the remote controller 200 and selects program content of an arbitrary viewpoint video as the program content to be displayed, the video output unit 304 selects the video signal from the video processing unit 303 and outputs it to the display unit. . That is, the video signal of the program content of the arbitrary viewpoint video received by the tuner module 301 is output to the display unit. Thus, the video output unit 304 outputs a video signal to be output to the display unit according to whether the program content selected by the user is a program content of an arbitrary viewpoint video or a program content other than the arbitrary viewpoint video. Has a switching function. Note that the system control unit 107 instructs switching control of the video output unit 304 in response to the user operating the remote controller 200 to select desired program content.

  FIG. 6 is a flowchart for explaining processing when the program content to be displayed is switched between program content of an arbitrary viewpoint video and other program content. The operations in steps S201, S202, and S205 in FIG. 6 are the same as the operations in steps S101, S102, and S105 in FIG. 2, and thus detailed description thereof will not be repeated.

  In step S <b> 201, the arbitrary viewpoint video generation unit 105 synthesizes and interpolates multi-viewpoint video content for arbitrary viewpoint video generation, and automatically selects a viewpoint that automatically follows the specific object set by the tracking object setting unit 106. Arbitrary viewpoint video is generated. The arbitrary viewpoint video generated by the arbitrary viewpoint video generation unit 105 is subjected to necessary processing by the video processing unit 303 and is output to the video output unit 304. The video output unit 304 selects the video signal from the video processing unit 303 and outputs it to the display unit. At this time, the video signal of the program content of the arbitrary viewpoint video received by the tuner module 301 is output to the display unit.

  In step S202, the system control unit 107 determines whether a program content other than the arbitrary viewpoint video has been selected by the user as the display target program content. If it is determined that other program content other than the arbitrary viewpoint video (normal digital broadcast program content) is selected as the program content to be displayed, the process proceeds from step S202 to step S203. The system control unit 107 interprets the remote control code received by the remote control receiving unit 109 to determine the program content to be displayed that is selected by the user by operating the remote control 200. It can be determined from the program information (identification information) of the program content whether the program content of the arbitrary viewpoint video is selected as the program content to be displayed or the program content other than the arbitrary viewpoint video is selected.

  In step S203, the system control unit 107 performs channel selection control so that the tuner module 101 receives program content other than the arbitrary viewpoint video (normal digital broadcast program content). Further, the tuner module 301 controls to continue receiving the program content of the arbitrary viewpoint video, and controls the arbitrary viewpoint video generation unit 105 to continue the process of generating the arbitrary viewpoint video in the automatic viewpoint tracking mode. The arbitrary viewpoint video generation unit 105 analyzes each video of the multi-view video content for generating the arbitrary viewpoint video, and continues the process of detecting the set specific object. Then, the multi-viewpoint video content for generating arbitrary viewpoint video is synthesized and interpolated, and the process of generating the arbitrary viewpoint video of the viewpoint that automatically follows the specific object set by the tracking object setting unit 106 is continued. .

  In step S <b> 204, when the system control unit 107 instructs the video output unit 304 to perform switching control, the video output unit 304 selects the video signal of the normal digital broadcast program content from the video processing unit 103. Output to the display.

  Next, in step S205, the system control unit 107 determines whether or not the program content of the arbitrary viewpoint video is selected again as the program content to be displayed by the user. If it is determined that the program content of the arbitrary viewpoint video is selected again as the program content to be displayed, the process proceeds from step S205 to step S206. Note that when the user operates the channel key of the remote controller 200 to select the original channel again and the program content of the arbitrary viewpoint video has ended, the process does not proceed from step S205 to step S206.

  In step S206, when the system control unit 107 instructs the video output unit 304 to perform switching control, the video output unit 304 selects a video signal of an arbitrary viewpoint video program content from the video processing unit 303 and outputs it to the display unit. To do. At this time, the video signal of the program content of the arbitrary viewpoint video received by the tuner module 301 is output to the display unit.

  As described above, in the second embodiment, the broadcast receiving apparatus is provided with two tuner modules. As a result, after the viewing of the program content of the arbitrary viewpoint video is temporarily interrupted, the arbitrary viewpoint video can be immediately displayed when the viewing of the program content of the arbitrary viewpoint video is resumed.

DESCRIPTION OF SYMBOLS 100 Broadcast receiving apparatus 101 Tuner module 102 TS decoder 103 Video processing part 104 Video output part 105 Arbitrary viewpoint video generation part 106 Following object setting part 107 System control part 108 Storage part 109 Remote control reception

Claims (5)

A broadcast receiving apparatus capable of generating an arbitrary viewpoint video corresponding to an arbitrary viewpoint position from a plurality of video contents having different viewpoint positions constituting program content,
A selection means for selecting program content to be displayed from among a plurality of program contents transmitted via a broadcast signal;
Setting means for setting a specific object to be followed when program content of an arbitrary viewpoint video is selected by the selection means;
When program content of an arbitrary viewpoint video is selected by the selection means, a plurality of video contents constituting the program content of the arbitrary viewpoint video are synthesized and the specific object set by the setting means is followed. Generating means for generating an arbitrary viewpoint video of the viewpoint to be performed;
Storage means for storing, in a storage unit, information on the specific object set by the setting means when another program content is selected after the program content of an arbitrary viewpoint video is selected by the selection means. ,
When the program content of the arbitrary viewpoint video is selected again after the other program content is selected by the selection unit, the generation unit uses information on the specific object stored in the storage unit. A broadcast receiving apparatus that generates an arbitrary viewpoint video of a viewpoint that follows the specific object from a plurality of video contents constituting the program content of the arbitrary viewpoint video.   The generating unit determines a viewpoint position, a line-of-sight direction, and a viewing angle for capturing the specific object from the front, and generates an arbitrary viewpoint video of a viewpoint that follows the specific object. The broadcast receiving apparatus according to claim 1.   The generating means is predetermined when information about the specific object stored in the storage unit cannot be detected from a plurality of video contents constituting the program content of the arbitrary viewpoint video. The broadcast receiving apparatus according to claim 1, wherein an arbitrary viewpoint video of the selected viewpoint is generated. A first tuner unit for receiving the program content of the arbitrary viewpoint video;
A second tuner unit for receiving the other program content;
Control is performed so that the first tuner unit continues to receive the program content of the arbitrary viewpoint video when another program content is selected after the selection means selects the program content of the arbitrary viewpoint video. And the generation means continues the process of synthesizing the plurality of video contents received by the first tuner unit to generate an arbitrary viewpoint video of a viewpoint that follows the specific object. The broadcast receiving apparatus according to any one of claims 1 to 3, wherein the broadcast receiving apparatus is controlled. A control method of a broadcast receiving apparatus capable of generating an arbitrary viewpoint video corresponding to an arbitrary viewpoint position from a plurality of video contents each having a different viewpoint position constituting program content,
A selection step of selecting program content to be displayed from among a plurality of program content transmitted via a broadcast signal;
A setting step for setting a specific object to be followed when program content of an arbitrary viewpoint video is selected in the selection step;
When a program content of an arbitrary viewpoint video is selected in the selection step, a plurality of video contents constituting the program content of the arbitrary viewpoint video are combined to follow the specific object set by the setting means Generating an arbitrary viewpoint video of the viewpoint to be performed;
A storage step of storing, in a storage unit, information related to the specific object set by the setting unit when another program content is selected after the program content of an arbitrary viewpoint video is selected in the selection step. ,
In the generation step, when the program content of the arbitrary viewpoint video is selected again after the other program content is selected in the selection step, the information regarding the specific object stored in the storage unit is used. A control method for a broadcast receiving apparatus, wherein an arbitrary viewpoint video of a viewpoint that follows the specific object is generated from a plurality of video contents constituting the program content of the arbitrary viewpoint video.

Images