JP2011114378A - Video display system and method of controlling the same - Google Patents

Abstract

When a viewer switches a device for presenting content, the content presented during a period required for the viewer to move the viewpoint is prevented from being overlooked.
An image display system displays images overlapping in time in both devices in a transition period in which image display is switched from a main terminal unit to a sub-terminal unit. The main terminal unit 100 includes a video output unit 102 that outputs a video signal for video display, and a video signal transmission unit to the sub-terminal unit 110. After the video signal is output by the video output unit 102, the main terminal unit 100 has a delay time. The signal is transmitted to the sub terminal unit 110. For example, the main terminal unit 100 includes first and second reading units that read data from the storage unit, and the second reading unit receives data from a reproduction position that is a predetermined time later than the reading position of the first reading unit. Read and send to the transmitter. The sub-terminal unit 110 receives the video signal, and displays the video with a time delay compared to the display video of the main terminal unit 100 in the transition period.
[Selection] Figure 1

Description

  The present invention relates to a video display system that presents content such as video, audio, data broadcasting, and applications, and a control method therefor. Here, the application includes a computer program capable of generating video and audio by being executed by a microprocessor.

  Currently, various contents including video and audio, data broadcasting, and applications are provided through various media including broadcasting, downloading via a network, and recording media such as a DVD. In order to provide a variety of contents to viewers conveniently, a content providing system using a main terminal device having a large screen and a large speaker and a sub-terminal device having a small screen and a small speaker is known.

The following forms can be considered as contents provision forms.
A mode in which the same content is simultaneously provided in the main terminal device and the sub-terminal device.
A form in which different contents are provided in the main terminal device and the sub-terminal device, respectively.
A form in which content is provided by only one of the main terminal device and the sub-terminal device.

  In order to switch between these various forms, it is necessary to switch and present the content presented on the main terminal device to the sub-terminal device, or conversely present the content presented on the sub-terminal device to the main terminal device. A need arises. In a presentation environment in which a still image is projected using a liquid crystal projector, a technique for simultaneously displaying the latest image and the image immediately before the presentation switching is disclosed (see Patent Document 1). That is, when the input image signal to the liquid crystal projector is switched, the liquid crystal projector displays the latest image, outputs the image immediately before switching to the image signal output provided in the liquid crystal projector, and is connected to the image signal output. Another liquid crystal projector displays the image just before switching.

JP 2005-049424 A

  When the technology disclosed in Patent Document 1 is applied to content such as a moving image and an application involving dynamic graphic drawing, the viewer may miss the content. That is, when switching the liquid crystal projection device that displays the content video, if the viewer's visual response to the switching is delayed, the content video presented at the time of switching is missed. In presentations that display still images, the same content continues to be displayed even if the viewer's response is delayed, so there is no possibility of overlooking. However, in the case of content such as a moving image or an application accompanied by dynamic graphic drawing, the display content changes constantly, so that the possibility of being overlooked increases.

  In particular, when switching the terminal device that presents content, in an environment where the viewer's viewpoint movement is large, the viewer may miss the content video presented during the period required for the viewpoint movement. As an environment in which the viewer's viewpoint movement is large, for example, a content presentation terminal device having a large screen and a large speaker is positioned in front of the viewer, and a content presentation terminal device having a small screen and a small speaker at hand is provided. The situation you have is listed.

  Therefore, when the content presentation terminal device is switched, if the content is presented at the switching destination device with a time delay from the switching source, the content at the time of switching can be presented in both devices in a time-overlapping manner. An object of the present invention is to prevent a viewer from overlooking a content video presented during a period required for the viewer's viewpoint movement.

  In order to solve the above-described problem, a video display system according to the present invention includes a first device and a second device, and transition when switching video display from the first device to the second device. In the period, the first device and the second device display images overlapping in time. The first device includes a video output means for outputting a video signal for displaying a video, a transmission means for transmitting the video signal to the second device, and after the video output means outputs the video signal. Control means for controlling the transmission means to transmit the video signal to the second device with a delay time. The second device receives the video signal from the transmission means, and displays the video with a time lag behind the video displayed on the first device in the transition period.

  The present invention can prevent the viewer from overlooking the video presented during the period required for the viewer to move the viewpoint.

FIG. 7 is a block diagram schematically showing a configuration example of an apparatus for explaining the first embodiment of the present invention in conjunction with FIGS. FIG. 2 is a block diagram illustrating a configuration example of an accumulation / playback unit 101 in FIG. 1. It is a block diagram which shows the structural example of the audiovisual presentation part 111 of FIG. 4 is a flowchart for explaining processing executed in a main terminal unit 100 and a sub-terminal unit 110. It is the figure which illustrated transition of the video brightness in the main terminal part 100 and the subterminal part 110, and an audio volume. It is the figure which illustrated the time change of the reproduction position in the main terminal unit 100 and the subterminal unit 110. FIG. 13 is a block diagram schematically showing an example of the configuration of an apparatus for explaining a second embodiment of the present invention in conjunction with FIGS. It is a block diagram which shows the structural example of the broadcast receiving part 801 of FIG. It is a block diagram which shows the structural example of the program presentation part 811 of FIG. 7 is a flowchart for explaining processing executed in a main terminal unit 800 and a sub terminal unit 810. It is the figure which illustrated transition of program picture transmissivity, program volume, and sound effect volume. It is the figure which illustrated time passage from the time of starting execution of a program in main terminal unit 800 and subterminal unit 810.

[First embodiment]
Hereinafter, as the video display system according to the first embodiment of the present invention, the video and audio presented by the first device (hereinafter referred to as the main terminal unit) are converted into the second device ( Hereinafter, an example of presentation at the sub terminal unit) will be described.
FIG. 1 is a diagram schematically illustrating a configuration example of a system according to the present embodiment, which includes a main terminal unit 100 and a sub terminal unit 110. For example, the main terminal unit 100 is a video display device, and the sub terminal The unit 110 is a remote control device.

  The main terminal unit 100 includes a storage / playback unit 101, a video output unit 102, and an audio output unit 103. The storage / playback unit 101 includes a storage device, a decoding device, and the like, and stores encoded video data and audio data. Hereinafter, the encoded video data and audio data may be referred to as content. The storage / playback unit 101 receives the operation signal 125 from the operation unit 114 of the sub-terminal unit 110, and decodes and plays back the video data and audio data stored in the storage device according to the operation signal 125. In addition, the main terminal unit 100 transmits an encoded video / audio signal 120 including encoded video information and audio information to the sub-terminal unit 110 by a wireless method. The video output unit 102 is configured by a display device or the like, and receives the video signal 105 output from the storage / playback unit 101 and outputs a video. The audio output unit 103 includes an audio amplifier, a speaker, and the like. The audio output unit 103 receives the audio signal 106 output from the storage / playback unit 101 and outputs audio.

  The sub-terminal unit 110 includes a video / audio presentation unit 111, a video output unit 112, an audio output unit 113, and an operation unit 114. The video / audio presentation unit 111 includes a decoding device and the like, and decodes the encoded video / audio signal 120 received from the main terminal unit 100. The video output unit 112 is configured by a display device or the like, and receives the video signal 115 output from the video / audio presentation unit 111 and outputs a video. The audio output unit 113 includes an audio amplifier and a speaker, and receives the audio signal 116 output from the video / audio presentation unit 111 and outputs audio. The operation unit 114 includes operation buttons, switches, and the like. When an operation instruction from the viewer is received, the operation unit 114 converts the operation signal 125 into an operation signal 125 such as infrared rays and transmits the signal to the main terminal unit 100.

  FIG. 2 is a block diagram of a configuration example of the storage / playback unit 101 shown in FIG. The video signal 105, audio signal 106, encoded video / audio signal 120, and operation signal 125 in the figure are as described above. The storage / playback unit 101 includes an encoded video / audio storage unit 200, an encoded video / audio read unit 201, a demax unit 202, a video decoding unit 203, a luminance adjustment unit 204, an audio decoding unit 205, and a volume adjustment unit 206. Furthermore, an encoded video / audio reading unit 210, an encoded video / audio transmission unit 211, a presentation control unit 220, and an operation signal reception unit 221 are provided. The encoded video / audio reading unit 201 constitutes a first reading unit for the encoded video / audio storage unit 200, and the encoded video / audio reading unit 210 constitutes a second reading unit for the encoded video / audio storage unit 200. . Hereinafter, the encoded video / audio reading unit is simply referred to as a reading unit.

  The encoded video / audio storage unit 200 is composed of a hard disk drive device or the like, and stores encoded video data and audio data. As a video encoding method, for example, an MPEG-2 Video (ISO / IEC 13818-2) method can be used. This is based on the standard of “Information technology-Generic coding of moving pictures and associated audio information: Video”. As a speech encoding method, for example, an AAC (ISO / IEC 13818-7) method can be used. This is in accordance with the standard of “Information technology-Generic coding of moving pictures and associated audio information-Part 7: Advanced Audio Coding (AAC)”. The encoded video / audio storage unit 200 multiplexes encoded video and audio data by a Transport Stream (hereinafter referred to as MPEG-2 TS) method defined by MPEG-2 Systems (ISO / IEC 13818-1). Turn into. Note that the encoded video and audio data are video data encoded by the MPEG-2 Video system and audio data encoded by the AAC system. The encoded video / audio storage unit 200 stores the multiplexed integrated data in the hard disk drive device. The MPEG-2 Systems standard is “Information technology-Generic coding of moving pictures and associated audio information: Systems”. The video encoding method, the audio encoding method, and the multiplexing method are not limited to this example, and other methods may be used.

  The first reading unit 201 reads out encoded video / audio data corresponding to the reproduction position to be presented to the viewer from the encoded video / audio storage unit 200. The demux unit 202 separates the encoded video / audio signal into an encoded video signal and an encoded audio signal according to a PID (Packet Identifier), and outputs each signal to the video decoding unit 203 and the audio decoding unit 205. PID is defined by MPEG-2 Systems.

  The video decoding unit 203 decodes a video signal encoded by the MPEG-2 Video method or the like and outputs the decoded video signal to the luminance adjustment unit 204. The luminance adjusting unit 204 adjusts the luminance of the video signal and outputs the video signal 105. Also, the audio decoding unit 205 decodes an encoded audio signal encoded by the AAC method or the like, and outputs the decoded audio signal to the volume adjustment unit 206. The volume adjustment unit 206 includes an audio volume and adjusts the volume and outputs the audio signal 106.

  Similar to the first readout unit 201, the second readout unit 210 reads out encoded video / audio data corresponding to the playback position to be presented to the viewer from the encoded video / audio storage unit 200. The reading units 201 and 210 can read the encoded video / audio signal in accordance with independent playback positions that are not related to each other. This can be realized by configuring the encoded video / audio storage unit 200 with a hard disk drive device or the like that can be randomly accessed. The encoded video / audio signal read out from the encoded video / audio storage unit 200 by the reading unit 210 is sent to the encoded video / audio transmission unit 211, where the transmission unit transmits the encoded video / audio signal 120 by a radio wave system. . As a radio system, an IEEE 802.11 (IEEE: The Institute of Electrical and Electronics Engineers, Inc.) system is known. In the RTP (Real-time Transport Protocol) system, a system for transmitting MPEG-2 TS is defined. The present embodiment can be applied by combining IEEE802.11 and RTP.

  The operation signal receiving unit 221 receives an operation signal 125 such as infrared rays and transmits an operation instruction to the presentation control unit 220. The presentation control unit 220 receives a viewer operation command via the operation signal receiving unit 221 and controls the reading units 201 and 210, the luminance adjustment unit 204, and the volume adjustment unit 206. In other words, the presentation control unit 220 instructs the reading units 201 and 210 to read the reading positions, and instructs the luminance adjustment unit 204 to specify the video luminance. The presentation control unit 220 instructs the volume adjustment unit 206 to adjust the volume. As a result, the contents of the video signal 105, the audio signal 106, and the encoded video / audio signal 120 are controlled.

  FIG. 3 shows a configuration example of the audio video presentation unit 111 shown in FIG. The encoded video / audio signal 120, the video signal 115, and the audio signal 116 are as described above. The video / audio presentation unit 111 includes an encoded video / audio reception unit 311, a demax unit 302, a video decoding unit 303, a luminance adjustment unit 304, an audio decoding unit 305, a volume adjustment unit 306, and a presentation control unit 320.

The encoded video / audio reception unit 311 receives the encoded video / audio signal 120 transmitted from the encoded video / audio transmission unit 211 and outputs the encoded video / audio signal 120 to the demux unit 302, and also presents the reception start of the encoded video / audio signal 120. 320 is notified. Regarding the functions of the demax unit 302, the video decoding unit 303, the luminance adjustment unit 304, the audio decoding unit 305, and the volume adjustment unit 306, the demax unit 202, the video decoding unit 203, the luminance adjustment unit 204, and the audio decoding unit illustrated in FIG. 205 and the sound volume adjustment unit 206. Therefore, those descriptions are omitted.
The presentation control unit 320 controls the contents of the video signal 115 and the audio signal 116 by instructing the video luminance to the luminance adjustment unit 304 and instructing the volume to the volume adjustment unit 306.

The flowchart on the left side of FIG. 4 shows the flow of processing executed in the main terminal unit 100 when the device that presents video and audio switches from the main terminal unit 100 to the sub-terminal unit 110.
The main terminal unit 100 starts the reproduction process (S400). At that time, the reading unit 201 receives an operation instruction of the viewer via the operation signal receiving unit 221 and the presentation control unit 220, and an encoded video / audio storage unit 200 receives an encoded video / audio signal corresponding to the instructed reproduction position. Read from. The demax unit 202 executes demax processing of the encoded video / audio signal. The video decoding unit 203 executes decoding processing of the encoded video signal, and the audio decoding unit 205 executes decoding processing of the encoded audio signal.

  Next, the luminance adjusting unit 204 adjusts the luminance so that the luminance of the video is maximized (S401), and the volume adjusting unit 206 adjusts the audio output so that the volume is maximized (S402). When the viewer performs a switching operation of the content presentation terminal device using the operation unit 114, the operation instruction is notified from the operation signal receiving unit 221 to the presentation control unit 220 (S403). The luminance adjusting unit 204 adjusts the luminance of the video to the intermediate level (S404), and the volume adjusting unit 206 adjusts the audio output so that the volume becomes the intermediate level (S405).

The presentation control unit 220 calculates a reading position that the reading unit 210 should read (S406). This reading position is a position that is back by a predetermined time (hereinafter referred to as N seconds) from the position that the reading unit 201 is currently reading. This time (N value) may be about 1 second, and can be changed within a range in which the viewer can easily operate by setting. Hereinafter, a method for calculating a read position will be described for an example in which the encoded video / audio storage unit 200 is configured using a hard disk drive device compliant with the LBA (Logical Block Addressing) method. In the hard disk drive device, the recording area is divided into sectors each having 512 bytes, and data can be read and written every 512 bytes by specifying a sector address. Also, it is assumed that the encoded video / audio signals are continuously recorded in the hard disk drive device in the order of increasing sector addresses. The sector address corresponding to the reading position of the reading unit 210 is calculated by the following equation.

SA2 in the above equation is a sector address corresponding to the position to be read by the reading unit 210, and SA1 is a sector address corresponding to the position being read by the reading unit 201. BR is the bit rate of the encoded video / audio signal (data capacity occupied by the encoded video / audio signal per second). If the value of SA2 is not an integer, rounding down or rounding up may be performed, and the obtained value is a sector address corresponding to the position read by the reading unit 210.
In the above equation, when SA2 becomes a negative value, or when SA2 becomes a sector address outside the recording range of the content read by the reading unit 201, the sector address needs to be changed. That is, the sector address corresponding to the start position of the content read by the reading unit 201 is set as the sector address SA2 corresponding to the reading position of the reading unit 210. In this case, the presentation control unit 220 changes the value of N by the following formula.

In this way, the reading unit 210 reads the encoded video / audio signal from the encoded video / audio storage unit 200 with a delay time of N seconds as compared with the reading unit 201. This read position is the read position calculated in S406. The encoded video / audio transmission unit 211 starts transmission of the encoded video / audio signal 120 (S407). Then, after the time waiting process until N seconds elapse (S408), the luminance adjusting unit 204 adjusts the luminance so that the luminance of the video is minimized (S409). The volume adjustment unit 206 adjusts the audio output so that the volume is minimized (S410).
The main terminal unit 100 stops reproduction (S411), and at that time, the reading unit 201 stops reading of the encoded video and audio. The demax unit 202 stops the demax process, and the video decoding unit 203 and the audio decoding unit 205 stop the decoding process.

  The encoded video / audio transmission unit 211 stops transmission of the encoded video / audio signal 120 (S412). At this time, the reading unit 210 stops reading the encoded video / audio. The cause of transmission stop includes the case where the content to be presented has reached the end or the case where the content is a stop operation instruction from the viewer, but it does not matter.

  The flowchart on the right side of FIG. 4 shows the flow of processing executed in the sub-terminal unit 110 when the device for presenting video and audio switches from the main terminal unit 100 to the sub-terminal unit 110. First, the encoded video / audio reception unit 311 detects the reception of the encoded video / audio signal 120, outputs the signal to the demux unit 302, and indicates that the reception of the encoded video / audio signal 120 has started. 320 is notified (S500). This step S500 corresponds to S407. When the main terminal unit 100 starts transmitting the encoded video / audio signal 120, the sub-terminal unit 110 starts receiving the encoded video / audio signal 120.

  The sub-terminal unit 110 starts reproduction (S501), and at that time, the demax unit 302 executes demax processing of the encoded video / audio signal. The video decoding unit 303 executes a decoding process for the encoded video signal, and the audio decoding unit 305 executes a decoding process for the encoded audio signal. Then, the luminance adjustment unit 304 adjusts the luminance so that the luminance of the video becomes an intermediate level (S502), and the volume adjustment unit 306 adjusts the audio output so that the volume becomes an intermediate level (S503). Then, after the time waiting process until N seconds elapse (S504), the luminance adjustment unit 304 adjusts the luminance so that the luminance of the video is maximized (S505). The volume adjustment unit 306 adjusts the audio output so that the volume is maximized (S506).

The encoded video / audio reception unit 311 stops receiving the encoded video / audio signal 120 (S507). This step S507 corresponds to S412, and when the main terminal unit 100 stops transmitting the encoded video / audio signal 120, the sub-terminal unit 110 stops receiving the encoded video / audio signal 120.
The sub-terminal unit 110 stops the reproduction (S508). At that time, the demax unit 302 stops the demax process. The video decoding unit 303 and the audio decoding unit 305 stop the decoding process.

FIG. 5 shows an example of temporal transition of the video luminance and audio volume of the main terminal unit 100 and the video luminance and audio volume of the sub-terminal unit 110. The horizontal axis represents elapsed time, and T600 to 603 indicate time. Further, the temporal change in the video luminance level and the audio volume level of the main terminal unit 100 is shown above, and the temporal change in the video luminance level and the audio volume level of the sub-terminal unit 110 is shown below.
The main terminal unit 100 starts reproduction at time T600 (see S400 in FIG. 4). At this time, the luminance of the video presented by the main terminal unit 100 is maximum (see S401), and the volume of audio output by the main terminal unit 100 is maximum (see S402).

During the period from time T600 to time T601, the main terminal unit 100 presents content video and audio. On the other hand, in the sub-terminal unit 110, both the video luminance and the audio volume are minimum.
A terminal switching operation is performed by the viewer at time T601 (see S403). In the main terminal unit 100, the video luminance is at an intermediate level (see S404), and the volume is at an intermediate level (see S405).
The main terminal unit 100 starts transmitting the encoded video / audio signal 120 (see S407), and the sub-terminal unit 110 starts receiving the encoded video / audio signal 120 (see S500). Then, the sub terminal unit 110 starts reproduction (see S501). At that time, in the sub-terminal unit 110, the video luminance is an intermediate level (see S502), and the volume level is an intermediate level (see S503).
When N seconds elapse from time T601, time T602 is reached (see S408 and S504). During the transition period from time T601 to time T602, both the main terminal unit 100 and the sub terminal unit 110 present video and audio of content.

At time T602, the video luminance of the main terminal unit 100 is minimized (see S409), and the audio volume of the main terminal unit 100 is also minimized (see S410). Thereafter, the main terminal unit 100 stops the reproduction (see S411). On the other hand, in the sub-terminal unit 110, the video luminance is maximized (see S505), and the audio volume is maximized (see S506).
During the period from time T602 to time T603, the sub-terminal unit 110 presents content video and audio. On the other hand, in the main terminal unit 100, both the video luminance and the audio volume are minimum.
At time T603, the main terminal unit 100 stops the transmission of the encoded video / audio signal 120 (see S412). The sub-terminal unit 110 stops receiving the encoded video / audio signal 120 (see S507). The sub terminal unit 110 stops the reproduction (see S508).

FIG. 6 is a graph in which time is shown on the horizontal axis, and time-dependent changes in playback positions in the main terminal unit 100 and the sub terminal unit 110 are shown on the vertical axis. Times T600 to 603 in the figure are the same as the time shown in FIG.
The playback position in the main terminal unit 100 changes over time according to a line segment that rises to the right connecting the position at time T600 (see point P0) and the position at time T602 (see point P2). In addition, the playback position in the sub-terminal unit 110 changes over time according to a line segment that rises to the right connecting the position at time T601 (see point P1) and the position at time T603 (see point P3).

The main terminal unit 100 starts reproduction at time T600 (see S400 in FIG. 4). At time T601, a terminal switching operation is performed (see S403), and the sub-terminal unit 110 starts reproduction (see S501). The reading unit 210 reads data at a position that is back in time by N seconds from the position read by the reading unit 201. Therefore, as shown in the figure, the position reproduced by the sub-terminal unit 110 is a position that is N seconds backward from the position reproduced by the main terminal unit 100.
When N seconds elapse from time T601, time T602 is reached (see S408 and S504), and the main terminal unit 100 stops reproduction at time T602 (see S411). The sub-terminal unit 110 continues the reproduction after that, and stops the reproduction at time T603 (see S508).

  According to the first embodiment, when the device that presents the content is switched, the switching destination device presents the content with a time lag behind the switching source device. As a result, the contents are presented overlappingly in both devices, so that it is possible to prevent the viewer from overlooking the content video presented during the period required for the viewer to move the viewpoint.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the second embodiment, an example will be described in which the program content presented at the main terminal unit is presented by switching to the sub-terminal unit. Here, the program content refers to content including video and audio generated by executing the program.
FIG. 7 shows a schematic configuration of a system according to the second embodiment, which includes a main terminal unit 800 and a sub terminal unit 810. The main terminal unit 800 includes a broadcast receiving unit 801, a video output unit 802, and an audio output unit 803. The broadcast receiving unit 801 includes a tuner and a decoding device, and receives an operation signal 825 from the operation unit 814 of the sub-terminal unit 810. The broadcast receiving unit 801 receives a broadcast wave 830 according to the operation signal 825, and presents a broadcast program using the video output unit 802 and the audio output unit 803 based on the demodulated and decoded data. The main terminal unit 800 wirelessly transmits the decoded video / audio signal 820, the program signal 821, and the program presentation control signal 822 to the sub-terminal unit 810. The video output unit 802 is configured by a display device or the like, and receives the video signal 805 output from the broadcast receiving unit 801 and outputs a video. The audio output unit 803 includes an audio amplifier and a speaker. The audio output unit 803 receives the audio signal 806 output from the broadcast receiving unit 801 and outputs audio.

  The sub-terminal unit 810 includes a program presentation unit 811, a video output unit 812, an audio output unit 813, and an operation unit 814. The program presentation unit 811 includes a microprocessor or the like that executes a program, and receives the decoded video / audio signal 820, program signal 821, and program presentation control signal 822 from the main terminal unit 800. The program presentation unit 811 executes the program received from the main terminal unit 800 and outputs video and audio using the video output unit 812 and the audio output unit 813, respectively. The video output unit 812 is configured by a display device or the like, and receives the video signal 815 output from the program presentation unit 811 and outputs a video. The audio output unit 813 includes an audio amplifier and a speaker. The audio output unit 813 receives the audio signal 816 output from the program presentation unit 811 and outputs audio. The operation unit 814 has operation buttons, switches, and the like, receives an operation instruction from the viewer, and transmits an operation signal 825 to the main terminal unit 800 by infrared communication or the like.

  FIG. 8 shows a configuration example of the broadcast receiving unit 801, and the broadcast wave 830 and the signals 805, 806, 820 to 822, and 825 in the figure are as described above. The broadcast receiving unit 801 includes a tuner unit 900, a demax unit 901, a video decoding unit 902, a video synthesis unit 903, an audio decoding unit 904, an audio synthesis unit 905, and a video / audio transmission unit 906. The broadcast receiving unit 801 further includes a program decoding unit 907, a first program execution unit 908, a program video generation unit 909, a program video transmittance adjustment unit 910, a program audio generation unit 911, a program volume adjustment unit 912, and a delay processing unit 920. Is provided. Furthermore, a program transmission unit 921, a program presentation control unit 930, a program information acquisition unit 940, a channel selection control unit 941, and an operation signal reception unit 942 are provided.

  The tuner unit 900 demodulates a broadcast wave 830 modulated by an ISDB-T (Integrated Services Digital Broadcasting for Terrestrial) system and outputs an encoded video / audio signal. The subsequent demax unit 901 separates the encoded video / audio signal according to the PID. The separated encoded video signal is sent to the video decoding unit 902, the encoded audio signal is sent to the audio decoding unit 904, the encoded program signal is sent to the program decoding unit 907, and the program information signal is sent to the program information acquisition unit. 940. The video decoding unit 902 decodes an encoded video signal conforming to the MPEG-2 Video system and outputs a video signal. The audio decoding unit 904 decodes an encoded audio signal conforming to the AAC method and outputs an audio signal. The video / audio transmission unit 906 transmits the video signal from the video decoding unit 902 and the audio signal from the audio decoding unit 904 to the sub-terminal unit 810 in a wireless manner. As wireless systems, Wireless HD (registered trademark) and WHDI (registered trademark) have been proposed, and are generally called Wireless HDMI (registered trademark). Note that WHDI is an abbreviation for “Wireless Home Digital Interface”, and HDMI is an abbreviation for “High-Definition Multimedia Interface”, both of which are applicable to this embodiment.

  The program decoding unit 907 decodes the encoded program signal. As a method for transmitting a program via the broadcast wave 830, for example, an MHP (ETSI ES 201 812) method is known and can be applied to this embodiment. This is based on the “Multimedia Home Platform” standard. In the MHP system, a broadcasting station encodes and transmits a byte code of a programming language Java (registered trademark) developed by Sun Microsystems using a DSM-CC (ISO / IEC 13818-10) system. This is based on the standard of “Information technology-Generic coding of moving pictures and associated audio information-Part 10: Conformance extensions for Digital Storage Media Command and Control (DSM-CC)”. The receiver receives and decodes the encoded program signal and executes it by the JVM in the receiver. JVM is an abbreviation of “Java (registered trademark) Virtual Machine”.

The program execution unit 908 executes a program with a microprocessor (not shown). As described above, the Java (registered trademark) bytecode is interpreted and executed by the JVM. The subsequent program video generation unit 909 draws the graphic instructed by the program execution unit 908 by combining graphic drawing functions such as dots, lines, and rectangles, and outputs the graphic as a program video signal. The program video transmissivity adjustment unit 910 receives the program video signal from the program video generation unit 909, and adds transparency information to the program video signal in accordance with a command from the program presentation control unit 930 described later, thereby transmitting the program video. Adjust the rate. That is, here, a process of adjusting the transmittance of the program video used when the video synthesis unit 903 synthesizes the video signal and the program video signal is executed. Hereinafter, the program video transmittance adjusting unit is simply referred to as a transmittance adjusting unit.
The video synthesis unit 903 synthesizes the video signal output from the video decoding unit 902 and the program video signal output from the transmittance adjustment unit 910. At this time, the video signal and the program video signal are synthesized according to the transmittance of the program video signal. For example, when the transmittance is expressed as a percentage and 0% (hereinafter, the program video is expressed as “opaque”), the video by the video decoding unit 902 is blocked by the program video, so only the program video signal is video. Output from the combining unit 903. When the transmissivity is 50% (hereinafter, the program video is expressed as “semi-transparent”), a video signal in a state where the video by the video decoding unit 902 and the program video are mixed in half is output from the video synthesis unit 903. Is done. When the transmittance is 100% (hereinafter, the program video is expressed as “transparent”), the video by the video decoding unit 902 is not blocked by the program video, and only the video signal is output from the video synthesis unit 903. The

  The program sound generation unit 911 generates a sound signal instructed by the program execution unit 908. As a generation method, for example, there is a method in which a voice encoded by the AAC method is embedded in a program, and voice data is decoded by a voice decoding unit (not shown). The program volume adjustment unit 912 is configured using an audio volume or the like, and adjusts the volume of audio output. The voice synthesizer 905 synthesizes the voice signal output from the voice decoder 904 and the program voice signal output from the program volume adjuster 912. The delay processing unit 920 temporarily stores the program signal output from the program decoding unit 907 in a memory (not shown), and when the output is instructed from the program presentation control unit 930, reads the program and outputs it to the program transmission unit 921. The program transmission unit 921 transmits the program signal output from the delay processing unit 920 to the sub-terminal unit 810 using a predetermined radio wave method. As the radio wave system, for example, the IEEE 802.11 system and the FTP (File Transfer Protocol) system can be combined and applied to the present embodiment.

  The program presentation control unit 930 instructs the transmittance adjustment unit 910 on the transmittance, instructs the program volume adjustment unit 912 on the volume, and instructs the delay processing unit 920 on the program transmission start timing. As a result, the contents of the video signal 805, the audio signal 806, and the program signal 821 are controlled. Further, the program presentation control unit 930 outputs a program presentation control signal 822, that is, a signal for controlling the timing of program presentation in the sub-terminal unit 810. As a transmission / reception method of the program presentation control signal 822, for example, an IEEE802.11 method and an RFC854 (TELNET PROTOCOL SPECIFICATION) method can be combined and applied to the present embodiment.

  The program information acquisition unit 940 acquires program information from the demax unit 901, for example, program information including EIT (Event Information Table). The operation signal receiving unit 942 receives the operation signal 825 by infrared communication or the like, and transmits an operation instruction to the channel selection control unit 941. The channel selection control unit 941 performs channel selection control in accordance with the viewer's operation instruction received via the operation signal reception unit 942. Specifically, a process of transmitting a channel to be selected to tuner unit 900 is performed. Further, the PID for transmitting the video information of the channel to be selected is read from the program information acquisition unit 940 and transmitted to the video decoding unit 902. Similarly, a process of transmitting a PID for transmitting audio information to the audio decoding unit 904 and transmitting a PID for transmitting program information to the program decoding unit 907 is executed. A method of handling data multiplexed by PID is described in detail in the MPEG-2 Systems standard.

  FIG. 9 shows a configuration example of the program presentation unit 811. The signals 815, 816, and 820 to 822 in the figure are as described above. The program presentation unit 811 includes a video / audio reception unit 1006, a program reception unit 1021, a second program execution unit 1008, a program video generation unit 1009, a program video transmittance adjustment unit 1010, and a video synthesis unit 1003. Furthermore, a program sound generation unit 1011, a program sound volume adjustment unit 1012, a sound effect generation unit 1040, a sound effect sound volume adjustment unit 1041, a sound synthesis unit 1005, and a program presentation control unit 1030 are provided.

  The video / audio reception unit 1006 receives the video / audio signal 820 transmitted by the video / audio transmission unit 906 by a radio wave method. The program receiving unit 1021 receives the program signal 821 from the program transmitting unit 921 by a radio wave system, and outputs the received program signal to the program executing unit 1008. The functions of the program execution unit 1008, the program video generation unit 1009, the transmittance adjustment unit 1010, the program audio generation unit 1011 and the program volume adjustment unit 1012 are the same as the units 908 to 912 described in FIG. Those descriptions are omitted.

  The sound effect generation unit 1040 generates a sound effect signal, outputs the sound effect signal to the sound effect sound volume adjustment unit 1041, and generates a sound effect from the sound output unit 813 via the sound synthesis unit 1005. As a generation method, for example, there is a method in which voice data is created in advance by the AAC method and stored in a non-volatile memory (not shown), and the voice data is decoded by a voice decoding unit (not shown). The sound effect is not particularly limited as long as it is a sound that alerts the viewer. The sound effect volume adjustment unit 1041 is configured using an audio volume or the like, and adjusts the sound effect volume.

  The video synthesis unit 1003 synthesizes the video signal output from the video / audio reception unit 1006 and the program video signal output from the transmittance adjustment unit 1010. The program video signal output from the transmittance adjusting unit 1010 includes transmittance information. The method of applying the transmittance to the image composition is as described above. The audio synthesizing unit 1005 synthesizes the audio signal output from the video / audio receiving unit 1006, the program audio signal output from the program sound volume adjusting unit 1012, and the sound effect signal output from the sound effect sound volume adjusting unit 1041.

Upon receiving the program presentation control signal 822, the program presentation control unit 1030 instructs the transmittance adjustment unit 1010 to specify the transmittance, instructs the program volume adjustment unit 1012 to specify the program volume, and effects sound volume adjustment unit 1041. The volume is instructed to. Thereby, the contents of the video signal 815 and the audio signal 816 are controlled.
The flowchart on the left side of FIG. 10 shows the flow of processing executed in the main terminal unit 800 when the terminal unit that presents the program video and program audio switches from the main terminal unit 800 to the sub terminal unit 810.

  It is assumed that the broadcast receiving unit 801 is in a state of receiving a program in advance. The delay processing unit 920 stores the program in the internal memory (S1100). In the main terminal unit 800, in response to an instruction from the program presentation control unit 930, the program execution unit 908 starts executing the program (S1101). The program video generation unit 909 generates a program video signal according to instructions from the program execution unit 908. The program sound generation unit 911 generates a program sound signal in accordance with an instruction from the program execution unit 908.

  The transmittance adjusting unit 910 adjusts the transmittance to 0% so that the program image becomes opaque (S1102). The program volume adjustment unit 912 adjusts so that the program volume is maximized (S1103). Then, the process waits for N seconds (S1104). The N value may be about 10, and this value can be changed within a range in which the viewer can easily operate. In response to an instruction from the program presentation control unit 930, the delay processing unit 920 outputs a program to the program transmission unit 921, and the program transmission unit 921 transmits a program signal 821 to the sub-terminal unit 810 (S1105). Then, the process waits for M seconds (S1106). M may be a positive value.

The program presentation control unit 930 transmits a program presentation control signal 822 (in this case, a program presentation start command) to the sub-terminal unit 810 (S1107). The transmittance adjusting unit 910 adjusts the transmittance to 50% so that the program video is translucent (S1108). The program volume adjustment unit 912 adjusts the program volume to the minimum (S1109). Then, the process waits for N seconds (S1110).
The transmittance adjusting unit 910 adjusts the transmittance to 100% so that the program video is transparent (S1111). In the main terminal unit 800, the program execution unit 908 stops the execution of the program (S1112).

The flowchart on the right side of FIG. 10 shows the flow of processing executed by the sub-terminal unit 810 when the apparatus for presenting program video and program audio switches from the main terminal unit 800 to the sub-terminal unit 810.
The program receiving unit 1021 receives the program signal 821 from the main terminal unit 800 and outputs the program to the program execution unit 1008 (S1200). Step S1200 corresponds to S1105, in which the main terminal unit 800 transmits a program and the sub-terminal unit 810 receives the program. The program execution unit 1008 starts executing the program (S1201). At that time, the program video generation unit 1009 generates a program video signal in accordance with an instruction from the program execution unit 1008. The program sound generation unit 1011 generates a program sound signal in accordance with an instruction from the program execution unit 1008.

The transmittance adjusting unit 1010 adjusts the transmittance to 100% so that the program image is transparent (S1202). The program volume adjustment unit 1012 adjusts the program volume to the minimum (S1203). The sound effect volume adjustment unit 1041 adjusts the sound effect sound volume to the minimum (S1204).
The program presentation control unit 1030 receives the program presentation start command (S1205). Step S1205 corresponds to S1107, and the main terminal unit 800 transmits a program presentation start command, which is received by the sub-terminal unit 810. The transmittance adjusting unit 1010 adjusts the transmittance to 50% so that the program video is translucent (S1206). The sound effect volume adjustment unit 1041 adjusts the sound effect volume to the maximum (S1207). Then, the process waits for N seconds (S1208). The transmittance adjusting unit 1010 adjusts the transmittance to 0% so that the program image becomes opaque (S1209). The program volume adjustment unit 1012 adjusts the program volume to the maximum (S1210). The sound effect volume adjustment unit 1041 adjusts the sound effect sound volume to the minimum (S1211).

The program execution unit 1008 stops executing the program (S1212). Examples of the program execution stop include when the viewer performs an execution stop operation via the operation unit 814 or when the processing by the program is completed, but any stop condition may be used in the present embodiment. .
FIG. 11 shows a temporal transition example of the program video transmission rate and program volume of the main terminal unit 800 and the program video transmission rate, program volume and sound effect volume of the sub-terminal unit 810. The horizontal axis represents the elapsed time, and T1300 to 1304 indicate the time. In addition, the upper part shows temporal changes in the program video transmittance and program volume level of the main terminal unit 800, and the lower part shows temporal changes in the program video transmittance, program volume level and sound effect sound level of the sub terminal part 810. ing.

At time T1300, the main terminal unit 800 starts executing the program (see S1101 in FIG. 10). At this time, the program video transmissivity of the main terminal unit 800 is minimum (program video is opaque: 0%) (see S1102), and the program volume of the main terminal unit 800 is maximum (see S1103).
When N seconds elapse from time T1300, time T1301 is reached (see S1104). At this point, the main terminal unit 800 transmits the program to the sub-terminal unit 810 (see S1105). The sub-terminal unit 810 receives the program (see S1200) and starts executing it (see S1201). At this time, the program video transmissivity of the sub-terminal unit 810 is maximum (program video is transparent: 100%) (see S1202). The program volume of the sub-terminal unit 810 is minimum (see S1203), and the volume of sound effects of the sub-terminal unit 810 is minimum (see S1204).

  When M seconds elapse from time T1301, time T1302 is reached (see S1106). During the period from time T1300 to time T1302, the main terminal unit 800 presents program content, but the sub-terminal unit 810 does not present program content. At time T1302, the main terminal unit 800 transmits a program presentation start command to the sub-terminal unit 810 (see S1107). During the transition period from time T1302 to time T1303, the program video of the main terminal unit 800 is translucent (see S1108), and the program volume of the main terminal unit 800 is minimized (see S1109). In this example, the program volume adjustment unit 1012 adjusts the program volume to be minimized during the transition period. However, the program volume may not be output during the transition period. That is, in this case, the program sound volume adjustment unit 1012 performs a program sound mute process during the transition period.

The sub terminal unit 810 receives a program presentation start command from the main terminal unit 800 (see S1205) and starts presenting the program. At this time, the program video of the secondary terminal unit 810 is translucent (see S1206), and the volume of the sound effect of the secondary terminal unit 810 is maximum (see S1207). The program volume of the sub-terminal unit 810 continues to be minimum.
When N seconds elapse from time T1302, time T1303 is reached (see S1110 and S1208). During the period from time T1302 to time T1303, both the main terminal unit 800 and the sub-terminal unit 810 present program content.

From time T1303, the program video of the main terminal unit 800 becomes transparent (see S1111). The main terminal unit 800 stops the execution of the program (see S1112). The program video of the sub-terminal unit 810 becomes opaque (see S1209), the program volume of the sub-terminal unit 810 is maximized (see S1210), and the volume of the sound effect of the sub-terminal unit 810 is minimized (see S1211). During the period from time T1303 to time T1304, the sub-terminal unit 810 presents program content, but the main terminal unit 800 does not present program content. At time T1304, the sub terminal unit 810 stops executing the program (see S1212).
FIG. 12 is a graph showing the time on the horizontal axis and the elapsed time from the time when the main terminal unit 800 and the sub-terminal unit 810 started executing the program on the vertical axis. Times T1300 to 1304 in the figure are the same as the time shown in FIG.

  The time lapse related to the program execution of the main terminal unit 800 changes in accordance with a line that rises to the right starting from the time T1300 as the start point (see point Q0) and ending at the time T1303 (see point Q3). Further, the time lapse related to the program execution of the sub-terminal unit 810 changes in accordance with a line segment rising to the right with the time T1301 as the start point (see point Q1) and the time T1304 as the end point (see point Q4).

  At time T1300, main terminal unit 800 starts executing the program (see S1101). When N seconds elapse from time T1300, time T1301 is reached (see S1104), and the sub-terminal unit 810 starts executing the program (see S1201). When M seconds elapse from time T1301, time T1302 is reached (see S1106), a program presentation start command is transmitted from the main terminal unit 800 to the subterminal unit 810 (see S1107), and the subterminal unit 810 starts presenting program video. To do.

When N seconds elapse from time T1302, time T1303 is reached (see S1110 and S1208), and the main terminal unit 800 stops executing the program (see S1112). Thereafter, at time T1304, the sub-terminal unit 810 stops executing the program (see S1212).
As described above, the sub terminal unit 810 starts executing the program after a delay time of N seconds from the main terminal unit 800. Therefore, the program content presented by the sub-terminal unit 810 at time T1303 corresponds to the program content presented by the main terminal unit 800 at time T1302.

  According to the second embodiment, when the terminal device is switched, the switching destination device presents the program content with a time lag behind the switching source device. Since the program video is presented in both devices in a time-overlapping manner, it is possible to prevent the viewer from overlooking the program video presented during the period required for the viewer to move the viewpoint. Further, according to the second embodiment, it is possible to alert the viewer by generating sound effects from the switching destination device. That is, it is possible to prevent a situation in which the viewer does not notice that the program content presentation device has been switched and misses the video.

100,800 Main terminal (first device)
102,802 Video output unit 110,810 Sub-terminal unit (second device)
200 Coded video / audio storage unit 201, 210 Coded video / audio read unit 204, 304 Brightness adjustment unit 211 Coded video / audio transmission unit 220, 320 Presentation control unit 906 Video / audio transmission unit 908, 1008 Program execution unit 910, 1010 Program Video transmission rate adjustment unit 920 delay processing unit 921 program transmission unit 930, 1030 program presentation control unit 1012 program volume adjustment unit 1040 sound effect generation unit

Claims (8)

A first device and a second device, and the first device and the second device display a video in a transition period when switching the display of the video from the first device to the second device. A video display system that displays images overlapping in time,
The first device includes a video output means for outputting a video signal for displaying a video, a transmission means for transmitting the video signal to the second device, and after the video output means outputs the video signal. Control means for controlling the transmission means to transmit the video signal to the second device with a delay time,
The second device receives a video signal from the transmission means, and displays a video delayed in time from the video displayed by the first device in the transition period. Display system. The first device includes:
Storage means for storing video data;
First reading means for reading video data from the storage means;
Second reading means for reading the video data with a time delay from the time when the first reading means read the video data from the storage means,
The video output means processes the video data read by the first reading means to display the video on the display means of the first device,
2. The video display system according to claim 1, wherein the second device processes the video data read by the second reading unit and displays a video on the display unit of the second device. 3. The video displayed on the first device and the second device in the transition period is a video based on video data generated by executing a program,
The first apparatus executes a program and outputs first video execution means for outputting video data generated according to the program to the video output means; and program transmission for transmitting the program to the second apparatus. Means, and
The second apparatus includes second program execution means for starting execution of the program received from the program transmission means with a time delay from the first program execution means, and is generated according to the program. The video display system according to claim 1, wherein the video is displayed based on the video data.   The first apparatus includes delay processing means for delaying execution of the program from the first program execution means, and the program is transmitted from the delay processing means to the second apparatus via the program transmission means. The video display system according to claim 3, wherein the video display system is transmitted to the network.   The second device includes sound effect generating means for generating a sound effect notifying that the video display is switched from the first device to the second device in the transition period. The video display system according to any one of claims 1 to 4.   The said 1st apparatus or the said 2nd apparatus is provided with the adjustment means which adjusts the brightness | luminance or the transmittance | permeability of the image | video displayed in the said transition period, The any one of Claim 1 to 5 characterized by the above-mentioned. The video display system described in 1.   The video display system according to any one of claims 1 to 6, wherein the control unit controls the volume adjusting unit so as not to output sound during the transition period. A first device and a second device, and the first device and the second device display a video in a transition period when switching the display of the video from the first device to the second device. A method of controlling a video display system that displays time overlaps,
Outputting a video signal for displaying a video on the first device;
Transmitting the video signal to the second device with a delay time after outputting the video signal in the step;
Receiving the video signal at the second device, and displaying the video with a time lag behind the video displayed on the first device in the transition period. Control method for video display system.

Images