JP2004088366A - Digital broadcast receiver and digital broadcast system - Google Patents

Abstract

An object of the present invention is to provide a digital broadcasting system capable of synchronously reproducing broadcast and each PES packet stream acquired in advance.
A broadcasting device for broadcasting a TS including first and second time count reference values, first content, and a first reproduction count value indicating a reproduction time of the first content by a first time counter, Receiving the TS, acquiring a second content and a second reproduction count value indicating a reproduction time of the second content by the count value of the second time counter, and obtaining the first and second time counters. Each time a time count reference value is received, the count values of the first and second counters are reset to the first and second time count reference values, and the count values of the first and second time counters are respectively And a broadcast receiving device that reproduces the first and second contents when the first and second reproduction count values are reached.
[Selection] Fig. 6

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a digital broadcast receiver and a digital broadcast system, and more particularly to a technique for synchronously reproducing video data and audio data.
[0002]
[Prior art]
In recent years, in television broadcasting, in addition to conventional terrestrial broadcasting, a new broadcasting format called digital broadcasting is becoming widespread. In digital broadcasting, various data such as video, audio, and text information are multiplexed and broadcast, and the broadcast is received by a digital broadcast receiver, and the multiplexed various data is cut out for each data type and cut out. The respective data is reproduced when a predetermined time arrives.
[0003]
The multiplexed broadcast of the digital broadcast is transmitted by a transport stream (hereinafter, referred to as “TS”) compliant with the MPEG-2 standard defined by the international standard ISO / IEC 13818-1.
FIG. 11 shows a configuration of a conventional transport stream. The TS includes a plurality of 188-byte fixed-length packets called TS packets. Each TS packet is composed of a header part and a payload part.
[0004]
The payload section stores data to be transmitted, such as video data and audio data. In the header section before the payload section, information for identifying the type of data stored in the payload section (adaptation field data byte), PCR (Program Clock Reference), PTS (Presentation Time Stamp), DTS (Decoding Time Stamp). ) Is stored.
[0005]
Here, the PCR is time information for resetting an STC (System Time Clock) serving as a reference time on the digital broadcast receiving apparatus side so as to be synchronized with a system clock serving as a reference time on the broadcast apparatus side. This refers to reference time information stored in the TS from the device side and sent at regular intervals.
The STC refers to a time count value that is counted as a reference time on the digital broadcast receiving device side and is counted at a fixed cycle by a reference clock on the digital broadcast receiving device side, and the counted time count value is periodically counted. Reset by the received PCR.
[0006]
The PTS is included in the header portion of the TS packet, is a value indicating the reproduction time of the video data and audio data by the time count value of the STC, and is a PES (TS) composed of a plurality of TS packets of video data and audio data. A PTS is provided for each packetized elementary stream (Packetized Elementary Stream) packet.
The DTS is included in the header portion of the TS packet, and is a value indicating the decoding time of the video data and the audio data by the time count value of the STC. The DTS is provided for each PES packet.
[0007]
FIG. 12 is a functional block diagram showing a configuration of a conventional digital broadcast receiving apparatus 900.
The conventional digital broadcast receiver 900 includes a demodulation unit 901, a descrambling unit 902, a separation unit 903, an STC generation unit 904, a video decoder unit 905, and an audio decoder unit 906.
[0008]
The demodulation unit 901 receives a broadcast wave including a TS transmitted from a broadcast station via an antenna, and demodulates the TS.
The descrambling unit 902 descrambles the TS.
The separation unit 903 extracts a PCR from the TS, outputs the extracted PCR to the STC generation unit 904, and outputs a PES packet of video data (hereinafter, referred to as a “video PES packet”) and a PES packet of audio data ( This is hereinafter referred to as “audio PES packet”), and the separated video PES packet and audio PES packet are output to the video decoder unit 905 and the audio decoder unit 906, respectively.
[0009]
The STC generation unit 904 has a system time clock generated from a master clock having a predetermined frequency (for example, 27 MHz), counts a time count value at a constant cycle, and outputs a PCR when the separation unit 903 outputs a PCR. By resetting the time count value to the time count value indicated by the PCR, the STC is generated by adjusting the time count value to indicate a value synchronized with the reference system clock on the broadcast device side.
[0010]
The video decoder unit 905 decodes the video PES packet output from the separation unit 903, compares the STC generated by the STC generation unit 904 with the DTS and PTS included in the decoded video PES packet, and determines the time indicated by the STC. When the count value matches DTS and PTS, decoding and reproduction of video are performed.
The audio decoder unit 906 decodes the audio PES packet output from the separation unit 903, compares the STC generated by the STC generation unit 904 with the DTS and PTS included in the decoded audio PES packet, and determines the time indicated by the STC. When the count value matches DTS and PTS, the audio is decoded and reproduced.
[0011]
As described above, in digital broadcasting, the DTS and PTS of the video PES packet and the DTS and PTS of the audio PES packet are set in advance so that the received video data and audio data are synchronized. Can be played.
[0012]
[Problems to be solved by the invention]
On the other hand, there is a limit to the amount of data that can be multiplexed into a digital broadcast at one time, and in order to meet the diverse needs of viewers for broadcasting, a part of the data that constitutes a broadcast program is provided to viewers in advance. However, it may be necessary to reproduce the provided data in synchronization with video data or the like received from digital broadcasting.
[0013]
For example, when a movie is broadcast in multiple languages according to the needs of viewers, it is difficult to transmit audio data in all languages at once by digital broadcasting. It is necessary to provide the viewer with a recording medium such as a DVD or the Internet in advance.
However, in conventional digital broadcasting, a PCR, a PTS, and a DTS are added to a TS in real time at the time of broadcasting and transmitted. Therefore, when preparing a PES packet stream before the broadcasting, a PTS synchronized with the PCR of the broadcasting is added. Therefore, there is a problem that the PES packet stream received from the broadcast cannot be synchronized with the PES packet stream sent separately from a storage medium, the Internet, or the like, and reproduced.
[0014]
Also, even if PTS and DTS are added to each PES packet constituting the PES packet stream to be provided to the viewer in advance, if the broadcast time of the target program is changed due to the broadcasting station side, However, there is a problem in that it becomes impossible to reproduce each PES packet in synchronization with the time zone in which the program is broadcast.
Therefore, an object of the present invention is to provide a digital broadcasting system that enables synchronous playback of a PES packet stream received from a digital broadcast and a PES packet stream obtained in advance.
[0015]
[Means for Solving the Problems]
In order to solve the above problem, the present invention is a digital broadcasting system comprising a broadcasting device and a broadcasting receiving device including first and second time counters for counting time at a fixed period, The apparatus sets the first and second time count reference values for resetting the count values of the first and second time counters at each instant, the first content, and the reproduction time of the first content to the first time. The broadcast receiving apparatus continuously broadcasts a transport stream (TS) including a first reproduction count value indicated by a count value of a time counter, and the broadcast receiving apparatus includes a receiving unit that receives the TS, a second content, and a second content. Acquisition means for acquiring a second reproduction count value indicating the reproduction time of the second time counter as a count value of the second time counter; A first content playback unit that plays back the first content when the count value reaches the second content count; and a second content playback unit that plays back the second content when the count value of the second time counter reaches the second playback count value. Content playback means, wherein the first and second time counters receive the respective count values each time the first and second time count reference values are received. It is characterized by resetting to a reference value.
[0016]
Further, the present invention is a broadcast receiving apparatus including first and second time counters for counting time at a fixed period, wherein each count value of the first and second time counters is reset at each instant. Receiving the transport stream (TS) including the first and second time count reference values, the first content, and the first reproduction count value indicating the reproduction time of the first content by the count value of the first time counter. Receiving means for obtaining the second content, and obtaining means for obtaining a second reproduction count value indicating the reproduction time of the second content by the count value of the second time counter;
When the count value of the first time counter reaches the first playback count value, a first content playback unit that plays back the first content, and the count value of the second time counter becomes the second playback count value. And a second content playback unit for playing back the second content when the time has reached, wherein the first and second time counters count each time the first and second time count reference values are received. A value may be reset to the received first and second time count reference values.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
(Embodiment 1)
Hereinafter, embodiments of the present invention will be described.
FIG. 1 is a functional block diagram showing the configuration of the digital broadcasting system 100. The digital broadcasting system 100 includes a broadcasting device 200 and a broadcasting receiving device 300.
[0018]
The broadcasting device 200 includes a content storage unit 201, a first PES generation unit 202, a PES storage unit 203, a communication module unit 204, a server 205, a second PES generation unit 206, and a transmission unit 207.
The content storage unit 201 stores video data, multilingual (Japanese, English, Korean, Chinese, etc.) audio data and video ancillary data (subtitle data such as Spanish subtitle data and French subtitle data) constituting the content of the broadcast program. ) Is remembered.
[0019]
The first PES generation unit 202 reads Korean audio data, Chinese audio data, and video ancillary data from the content storage unit 201, compresses and encodes the read data, and performs audio PES packets of each language and PES of the video ancillary data. A packet (hereinafter, referred to as “additional PES packet”) is generated, a DTS and a PTS are added to each generated PES packet, and the generated PES packet is stored in the storage unit 203.
[0020]
Here, the PTS and DTS are respectively added by a time count value of a TSTC described later instead of the STC.
FIG. 2 is a functional block diagram illustrating a configuration of the first PES generation unit 202. The first PES generator 202 includes a video encoder 212, an audio encoder 222, a timing generator 232, and a PES generator 242.
[0021]
The video encoder 212 reads the video ancillary data from the content storage 201, compresses and encodes the data, and outputs the data to the PES generator 242.
The audio encoder 222 reads the Korean audio data and the Chinese audio data from the content storage unit 201, compresses and encodes them, and outputs them to the PES creation unit 242.
The PES creation unit 242 sequentially packetizes the video ancillary data input from the video encoder unit 212 to generate video ancillary PES packets, and sequentially generates a clock included in the timing generation unit 232 for each of the generated video ancillary PES packets. A time count value (TSTC described later) is added to each video-attached PES packet generated as DTS and PTS, and stored in the storage unit 203.
[0022]
The DTS and the PTS are given a time count value sequentially generated by the timing generation unit 232 with a predetermined initial time count value (a time count value obtained by adding a delay time to a broadcast start time of a broadcast program) as an initial value.
Also, the PES creation unit 242 performs the same processing as the case of the video ancillary data on the Korean audio data and the Chinese audio data input from the audio encoder unit 222, and outputs the audio PES of each language to which the DTS and the PTS are added. A packet is generated and stored in the storage unit 203.
[0023]
Note that the video-added PES packet and the audio PES packet of each language may be stored in a storage medium 311 mounted on the broadcast receiving device 300, such as a CD-ROM, DVD, or memory card, which will be described later.
The timing generation unit 232 has a clock generated from a master clock having a predetermined frequency (for example, 27 MHz), and generates a time count value indicating a date and time indicated by a TSTC described later.
[0024]
The storage unit 203 stores each PES packet generated by the first PES generation unit 202.
The communication module unit 204 outputs each PES packet stored in the storage unit 203 (hereinafter, referred to as a “prior acquisition PES packet”) to the server 205.
Note that the communication module unit 204 may output the pre-acquired PES packet to the transmission unit 207.
[0025]
The server 205 transmits the pre-acquired PES packet input from the communication module unit 204 to the broadcast receiving device 300 via the Internet.
The second PES generation unit 206 reads video data, Japanese audio data, and English audio data from the content storage unit 201, compression-encodes the read data, and generates and generates a video PES packet and an audio PES packet of each language. A DTS and a PTS are added to each of the PES packets thus obtained, and the resultant is output to the transmission unit 207.
[0026]
The DTS and PTS added to each PES packet are given by the STC time count value.
FIG. 3 is a diagram illustrating a conceptual diagram of a configuration of each PES packet generated by the second PES generation unit 206.
The PES packet is composed of a header part and a payload part. The header part contains DTS and PTS, and the payload part contains various data.
[0027]
The transmitting unit 207 generates a TS packet by dividing the video PES packet and the audio PES packet of each language (hereinafter, both PES packets are collectively referred to as a broadcast PES packet) input from the second PES generating unit 206, PCR and TIME are periodically inserted into the header of the generated TS packet, and the TS is broadcast via the antenna 208.
[0028]
When a pre-acquired PES packet is input from the communication module unit 204, the transmission unit 207 generates a TS packet by dividing the PES packet, and broadcasts the generated TS packet as a broadcast PES packet. Broadcast the data beforehand.
Here, “TIME” is a time count value (TSTC described later) generated by the TSTC generation unit 309 of the broadcast receiving apparatus 300, which is a criterion for determining whether the decoding and reproduction time of the pre-acquired PES packet has arrived. Is a time count value indicating the date and time for resetting to be synchronized with the time count value generated by the timing generation unit 232 of the broadcasting device 200, and is initialized to a predetermined time count value in advance. A value is set, the time is periodically counted by a clock of the timing generation unit 232, and is a time count value transmitted at a constant interval via the TS.
[0029]
For example, when the target broadcast program is broadcast at the scheduled broadcast time, the TIME is set to an initial value so as to match the PCR, and when the target broadcast program is broadcast with a delay of 30 minutes, the TIME is delayed by 30 minutes from the PCR. An initial value is set to indicate the time count value.
In this way, by adjusting the time count value of TIME, even when the broadcast time of the target broadcast program is changed, the decoding and reproduction times indicated by the DTS and PTS added to the pre-acquired PES can be transmitted to the broadcast receiving apparatus 300. Can be synchronized with the decoding and reproduction times indicated by the DTS and PTS added to the received broadcast PES packet.
[0030]
FIG. 4 is a conceptual diagram illustrating a configuration of a TS generated by the transmission unit 207. In FIG. 4, PES1, PES2, and PES3 indicate TS packets including the constituent elements constituting each PES packet. For example, PES1 indicates a TS packet constituting a PES1 packet. Each TS packet is composed of a header part and a payload part, and PCR and TIME are embedded in the header part as shown in FIG.
[0031]
Next, the broadcast receiving device 300 will be described.
FIG. 5 is a functional block diagram showing a configuration of the broadcast receiving device 300.
The broadcast receiving apparatus 300 includes a demodulation unit 301, a switch unit 302, a descramble unit 303, a separation unit 304, a video decoder unit 305, a communication module unit 306, a storage unit 307, an STC generation unit 308, a TSTC generation unit 309, and time information switching. The storage unit 310 includes a storage medium 311, an audio switching unit 312, an audio decoder unit 313, a control unit 314, and an input unit 315.
[0032]
The demodulation unit 301 demodulates a broadcast wave including a TS received via the antenna and outputs the demodulated broadcast wave to the switch unit 302.
The switch unit 302 switches the output destination of the TS input from the demodulation unit 301 or the storage unit 307.
The descrambling unit 303 descrambles the TS input from the switch unit 302 and outputs the descrambled TS to the separating unit 304.
[0033]
Separating section 304 extracts PCR and TIME from the TS input from descramble section 303, outputs the extracted PCR to STC generating section 308, and outputs the extracted TIME to TSTC section 309.
The separating unit 304 separates the video PES packet, the Japanese audio PES packet, and the English PES packet from the TS, outputs the separated video PES packet to the video decoder unit 305, and outputs the separated Japanese audio PES packet and the English audio PES packet. The PES packet is output to the audio switching unit 312.
[0034]
The video decoder unit 305 decodes the video PES packet input from the separation unit 304, and counts the time count values indicated by the DTS and PTS included in the video PES packet and the time count value indicated by the STC input from the STC generation unit 308 When the time count value indicated by the DTS matches the time count value indicated by the STC, the video PES packet is decoded. When the time count value indicated by the PTS matches the time count value indicated by the STC, the video The PES packet is reproduced.
[0035]
The communication module unit 306 receives the pre-acquired PES packet transmitted from the server 205 of the broadcasting unit 200 via the Internet, and outputs the received pre-acquired PES packet to the storage unit 307.
In the case where the pre-acquired PES packet is multiplexed and transmitted from the transmitting unit 207 of the broadcasting device 200 to the TS instead of being transmitted via the Internet, the pre-acquired PES packet is separated by the demultiplexing unit 304 and controlled. The unit 314 outputs the separated pre-acquired PES packet to the storage unit 307.
[0036]
Further, the pre-acquired PES packet may be stored in a storage medium 311 such as a CD-ROM or a DVD.
The storage unit 307 stores the TS input from the switch unit 302 and the pre-acquired PES packet input from the communication module 306.
The STC generation unit 308 has a system time clock generated from a master clock of a predetermined frequency (for example, 27 MHz) that can be finely adjusted, counts a time count value in a fixed cycle, and outputs a PCR when the separation unit 304 outputs a PCR. Compares the counted time count value with the time count value indicated by the PCR, and if the error is within a predetermined range, fine-tunes the master clock so as to correct the error, and exceeds the predetermined range. In this case, the STC is generated by resetting the time count value to the time count value indicated by the PCR so that the time count value indicates a time count value synchronized with the reference system clock of the broadcasting device 200. .
[0037]
STC generating section 308 outputs the generated STC to time information switching section 310 and video decoding section 305.
The TSTC generation unit 309 has a clock indicating the date and time generated from the master clock used by the STC generation unit 308 to generate the system clock, counts the time count value at a fixed cycle, and When the TIME is output from 304, the counted time count value is compared with the time count value indicated by the TIME, and if the error is within a predetermined range, the master clock is corrected so as to correct the error. The time count value is finely adjusted, and when the time count value exceeds a predetermined range, the time count value is reset to the time count value indicated by the TIME so that the time count value is synchronized with the clock of the timing generation unit 232 of the broadcasting device 200. The TSTC is generated by adjusting to indicate the value.
[0038]
Here, the TSTC is a date, a time, and a time that are counted by the TSTC generation unit 309 at a fixed period, and serve as a criterion for determining whether the decoding and reproduction time of the pre-acquired PES in the broadcast receiving apparatus 300 has arrived. And the counted time count value is reset by periodically received TIME.
[0039]
The TSTC generation unit 309 outputs the TSTC generated by the TSTC generation processing to the time information switching unit 310.
Time information switching section 310 outputs one of STC and TSTC to audio decoder section 313 in response to an instruction from control section 314.
The audio switching unit 312 selects an audio PES packet to be output to the audio decoder 313 according to an instruction from the control unit 314, and outputs the selected audio PES packet to the audio decoder unit 313.
[0040]
The audio decoder unit 313 decodes the audio PES packet input from the audio switching unit 312, and stores the time count values indicated by the DTS and PTS included in the audio PES packet and the STC or TSTC input from the time information switching unit 310. When the time count value indicated by the DTS matches the time count value indicated by the STC or TSTC, the audio PES is decoded, and the time count value indicated by the PTS and the time count indicated by the STC or TSTC are compared. When the values match, audio PES is reproduced.
[0041]
The control unit 314 performs an output process of the TS or the pre-acquired PES packet stored in the storage unit 307, an output switching process of the time information, and an audio PES output switching process.
First, the output processing will be described. Upon receiving the user's TS reproduction instruction from the input unit 315, the control unit 314 reads the stored TS from the storage unit 307, and outputs the TS to the descramble unit 303 via the switch unit 302.
[0042]
Next, the output switching process of the time information will be described. Control unit 314 instructs time information switching unit 310 to output STC when receiving a normal voice selection instruction from the user from input unit 315, and receives time information when receiving a sub voice selection instruction from the user from input unit 315. The switching unit 310 is instructed to output the TSTC.
Next, the output switching process of the audio PES packet will be described. When receiving the normal voice selection instruction from the user from the input unit 315, the control unit 314 instructs the voice switching unit 312 to output a Japanese voice PES packet and an English PES packet, and the input unit 315 selects the sub voice from the user. When the instruction is received, a Korean voice PES packet or a Chinese voice PES packet (hereinafter, a bilingual voice PES packet is referred to as a “pre-acquired voice packet”) is read from the storage unit 307 or the storage medium 311, and is read to the voice switching unit 312. Output, and instructs the audio switching unit 312 to output the input audio PES.
[0043]
The input unit 315 receives an instruction from a user.
<Operation>
Next, the broadcast PES packet performed by the broadcast receiving apparatus 300 and the prior acquisition voice The synchronous reproduction process of the PES packet will be described. FIG. 6 is a flowchart showing the synchronous reproduction process performed by the broadcast receiving device 300.
[0044]
When extracting the PCR and the TIME from the TS input from the descrambler 303 (step S1001), the separator 304 outputs the extracted PCR and the TIME to the STC generator 308 and the TSTC generator 309, respectively.
The STC generation unit 308 generates an STC by adjusting the counted time count value based on the output PCR (step S1002), and outputs the generated STC to the time information switching unit 310 and the video decoder unit 305. , The TSTC generation unit 309 generates a TSTC by adjusting the counted time count value based on the output TIME (step S1007), and outputs the generated TSTC to the time information switching unit 310.
[0045]
If the audio selection instruction from the user is a normal audio selection instruction (step S1003), time information switching section 310 outputs the input STC to audio decoder section 313 (step S1004), and video decoder section 305 separates It is determined whether or not the time count value indicated by each DTS and PTS included in the video PES packet input from unit 304 and the time count value of STC input from STC generation unit 308 match, and audio decoder unit 313 Determines whether or not the time count value indicated by each DTS and PTS included in the audio PES packet input from the audio switching unit 312 matches the time count value of the STC input from the time information switching unit 310. , (Step S1005), if they match (step S1005: Y), the video decoder unit 305 and the audio Coder 313, respectively reproduced video PES packets, audio PES packets, thereby, the video PES packet and the audio PES packets constituting the received broadcast PES packet is synchronously reproduced (Step S1006).
[0046]
If the audio selection instruction from the user is a sub audio selection instruction (step S1003), time information switching section 310 outputs the input TSTC to audio decoder section 313 (step S1008), and video decoder section 305 separates the TSTS. It is determined whether or not the time count value indicated by each DTS and PTS included in the video PES packet input from unit 304 and the time count value of STC input from STC generation unit 308 match, and audio decoder unit 313 Determines whether or not the time count value indicated by each DTS and PTS included in the pre-acquired audio PES packet input from the audio switching unit 312 matches the time count value of the TSTC input from the time information switching unit 310. If it is determined (step S1009) that they match (step S1009: Y), the video decoder unit 3 5 and the audio decoder unit 313 reproduce the video PES packet and the pre-acquired audio PES packet, respectively, and thereby, the Korean audio included in the video PES packet and the pre-acquired PES packet which are components of the received broadcast PES packet. The PES packet or the Chinese audio PES packet is reproduced synchronously (step S1010).
(Embodiment 2)
In the first embodiment, the broadcast PES packet broadcasted from the broadcast apparatus 200 is received by the broadcast receiving apparatus 300, and is reproduced in synchronization with the audio PES packet included in the pre-acquired PES packet. In the embodiment, an embodiment is shown in which an additional PES packet included in the pre-acquired PES packet is reproduced synchronously.
[0047]
Hereinafter, the same components as those of digital broadcasting system 100 according to Embodiment 1 will be assigned the same reference numerals, and differences will be mainly described.
<Structure>
The digital broadcasting system 400 according to the present embodiment includes a broadcasting device 200 and a broadcasting receiving device 500.
[0048]
The broadcast device 200 has already been described in the first embodiment, and a description thereof will be omitted. FIG. 7 is a functional block diagram showing the configuration of the broadcast receiving device 500.
The broadcast receiving apparatus 500 includes a demodulator 301, a switch 302, a descrambler 303, a separator 304, a video decoder 405, a communication module 306, a storage 307, an STC generator 308, a TSTC generator 409, and time information switching. It comprises a unit 310, a storage medium 311, an audio switching unit 312, an audio decoder unit 313, a control unit 414, an input unit 315, a sub-video decoder unit 416, and a video synthesizing unit 417.
[0049]
The video decoder 405 outputs the video indicated by the reproduced video PES packet to the video synthesizer 417, in addition to the function of the video decoder 305.
The TSTC generation unit 409 outputs the generated TSTC to the sub-video decoder unit 416 in addition to the function of the TSTC generation unit 309.
The control unit 414 has a function of the user from the input unit 315 in addition to the function of the control unit 314. Vice When the video display instruction is received, the additional PES packet is read from the storage unit 307 or the storage medium 311 and output to the sub video decoder unit 416.
[0050]
The sub-picture decoder 416 decodes the additional PES packet input from the controller 414, and counts the respective time counts indicated by the DTS and PTS included in the additional PES packet and the time count indicated by the TSTC input from the TSTS generator 409. When the time count value indicated by the DTS matches the time count value indicated by the TSTC, the additional PES packet is decoded. When the time count value indicated by the PTS matches the time count value indicated by the TSTC, The additional PES packet is reproduced, and the subtitle video indicated by the reproduced additional PES packet is output to the combining unit 417.
[0051]
The video combining unit 417 combines the video input from the video decoder unit 405 and the subtitle video input from the sub-video decoder unit 416, and outputs the synthesized video.
<Operation>
Next, a description will be given of a synchronous reproduction process of the broadcast PES packet and the pre-acquired PES packet performed by the broadcast receiving device 500. FIG. 8 is a flowchart showing the synchronous reproduction process performed by the broadcast receiving device 500.
[0052]
When extracting the PCR and the TIME from the TS input from the descrambler 303 (step S2001), the separating unit 304 outputs the extracted PCR and the TIME to the STC generator 308 and the TSTC generator 409, respectively.
The STC generation unit 308 generates an STC by adjusting the time count value of the generated STC based on the output PCR (step S2002), and transmits the generated STC to the time information switching unit 310 and the video decoder unit 405. The TSTC generation unit 409 generates a TSTC by adjusting the time count value of the generated TSTC based on the output TIME (step S2007), and transmits the generated TSTC to the time information switching unit 310 and the sub-image. Output to the decoder section 416.
[0053]
If the selection instruction from the user is a normal video display instruction (step S2003), the time information switching unit 310 outputs the input STC to the audio decoder unit 313 (step S2004), and the video decoder unit 405 It is determined whether or not the time count value indicated by each DTS and PTS included in the video PES packet input from 304 and the STC input from the STC generation unit 308 match, and the audio decoder unit 313 It is determined whether or not the time count value indicated by each DTS and PTS included in the audio PES packet input from the audio switching unit 312 matches the STC input from the time information switching unit 310 (step S2005). (Step S2005: Y), the video decoder unit 405 reproduces the video PES packet and Over the reader unit 313 by reproducing the audio PES packet, synchronously reproducing video PES packet and the audio PES packet (Step S2006).
[0054]
If the selection instruction from the user is a sub-video display instruction (step S2003), control unit 414 reads the additional PES packet from storage unit 307 or storage medium 311 and outputs it to sub-video decoder unit 416 (step S2008). Further, the time information switching unit 310 outputs the STC to the audio decoder unit 313, and the video decoder unit 405 outputs the time count value indicated by each DTS and PTS included in the video PES packet input from the separation unit 304 and the STC generation. The sub-picture decoder 416 determines whether or not the time count value of the STC input from the unit 308 matches the time count value of the STC indicated by the DTS and PTS included in the additional PES packet input from the control unit 414. Whether the value matches the time count value of TSTC input from TSTC generation section 409 The audio decoder unit 313 determines that the time count value indicated by each DTS and PTS included in the audio PES packet input from the audio switch unit 312 matches the time count value of the STC input from the time information switch unit 310. (Step S2009: Y), and if they match (Step S2009: Y), the video decoder unit 405 and the sub-video decoder unit 416 reproduce the video PES packet and the additional PES packet, respectively, The subtitle video is output to the video synthesizing unit 417 (step S2010), the video synthesizing unit 417 synthesizes the input video and the subtitle video and outputs (step S2011), and the audio decoder unit 313 reproduces the audio PES packet. And output.
[0055]
Thus, the video, the subtitle video, and the audio are synchronously reproduced and output.
(Embodiment 3)
The present embodiment is configured to receive an audio PES packet broadcast from the broadcast device 200, and perform a radio broadcast composed of the received audio PES packet and a video composed of a video PES packet stored in advance in the broadcast receiving device. Is shown in an embodiment in which the content is reproduced synchronously.
[0056]
Hereinafter, the same components as those of digital broadcasting system 100 according to Embodiment 1 will be assigned the same reference numerals, and differences will be mainly described.
<Structure>
The digital broadcasting system 600 according to the present embodiment includes a broadcasting device 200 and a broadcasting receiving device 700.
[0057]
The broadcast device 200 has already been described in the first embodiment, and a description thereof will be omitted. FIG. 9 is a functional block diagram showing the configuration of the broadcast receiving device 700.
The broadcast receiving apparatus 700 includes a demodulation section 301, a switch section 302, a descrambling section 303, a separation section 704, an audio decoder section 705, a communication module section 306, a storage section 707, an STC generation section 708, a TSTC generation section 309, and time information switching. It comprises a unit 710, a storage medium 711, a video switching unit 712, a video decoder unit 713, a control unit 714, and an input unit 315.
[0058]
The separation unit 704 separates audio PES packets, PCRs, and TIMEs constituting a radio broadcast from the TS, outputs the separated audio PES packets to the audio decoder unit 705, and outputs the PCRs and the TIMEs to the STC generation unit 708 and the TSTC generation unit, respectively. 309.
In the case of non-radio broadcasting, the separating unit 704 separates a video PES packet constituting a broadcast from a TS in addition to the above, and outputs the video PES packet to the video switching unit 712.
[0059]
The audio decoder unit 705 decodes the audio PES packet input from the separation unit 704, and counts the respective time counts indicated by the DTS and PTS included in the audio PES packet and the time count indicated by the STC input from the STC generator 708. When the time count value indicated by the DTS matches the time count value indicated by the STC, the audio PES packet is decoded. When the time count value indicated by the PTS matches the time count value indicated by the STC, the audio PES packet is decoded. The PES packet is reproduced.
[0060]
The STC generator 708 differs from the STC generator 308 in that the STC generator 708 outputs the generated STC to the audio decoder 705 instead of outputting the generated STC to the video decoder 305.
Time information switching section 710 outputs one of STC and TSTC to video decoder section 713 in response to an instruction from control section 714.
[0061]
The storage unit 707 or the storage medium 711 stores a video PES packet (hereinafter, referred to as a “selected video PES packet”) that forms a video to be reproduced in synchronization with a radio broadcast broadcast from the broadcasting device 200.
The storage unit 707 has the functions of the storage unit 307, and the storage medium 711 also has the functions of the storage medium 311.
[0062]
The video switching unit 712 outputs the selected video PES packet read by the control unit 714 from the storage unit 707 or the storage medium 711 to the video decoder unit 713 in response to an instruction from the control unit 714. .
The video decoder unit 713 decodes the video PES packet input from the control unit 714, and counts the respective time count values indicated by the DTS and PTS included in the video PES packet and the time count indicated by the TSTC input from the time information switching unit 710. When the time count value indicated by the DTS matches the time count value indicated by the TSTC, the additional PES packet is decoded. When the time count value indicated by the PTS matches the time count value indicated by the TSTC, Play video PES packets.
[0063]
The control unit 714 performs a process of outputting a TS or a pre-acquired PES packet stored in the storage unit 707, a process of switching output of time information, and a process of switching output of a video PES.
First, the output processing will be described. Upon receiving the user's TS reproduction instruction from the input unit 315, the control unit 714 reads the stored TS from the storage unit 707 and outputs the TS to the descramble unit 303 via the switch unit 302.
[0064]
Next, the output switching process of the time information will be described. When receiving a normal video display instruction from the user from input unit 315, control unit 714 instructs time information switching unit 710 to output the STC, and receives a selected video display instruction from the user from input unit 315 to display the time information. The switching unit 310 is instructed to output the TSTC.
Next, the output switching process of the video PES packet will be described. When receiving the normal video display instruction from the user from the input unit 315, the control unit 714 instructs the video switching unit 712 to output the video PES packet separated by the separation unit 704, and selects the selected video from the user from the input unit 315. When the instruction is received, the selected video PES packet is read from the storage unit 307 or the storage medium 311 and output to the video switching unit 712, and the video switching unit 712 is instructed to output the read selected video PES packet.
[0065]
<Operation>
Next, the synchronous reproduction process of the broadcast PES packet and the selected video PES packet performed by the broadcast receiving device 700 will be described. FIG. 10 is a flowchart showing the synchronous reproduction process performed by the broadcast receiving device 700.
When extracting the PCR and TIME from the TS input from the descrambler 303 (step S3001), the separating unit 704 outputs the extracted PCR and TIME to the STC generator 708 and the TSTC generator 309, respectively.
[0066]
The STC generation unit 708 generates an STC by adjusting the time count value of the generated STC based on the output PCR (step S3002), and transmits the generated STC to the time information switching unit 710 and the audio decoder unit 705. Then, the TSTC generation unit 309 generates the TSTC by adjusting the time count value of the generated TSTC based on the output TIME (step S3007), and outputs the generated TSTC to the time information switching unit 710.
[0067]
If the selection instruction from the user is a normal video display instruction (step S3003), the time information switching unit 310 outputs the input STC to the video decoder unit 713 (step S3004), and the video decoder unit 713 sets The audio decoder unit 705 determines whether the time count value indicated by each DTS and PTS included in the video PES packet input from the switching unit 712 matches, and the audio decoder unit 705 outputs the audio PES packet input from the separation unit 704. It is determined whether or not the time count value indicated by each DTS and PTS included in the STC matches the time count value indicated by the STC input from the STC generation unit 708 (step S3005), and when they match (step S3005: Y), the video decoder unit 713 and the audio decoder unit 705 respectively include a video PES packet and an audio PE Than to play a packet, synchronously reproducing two PES packet (Step S3006).
[0068]
If the selection instruction from the user is a selection video display instruction (step S3003), the time information switching unit 710 outputs the TSTC input from the TSTC generation unit 309 to the video decoder unit 713 in response to the instruction from the control unit 714. (Step S3008) The audio decoder unit 705 matches the time count value indicated by each DTS and PTS included in the audio PES packet input from the separation unit 304 with the time count value of the STC input from the STC generation unit 708. The video decoder unit 713 determines whether or not the time count value indicated by each DTS and PTS included in the selected video PES packet input from the video switching unit 712 and the TSTC input from the time information switching unit 710. Are determined to match (step S3009). If they match (step S300) : Y), the audio decoder 705 and the video decoder 713, respectively audio PES packet, synchronously reproducing the selected video PES packet (Step S3010).
[0069]
<Supplement>
As described above, the digital broadcasting system according to the present invention has been described based on the embodiments. However, it is needless to say that the present invention is not limited to these embodiments.
For example, in Embodiments 1 to 3, the received TS may be directly output to the descrambler 303 via the switch 302, or may be stored in the storage 307 or the storage 707. , The TS may be read out and output to the descrambling unit 303 via the switch unit 302.
[0070]
【The invention's effect】
(1) The present invention is a digital broadcasting system including a broadcasting device and a broadcasting receiving device including first and second time counters for counting time at a fixed period, wherein the broadcasting device has A first and second time count reference value for resetting each count value of the first and second time counters, a first content, and a reproduction time of the first content by the count value of the first time counter. The broadcast receiver continuously broadcasts a transport stream (TS) including the first playback count value indicated by the symbol, and the broadcast receiving device sets the receiving means for receiving the TS, and the playback time of the second content and the second content to the Acquiring means for acquiring a second reproduction count value indicated by a count value of a second time counter; and an acquisition means for acquiring a count value of the first time counter reaching the first reproduction count value. A first content playback unit that plays back the first content; and a second content playback unit that plays back the second content when the count value of the second time counter reaches the second playback count value. The first and second time counters reset the respective count values to the received first and second time count reference values each time the first and second time count reference values are received. It is characterized by the following.
(2) Further, the present invention is a broadcast receiving apparatus including first and second time counters for counting time in a fixed cycle, wherein each count value of the first and second time counters is regenerated at each instant. A transport stream (TS) including first and second time count reference values for setting, a first content, and a first playback count value indicating a playback time of the first content by the count value of the first time counter. ), Receiving means for obtaining the second content, a second reproduction count value indicating the reproduction time of the second content by the count value of the second time counter, and counting by the first time counter. When the value reaches the first playback count value, the first content playback means for playing back the first content, and the count value of the second time counter becomes the second playback count value. And a second content playback unit that plays back the second content when the count value reaches the first count value. The first and second time counters each receive the first and second time count reference values. The respective count values may be reset to the received first and second time count reference values.
[0071]
In (1), the first and second time count reference values may be count values that are time counted in the same cycle by a clock having a predetermined frequency.
Thereby, the reproduction times of the first and second contents on the receiving device side can be adjusted to be synchronized with the time count on the broadcasting device side based on the first and second time count reference values. Even when two contents are acquired by the broadcast receiving apparatus through different receiving routes, the two contents are synchronized by setting the first and second reproduction count values in association with the time count on the broadcast apparatus side. Can be played back.
[0072]
Further, in (1), before broadcasting the TS, the broadcasting device data-broadcasts a TS including the second content and the second reproduction count value, and the obtaining unit obtains the second content. Recording means for recording the content and the second reproduction count value in a storage area may be provided.
Also, in (2), the receiving means receives a TS including the data-broadcasted second content and the second reproduction count value, and the obtaining means sets the obtained second reproduction count value and the second reproduction count value. A recording unit for recording the second content in the storage area may be provided.
[0073]
This makes it possible to use data broadcasting effectively and transmit in advance one of the contents to be synchronized and reproduced by digital broadcasting. In this case, two contents (for example, a movie and its corresponding native language sound) can be reproduced in synchronization with each other.
Further, in (1), the broadcasting device has a transmitting unit that transmits the second content and the second reproduction count value via the Internet, and the obtaining unit is configured to transmit the second content and the second reproduction count value via the Internet. An internet receiving unit for receiving the second content and the second reproduction count value and a storage unit for storing the received second reproduction count value and the second content may be provided.
[0074]
Also, in (2), the obtaining unit includes an Internet receiving unit that receives the second content and the second reproduction count value transmitted via the Internet, and an Internet reception unit that receives the second reproduction count value and the second reproduction count value. Storage means for storing the second content.
As a result, one content to be synchronously reproduced by digital broadcasting can be transmitted in advance via the Internet, so that a large amount of data is not multiplexed and broadcast at one time, but can be adapted to the needs of the viewer. Thus, two contents (for example, a movie and its corresponding native language sound) can be reproduced in synchronization.
[0075]
Further, in (1), the configuration of <Claim 4> and <Claim 12> may be adopted.
As a result, one content to be synchronously reproduced by digital broadcasting can be recorded in advance on a recording medium, so that a large amount of data can not be multiplexed and broadcast at once, but can be adapted to the needs of the viewer. Two contents (for example, a movie and its corresponding native language audio) can be played back in synchronization.
[0076]
Also, in (1), the receiving means has a recording means for recording the TS in a storage area, and the first content reproduction means reads the first reproduction count value and the first content from the storage area. When the count value of the first time counter reaches the first reproduction count value, the first content may be reproduced.
Also, in (2), the receiving means has a recording means for recording the TS in a storage area, and the first content reproduction means reads the first reproduction count value and the first content from the storage area. When the count value of the first time counter reaches the first reproduction count value, the first content may be reproduced.
[0077]
Thus, the first content that has been digitally broadcast can be recorded, so that the user can synchronously reproduce the first content and the second content that are recorded at a desired timing.
Further, in (1), the first and second contents are contents indicating different images, respectively, and the broadcast receiving apparatus further combines the reproduced images indicated by the first and second contents on the same screen. It may be provided with a combined output means for outputting.
[0078]
Also, in (2), the first and second contents are contents indicating different images, respectively, and the broadcast receiving apparatus further combines the respective images indicated by the reproduced first and second contents on the same screen. It may be provided with a combined output means for outputting.
This allows the two video contents to be displayed in a synchronized manner, so that, for example, subtitles in the viewer's native language can be displayed on the movie broadcast.
[0079]
In (1), the first content may be content for reproducing sound, and the second content may be content indicating a video.
In (2), the first content may be a content for reproducing sound, and the second content may be a content indicating a video.
[0080]
As a result, video content such as a still image can be inserted into the audio broadcast.
[Brief description of the drawings]
FIG. 1 is a functional block diagram showing a configuration of a digital broadcasting system 100.
FIG. 2 is a functional block diagram illustrating a configuration of a first PES generation unit 202.
FIG. 3 is a diagram illustrating a conceptual diagram of a configuration of each PES packet generated by a second PES generation unit 206.
FIG. 4 is a conceptual diagram showing a configuration of a TS generated by a transmission unit 207.
FIG. 5 is a functional block diagram showing a configuration of a broadcast receiving device 300.
FIG. 6 is a flowchart showing the synchronous reproduction process performed by the broadcast receiving device 300.
FIG. 7 is a functional block diagram showing a configuration of a broadcast receiving device 500.
FIG. 8 is a flowchart showing the synchronous reproduction process performed by the broadcast receiving device 500.
FIG. 9 is a functional block diagram showing a configuration of a broadcast receiving device 700.
FIG. 10 is a flowchart showing the synchronous reproduction process performed by the broadcast receiving device 700.
FIG. 11 shows a configuration of a conventional transport stream.
FIG. 12 is a functional block diagram showing a configuration of a conventional digital broadcast receiving apparatus 900.
[Explanation of symbols]
100 Digital Broadcasting System
200 broadcasting equipment
201 Content storage unit
202 First PES generation unit
203 storage unit
204 Communication module
205 server
206 Second PES generation unit
207 sending unit
208 antenna
212 Video encoder
222 audio encoder
232 Timing generator
242 PES creation unit
300, 500, 700, 900 broadcast receiving device
301 Demodulation unit
302 switch section
303 descramble section
304, 704 separation unit
305, 405, 713 Video decoder unit
306 Communication module
307, 707 storage unit
308 STC generator
309, 409 TSTC generator
310 Time information switching unit
311、711 Storage media
312 Voice switching unit
313, 705 Audio decoder section
314, 414, 714 control unit
315 Input section
416 Sub-picture decoder
417 Image synthesis unit
712 Video switching unit

Claims (16)

A digital broadcasting system comprising a broadcasting device and a broadcast receiving device including first and second time counters for counting time at a fixed period,
The broadcast device may include a first and a second time count reference value for resetting each count value of the first and the second time counters at each instant, a first content, and a reproduction time of the first content. Continuously broadcast a transport stream (TS) including a first reproduction count value indicated by a count value of a first time counter;
The broadcast receiving device,
Receiving means for receiving the TS,
Acquiring means for acquiring a second content and a second reproduction count value indicating a reproduction time of the second content by a count value of the second time counter;
A first content playback unit that plays back the first content when the count value of the first time counter reaches the first playback count value;
A second content playback unit that plays back the second content when the count value of the second time counter reaches the second playback count value;
The first and second time counters each reset the count value to the received first and second time count reference values each time the first and second time count reference values are received. Digital broadcasting system characterized by: The broadcasting device data broadcasts a TS including the second content and the second reproduction count value before broadcasting the TS,
2. The digital broadcasting system according to claim 1, wherein the acquisition unit includes a recording unit that records the acquired second content and the second reproduction count value in a storage area. The broadcasting device has a transmission unit that transmits the second content and the second reproduction count value via the Internet,
The acquisition means,
Internet receiving means for receiving the second content and the second reproduction count value transmitted from the transmitting means,
2. The digital broadcasting system according to claim 1, further comprising a storage unit configured to store the received second reproduction count value and the second content. The broadcasting device includes a recording unit that records the second reproduction count value and the second content on a recording medium,
The acquisition means reads the second reproduction count value and the second content from a recording medium on which the second reproduction count value and the second content are recorded, thereby obtaining the second reproduction count value and the second content. 2. The digital broadcasting system according to claim 1, wherein 2. The digital broadcasting system according to claim 1, wherein the first and second time count reference values are count values that are counted in the same cycle by a clock having a predetermined frequency. The receiving means has a recording means for recording the TS in a storage area,
The first content reproducing means reads the first reproduction count value and the first content from the storage area, and when the count value of the first time counter reaches the first reproduction count value, the first content reproduction means reads the first content. The digital broadcast system according to any one of claims 1 to 5, wherein the digital broadcast system performs reproduction. The first and second contents are contents showing different images, respectively.
The digital broadcast receiver according to any one of claims 1 to 6, wherein the broadcast receiving apparatus further includes a composite output unit that composites and outputs each of the reproduced videos represented by the first and second contents on the same screen. Broadcast system. The first content is a content for reproducing sound,
7. The digital broadcasting system according to claim 1, wherein the second content is a content indicating a video. A broadcast receiving device that counts time at a fixed cycle and includes first and second time counters,
The first and second time count reference values for resetting the count values of the first and second time counters at each instant, the first content, and the reproduction time of the first content are stored in the first time counter. Receiving means for receiving a transport stream (TS) including a first reproduction count value represented by a count value;
Acquiring means for acquiring the second content and a second reproduction count value indicating the reproduction time of the second content by the count value of the second time counter;
A first content playback unit that plays back the first content when the count value of the first time counter reaches the first playback count value;
A second content playback unit that plays back the second content when the count value of the second time counter reaches the second playback count value;
The first and second time counters reset the respective count values to the received first and second time count reference values each time the first and second time count reference values are received. A broadcast receiving apparatus characterized by the above. The receiving means receives a TS including the data-broadcasted second content and the second reproduction count value,
10. The broadcast receiving apparatus according to claim 9, wherein the acquisition unit includes a recording unit that records the acquired second reproduction count value and the acquired second content in a storage area. The acquisition means,
Internet receiving means for receiving the second content and the second reproduction count value transmitted via the Internet,
The broadcast receiving apparatus according to claim 9, further comprising a storage unit configured to store the received second reproduction count value and the second content. The acquisition means reads the second reproduction count value and the second content from a recording medium on which the second content and the second reproduction count value are recorded, thereby obtaining the second reproduction count value and the second content. The broadcast receiving apparatus according to claim 9, wherein 10. The broadcast receiving apparatus according to claim 9, wherein the first and second time count reference values are count values counted at the same cycle by a clock having a predetermined frequency. The receiving means has a recording means for recording the TS in a storage area,
The first content reproducing means reads the first reproduction count value and the first content from the storage area, and when the count value of the first time counter reaches the first reproduction count value, the first content reproduction means reads the first content. The broadcast receiving device according to claim 9, wherein the broadcast is reproduced. The first and second contents are contents showing different images, respectively.
The broadcast according to any one of claims 9 to 14, wherein the broadcast receiving apparatus further includes a combining output unit that combines and outputs each of the reproduced videos represented by the first and second contents on the same screen. Receiver. The first content is a content for reproducing sound,
The broadcast receiving device according to claim 9, wherein the second content is a content indicating a video.

Images