[go: up one dir, main page]

HK1173291B - Decoder and method at the decoder for synchronizing the rendering of contents received through different networks - Google Patents

Decoder and method at the decoder for synchronizing the rendering of contents received through different networks Download PDF

Info

Publication number
HK1173291B
HK1173291B HK13100359.0A HK13100359A HK1173291B HK 1173291 B HK1173291 B HK 1173291B HK 13100359 A HK13100359 A HK 13100359A HK 1173291 B HK1173291 B HK 1173291B
Authority
HK
Hong Kong
Prior art keywords
decoding
frames
decoded
time information
program content
Prior art date
Application number
HK13100359.0A
Other languages
Chinese (zh)
Other versions
HK1173291A (en
Inventor
A.劳伦特
E.高蒂尔
P.吉尔伯顿
Original Assignee
交互数字麦迪逊专利控股公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 交互数字麦迪逊专利控股公司 filed Critical 交互数字麦迪逊专利控股公司
Publication of HK1173291A publication Critical patent/HK1173291A/en
Publication of HK1173291B publication Critical patent/HK1173291B/en

Links

Description

同步通过不同网络接收的内容的呈现的解码器及其方法Decoder and method for synchronizing the presentation of content received via different networks

技术领域Technical Field

本发明大体上涉及一种用于解码通过宽带网络接收的音频视频节目的方法,并且具体地涉及一种将通过宽带网络接收的内容的呈现与通过广播网络接收的内容的呈现同步的方法。The present invention generally relates to a method for decoding audio video programs received over a broadband network, and in particular to a method of synchronizing the presentation of content received over a broadband network with the presentation of content received over a broadcast network.

背景技术Background Art

本部分旨在向读者介绍可能与下面描述和/或要求保护的本发明的各个方面有关的技术的各个方面。相信本讨论有助于帮助向读者提供背景技术信息以便促使对本发明的各个方面的更好理解。相应地,应该理解这些陈述应该鉴于此地阅读,并且不作为对现有技术的承认。This section is intended to introduce the reader to various aspects of the technology that may be related to various aspects of the present invention described and/or claimed below. It is believed that this discussion will help provide the reader with background information to facilitate a better understanding of the various aspects of the present invention. Accordingly, it should be understood that these statements should be read in this light and not as admissions of prior art.

在过去的几年中,随着通过宽带因特网协议(IP)网络的TV或视频服务的大量推出(roll out),已经扩展了地面、卫星和有线网络的传统TV广播领域。这些网络是互补的,其中广播分发适配用于实况事件和大量分发和宽带分发适配用于点播、赶上(catch-up)以及个人化服务。这样的互补提供了混合模型的前景,其中平衡每个网络的强度以便以高效的方式提供增强TV和视频服务。可以通过宽带传递的个人化内容来丰富广播事件,这个内容事先用流传输并且推送(push)。这样的混合服务可能需要通过分离的网络传递的分量(component)紧密同步。例示这个精确同步的需要的一个典型示例是正在观看广播节目的用户选择没有被广播但是通过宽带可用的外国音频序列。另一个示例是通过由广播传递另一视频分量来丰富广播内容,根据广播分量该另一个视频分量例如是可分级视频编码(SVC)增强层的多视图视频编码(MVC)分量,以在3D或同一场景的另一视图提出该事件。Over the past few years, the massive rollout of TV and video services over broadband Internet Protocol (IP) networks has expanded the traditional TV broadcast landscape of terrestrial, satellite, and cable networks. These networks complement each other, with broadcast delivery adapted for live events and mass distribution and broadband delivery adapted for on-demand, catch-up, and personalized services. This complementarity offers the prospect of a hybrid model, leveraging the strengths of each network to efficiently deliver enhanced TV and video services. Broadcast events can be enriched with personalized content delivered via broadband, which is previously streamed and pushed. Such hybrid services may require tight synchronization of the components delivered via separate networks. A typical example illustrating the need for this precise synchronization is a user watching a broadcast program selecting a foreign audio sequence that is not broadcast but is available via broadband. Another example is enriching broadcast content by delivering an additional video component via the broadcast, such as a Multiview Video Coding (MVC) component of a Scalable Video Coding (SVC) enhancement layer, to present the event in 3D or in an alternate view of the same scene.

有多种通过宽带传递这个额外分量的方法。第一种基于点播传递的解决方案是使用超文本传输协议(HTTP)流传输,如在文件“HTTP Live Streaming,draft-pantos-http-live-streaming-01-R.Pantos,Apple Inc June 8,2009”中所描述的,或者依赖于推荐RFC3550,“A Transport Protocol for Real-Time Applications”中定义的通过UDP/IP的实时传输协议(RTP)。在这最后一种情况中如实时流协议(RTSP)(在推荐RFC 2326中所描述的)的通信协议与RTP相关联。基于多播传递的另一种解决方案是使用如文件“A TransportProtocol for Real-Time Applications”中定义的RTP协议(RTP/UDP/IP)。There are several ways to deliver this additional component via broadband. A first solution based on on-demand delivery is to use Hypertext Transfer Protocol (HTTP) streaming, as described in the document "HTTP Live Streaming, draft-pantos-http-live-streaming-01-R. Pantos, Apple Inc. June 8, 2009," or to rely on the Real-time Transport Protocol (RTP) over UDP/IP as defined in the recommendation RFC 3550, "A Transport Protocol for Real-Time Applications." In this latter case, a communication protocol such as the Real-Time Streaming Protocol (RTSP) (described in the recommendation RFC 2326) is associated with RTP. Another solution based on multicast delivery is to use the RTP protocol (RTP/UDP/IP) as defined in the document "A Transport Protocol for Real-Time Applications."

在点播传递的情况下,内容的请求可以嵌入表示要传递的第一视听样本的展示时间戳(PTS)的定时信息。当终端向多播流订阅时不是这种情况。终端不能请求给定时间戳的定时信息,并且该行为类似于客户端经受内容传递限制的广播网络。In the case of on-demand delivery, the request for content can embed timing information indicating the presentation timestamp (PTS) of the first audiovisual sample to be delivered. This is not the case when a terminal subscribes to a multicast stream. The terminal cannot request timing information for a given timestamp, and the behavior is similar to that of a broadcast network where the client is subject to content delivery restrictions.

一些网络的特征是其等待时间和其抖动。这意味着通过一个网络与通过另一网络传递内容不采用相同的持续时间。Some networks are characterized by their latency and their jitter. This means that content does not take the same duration to be delivered over one network as it does over another.

广播网络的特定性在于内容在不需要接收器请求任何东西的情况下到达接收器,即,接收器持久地接收内容,并且传递具有有限的抖动,其可以在具有有限尺寸的缓冲器的接收器中处理(treat)。内容传递持续时间包括从服务器到终端通过广播网络传递内容的持续时间以及终端需要用来多路分解、缓冲并且解码内容的持续时间。The specificity of broadcast networks is that content arrives at the receiver without the receiver having to request anything, that is, the receiver receives the content continuously, and the delivery has limited jitter, which can be treated in the receiver with a buffer of limited size. The content delivery duration includes the duration of content delivery from the server to the terminal over the broadcast network and the duration required by the terminal to demultiplex, buffer and decode the content.

宽带网络可以被视为个人化传递网络,由于其仅在接收器请求时传递内容。Broadband networks can be considered personalized delivery networks, as they deliver content only when requested by the receiver.

图1图示通过宽带网络传递节目内容。视频服务器向机顶盒接收器(STB)传递节目内容。机顶盒接收并解码内容以便在显示设备上对其显示。传递可以被分开为4个主要步骤以及对应持续时间:Figure 1 illustrates the delivery of program content over a broadband network. A video server delivers program content to a set-top box (STB). The STB receives and decodes the content in order to display it on a display device. The delivery can be broken down into four main steps and their corresponding durations:

●请求到达服务器需要的持续时间为T1。●The duration required for the request to reach the server is T1.

●服务器对请求进行处理并发射节目内容的持续时间为T2。●The duration for the server to process the request and transmit the program content is T2.

●从服务器到机顶盒的节目内容传递的持续时间为T3。●The duration of program content delivery from the server to the set-top box is T3.

●机顶盒需要用来缓冲、解码和显示节目内容的持续时间为T4。The duration that the set-top box needs to use to buffer, decode and display the program content is T4.

在混合广播宽带环境中的传递不一定暗示时间格式对于所有分量都相同。在MPEG-2传输流格式(通常用于广播网络)中,定时信息基于节目时钟参考(PCR)格式,而网络时间协议(NTP)是用于在实时传输协议(通常用于宽带网络)中编码的流的定时的格式。此外,两个分量可以具有相同的时间格式,而时间参考可以不同(偏移值)。为了补偿分量之间的所提到的定时问题,必须实施一种机制来变换(transpose)其它分量中一些的定时格式和/或参考。通过宽带传递的(多个)分量的定时格式和/或参考与通过广播传递的(多个)分量的定时格式和/或参考对齐(line up),后者为“主”分量。在此处的描述中,估计当定时格式和/或参考不同时,这个定时对准操作隐式地进行以便同步分量,并且当我们引起(evoke)定时值时它们指代相同变换的参考(相同的格式和相同的初始值)中的定时值。这个唯一的时间参考叫做系统时钟。Delivery in a hybrid broadcast-broadband environment does not necessarily imply that the time format is the same for all components. In the MPEG-2 transport stream format (commonly used in broadcast networks), the timing information is based on the Program Clock Reference (PCR) format, while the Network Time Protocol (NTP) is a format used for the timing of streams encoded in the Real-Time Transport Protocol (commonly used in broadband networks). In addition, two components can have the same time format, but the time reference can be different (offset value). In order to compensate for the mentioned timing issues between components, a mechanism must be implemented to transform the timing format and/or reference of some of the other components. The timing format and/or reference of the component(s) delivered via broadband is aligned with the timing format and/or reference of the component(s) delivered via broadcast, the latter being the "master" component. In the description herein, it is estimated that when the timing format and/or reference are different, this timing alignment operation is performed implicitly to synchronize the components, and when we evoke timing values, they refer to timing values in the same transformed reference (same format and same initial value). This unique time reference is called the system clock.

通过广播传递的分量叫做“主分量”而通过宽带传递的分量叫做“个人化分量(personalized component)”。The component delivered via broadcast is called the "main component" and the component delivered via broadband is called the "personalized component".

在此描述传递个人化分量的方法。终端请求个人化分量并且通过双向宽带网络发送个人化分量。传递可以是线性的或是非线性的。A method for delivering a personalized component is described herein. A terminal requests the personalized component and sends the personalized component via a bidirectional broadband network. The delivery can be linear or nonlinear.

线性传递确保终端以相当恒定的速率接收分量。由于抖动网络,其不是精确恒定的。对于要与广播的主分量同步的个人化分量的传递可以考虑两种情况。在展示主分量的对应的帧之前可以接收、解码并展示个人化分量流,或者个人化分量流在之后到达,并且在这种情况下个人化分量的所有帧将没有用处。Linear delivery ensures that the terminal receives the components at a fairly constant rate. Due to network jitter, this is not exactly constant. Two scenarios can be considered for the delivery of personalized components to be synchronized with the broadcast main component. The personalized component stream can be received, decoded, and displayed before the corresponding frames of the main component are displayed, or the personalized component stream arrives after, in which case all frames of the personalized component will be useless.

线性传递机制的典型情况是当终端通过发送请求以加入多播组(如因特网组管理协议(IGMP协议)中定义的)来订阅多播流时。使用多播流传递,终端不能从定义的时间戳接收流。在这种情况下,并且如果个人化分量比主分量的对应的帧到达更晚,则不能同步它们的呈现。A typical case of a linear delivery mechanism is when a terminal subscribes to a multicast stream by sending a request to join a multicast group (as defined in the Internet Group Management Protocol (IGMP) protocol). With multicast streaming, the terminal cannot receive the stream at a defined timestamp. In this case, if the personalized component arrives later than the corresponding frame of the main component, their presentation cannot be synchronized.

实时传输协议(RTP)对于线性传递也是熟知的。RTP协议允许从给定时间戳的内容的请求,所述给定时间戳等于当前接收时间参考加上偏移(offset)。终端估计偏移以便事先请求内容使得在解码和呈现内容之前对其接收。如果不正确地评估了偏移,则个人化分量被接收得太迟以至于不能与主分量同步。从而,客户机必须停止当前流传输的接收并且必须更加准确地评估偏移并且然后基于新估计的偏移值发送新请求。The Real-time Transport Protocol (RTP) is also well-known for linear delivery. The RTP protocol allows requests for content from a given timestamp, which is equal to the current reception time reference plus an offset. The terminal estimates the offset in order to request content in advance so that it is received before decoding and presenting the content. If the offset is estimated incorrectly, the personalized component is received too late to be synchronized with the main component. Therefore, the client must stop receiving the current streaming transmission, must more accurately estimate the offset, and then send a new request based on the newly estimated offset value.

非线性传递是其中终端以非定期方式接收内容的机制。内容的一部分以比其被展示更高的速率被传递。示例中,帧速率接收高于帧速率展示。非线性传递的构思是向接收起初迟于展示的个人化分量的终端提供赶上主分量以便能够在给定的时刻展示的可能性。Non-linear delivery is a mechanism in which a terminal receives content non-periodically. Portions of the content are delivered at a higher rate than they are presented. In one example, the frame rate of reception is higher than the frame rate of presentation. The idea behind non-linear delivery is to provide a terminal that initially receives a personalized component later than the presentation with the possibility of catching up with the main component so that it can be presented at a given moment.

实时流协议(RTSP)服务器也可以以非线性方式传递内容。取决于请求参数,其可以例如在突发(burst)中传递节目内容的第一帧或画面组并且然后以巡航速率(cruisingrate)传递内容。在使用RTSP的情况下,终端请求给定展示时间戳。Real-Time Streaming Protocol (RTSP) servers can also deliver content in a nonlinear fashion. Depending on the request parameters, they can, for example, deliver the first frame or group of pictures of a program in a burst and then deliver the content at a cruising rate. When using RTSP, the terminal requests a given presentation timestamp.

超文本传输协议(HTTP)流传输是另一种非线性传递。个人化分量被分开为许多被称为块(chunk)的连续部分。块是文件或者是包括描述其的一段信息的文件的一部分。所述一段信息可以包括例如时隙、文件名、字节范围、比特率或者任何对于终端解码和呈现块的内容可能有用的其它信息。包含视频的块的编码开始于可以不参照先前帧而解码的关键帧(key-frame)。关键帧可以例如是如MPEG压缩标准(ISO/IEC13818)中定义的I画面(或I帧)。块包含如MPEG压缩中定义的一整组或若干整组画面(GOP)。当使用HTTP流传输接收内容时,终端向服务器请求块。服务器然后尽力而为地发送块。内容被发送至连续突发。Hypertext Transfer Protocol (HTTP) streaming is another nonlinear transmission. The personalized component is divided into many continuous parts called chunks. A chunk is a file or a part of a file that includes a piece of information describing it. The piece of information may include, for example, a time slot, a file name, a byte range, a bit rate, or any other information that may be useful for the terminal to decode and present the content of the chunk. The encoding of the chunk containing the video begins with a key frame that can be decoded without reference to the previous frame. The key frame may be, for example, an I picture (or I frame) as defined in the MPEG compression standard (ISO/IEC13818). A chunk contains a whole group or several whole groups of pictures (GOPs) as defined in MPEG compression. When receiving content using HTTP streaming, the terminal requests chunks from the server. The server then sends chunks on a best-effort basis. The content is sent in continuous bursts.

非线性传递向终端提供以下可能性:通过发送连续请求以便得到开始于关键帧的在系统时钟方面与主分量同步的个人化内容的一些片段,解码时间参考并且展示时间参考,来将个人化分量的呈现与主分量的呈现同步。Non-linear transmission offers the terminal the possibility to synchronize the presentation of the personalized component with that of the main component by sending successive requests for segments of the personalized content starting at a key frame synchronized with the main component in terms of the system clock, decoding the time reference and presenting the time reference.

这样的同步的一个缺点在于:当终端请求要与主分量同步个人化分量并且接收开始于关键帧(对于其解码和展示时间参考指示接收太迟以至于不能与主分量同步)内容时,丢弃的内容可能与就呈现而言重要的时间范围(达到许多秒)对应。终端然后必须发送一个或更多新请求并且接收新个人化流内容直至解码和展示时间参考指示在终端中可以同步。One disadvantage of such synchronization is that when a terminal requests a personalized component to be synchronized with the main component and receives content starting at a key frame (for which the decoding and presentation time reference indications were received too late to be synchronized with the main component), the discarded content may correspond to a time range that is important for presentation (up to many seconds). The terminal must then send one or more new requests and receive new personalized stream content until the decoding and presentation time reference indications can be synchronized in the terminal.

发明内容Summary of the Invention

本发明的目的在于克服现有技术的缺点。更具体地,本发明提供将个人化分量的呈现与主分量的呈现同步所需的延迟的优化。The object of the present invention is to overcome the drawbacks of the prior art. More specifically, the present invention provides for an optimization of the delay required to synchronize the presentation of a personalized component with the presentation of a main component.

在分量的混合广播和宽带传递需要紧密的同步的环境中,本发明提出一种显著减少访问点播分量(个人化分量)的等待时间来增强用户体验的方法。本发明的方法的使用因此最小化时间参考参数的不良估计的影响,依据时间参考参数必须向终端发送点播(个人化)分量以便与主分量同步。在这种方法中,即便通过宽带传递的分量的帧在当展示要同时呈现的广播内容帧时的时刻之后到达,也处理它们。该方法基于以下事实:宽带分量的传递帧速率高于展示帧速率,使得,在给定时刻,对于其系统时钟参考与广播分量的系统时钟参考一致的宽带分量的一部分,可以在广播分量的对应部分同时展示。In an environment where hybrid broadcast and broadband delivery of components requires tight synchronization, the present invention proposes a method for significantly reducing the latency for accessing on-demand components (personalized components) in order to enhance the user experience. The use of the method of the present invention thus minimizes the impact of bad estimates of the time reference parameters according to which the on-demand (personalized) components must be sent to the terminal in order to be synchronized with the main component. In this method, even if the frames of the component delivered via broadband arrive after the moment when the broadcast content frames to be presented simultaneously are presented, they are processed. The method is based on the fact that the delivery frame rate of the broadband component is higher than the presentation frame rate, so that, at a given moment, a part of the broadband component whose system clock reference coincides with the system clock reference of the broadcast component can be presented simultaneously with the corresponding part of the broadcast component.

本发明的方法忽视其中帧以由解码时间戳给定的节奏解码并且其中系统地呈现解码的帧的视频解码器的通常行为。该方法尽可能快地解码晚到的宽带分量的一组画面的第一帧,但不对其进行呈现。因此简单地不呈现这些帧。但是,因为对不是关键帧的解码需要参照一个或更多先前或之后帧来解码,所以被解码但未被呈现的帧用于准时呈现的该组画面的其它帧的解码。The method of the present invention disregards the typical behavior of video decoders, in which frames are decoded at a cadence given by decoding timestamps and decoded frames are systematically presented. The method decodes the first frame of a group of pictures of the late-arriving wideband component as quickly as possible, but does not present it. Therefore, these frames are simply not presented. However, because decoding of non-key frames requires reference to one or more preceding or following frames, the decoded but not presented frames are used to decode the remaining frames of the group of pictures that are presented on time.

本发明的方法用于解码通过宽带网络接收的第二节目内容,节目内容的呈现与呈现第一节目内容同步,该方法包括以下步骤:关于节目时钟参考解码第一节目内容,关于节目时钟参考解码第二节目内容,所述第二节目内容包括与解码时间信息以及展示时间信息相关联的连续第二帧。该方法还包括以下步骤:当解码时间信息次于节目时钟参考时,解码第二节目内容的第二帧,以及当展示时间信息使得第二帧的呈现能够与第一节目内容的呈现同步时呈现解码的第二帧。A method of the present invention is for decoding second program content received via a broadband network, wherein presentation of the program content is synchronized with presentation of first program content. The method comprises the following steps: decoding the first program content with respect to a program clock reference; decoding second program content with respect to the program clock reference, wherein the second program content includes a second consecutive frame associated with decoding time information and presentation time information. The method further comprises the following steps: decoding a second frame of the second program content when the decoding time information is later than the program clock reference; and presenting the decoded second frame when the presentation time information enables presentation of the second frame to be synchronized with presentation of the first program content.

根据本发明的实施例,解码第二帧的步骤包括以下步骤:读取与第二帧中的一个相关联的解码时间戳,以及根据解码时间戳和节目时钟参考之间的比较结果来解码第二帧。According to an embodiment of the invention, the step of decoding the second frames comprises the steps of reading a decoding timestamp associated with one of the second frames, and decoding the second frame based on a comparison between the decoding timestamp and a program clock reference.

根据本发明的实施例,呈现解码的第二帧的步骤包括以下步骤:读取与一个第二帧相关联的展示时间戳,以及根据展示时间戳和节目时钟参考之间的比较结果来呈现第二帧。According to an embodiment of the invention, the step of presenting the decoded second frame comprises the steps of reading a presentation timestamp associated with a second frame and presenting the second frame based on a comparison between the presentation timestamp and a program clock reference.

根据本发明的实施例,第一节目内容包括:与解码时间信息和展示时间信息相关联的连续第一帧。According to an embodiment of the present invention, the first program content includes: consecutive first frames associated with decoding time information and presentation time information.

根据本发明的实施例,解码时间信息包括解码时间戳。According to an embodiment of the present invention, the decoding time information includes a decoding timestamp.

根据本发明的实施例,展示时间信息包括展示戳。According to an embodiment of the present invention, the presentation time information includes a presentation stamp.

根据本发明的实施例,通过第一解码器装置从广播网络接收第一节目内容,并且通过第二解码器装置从宽带网络接收第二节目内容。According to an embodiment of the present invention, first program content is received from a broadcast network by a first decoder device, and second program content is received from a broadband network by a second decoder device.

本发明还关注解码器装置,其包括:解码部件,用于关于节目时钟参考解码从宽带网络接收的节目内容,所述节目内容包括与解码时间信息和展示时间信息相关联的连续帧。解码器装置的解码部件被适配用于当解码时间信息次于节目时钟参考时来解码帧,并且解码部件还包括:用于当展示时间信息优于或者等于节目时钟参考时呈现解码帧的部件。The present invention also concerns a decoder apparatus comprising: decoding means for decoding program content received from a broadband network with respect to a program clock reference, the program content comprising consecutive frames associated with decoding time information and presentation time information. The decoding means of the decoder apparatus is adapted to decode the frames when the decoding time information is inferior to the program clock reference, and the decoding means further comprises means for presenting the decoded frames when the presentation time information is superior to or equal to the program clock reference.

根据本发明的实施例,解码器装置还包括:滤波模块,其被适配解析解码时间信息和展示时间信息,用于根据将解码时间信息和展示信息分别相比较于节目时钟参考之间的比较结果,以便对帧进行滤波。According to an embodiment of the present invention, the decoder device further comprises: a filtering module adapted to parse the decoding time information and the presentation time information, for filtering the frame according to a comparison result between the decoding time information and the presentation information and the program clock reference respectively.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

以非限制性方式,参照附图,借助于以下实施例和执行示例,将更好地理解和图示本发明,附图中:The invention will be better understood and illustrated by means of the following embodiments and execution examples, with reference to the accompanying drawings, in which:

图1图示通过宽带网络的传递;Figure 1 illustrates delivery over a broadband network;

图2是遵从于本发明第一实施例的系统的框图;FIG2 is a block diagram of a system according to a first embodiment of the present invention;

图3是遵从于本发明第一实施例的接收器/解码器的框图;FIG3 is a block diagram of a receiver/decoder according to a first embodiment of the present invention;

图4图示根据本发明第一实施例的加速解码的第一种情况;FIG4 illustrates a first situation of accelerated decoding according to the first embodiment of the present invention;

图5图示根据本发明第一实施例的加速解码的第二种情况;FIG5 illustrates a second situation of accelerated decoding according to the first embodiment of the present invention;

图6是描述根据本发明第一实施例的解码的方法的图;FIG6 is a diagram describing a decoding method according to a first embodiment of the present invention;

图7是根据本发明第二实施例的接收器/解码器的框图。FIG7 is a block diagram of a receiver/decoder according to a second embodiment of the present invention.

在图2、图3和图7中,所表示的方框为单纯功能实体,其不必与物理分离实体对应。即,可以以硬件或软件形式对其开发,或者在一个或若干个集成电路中实现。In Figures 2, 3 and 7, the blocks represented are purely functional entities, which do not necessarily correspond to physically separate entities, i.e. they can be developed in the form of hardware or software, or implemented in one or several integrated circuits.

具体实施方式DETAILED DESCRIPTION

已经了解到已经对本发明的附图和描述进行了简化以便例示有关用于清楚地理解本发明的元件,同时为简要目的,消除典型数字多媒体内容传递方法和系统中发现的许多其它元件。然而,因为这样的元件在技术中已知,所以在此不提供这样的元件的详细讨论。在此的公开针对本领域技术人员已知的所有的这样的变型和修改。It is understood that the drawings and description of the present invention have been simplified to illustrate relevant elements for a clear understanding of the present invention and, for the sake of brevity, to eliminate many other elements found in typical digital multimedia content delivery methods and systems. However, because such elements are known in the art, a detailed discussion of such elements is not provided herein. The disclosure herein is intended to encompass all such variations and modifications known to those skilled in the art.

图2图示根据本发明第一实施例的网络架构。广播定时被考虑为参考并且宽带网络被适配用于同步。视频源1向编码器2传递非编码主分量节目。编码器2编码主分量并且将其发送至发射器3。通过发送器3广播主分量可以与通过编码器2的编码同步完成但是也可以迟于编码器2的编码。主分量通过空中被广播至接收器/解码器6。编码器2还向点播服务器4提供编码的个人化分量节目。个人化分量与主分量同步。编码器2可以在编码期间提供个人化分量,但是个人化分量还可以在点播服务器4上已经可用。其可以在与要广播的主分量有关的个人化分量的数据库中可用。通过编码器2同步两个分量的时间参考信息(诸如,解码时间戳、展示时间戳和节目时钟参考)。通过编码器2对齐定时格式和/或参考的方式不在范围以内。Figure 2 illustrates a network architecture according to a first embodiment of the present invention. The broadcast timing is taken into account as a reference and the broadband network is adapted for synchronization. A video source 1 delivers a non-encoded main component program to an encoder 2. Encoder 2 encodes the main component and sends it to a transmitter 3. Broadcasting the main component by transmitter 3 can be done synchronously with the encoding by encoder 2 but can also be done later than the encoding by encoder 2. The main component is broadcast over the air to a receiver/decoder 6. Encoder 2 also provides an encoded personalized component program to an on-demand server 4. The personalized component is synchronized with the main component. Encoder 2 can provide the personalized component during encoding, but the personalized component can also be already available on the on-demand server 4. It can be available in a database of personalized components related to the main component to be broadcast. Time reference information of the two components (such as decoding timestamps, presentation timestamps and program clock reference) is synchronized by encoder 2. The way in which the timing formats and/or references are aligned by encoder 2 is not within the scope.

接收器/解码器6在来自用户的初始请求时通过宽带网络5向点播服务器4请求个人化分量。然后点播服务器4通过宽带网络传递个人化分量到接收器/解码器6。接收器/解码器6处理个人化分量的加速解码阶段(accelerated decoding phase)以便将其呈现与发送器3广播的主分量的呈现同步。以同步的方式呈现两个分量并且通过接收器/解码器6输出这两个分量以便在显示设备7上显示。Upon initial request from a user, receiver/decoder 6 requests the personalized component from on-demand server 4 via broadband network 5. On-demand server 4 then delivers the personalized component to receiver/decoder 6 via the broadband network. Receiver/decoder 6 processes the accelerated decoding phase of the personalized component to synchronize its presentation with the presentation of the main component broadcast by transmitter 3. Both components are presented in a synchronized manner and output by receiver/decoder 6 for display on display device 7.

根据本发明的实施例,将个人化分量和主分量的同步定义成本领域技术人员共用的。换言之,如果主分量和个人化分量二者是视频内容,那么同步例如与个人化分量的呈现处理GOP的事实对应,该GOP包括展示时间参考(用于定义展示时间),其与用于呈现主分量而处理的GOP中包括的展示时间参考接近。如果分别属于第一和第二视频内容的两个GOP在几秒钟或更短的时间范围内至少部分地都被呈现,则两个视频分量可以例如被认为就呈现而言同步。关于音频和视频分量的同步,同步基于已经熟知的“嘴唇同步(lip sync)”同步,其中包括声音作品的音频流应该与正在说话(或正在唱歌)的人的嘴唇的运动同步。“嘴唇同步”的目标在于具有嘴唇运动和唱出或说出的声音作品的匹配。According to an embodiment of the present invention, the synchronization of the personalized component and the main component is defined as common to those skilled in the art. In other words, if both the main component and the personalized component are video contents, the synchronization corresponds, for example, to the fact that the presentation of the personalized component processes a GOP comprising a presentation time reference (for defining the presentation time) which is close to the presentation time reference comprised in the GOP processed for presenting the main component. The two video components can, for example, be considered to be synchronized with respect to presentation if both GOPs, respectively belonging to the first and second video contents, are presented at least partially within a time range of a few seconds or less. With regard to the synchronization of the audio and video components, the synchronization is based on the already well-known "lip sync" synchronization, in which the audio stream comprising the sound work should be synchronized with the movements of the lips of the person who is speaking (or singing). The goal of "lip sync" is to have a match between the lip movements and the sung or spoken sound work.

图3图示根据本发明第一实施例的接收器/解码器6。解码器具有两个输入接口。第一输入接口601被连接用于接收广播主分量。第二输入接口602被连接用于接收通过宽带网络传递的个人化分量。两个分量都被作为通过节目标识符识别的并且包含一些连续画面组(GOP)的连续分组被发送。广播输入接口601和宽带输入接口602实现它们各自接收的内容的多路分解并且在接收缓冲器603的专用缓冲区域中存储与每个分量对应的数据。每个GOP开始于与解码时间戳(DTS)以及展示时间戳(PTS)相关联的所谓的关键帧的第一帧。第一帧解码器607通过读取接收缓冲器603中的主分量的分组来处理正常解码。当从广播输入接口601以分组接收的关键帧具有等于当前节目时钟参考(PCR)的解码时间戳时,第一帧解码器607操作帧的解码并且在帧缓冲器604中存储对应的解码帧。当关键帧的展示时间戳等于PCR值时,第一帧解码器607还读取帧缓冲器604中的帧并且传输显示缓冲器605中的关键帧。显示输出接口606读取显示缓冲器的内容并且输出帧到连接的显示设备(未示出)。显示缓冲器中解码和传输的处理对于来自广播输入接口的当前GOP的连续帧相同直至通过第一帧解码器607在接收缓冲器603中读取下一关键帧。第一帧解码器607通过当GOP的关键帧的DTS等于PCR值时开始解码一组画面,并且通过当关键帧的PTS等于PCR值时开始展示显示缓冲器605中的解码帧,来实现被广播的主分量的解码和显示。FIG3 illustrates a receiver/decoder 6 according to a first embodiment of the present invention. The decoder has two input interfaces. A first input interface 601 is connected to receive a broadcast main component. A second input interface 602 is connected to receive a personalized component delivered via a broadband network. Both components are transmitted as consecutive packets identified by program identifiers and containing a number of consecutive groups of pictures (GOPs). The broadcast input interface 601 and the broadband input interface 602 demultiplex the content they receive and store the data corresponding to each component in dedicated buffer areas in a receive buffer 603. Each GOP begins with the first frame of a so-called key frame, which is associated with a decoding timestamp (DTS) and a presentation timestamp (PTS). A first frame decoder 607 performs normal decoding by reading packets of the main component from the receive buffer 603. When a key frame received as a packet from the broadcast input interface 601 has a decoding timestamp equal to the current program clock reference (PCR), the first frame decoder 607 decodes the frame and stores the corresponding decoded frame in a frame buffer 604. When the presentation timestamp of the key frame equals the PCR value, the first frame decoder 607 also reads the frame in the frame buffer 604 and transmits the key frame in the display buffer 605. The display output interface 606 reads the contents of the display buffer and outputs the frame to a connected display device (not shown). The decoding and transmission process in the display buffer is the same for consecutive frames of the current GOP from the broadcast input interface until the next key frame is read in the receive buffer 603 by the first frame decoder 607. The first frame decoder 607 implements the decoding and display of the broadcasted main component by starting to decode a group of pictures when the DTS of the key frame of the GOP equals the PCR value, and by starting to display the decoded frame in the display buffer 605 when the PTS of the key frame equals the PCR value.

第二帧解码器608通过解码在接收缓冲器603中读取的所有对应的帧直至关键帧的DTS大于或等于当前PCR值,来操作通过宽带输入接口602接收的个人化分量的解码。对于要与从广播输入接口601接收的对应的广播内容同步呈现的、从宽带输入接口602晚到达的GOP就是这种情况。即使相关联的DTS小于当前PCR值,第二帧解码器608也解码来自接收缓冲器603的帧。在帧缓冲器604中存储解码帧。当对应的PTS等于当前PCR值时,第二帧解码器608也读取与帧缓冲器604中的个人化分量对应的解码帧,并且传输解码器帧到显示缓冲器605。如果个人化分量的帧的相关联的PTS小于当前PTS,则不将该帧复制到显示缓冲器。当DTS信息小于PCR值时第二帧解码器608操作加速解码阶段,并且一旦DTS值等于或大于PCR值第二帧解码器608操作正常解码。The second frame decoder 608 decodes the personalized component received via the broadband input interface 602 by decoding all corresponding frames read from the receive buffer 603 until the DTS of a key frame is greater than or equal to the current PCR value. This is the case for late-arriving GOPs from the broadband input interface 602, which are to be presented synchronously with the corresponding broadcast content received from the broadcast input interface 601. The second frame decoder 608 decodes frames from the receive buffer 603 even if the associated DTS is less than the current PCR value. The decoded frames are stored in the frame buffer 604. When the corresponding PTS equals the current PCR value, the second frame decoder 608 also reads the decoded frame corresponding to the personalized component from the frame buffer 604 and transfers the decoded frame to the display buffer 605. If the associated PTS of a frame of the personalized component is less than the current PTS, the frame is not copied to the display buffer. The second frame decoder 608 operates in an accelerated decoding phase when the DTS information is less than the PCR value, and operates in normal decoding once the DTS value equals or exceeds the PCR value.

图4图示根据本发明第一实施例的加速解码处理。该图示出其中通过宽带网络接收的个人化分量的第一帧太迟以至于不能被解码并且以正常解码速率与主分量同步的情况。因此可以通过使用不考虑DTS值的加速解码阶段来实现两个分量的同步呈现。这样的情况取决于网络等待时间(latency)。该图示出在以第二步骤中的巡航速率发送之前,对于第一步骤中的宽带内容(个人化分量)的缓冲器的填充更快,这是因为宽带网络可以实现以比解码和展示速率更高的速率的发送(突发(burst)模式)。宽带缓冲器填充从当接收到个人化内容的第一数据时的BTS1时间开始。当缓冲器包含足够数据时(例如考虑如MPEG压缩标准定义的发送比特率),在DTS1时间开始加速解码阶段。在加速解码期间,即便帧的对应的DTS信息小于PCR值,也可以对其解码。然后解码速率是比当解码器等待等于DTS的PCR值以便开始帧的解码时的正常模式更高。在所表示的情况中,因为宽带内容不是太迟以至于不能以与广播内容(主分量)同步的方式来呈现,加速解码允许具有一些来自宽带内容具有大于或等于PCR值的PTS值的解码画面。没有丢弃任何用于呈现的解码帧。当加速解码阶段允许在接收缓冲器中存储一些具有DTS信息等于或大于PCR值的画面时,加速解码阶段结束并且以正常速率继续解码。FIG4 illustrates an accelerated decoding process according to a first embodiment of the present invention. The figure illustrates a scenario in which the first frame of a personalized component received over a broadband network is too late to be decoded and synchronized with the main component at the normal decoding rate. Synchronous presentation of the two components can therefore be achieved by using an accelerated decoding phase that disregards the DTS value. This scenario depends on network latency. The figure shows that the buffer for the broadband content (personalized component) in the first step fills faster before being transmitted at the cruise rate in the second step, because the broadband network can transmit at a higher rate than the decoding and presentation rate (burst mode). The broadband buffer filling begins at the BTS1 time when the first data of the personalized content is received. When the buffer contains sufficient data (e.g., considering the transmission bit rate as defined by the MPEG compression standard), the accelerated decoding phase begins at the DTS1 time. During accelerated decoding, a frame can be decoded even if its corresponding DTS information is less than the PCR value. The decoding rate is then higher than in the normal mode, when the decoder waits for a PCR value equal to the DTS value to begin decoding the frame. In the illustrated case, because the broadband content is not too late to be presented in a synchronized manner with the broadcast content (primary component), accelerated decoding allows for some decoded pictures from the broadband content with PTS values greater than or equal to the PCR value. No decoded frames are discarded for presentation. When the accelerated decoding phase allows for some pictures with DTS information equal to or greater than the PCR value to be stored in the receive buffer, the accelerated decoding phase ends and decoding continues at the normal rate.

图5图示根据具有宽带网络等待时间大于图4中所示的情况的本发明的第一实施例的加速解码的情况。宽带网络的等待时间太长使得输入帧太迟以至于不能被解码并且太迟以至于不能在解码的开始被呈现。来自宽带网络的要解码的第一帧从时间BTS1存储在接收缓冲器中。缓冲器的填充速率快于从广播网络接收的内容的填充速率,这是因为宽带网络的突发容量造成的。当接收缓冲器中存在足够的数据时(例如,取决于根据压缩标准的比特率),在DTS1时间,加速解码阶段开始,但是解码帧太迟以至于不能以与广播内容同步的方式呈现。丢弃解码帧而不将其展示,并且仅仅呈现来自广播内容的解码帧。在加速解码期间,在DTSn时间,广播内容的解码帧具有符合PCR值的相关联的PTS值。所以宽带内容和广播内容的呈现可以同步。最后,在DTSi时间,来自宽带网络的输入帧具有根据正常解码处理的要及时解码的相关联的DTS值。加速解码阶段完成并且以正常速率继续解码。Figure 5 illustrates the scenario of accelerated decoding according to the first embodiment of the present invention with broadband network latency greater than that shown in Figure 4 . The broadband network latency is so long that incoming frames are too late to be decoded and too late to be presented at the start of decoding. The first frame to be decoded from the broadband network is stored in the receive buffer at time BTS1. The buffer fills faster than the content received from the broadcast network due to the broadband network's burst capacity. When sufficient data is available in the receive buffer (e.g., depending on the bit rate according to the compression standard), the accelerated decoding phase begins at time DTS1, but the decoded frame is too late to be presented synchronously with the broadcast content. The decoded frame is discarded and not presented, and only the decoded frame from the broadcast content is presented. During the accelerated decoding period, at time DTSn, the decoded frame of the broadcast content has an associated PTS value that matches the PCR value. This allows the presentation of the broadband and broadcast content to be synchronized. Finally, at time DTSi, the incoming frame from the broadband network has an associated DTS value that is decoded in time according to the normal decoding process. The accelerated decoding phase is completed, and decoding continues at the normal rate.

图6是包括加速解码阶段的第二帧解码器解码的方法。第二帧解码器负责从宽带网络接收的个人化分量的解码和呈现。认为在是第二帧解码器的解码处理的开始的步骤S1,在接收缓冲器中接收的第一帧是与解码时间戳和展示时间戳相关联的关键帧。FIG6 illustrates a method for decoding by a second frame decoder including an accelerated decoding phase. The second frame decoder is responsible for decoding and presenting the personalized component received from the broadband network. Assuming that at step S1, which is the beginning of the decoding process of the second frame decoder, the first frame received in the receive buffer is a key frame associated with a decoding timestamp and a presentation timestamp.

在步骤S2,第二帧解码器读取帧并且在步骤S3确定其是否是关键帧。如果其不是关键帧,解码处理继续下一帧而不考虑任何与先前关键帧相关联的解码时间戳值。因此处理经过步骤S6。这种情况与不是关键帧的GOP中的画面对应。在步骤S4,第二帧解码器读取与关键帧相关联的PTS和DTS信息。在步骤S5,第二帧解码器将DTS值与PCR值相比较。如果DTS值小于当前PCR值,则读取帧太迟以至于不能及时解码。因此在步骤S6立即解码帧以便在解码帧缓冲器中对于下一帧的解码可用。在步骤S5,如果帧还不太迟,当DTS大于PCR值时,处理在步骤S5循环直至PCR值大于或等于DTS。正常解码模式(没有加速的)是这种情况。在步骤S7,第二帧解码器将PTS值与PCR值相比较以便定义是必须显示还是丢弃该帧。如果PTS小于PCR值,那么解码帧太迟以至于不能以与主分量同步的方式呈现。处理循环到步骤S2。如果PTS大于或等于PCR值,那么帧还不太迟并且必须以PCR及时呈现。处理在步骤S8上循环直至PCR大于或等于PTS。当达到这个条件时,在步骤S9,第二帧解码器将帧从解码帧缓冲器复制到显示缓冲器用于呈现。处理然后在步骤S2上循环。In step S2, the second frame decoder reads a frame and determines in step S3 whether it is a key frame. If it is not a key frame, the decoding process continues with the next frame without considering any decoding timestamp value associated with the previous key frame. Therefore, the process proceeds to step S6. This situation corresponds to a picture in a GOP that is not a key frame. In step S4, the second frame decoder reads the PTS and DTS information associated with the key frame. In step S5, the second frame decoder compares the DTS value with the PCR value. If the DTS value is less than the current PCR value, the frame is read too late to be decoded in time. Therefore, in step S6, the frame is immediately decoded so that it is available in the decoded frame buffer for decoding the next frame. In step S5, if the frame is not too late, when the DTS value is greater than the PCR value, the process loops through step S5 until the PCR value is greater than or equal to the DTS. This is the case in normal decoding mode (without acceleration). In step S7, the second frame decoder compares the PTS value with the PCR value to determine whether the frame must be displayed or discarded. If the PTS value is less than the PCR value, the decoded frame is too late to be presented in a manner synchronized with the main component. The process loops back to step S2. If the PTS is greater than or equal to the PCR value, then the frame is not too late and must be presented in time with the PCR. The process loops at step S8 until the PCR is greater than or equal to the PTS. When this condition is met, at step S9, the second frame decoder copies the frame from the decoded frame buffer to the display buffer for presentation. The process then loops at step S2.

第二帧解码器使用的解码方法然后是用于解码通过宽带网络接收的第二节目内容的方法,第二节目内容的呈现为要与第一节目内容的呈现同步,第一节目内容通过广播网络接收。方法包括以下步骤:关于节目时钟参考解码第一节目内容,关于节目时钟参考解码第二节目内容,所述第二节目内容包括与解码时间信息以及展示时间信息相关联的连续第二帧。该方法特征在于其还包括以下步骤:当解码时间信息次于节目时钟参考时,解码第二帧(S4,S5,S6),以及当展示时间信息使得第二帧的呈现可以与第一节目内容的呈现同步时呈现解码第二帧(S8,S9)。The decoding method used by the second frame decoder is then a method for decoding second program content received via a broadband network, the presentation of the second program content being synchronized with the presentation of first program content, the first program content being received via a broadcast network. The method comprises the following steps: decoding the first program content with respect to a program clock reference, decoding the second program content with respect to the program clock reference, the second program content comprising a second consecutive frame associated with decoding time information and presentation time information. The method is characterized in that it further comprises the following steps: decoding the second frame (S4, S5, S6) when the decoding time information is later than the program clock reference, and presenting the decoded second frame (S8, S9) when the presentation time information allows the presentation of the second frame to be synchronized with the presentation of the first program content.

根据实施例的变型,通过两个分离的装置实现主分量和个人化分量的解码和呈现。两个装置的每一个都包括用于接收、解码和呈现相关联的分量的部件。解码个人化分量的装置使用非传统解码,其允许关于节目时钟参考解码从宽带网络接收的节目内容并且该节目内容包括与解码时间信息以及展示时间信息相关联的连续帧。解码个人化分量的装置的解码部件被适配用于当解码时间信息次于(inferior to)节目时钟参考时对帧解码,并且包括用于当对应展示时间信息优于(superior to)或者等于节目时钟参考时呈现解码帧的部件。According to a variant of the embodiment, decoding and presentation of the main component and the personalized component are achieved by two separate devices. Each of the two devices includes means for receiving, decoding and presenting the associated component. The device for decoding the personalized component uses non-traditional decoding that allows decoding of program content received from a broadband network with respect to a program clock reference and the program content includes consecutive frames associated with decoding time information and presentation time information. The decoding means of the device for decoding the personalized component are adapted to decode frames when the decoding time information is inferior to the program clock reference and include means for presenting decoded frames when the corresponding presentation time information is superior to or equal to the program clock reference.

在这种情况下,两个装置包括用于交换关于正在被接收和呈现的当前节目的解码和呈现的信息的部件。具体地,解码个人化分量的装置必须知道当前正在解码和呈现主分量的哪个部分以便选择/请求来自远程服务器的个人化分量的对应片段。由接收并解码主分量的装置发送到接收并解码个人化分量的装置的信息是,例如,节目中的时间索引、用于呈现的节目时钟参考值、或者允许识别当前解码和呈现的主分量的当前部分的任何其它值。In this case, both devices include means for exchanging information about the decoding and presentation of the current program being received and presented. Specifically, the device decoding the personalized component must know which portion of the main component is currently being decoded and presented in order to select/request the corresponding segment of the personalized component from the remote server. The information sent by the device receiving and decoding the main component to the device receiving and decoding the personalized component is, for example, a time index within the program, a program clock reference value for presentation, or any other value that allows identification of the current portion of the main component currently being decoded and presented.

这样的装置可以包括滤波模块,其被适配用于解析解码时间信息和展示时间信息,以便根据解码时间信息和展示信息相比较于节目时钟参考之间的比较结果来对帧进行滤波。Such an apparatus may comprise a filtering module adapted to parse the decoding time information and the presentation time information in order to filter the frames based on a comparison between the decoding time information and the presentation information compared to a program clock reference.

根据实施例的这个变型的用于解码个人化分量的装置例如是与家用网关连接的因特网平板电脑(internet tablet),允许用户观看多视图节目的视图,主视图在诸如例如地面数字电视机的另一装置上广播和呈现。The device for decoding the personalized component according to this variant of the embodiment is for example an internet tablet connected to a home gateway, allowing the user to watch views of a multi-view program, the main view being broadcast and presented on another device such as for example a terrestrial digital television set.

图7图示根据本发明第二实施例的接收器/解码器6。个人化分量(来自宽带网络)由包含许多组画面的连续块组成,滤波模块609通过读取块和/或画面组内的某些时间参考信息来对在宽带输入接口602上接收的块内容进行滤波。滤波模块609将接收的内容里的时间信息与接收器/解码器6使用的节目时间参考相比较,以进行解码和呈现。如果滤波模块检测到块或GOP太迟以至于不能将其内容的呈现与接收的广播内容的呈现同步,则不将GOP或块发送到接收缓冲器。这避免第二帧解码器608解码接收缓冲器603中出现的、不能与广播内容同步的内容。这个滤波使得两个分量的呈现有可能提前。FIG7 illustrates a receiver/decoder 6 according to a second embodiment of the invention. The personalized component (coming from the broadband network) consists of a series of blocks containing a number of groups of pictures. The filtering module 609 filters the block content received on the broadband input interface 602 by reading certain time reference information within the blocks and/or groups of pictures. The filtering module 609 compares the time information in the received content with the program time reference used by the receiver/decoder 6 for decoding and presentation. If the filtering module detects that a block or GOP is too late to synchronize the presentation of its content with the presentation of the received broadcast content, the GOP or block is not sent to the receive buffer. This prevents the second frame decoder 608 from decoding content present in the receive buffer 603 that cannot be synchronized with the broadcast content. This filtering makes it possible to present both components earlier.

根据本发明第三实施例,通过双向宽带网络接收的个人化分量是包括音频样本的连续块的音频内容。音频样本的块的每一个都包括用于其解码和呈现的时间参考信息。只有如果时间参考信息指示样本可以被及时解码以便以与主分量同步的方式呈现,接收器/解码器滤波器的滤波模块才解析时间信息并且向接收缓冲器传输块。According to a third embodiment of the present invention, the personalized component received via a bidirectional broadband network is audio content comprising consecutive blocks of audio samples. Each block of audio samples includes time reference information for its decoding and presentation. A filtering module of a receiver/decoder filter parses the time information and transmits the block to a receive buffer only if the time reference information indicates that the sample can be decoded in time for presentation in synchronization with the main component.

显然地,本发明不限于包括被承载作为连续画面组或块的视频或音频的主分量和个人化分量。本发明关注包括在接收器中节目内容的解码和展示所需的、可以与节目时钟参考(系统时钟)相比较的时间参考信息的所有同步节目内容。Obviously, the present invention is not limited to main components and personalized components including video or audio carried as successive groups of pictures or blocks. The present invention concerns all synchronized program content including time reference information that can be compared with a program clock reference (system clock) required for decoding and presentation of the program content in a receiver.

说明书、权利要求书和附图中公开的引用可以被单独提供或以任何适当方式提供。在适当处,可以以硬件、软件或二者的结合实现特征。References disclosed in the specification, claims and drawings may be provided independently or in any appropriate manner.Where appropriate, features may be implemented in hardware, software or a combination of both.

在此对“一个实施例”或“实施例”的引用意味着结合该实施例所描述的具体特征、结构、或特性可以被包括到本发明的至少一个实现方式中。短语“在一个实施例中”在说明书各处的出现不必全部指代相同的实施例,单独或可替换实施例也不必与其它实施例彼此排斥。Reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one implementation of the invention. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments necessarily mutually exclusive of other embodiments.

Claims (10)

1.一种用于解码从宽带网络接收的节目内容的方法,所述节目内容的呈现与从广播网络接收的另一节目内容的呈现同步用于两个节目的同步呈现,所述另一节目内容关于节目时钟参考解码,所述节目内容包括与展示时间信息相关联的连续帧,所述连续帧包括在所述节目内容的帧的组中,所述方法包括:1. A method for decoding program content received from a broadband network, the presentation of said program content being synchronized with the presentation of another program content received from a broadcast network for the synchronized presentation of the two programs, said other program content being decoded with respect to a program clock reference, said program content comprising consecutive frames associated with display time information, said consecutive frames being included in a group of frames of said program content, the method comprising: -当与所述接收的节目内容的所述连续帧中的关键帧相关联的解码时间信息次于所述节目时钟参考时,解码所述关键帧,以及- When the decoding timing information associated with a keyframe in the consecutive frames of the received program content is lower than the program clock reference, the keyframe is decoded, and 通过使用所述解码的关键帧,解码包括所述解码的关键帧的组中的帧。Frames in a group containing the decoded keyframes are decoded by using the decoded keyframes. 2.如权利要求1所述的方法,其特征在于,所述方法包括:2. The method as described in claim 1, wherein the method comprises: 当所述关联的展示时间信息大于或等于所述节目时钟参考时,呈现所述解码的组的帧。When the associated display time information is greater than or equal to the program clock reference, the frames of the decoded group are presented. 3.如权利要求1所述的方法,其特征在于,所述另一节目内容包括与展示时间信息相关联的连续帧。3. The method of claim 1, wherein the other program content comprises consecutive frames associated with display time information. 4.如权利要求1所述的方法,其特征在于,所述解码时间信息包括解码时间戳。4. The method as described in claim 1, wherein the decoding time information includes a decoding timestamp. 5.如权利要求1所述的方法,其特征在于,所述展示时间信息包括展示时间戳。5. The method as described in claim 1, wherein the display time information includes a display timestamp. 6.一种解码器装置,用于解码从宽带网络接收的节目内容,所述节目内容的呈现与从广播网络接收的另一节目内容的呈现同步用于两个节目的同步呈现,所述另一节目内容关于节目时钟参考解码,所述节目内容包括与展示时间信息相关联的连续帧,所述连续帧包括在所述节目内容的帧的组中,6. A decoder apparatus for decoding program content received from a broadband network, the presentation of said program content being synchronized with the presentation of another program content received from a broadcast network for the synchronized presentation of the two programs, said other program content being decoded with respect to a program clock reference, said program content comprising consecutive frames associated with display time information, said consecutive frames being included in a group of frames of said program content. 其特征在于,解码器装置包括帧解码器,所述帧解码器被适配用于:The decoder device is characterized in that it includes a frame decoder adapted for: -解码所述连续帧,所述解码操作于所述连续帧的关键帧,所述连续帧的该关键帧与次于所述节目时钟参考地解码时间信息相关联,所述关键帧开始所述节目内容的帧的组,所述关键帧被适配以不参照先前帧而解码,- Decoding the consecutive frames, the decoding operation being performed on a key frame of the consecutive frames, the key frame of the consecutive frames being associated with decoding time information following the program clock reference, the key frame being the beginning of a group of frames of the program content, the key frame being adapted to be decoded without reference to previous frames. 通过使用所述解码的关键帧,解码包括所述解码的关键帧的组中的帧。Frames in a group containing the decoded keyframes are decoded by using the decoded keyframes. 7.如权利要求6所述的解码器装置,其特征在于,7. The decoder device as claimed in claim 6, characterized in that, 所述帧解码器被适配用于当开始所述帧的组的关键帧的解码时间信息次于所述节目时钟参考时,解码所述帧的组中一组的帧;The frame decoder is adapted to decode frames in a group of frames when the decoding time information of the key frame of the group that begins the frame is later than the program clock reference. 所述解码器装置包括呈现部件,用于当所述解码的组的所述帧的展示时间信息大于或等于所述节目时钟参考时,呈现所述解码的组的帧。The decoder device includes a presentation component for presenting frames of the decoded group when the display time information of the frames of the decoded group is greater than or equal to the program clock reference. 8.如权利要求7所述的解码器装置,其特征在于,其包括:8. The decoder device as claimed in claim 7, characterized in that it comprises: 滤波模块(609),其被适配用于解析所述解码时间信息和展示时间信息,用于根据将所述解码时间信息和所述展示时间信息相比较于节目时钟参考之间的比较结果,对所述连续帧进行滤波。A filtering module (609) is adapted to parse the decoding time information and the display time information, and to filter the consecutive frames based on a comparison result between the decoding time information and the display time information and a program clock reference. 9.如权利要求6所述的解码器装置,其特征在于,其包括:9. The decoder device as claimed in claim 6, characterized in that it comprises: 广播输入接口,适配用于从所述广播网络接收所述另一节目内容;以及A broadcast input interface, adapted for receiving the other program content from the broadcast network; and 另一帧解码器,适配用于关于所述节目时钟参考解码所述另一节目内容。Another frame decoder, adapted for decoding the other program content with respect to the program clock reference. 10.如权利要求9所述的解码器装置,其特征在于,所述另一节目内容包括与展示时间信息相关联的连续帧。10. The decoder apparatus of claim 9, wherein the other program content comprises consecutive frames associated with display time information.
HK13100359.0A 2011-03-11 2013-01-10 Decoder and method at the decoder for synchronizing the rendering of contents received through different networks HK1173291B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP11305271.6 2011-03-11

Publications (2)

Publication Number Publication Date
HK1173291A HK1173291A (en) 2013-05-10
HK1173291B true HK1173291B (en) 2020-03-27

Family

ID=

Similar Documents

Publication Publication Date Title
US10063938B2 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
KR101727050B1 (en) Method for transmitting/receiving media segment and transmitting/receiving apparatus thereof
KR101797507B1 (en) Media content transceiving method and transceiving apparatus using same
US9800908B2 (en) Synchronized data processing of broadcast streams between receivers, including synchronized data processing between a receiver that is in the process of processing a stream and a receiver that wants to join the stream
CN102752669A (en) Transfer processing method and system for multi-channel real-time streaming media file and receiving device
US20150109411A1 (en) Image playback apparatus for 3dtv and method performed by the apparatus
Howson et al. Second screen TV synchronization
EP2814256B1 (en) Method and apparatus for modifying a stream of digital content
JP5767638B2 (en) Apparatus and method for channel selection of MPEG (Moving Pictures Expert Group) transport stream (MPEG-TS)
AU2015204359B2 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
Köhnen et al. A DVB/IP streaming testbed for hybrid digital media content synchronization
HK1173291B (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
HK1173291A (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks