[go: up one dir, main page]

CN1852429A - Video-code-flow grouped transmission method and system - Google Patents

Video-code-flow grouped transmission method and system Download PDF

Info

Publication number
CN1852429A
CN1852429A CN 200510102176 CN200510102176A CN1852429A CN 1852429 A CN1852429 A CN 1852429A CN 200510102176 CN200510102176 CN 200510102176 CN 200510102176 A CN200510102176 A CN 200510102176A CN 1852429 A CN1852429 A CN 1852429A
Authority
CN
China
Prior art keywords
rtp
video
code
code stream
grouping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200510102176
Other languages
Chinese (zh)
Inventor
林四新
熊联欢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN 200510102176 priority Critical patent/CN1852429A/en
Publication of CN1852429A publication Critical patent/CN1852429A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本发明涉及一种视频码流分组传输方法,包括以下步骤:(a)在服务端将编码器生成的码流根据网络状况封装为RTP分组,并将所述RTP分组传送到接收端;(b)所述接收端将接收的RTP分组解码获得视频数据。本发明还提供一种对应的视频码流分组传输系统。本发明通过根据网络状况将码流封装为大小不同的RTP分组,提高了传输效率,使端到端的延时最小化,从而提高视频传输质量。此外,本发明通过设置重要等级参数,保证了视频质量。

Figure 200510102176

The present invention relates to a video code stream packet transmission method, comprising the following steps: (a) encapsulating the code stream generated by an encoder into RTP packets at the server end according to network conditions, and transmitting the RTP packets to the receiving end; (b) ) The receiving end decodes the received RTP packet to obtain video data. The invention also provides a corresponding video code stream packet transmission system. The invention improves the transmission efficiency by encapsulating code streams into RTP packets of different sizes according to network conditions, minimizes end-to-end delay, and improves video transmission quality. In addition, the present invention ensures the video quality by setting important level parameters.

Figure 200510102176

Description

视频码流分组传输方法及系统Video stream packet transmission method and system

技术领域technical field

本发明涉及数据传输领域,更具体地说,涉及一种视频码流分组传输方法及系统。The present invention relates to the field of data transmission, and more specifically, to a method and system for packet transmission of video streams.

背景技术Background technique

随着IP网络技术和视频、音频编码技术的发展,越来越多种编码格式的视频、音频内容通过IP网络进行传输。With the development of IP network technology and video and audio coding technology, more and more video and audio content in various coding formats are transmitted through the IP network.

现有的视频编码标准技术包括有ITU-T的H.261、H.263、H.264和ISO/IEC的MPEG1的第2部分、MPEG2的第2部分以及MPEG4的第2部分等。现有的视频传输系统包括视频会议和视频电话。这些系统包含了ITU-T的建议H.320、H.323和H.324等,其分别规定了视频会议和视频电话系统在网络上传输的操作方法。Existing video coding standard technologies include H.261, H.263, H.264 of ITU-T and Part 2 of MPEG1, Part 2 of MPEG2 and Part 2 of MPEG4 of ISO/IEC. Existing video transmission systems include video conferencing and video telephony. These systems include ITU-T recommendations H.320, H.323, and H.324, etc., which respectively stipulate the operation methods of video conferencing and video telephone system transmission on the network.

AVS(Audio Videocoding Standard,数字音视频编解码技术标准)是为了适应数字电视广播、因特网流媒体和多媒体通讯等应用中对运动图像压缩技术的需要而制定的,其中第2部分(P2)涉及视频编码技术。AVS-P2本身通过把原始视频数据划分成条带,以宏块为基本编码单位,经过预测、运动估计、差分变换、频域变换、量化和熵编码等功能模块压缩输出码流,此码流在语法上采用了分层结构,可分成图像序列层、图像层、条带层和宏块层等。在每一语法层,都有一个4字节起始码标志符。其中条带是对数据丢失或损坏进行恢复的单元。在此码流中还包含了编解码参数,如图像尺寸、参考图像列表、初始量化参数等。在远程视频通讯中,经过压缩的AVS-P2视频码流通过网络传输到接收端,由接收端根据码流中的参数解码并播放。AVS (Audio Videocoding Standard, digital audio and video codec technology standard) is formulated to meet the needs of motion image compression technology in applications such as digital TV broadcasting, Internet streaming media, and multimedia communications. Part 2 (P2) involves video Coding technology. AVS-P2 itself divides the original video data into strips, takes macroblock as the basic coding unit, and compresses the output code stream through functional modules such as prediction, motion estimation, differential transformation, frequency domain transformation, quantization and entropy coding. Grammatically, a layered structure is adopted, which can be divided into image sequence layer, image layer, strip layer, and macroblock layer. At each syntax level, there is a 4-byte start code identifier. A stripe is a unit for recovering from data loss or corruption. This code stream also includes codec parameters, such as image size, reference image list, initial quantization parameters, etc. In remote video communication, the compressed AVS-P2 video code stream is transmitted to the receiving end through the network, and the receiving end decodes and plays it according to the parameters in the code stream.

为了适应IP网络特点,有效地传输上述视频、音频内容,出现了MPEG2编码内容的IP传输分组方法、MPEG4编码内容的IP传输分组方法、H.263和H.263+编码内容的IP传输分组方法、H.264编码内容的IP传输分组方法等。这些技术通过适配视频内容的特征来最小化端到端的延时,从而提高视频通讯质量。In order to adapt to the characteristics of the IP network and effectively transmit the above-mentioned video and audio content, the IP transmission grouping method of the MPEG2 coded content, the IP transmission grouping method of the MPEG4 coded content, and the IP transmission grouping method of the H.263 and H.263+ coded content have emerged , IP transmission grouping method of H.264 coded content, etc. These technologies minimize the end-to-end delay by adapting to the characteristics of the video content, thereby improving the quality of video communication.

例如,RFC 2250提供了一种主要针对MPEG2的视频分组方案。但该方案的主要缺点是视频分组的信息头参数过多,影响了传输效率的进一步提高。此外,该法案主要依靠底层传输协议来保证传输的质量,缺少针对视频特点的重要内容重点保护等措施。For example, RFC 2250 provides a video packetization scheme primarily for MPEG2. But the main disadvantage of this scheme is that there are too many information header parameters in the video packet, which affects the further improvement of transmission efficiency. In addition, the Act mainly relies on the underlying transmission protocol to ensure the quality of transmission, and lacks measures such as key content protection for video characteristics.

RFC 3984提供了一种主要针对H.264标准的视频分组方案,该方案充分利用了H.264标准规定的网络抽象层单元头(NALU)来构成不同结构的分组。但该方案主要针对符合H.264语法的视频数据,其用于传输非H.264标准的视频数据时,信息头的参数比较少,影响了视频数据的有效传输,特别是一些视频扩展数据的传输。在分组前,必须对非H.264视频数据做一定的转换,接收端的解码器也必须重构这些数据。RFC 3984 provides a video grouping scheme mainly for the H.264 standard, which makes full use of the network abstraction layer unit header (NALU) specified by the H.264 standard to form packets of different structures. However, this solution is mainly aimed at video data that conforms to the H.264 syntax. When it is used to transmit non-H.264 standard video data, the parameters of the information header are relatively small, which affects the effective transmission of video data, especially some video extension data. transmission. Before grouping, non-H.264 video data must be converted to a certain extent, and the decoder at the receiving end must also reconstruct these data.

发明内容Contents of the invention

本发明要解决的技术问题在于,针对现有技术的上述流媒体传输效率较低的缺陷,提供一种新的视频码流分组传输方法及系统。The technical problem to be solved by the present invention is to provide a new video stream packet transmission method and system for the above-mentioned defects of low streaming media transmission efficiency in the prior art.

本发明解决其技术问题所采用的技术方案是:构造一种视频码流分组传输方法,包括以下步骤:The technical solution adopted by the present invention to solve its technical problems is: construct a kind of video stream grouping transmission method, comprise the following steps:

(a)在服务端将编码器生成的码流根据网络状况封装为RTP分组,并将所述RTP分组传送到接收端;(a) encapsulating the code stream generated by the encoder into RTP packets according to network conditions at the server end, and sending the RTP packets to the receiving end;

(b)所述接收端将接收的RTP分组解码获得视频数据。(b) The receiving end decodes the received RTP packet to obtain video data.

在本发明所述的视频码流分组传输方法中,所述步骤(a)包括:In the video code stream packet transmission method of the present invention, said step (a) includes:

(a1)在服务端根据接收端的服务请求将来自编码器的码流置入位于服务端的打包缓冲区;(a1) At the server end, according to the service request of the receiving end, the code stream from the encoder is placed into the packaging buffer located at the server end;

(a2)在服务端通过应用控制器监测网络状况,并使用打包器根据所述网络状况将编码器生成的码流封装为RTP分组;(a2) monitor the network condition through the application controller at the server end, and use the packer to encapsulate the code stream generated by the encoder into RTP packets according to the network condition;

(a3)将所述RTP分组传送到所述接收端。(a3) Transmitting the RTP packet to the receiving end.

在本发明所述的视频码流分组传输方法中,所述步骤(b)包括:In the video code stream packet transmission method of the present invention, said step (b) includes:

(b1)在所述接收端将接收的RTP分组置入位于接收端的接收缓冲区并等待指定时间;(b1) placing the received RTP packet into the receiving buffer at the receiving end at the receiving end and waiting for a specified time;

(b2)将所述接收缓冲区中的RTP分组发送到解码器解码。(b2) Send the RTP packet in the receiving buffer to the decoder for decoding.

在本发明所述的视频码流分组传输方法中,所述步骤(a)中包括向RTP分组中加入重要等级参数以及根据重要等级传送RTP分组的步骤,所述步骤(b)包括有根据RTP分组中的重要等级参数优先解码重要等级高的RTP分组的步骤。In the video code stream packet transmission method of the present invention, said step (a) includes the steps of adding an importance level parameter to the RTP packet and transmitting the RTP packet according to the importance level, and said step (b) includes the step of adding an important level parameter according to the RTP The importance level parameter in the packet preferentially decodes the RTP packet with high importance level.

在本发明所述的视频码流分组传输方法中,所述码流为AVS-P2码流,所述RTP分组中包括有RTP头文件、AVS-P2码流的语法层元素和媒体数据。In the video code stream packet transmission method of the present invention, the code stream is an AVS-P2 code stream, and the RTP packet includes RTP header files, syntax layer elements of the AVS-P2 code stream and media data.

在本发明所述的视频码流分组传输方法中,所述网络状况包括网络带宽、码率及丢包率中的一个或多个,在所述步骤(a)中,服务端所生成的RTP分组的大小随着网络带宽的增大而增大、随着码率的增大而增大、随着丢包率的增大而减小。In the video code stream packet transmission method of the present invention, the network conditions include one or more of network bandwidth, code rate and packet loss rate, and in the step (a), the RTP generated by the server The size of the packet increases with the increase of the network bandwidth, increases with the increase of the code rate, and decreases with the increase of the packet loss rate.

在本发明所述的视频码流分组传输方法中,所述RTP分组包括RTP头和RTP净载,其中RTP净载包括有RTP净载头信息和媒体数据。In the video code stream packet transmission method of the present invention, the RTP packet includes an RTP header and an RTP payload, wherein the RTP payload includes RTP payload header information and media data.

在本发明所述的视频码流分组传输方法中,所述RTP净载头信息包括有首场优先标志、重要首场标志以及逐行帧标志参数。In the video code stream packet transmission method of the present invention, the RTP payload header information includes first field priority flag, important first field flag and progressive frame flag parameters.

在本发明所述的视频码流分组传输方法中,所述步骤(a)中包括使用传递编码时间信息和多视频数据分组封装进行交错分组和视频源切换的步骤。In the video code stream packet transmission method of the present invention, the step (a) includes the steps of using the transfer encoding time information and multi-video data packet encapsulation to perform interleaved grouping and video source switching.

本发明还提供一种视频码流分组传输系统,包括通过网络相连接的服务端和接收端,所述服务端包括有提供码流的码流源、用于监测网络状况的应用控制器以及将来自码流源的码流封装为RTP分组的打包器,所述接收端包括解码来自服务端的所述RTP分组的解码器,其中所述打包器根据应用控制器的监测网络的结果将所述码流封装为特定大小的RTP分组。The present invention also provides a video code stream grouping transmission system, including a server and a receiving end connected through a network, the server includes a code stream source for providing a code stream, an application controller for monitoring network conditions, and a The code stream from the code stream source is encapsulated into a packer for RTP packets, and the receiving end includes a decoder for decoding the RTP packets from the server, wherein the packer converts the code stream according to the results of monitoring the network of the application controller Streams are encapsulated into RTP packets of a certain size.

在本发明所述的视频码流分组传输系统中,所述码流源为将视频文件编码为码流的编码器或编码器组,或者为存储有码流的存储装置。In the video code stream packet transmission system of the present invention, the code stream source is an encoder or an encoder group that encodes a video file into a code stream, or a storage device storing a code stream.

在本发明所述的视频码流分组传输系统中,所述接收端包括有缓存来自服务端的RTP分组的接收缓冲区,所述接收缓冲区将接收的RTP分组缓存预定时间后发送到所述解码器解码。In the video code stream packet transmission system of the present invention, the receiving end includes a receiving buffer for buffering RTP packets from the server, and the receiving buffer buffers the received RTP packets for a predetermined time and sends them to the decoder device decoding.

在本发明所述的视频码流分组传输系统中,所述RTP分组包括RTP头和RTP净载,其中RTP净载包括有RTP净载头信息和媒体数据。In the video code stream packet transmission system of the present invention, the RTP packet includes an RTP header and an RTP payload, wherein the RTP payload includes RTP payload header information and media data.

在本发明所述的视频码流分组传输系统中,所述RTP分组中包括有标识RTP分组重要等级的参数,所述编码器优先解码重要等级高的RTP分组。In the video stream packet transmission system of the present invention, the RTP packet includes a parameter identifying the importance level of the RTP packet, and the encoder preferentially decodes the RTP packet with a high importance level.

在本发明所述的视频码流分组传输系统中,所述码流为AVS-P2码流,所述RTP分组中包括有RTP头文件、AVS-P2码流的语法层元素和媒体数据In the video code stream packet transmission system of the present invention, the code stream is an AVS-P2 code stream, and the RTP packet includes RTP header files, syntax layer elements and media data of the AVS-P2 code stream

在本发明所述的视频码流分组传输系统中,所述RTP分组中包括标识扩展数据出现的参数,所述网络状况包括网络带宽、码率及丢包率中的一个或多个,服务端所生成的RTP分组的大小随着网络带宽的增大而增大、随着码率的增大而增大、随着丢包率的增大而减小。In the video code stream packet transmission system according to the present invention, the RTP packet includes parameters identifying the occurrence of extended data, and the network conditions include one or more of network bandwidth, code rate and packet loss rate, and the server The size of the generated RTP packet increases with the increase of the network bandwidth, increases with the increase of the code rate, and decreases with the increase of the packet loss rate.

本发明的视频码流分组传输和系统,通过根据网络状况将码流封装为大小不同的RTP分组,提高了传输效率,使端到端的延时最小化,从而提高视频传输质量。此外,本发明通过设置重要等级参数,保证了视频质量。The video code stream packet transmission and system of the present invention, by encapsulating the code stream into RTP packets of different sizes according to network conditions, improves transmission efficiency, minimizes end-to-end delay, and improves video transmission quality. In addition, the present invention ensures the video quality by setting important level parameters.

此外,本发明通过传递编码时间信息和多视频数据分组封装进行交错分组和视频源切换的方法,提高了错误掩盖和服务系统的负载均衡能力。In addition, the present invention improves the error concealment and the load balancing ability of the service system by transmitting the encoding time information and encapsulating multiple video data packets to perform interleaved grouping and video source switching.

附图说明Description of drawings

下面将结合附图及实施例对本发明作进一步说明,附图中:The present invention will be further described below in conjunction with accompanying drawing and embodiment, in the accompanying drawing:

图1是本发明视频码流分组传输系统的结构示意图;Fig. 1 is the structural representation of video code stream packet transmission system of the present invention;

图2是本发明视频码流分组传输系统中的RTP分组的第一实施例结构示意图;Fig. 2 is the structural representation of the first embodiment of the RTP packet in the video code stream packet transmission system of the present invention;

图3是本发明视频码流分组传输系统中的RTP分组的第二实施例结构示意图;Fig. 3 is the second embodiment structural representation of the RTP packet in the video code stream packet transmission system of the present invention;

图4是本发明视频码流分组传输系统中的切换视频源的RTP分组示意图;Fig. 4 is the RTP packet schematic diagram of switching video source in the video stream packet transmission system of the present invention;

图5是本发明视频码流分组传输系统中RTP净载头的示意图;Fig. 5 is the schematic diagram of the RTP payload header in the video stream packet transmission system of the present invention;

图6是本发明视频码流分组传输方法的流程图;Fig. 6 is the flow chart of the video code stream packet transmission method of the present invention;

图7是图6中封装AVS-P2码流步骤的流程图;Fig. 7 is the flow chart of encapsulation AVS-P2 stream step among Fig. 6;

图8是图6中接收并解码播放RTP分组步骤的流程图。FIG. 8 is a flow chart of the steps of receiving and decoding the playing RTP packet in FIG. 6 .

具体实施方式Detailed ways

如图1所示,是本发明的视频码流分组传输系统的结构示意图。以下以AVS-P2码流为例,来说明本发明的视频码流分组传输系统。As shown in FIG. 1 , it is a schematic structural diagram of the video code stream packet transmission system of the present invention. In the following, an AVS-P2 code stream is taken as an example to illustrate the video code stream packet transmission system of the present invention.

在本实施例中,本发明的视频码流分组传输系统是基于AVS-P2的视频通讯系统,其包括一个AVS-P2视频互联网服务系统(简称服务端)11和多个通过网络与服务端连接的AVS-P2视频互联网接收终端系统(简称接收端,图中仅示出一个)12。其中,服务端11用于根据接收端的请求发送流媒体,而接收端12则解码来自服务端11的流媒体,从而播放视频或音频文件。在服务端11也可包括多个后备视频互联网服务系统。In the present embodiment, the video stream packet transmission system of the present invention is based on the AVS-P2 video communication system, which includes an AVS-P2 video Internet service system (abbreviated as the server) 11 and a plurality of devices connected to the server through the network. The AVS-P2 video Internet receiving terminal system (abbreviated as the receiving end, only one is shown in the figure) 12. Among them, the server 11 is used to send streaming media according to the request of the receiving end, and the receiving end 12 decodes the streaming media from the server 11 to play video or audio files. The server 11 may also include multiple backup video Internet service systems.

服务端11包括有编码器112、打包器113以及应用服务器111。其中编码器112用于将原始图像编码为AVS-P2码流,并将生成的码流传送到打包器113。应用控制器111用于监测网络13的状况,该网络状况可以是网络13的带宽、码率、丢包率中的一个或多个。打包器113用于根据应用控制器111的监测结果将来自编码器112的码流,按照RTP净载格式(请参考图5及相关描述)封装为具有不同大小的RTP(Real Time Transport Protocol,实时传输协议)分组。例如,当应用控制器111监测到网络带宽不足时,打包器113生成的每一RTP分组包含较小的数据量,而在网络带宽较大时,打包器113生成的每一RTP分组包含较大的数据量。封装完成后,服务端11将封装完的RTP分组通过网络13发送到接收端12。在本实施例中,打包器113所生成的RTP分组的大小随着网络带宽的增大而增大,随着码率的增大而增大,随着丢包率的增大而减小。RTP分组的结构将在图2和图3中详细描述。此外,服务端11可通过重复传输来提高接收端12的正确解码能力。The server 11 includes an encoder 112 , a packager 113 and an application server 111 . The encoder 112 is used to encode the original image into an AVS-P2 code stream, and send the generated code stream to the packer 113 . The application controller 111 is used to monitor the status of the network 13, and the network status may be one or more of the bandwidth, code rate, and packet loss rate of the network 13. The packer 113 is used to package the code stream from the encoder 112 according to the monitoring results of the application controller 111 into RTP (Real Time Transport Protocol, real-time transport protocol) packets. For example, when the application controller 111 detects that the network bandwidth is insufficient, each RTP packet generated by the packer 113 contains a small amount of data, and when the network bandwidth is large, each RTP packet generated by the packer 113 contains a large amount of data. After the encapsulation is completed, the server 11 sends the encapsulated RTP packet to the receiving end 12 through the network 13 . In this embodiment, the size of the RTP packet generated by the packer 113 increases with the increase of the network bandwidth, increases with the increase of the code rate, and decreases with the increase of the packet loss rate. The structure of the RTP packet will be described in detail in Figure 2 and Figure 3. In addition, the server 11 can improve the correct decoding capability of the receiving end 12 through repeated transmission.

当然,服务端11也可包括多个编码器;或者不包括编码器112,而通过存储器直接存储AVS-P2码流,打包器113直接打包存储器中的AVS-P2码流。Of course, the server 11 may also include multiple encoders; or the encoder 112 is not included, and the AVS-P2 code stream is directly stored in the memory, and the packer 113 directly packs the AVS-P2 code stream in the memory.

打包器113与编码器112之间还可设置一个打包缓冲区,用来缓存码流,打包器113依次从打包缓冲区中取出码流进行封装。A packing buffer may also be set between the packer 113 and the encoder 112 for buffering the code stream, and the packer 113 sequentially takes out the code stream from the packing buffer for packing.

接收端12包括解码器122和播放器123。其中解码器122用于解码接收的RTP分组,并将解码后的视频数据传送到播放器123播放。The receiver 12 includes a decoder 122 and a player 123 . The decoder 122 is used to decode the received RTP packet, and transmit the decoded video data to the player 123 for playing.

为提高播放器123的播放效果,可在接收端12设置一个接收缓冲区121。通过该接收缓冲区121将来自服务端11的RTP分组缓存一个预定的时间(可根据网络状况设置),再传送到解码器122解码,从而避免了由于网络延时和丢包等原因造成的播放停顿,保证了视频数据播放的连续性。In order to improve the playback effect of the player 123, a receiving buffer 121 can be set at the receiving end 12. Through the receiving buffer 121, the RTP packet from the server 11 is buffered for a predetermined time (can be set according to network conditions), and then sent to the decoder 122 for decoding, thereby avoiding the playback caused by network delay and packet loss. The pause ensures the continuity of video data playback.

由于接收端11接收到的RTP分组的编码时间可能是交错的,因此接收缓冲区121所需要的内存可能比AVS-P2视频标准中相应档次级别所规定的解码缓冲区大。该接收缓冲区121的初始大小可以由服务端11根据分组生成方法估计,然后通过MIME参数的形式传送给接收端12。解码器122取得缓存在接收缓冲区121中的RTP分组后,将根据伴随的参数信息,按时间顺序解码重组。Since the encoding time of the RTP packets received by the receiving end 11 may be interleaved, the memory required by the receiving buffer 121 may be larger than the decoding buffer specified by the corresponding profile level in the AVS-P2 video standard. The initial size of the receiving buffer 121 can be estimated by the server 11 according to the packet generation method, and then transmitted to the receiving end 12 in the form of MIME parameters. After the decoder 122 obtains the RTP packets buffered in the receiving buffer 121, it will decode and reassemble them in time order according to the accompanying parameter information.

如图2、图3、图5所示,是本发明视频码流分组传输系统中的RTP分组的结构示意图。As shown in FIG. 2 , FIG. 3 , and FIG. 5 , they are schematic structural diagrams of RTP packets in the video code stream packet transmission system of the present invention.

服务端11接收到接收端12发出的服务请求以后,从编码器112中得到AVS-P2码流(或者从存储器中得到预先生成的AVS-P2码流)。由于AVS-P2的图像一般比较大,而网络带宽是有限的,因此需将码流进行分组传送。正常情况下,码流将被分割成几个RTP分组。如果不考虑AVS-P2压缩编码的特点,盲目分组,将影响传输的效率和质量,既有可能因为无法适应底层分组数据单元(PDU)的大小而被重新强制分割造成传输效率低下,也有可能因为前面传输数据的丢失,而影响后面数据的播放。因此在发送到网络上之前,使生成的AVS-P2码流进入打包器113。After receiving the service request sent by the receiving end 12, the server 11 obtains the AVS-P2 code stream from the encoder 112 (or obtains the pre-generated AVS-P2 code stream from the memory). Since the image of AVS-P2 is generally relatively large, and the network bandwidth is limited, it is necessary to transmit the code stream in packets. Normally, the code stream will be divided into several RTP packets. If the characteristics of AVS-P2 compression coding are not considered, blind grouping will affect the efficiency and quality of transmission. It may not be able to adapt to the size of the underlying packet data unit (PDU) and be forced to re-segment, resulting in low transmission efficiency. The loss of previously transmitted data will affect the playback of subsequent data. Therefore, the generated AVS-P2 stream enters the packetizer 113 before being sent to the network.

由于AVS-P2码流是分层结构的,因此可采用不同的分组结构,并使用参数来指示分组中的码流内容。在每一RTP分组中,其通过参数的组合来指示分组中的内容中是否包含AVS-P2的各语法层元素,如序列头信息、图像头信息、条带数据或者在一个RTP分组中包含多种类型内容等,以头部参数信息加随后媒体数据形式构成分组。这样,就可以充分利用带宽,提高传输效率。Since the AVS-P2 code stream has a hierarchical structure, different packet structures can be used, and parameters are used to indicate the content of the code stream in the group. In each RTP packet, it uses a combination of parameters to indicate whether the contents of the packet contain AVS-P2 syntax layer elements, such as sequence header information, image header information, slice data, or multiple Various types of content, etc., are grouped in the form of header parameter information plus subsequent media data. In this way, the bandwidth can be fully utilized and the transmission efficiency can be improved.

当网络资源比较紧张时,可以把一个码流(甚至一个条带)分成几个分组来传输,防止因为带宽的不足而无法承载大数据。如图2所示,参数1、参数2等为AVS-P2码流的语法元素(例如序列头信息、图像头信息、条带数据等),而媒体信息则为上述语法元素组合对应的码流片段包含的视频数据,该情况下,一个RTP分组可包括一个或多个参数。当带宽允许时,也可以把多个码流封装在一个RTP分组内,其也可以通过参数来指示。如图3所示,参数1’、2’等为视频数据序列号,而媒体信息1’、2’则为码流对应的视频数据。这种依据网络状况的实时封装提高了数据的传输效率。When network resources are relatively tight, a code stream (or even a strip) can be divided into several packets for transmission to prevent large data from being unable to be carried due to insufficient bandwidth. As shown in Figure 2, parameter 1, parameter 2, etc. are the syntax elements of the AVS-P2 code stream (such as sequence header information, image header information, slice data, etc.), and the media information is the code stream corresponding to the combination of the above syntax elements A fragment contains video data, in this case an RTP packet may contain one or more parameters. When bandwidth permits, multiple code streams can also be encapsulated in one RTP packet, which can also be indicated by parameters. As shown in Figure 3, parameters 1', 2', etc. are video data serial numbers, while media information 1', 2' are video data corresponding to the code stream. This real-time encapsulation based on network conditions improves data transmission efficiency.

当带宽允许并且服务段11和接收端12的处理内存足够时,甚至可以把不同编码时序的多个码流封装在一个RTP分组中,通过码流前的一个时间参数来指示该段数据的解码顺序。例如:在一般情况下,分组中的内容按照原来码流的编码时间顺序依次封装后发送到网络上,“1,2,3,4,5,6,7,8,9,…”;为提高错误掩盖能力,通过设定参数,可以在时间上交错的封装码流,如按以下编码顺序来发送分组:“1,4,2,5,3,6,7,10,8,…”。When the bandwidth allows and the processing memory of the service segment 11 and the receiving end 12 is sufficient, it is even possible to encapsulate multiple code streams with different encoding timings in one RTP packet, and indicate the decoding of the data by a time parameter before the code stream order. For example: under normal circumstances, the content in the packet is encapsulated in sequence according to the encoding time of the original code stream and then sent to the network, "1, 2, 3, 4, 5, 6, 7, 8, 9, ..."; To improve the error concealment ability, by setting parameters, the encapsulation code stream can be interleaved in time, such as sending packets in the following encoding order: "1, 4, 2, 5, 3, 6, 7, 10, 8, ..." .

当有多个服务请求时,为了均衡服务端11的负载,视频源需要进行切换时,也可以通过周期传送序列头信息的方法,在任意开始点连续中继的传输AVS-P2码流,如图4所示。序列头随后的码流由该序列头负责解释。When there are multiple service requests, in order to balance the load of the server 11, when the video source needs to be switched, the AVS-P2 code stream can also be continuously relayed at any starting point by periodically transmitting the sequence header information, such as Figure 4 shows. The code stream following the sequence header is responsible for interpretation by the sequence header.

如图5所示,为一个具体的RTP净载头的示意图。RTP净载由RTP净载头和媒体数据构成。RTP净载头中的各参数说明如下:As shown in FIG. 5 , it is a schematic diagram of a specific RTP payload header. The RTP payload consists of the RTP payload header and media data. The parameters in the RTP payload header are described as follows:

PD:用于标识当前图像的显示时间顺序(8位),其值的范围是0-255,对于同一图像的所有RTP分组,该参数值是相同。PD: It is used to identify the display time sequence of the current image (8 bits), and its value ranges from 0 to 255. For all RTP packets of the same image, the value of this parameter is the same.

AN:用于启动位N(1位),当随后的位N被用作传递AVS-P2净载中的图像头信息发生变化的情况时该位设置为1;当随后的位N不用时此位设置为0。AN: It is used to start bit N (1 bit). When the subsequent bit N is used to convey the change of the image header information in the AVS-P2 payload, this bit is set to 1; when the subsequent bit N is not used, this bit is set to 1. bit is set to 0.

N:用于标识新图像头的出现(1位)。当包含在上一图像头中的信息不能用来为当前图像重建图像头时(即上一相同类型的图像与当前图像采用不同的参数集编码),此位设置为1。对于属于同一图像的所有RTP包,该位保持不变。这样,重建一幅图像(一场或一帧)时,可通过检测组成该图像的任何一个RTP包中的位N,来判断重建所需要的信息是包含在当前图像(N=1)还是以前的图像中(N=0)。N: Used to identify the presence of a new picture header (1 bit). This bit is set to 1 when the information contained in the previous picture header cannot be used to reconstruct the picture header for the current picture (ie, the previous picture of the same type was encoded with a different parameter set than the current picture). This bit remains unchanged for all RTP packets belonging to the same image. In this way, when reconstructing an image (one field or one frame), it can be judged whether the information required for reconstruction is contained in the current image (N=1) or before by detecting the bit N in any RTP packet that makes up the image. in the image (N=0).

S:用于标识序列头是否出现(1位)。通常设置为0,只有当每次AVS-P2的序列头出现时,该位才设置为1。S: Used to identify whether the sequence header appears (1 bit). Normally set to 0, this bit is only set to 1 each time the AVS-P2 sequence header is present.

B:用于标识条带的开始(1位)。当RTP净载的开头是条带开始码,或者当条带开始码前面只有一个或多个序列头和/或图像头时,该位设置为1。B: Used to identify the start of a stripe (1 bit). This bit is set to 1 when the beginning of the RTP payload is a slice start code, or when the slice start code is preceded by only one or more sequence headers and/or picture headers.

E:用于标识条带的结束(1位)。当RTP净载的最后一字节是AVS-P2的条带的结束码时,该位设置为1。E: used to identify the end of the stripe (1 bit). This bit is set to 1 when the last byte of the RTP payload is the slice end code for AVS-P2.

P:用于标识图像类型(3位)。例如值1表示I帧,值2表示P帧,值3表示B帧。对于一个给定图像的每个RTP包,这个值是不变的。值000禁止,值100-111保留用于支持AVS规定在以后的扩展。P: Used to identify the image type (3 bits). For example, a value of 1 indicates an I frame, a value of 2 indicates a P frame, and a value of 3 indicates a B frame. This value is constant for each RTP packet of a given image. A value of 000 is prohibited, and a value of 100-111 is reserved to support future extensions specified by AVS.

PS:用于标识图像结构(2位)。PS为“0”表示当前图像的两场的编码数据依次出现;值为“1”表示当前图像的两场的编码数据交替出现(请参考AVS-P2中对picture_structure的解释)。PS: Used to identify the image structure (2 bits). When PS is "0", it means that the encoded data of the two fields of the current image appears sequentially; when the value is "1", it means that the encoded data of the two fields of the current image appears alternately (please refer to the explanation of picture_structure in AVS-P2).

TF:首场优先标志(1位)(请参考AVS-P2中对top_field_first字段的解释)。TF: First field priority flag (1 bit) (please refer to the explanation of the top_field_first field in AVS-P2).

R:重要首场标志(1位)(请参考AVS-P2中对repeat_first_field字段的解释)。R: important first field flag (1 bit) (please refer to the explanation of the repeat_first_field field in AVS-P2).

G:逐行帧标志位(1位)。值为“0”表示该帧的两行是隔行场,这两场之间存在一个场时间间隔。如果该位值为“1”,则说明该帧的两场实际来自同一时刻(请参考AVS-P2中对progressive_frame字段的规定)。G: Progressive frame flag (1 bit). A value of "0" indicates that the two lines of the frame are interlaced fields with a field time gap between them. If the bit value is "1", it means that the two fields of the frame actually come from the same moment (please refer to the provisions of the progressive_frame field in AVS-P2).

PHD:图像头出现标志位(1位)。通常设置为0,仅当每次AVS-P2的图像头(i_piciture_header或者pb_picture_header)出现时,该位才设置为1。这一位用来检测RTP包中图像头是否出现。PHD: The flag bit (1 bit) appears in the image header. Normally set to 0, this bit is only set to 1 every time an AVS-P2 picture header (i_picture_header or pb_picture_header) appears. This bit is used to detect whether the image header is present in the RTP packet.

T:扩展数据出现标志位(1位),该参数关系到RTP分组的大小。AVS-P2规定的sequence_display_extension,copyright_extenstion,camera_parameter_extenstion等扩展出现标志。当RTP净载中有这些扩展数据出现的时候,该位设置为1。尽管扩展数据可以改进视频性能,但是它们是否包含在RTP净载中是可选的。T: Extended data occurrence flag (1 bit), this parameter is related to the size of the RTP packet. AVS-P2 stipulated sequence_display_extension, copyright_extenstion, camera_parameter_extenstion and other extended signs. When these extended data appear in the RTP payload, this bit is set to 1. Although extension data can improve video performance, their inclusion in the RTP payload is optional.

I:交织模式标志位(1位)。表示在同一RTP包中当前净载头和净载媒体数据之后,将跟随另一个净载头和媒体数据。I: Interleaving mode flag bit (1 bit). Indicates that after the current payload header and payload media data in the same RTP packet, another payload header and media data will follow.

RSV:保留(6位)。保留用于将来的扩展应用。RSV: Reserved (6 bits). Reserved for future extended applications.

本实施例中,通过AN、N、S、B、E以及PD、PS、TF、R、G、PHD、T、I、PR等参数,使RTP分组内容能在有效传输的基础上被充分理解并有助于接收端解码。通过参数S、PHD、B、E、T和I所赋值的组合,实时把视频数据封装成大小尺寸适当的分组,以提高传输效率。例如,当这几个参数都设置为1时,在一个RTP分组中就可能封装一个视频序列和一些用户数据。通过S,PD和I参数的组合,可以在一个RTP分组内封装多个视频数据单元,每个视频数据单元之前的净载信息中PD标识了该码流的解码时间。例如以下列形式封装RTP分组:“RTP头+序列头1+时序1+码流1+时序2+码流2+序列头2+时序3+码流3”。这样可以把多源视频数据封装在一个RTP分组中,进行交错分组和视频源的切换。从而提高传输的错误掩盖能力和服务端的负载均衡能力。通过TF、R、G参数实现重复传输,从而提高正确解码的能力。In this embodiment, through parameters such as AN, N, S, B, E and PD, PS, TF, R, G, PHD, T, I, PR, etc., the RTP packet content can be fully understood on the basis of effective transmission And help the receiving end to decode. Through the combination of the assigned values of parameters S, PHD, B, E, T and I, the video data is encapsulated into packets of appropriate size in real time to improve transmission efficiency. For example, when these parameters are all set to 1, a video sequence and some user data may be encapsulated in one RTP packet. Through the combination of S, PD and I parameters, multiple video data units can be encapsulated in one RTP packet, and the payload information before each video data unit indicates the decoding time of the code stream in PD. For example, the RTP packet is encapsulated in the following form: "RTP header + sequence header 1 + sequence 1 + code stream 1 + sequence 2 + code stream 2 + sequence header 2 + sequence 3 + code stream 3". In this way, multi-source video data can be encapsulated in one RTP packet to perform interleaved packet switching and video source switching. In this way, the error concealment capability of transmission and the load balancing capability of the server are improved. Repeated transmission is realized through TF, R, and G parameters, thereby improving the ability of correct decoding.

由于AVS-P2是一种运动图像的压缩技术,图像之间的时间依赖性比较强,当前面的图像发生错误时,有可能影响后续图像的解码。通常B帧不参加预测,因此其损坏并不会造成错误扩散,而I帧和P帧则不同,它们的损坏将引起错误扩散,从而影响播放质量。在观看视频时,主观感觉是一个很重要的指标,在一幅图像中,观众对每部分的兴趣点是不同的。在一序列图像中,有些图像的相似程度较高,它们的损坏或丢失对主观感受的影响比较小,而有些图像是场景转换点或者是观众的兴趣点,是比较重要的。因此在分组时,可以依据分组控制器对内容的判断,通过一个参数来标志该分组的重要性。对重要性标志等级比较高的分组,传输系统优先发送传输,或者在一定时间范围内向接收端重复传输。Since AVS-P2 is a moving image compression technology, the time dependence between images is relatively strong. When an error occurs in the previous image, it may affect the decoding of subsequent images. Usually the B frame does not participate in the prediction, so its damage will not cause error diffusion, but the I frame and P frame are different, their damage will cause error diffusion, thus affecting the playback quality. When watching a video, subjective feeling is a very important indicator. In an image, the audience's interest points for each part are different. In a sequence of images, some images have a high degree of similarity, and their damage or loss has relatively little impact on subjective experience, while some images are scene transition points or points of interest of the audience, which are more important. Therefore, when grouping, according to the judgment of the grouping controller on the content, a parameter can be used to mark the importance of the grouping. For packets with a relatively high level of importance, the transmission system sends the transmission first, or repeats the transmission to the receiving end within a certain time range.

因此可依据内容重要性和兴趣点,在RTP分组中设置优先级标志位PR(2位),以适配网络状况和平衡接收端负载。例如当00级为最高优先级,11级为最低优先级。当网络资源紧张时,将优先传送参数和满足基本传输带宽的视频数据(优先级较高的数据);在网络队列中或在接收端超负荷时,尽量先处理高优先级数据而丢弃低优先级数据。在接收端12,对于标志为重要等级高的分组,接收缓冲区121接收到后,将优先交付解码播放。当由于延时超过缓冲区大小时,可丢弃标志为较低优先级的分组,保证高优先级分组的实时解码播放。Therefore, the priority flag bit PR (2 bits) can be set in the RTP packet according to the importance of the content and the point of interest, so as to adapt to the network condition and balance the load of the receiving end. For example, when level 00 is the highest priority, level 11 is the lowest priority. When network resources are tight, the parameters and video data that meet the basic transmission bandwidth (higher priority data) will be transmitted first; in the network queue or when the receiving end is overloaded, try to process high priority data first and discard low priority data level data. At the receiving end 12, after the receiving buffer 121 receives the packets marked with a high importance level, they will be given priority for decoding and playing. When the delay exceeds the buffer size, the packets marked as lower priority can be discarded to ensure real-time decoding and playback of high priority packets.

当然,上述分组格式中各参数的命名除了以上的形式外,也可以采用其它的命名形式。Of course, besides the above-mentioned forms, other naming forms may also be used for the naming of each parameter in the above grouping format.

以下以AVS-P2码流为例,描述本发明的视频码流分组传输方法。The video code stream packet transmission method of the present invention is described below by taking an AVS-P2 code stream as an example.

如图6所示,为本发明视频码流分组传输方法的流程图。As shown in FIG. 6 , it is a flow chart of the video code stream packet transmission method of the present invention.

首先,在服务端11,其根据接收端12的服务请求(即播放视频数据的请求),使用编码器112将指定的视频文件编码为AVS-P2码流,或者直接从存储有AVS-P2码流的存储装置取出AVS-P2码流,并将上述码流根据网络状况按照《AVS-P2RTP净载格式》封装为RTP分组。然后,服务端11将生成的RTP分组通过网络传送到接收端12(步骤S61)。First, at the service end 11, according to the service request of the receiving end 12 (i.e., the request for playing video data), use the encoder 112 to encode the specified video file into an AVS-P2 code stream, or directly from the stored AVS-P2 code stream. The stream storage device takes out the AVS-P2 code stream, and encapsulates the above code stream into RTP packets according to the "AVS-P2RTP Payload Format" according to the network conditions. Then, the server 11 transmits the generated RTP packet to the receiving end 12 through the network (step S61).

在接收端12接收到RTP分组后,将接收的RTP分组解码为视频数据,并通过播放器播放视频数据(步骤S62)。After receiving the RTP packet, the receiver 12 decodes the received RTP packet into video data, and plays the video data through the player (step S62).

如图7所示,为图6中封装AVS-P2码流步骤的流程图。As shown in FIG. 7 , it is a flow chart of the steps of encapsulating the AVS-P2 code stream in FIG. 6 .

首先服务端11根据来自接收端12的服务请求,将请求的视频文件编码为AVS-P2码流;或者直接从存储装置中取出AVS-P2码流,并将码流置入打包缓冲区(步骤S71)。At first service end 11 according to the service request from receiving end 12, the video file of request is encoded as AVS-P2 code stream; Or directly take out AVS-P2 code stream from storage device, and code stream is put into packing buffer (step S71).

服务端11还通过应用控制器111获取网络13的实时状况,具体包括网络带宽、码率、丢包率中的一个或多个(步骤S72)。The server 11 also obtains the real-time status of the network 13 through the application controller 111, specifically including one or more of network bandwidth, code rate, and packet loss rate (step S72).

然后,服务端11使用打包器113根据应用控制器111监测的网络状况,将打包缓冲区中的AVS-P2码流按照RTP净载格式封装为具有不同大小的RTP分组。例如,当应用控制器111监测到网络带宽不足时,打包器113生成的每一RTP分组包含较小的数据量,而在网络带宽较大时,打包器113生成的每一RTP分组包含较大的数据量。封装完成后,服务端11将封装完的RTP分组通过网络13发送到接收端12。RTP分组的结构如图2、图3、图5所示(步骤S73)。此外,还可通过重复传输来提高接收端12的正确解码能力。Then, the server 11 uses the packetizer 113 to encapsulate the AVS-P2 code stream in the packet buffer into RTP packets with different sizes according to the RTP payload format according to the network conditions monitored by the application controller 111 . For example, when the application controller 111 detects that the network bandwidth is insufficient, each RTP packet generated by the packer 113 contains a small amount of data, and when the network bandwidth is large, each RTP packet generated by the packer 113 contains a large amount of data. After the encapsulation is completed, the server 11 sends the encapsulated RTP packet to the receiving end 12 through the network 13 . The structure of the RTP packet is shown in Fig. 2, Fig. 3 and Fig. 5 (step S73). In addition, the correct decoding capability of the receiving end 12 can also be improved by repeated transmission.

最后,服务端11将生成的RTP分组通过网络13传送到接收端12(步骤S74)。Finally, the server 11 transmits the generated RTP packet to the receiving end 12 through the network 13 (step S74).

如图8所示,为图6中接收并解码播放RTP分组步骤的流程图。As shown in FIG. 8 , it is a flowchart of the steps of receiving and decoding the RTP packet in FIG. 6 .

首先接收端12将来自服务端11的RTP分组置入接收缓冲区121,并等待一个预定的时间。该预定的时间避免了因网络延时和包的丢失等造成的播放停顿,保证了播放的连续性(直接播放则有可能因后续RTP分组未接收到而使解码暂停),其值可根据网络状况预先设定,例如网络带宽较小时等待时间较长,而网络带宽较大时等待时间较短(步骤S81)。First, the receiving end 12 puts the RTP packet from the server 11 into the receiving buffer 121, and waits for a predetermined time. The predetermined time avoids the playback pause caused by network delay and packet loss, etc., and ensures the continuity of the playback (direct playback may cause the decoding to be suspended because the subsequent RTP packet is not received), and its value can be determined according to the network. The situation is preset, for example, when the network bandwidth is small, the waiting time is longer, and when the network bandwidth is large, the waiting time is short (step S81).

然后将接收缓冲区121中的RTP分组发送到解码器122进行解码,从而获得视频数据,并使用播放器123进行播放(步骤S82)。Then send the RTP packet in the receiving buffer 121 to the decoder 122 for decoding, so as to obtain video data, and use the player 123 to play (step S82).

以上所述,仅为本发明较佳的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应该以权利要求的保护范围为准。The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present invention can easily think of changes or Replacement should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (16)

1, a kind of video-code-flow grouped transmission method is characterized in that, may further comprise the steps:
(a) in service end the code stream that encoder generates is encapsulated as the RTP grouping according to network condition, and described RTP grouping is sent to receiving terminal;
(b) described receiving terminal obtains video data with the RTP packet decoding that receives.
2, video-code-flow grouped transmission method according to claim 1 is characterized in that, described step (a) comprising:
(a1) insert the packing buffering area that is positioned at service end in service end according to the code stream of the service request own coding device in future of receiving terminal;
(a2) pass through application controller monitoring network situation in service end, and the code stream that uses packing device according to described network condition encoder to be generated is encapsulated as the RTP grouping;
(a3) described RTP grouping is sent to described receiving terminal.
3, video-code-flow grouped transmission method according to claim 1 is characterized in that, described step (b) comprising:
(b1) at described receiving terminal the RTP grouping that receives is inserted the reception buffering area that is positioned at receiving terminal and waited for the fixed time;
(b2) grouping of the RTP in the described reception buffering area is sent to decoder decode.
4, video-code-flow grouped transmission method according to claim 1, it is characterized in that, comprise in the described step (a) in RTP grouping, adding the important level parameter and transmitting the step of RTP grouping that described step (b) includes according to preferentially the decode step of the high RTP grouping of important level of the important level parameter in the RTP grouping according to important level.
5, video-code-flow grouped transmission method according to claim 1 is characterized in that, described code stream is the AVS-P2 code stream, includes the grammer layer element and the media data of RTP header file, AVS-P2 code stream in the described RTP grouping.
6, according to each described video-code-flow grouped transmission method among the claim 1-5, it is characterized in that, described network condition comprises one or more in the network bandwidth, code check and the packet loss, in described step (a), the size of the RTP grouping that service end generated increases along with the increase of the network bandwidth, increases along with the increase of code check, reduces along with the increase of packet loss.
7, video-code-flow grouped transmission method according to claim 1 is characterized in that, described RTP grouping comprises that RTP head and RTP carry only, and wherein RTP included RTP in clean year and carries header and media data only.
8, video-code-flow grouped transmission method according to claim 7, it is characterized in that, also comprise the step that improves the ability that is correctly decoded by repeating to transmit, described RTP carries header only and includes first precedence designation, important first sign and progressive frame flags parameters.
9, video-code-flow grouped transmission method according to claim 1 is characterized in that, comprises in the described step (a) that use transmission code time information and many video data packets encapsulate the step of interlock grouping and video source switching.
10, a kind of video code flow block transmission system, comprise the service end and the receiving terminal that are connected by network, it is characterized in that, the packing device that described service end includes provides the code stream of code stream source, be used for the application controller of monitoring network situation and will be encapsulated as the RTP grouping from the code stream in code stream source, described receiving terminal comprises the decoder of decoding from the described RTP grouping of service end, and wherein said packing device is encapsulated as described code stream according to the result of the monitoring network of application controller the RTP grouping of specific size.
11, video code flow block transmission system according to claim 10 is characterized in that, described code stream source is for being encoded to video file the encoder or the encoder group of code stream, perhaps for storing the storage device of code stream.
12, video code flow block transmission system according to claim 10, it is characterized in that, described receiving terminal includes the reception buffering area of buffer memory from the RTP grouping of service end, and described reception buffering area sends to described decoder decode after the RTP grouping cache scheduled time with reception.
13, video code flow block transmission system according to claim 10 is characterized in that, described RTP grouping comprises that RTP head and RTP carry only, and wherein RTP included RTP in clean year and carries header and media data only.
14, video code flow block transmission system according to claim 10 is characterized in that, includes the parameter of sign RTP grouping important level in the described RTP grouping, the high RTP grouping of important level of preferentially decoding of described encoder.
15, video code flow block transmission system according to claim 10 is characterized in that, described code stream is the AVS-P2 code stream, includes the grammer layer element and the media data of RTP header file, AVS-P2 code stream in the described RTP grouping.
16, according to each described video code flow block transmission system among the claim 10-15, it is characterized in that, comprise the parameter that the sign growth data occurs in the described RTP grouping, described network condition comprises one or more in the network bandwidth, code check and the packet loss, and the size of the RTP grouping that service end generated increases along with the increase of the network bandwidth, increases along with the increase of code check, reduces along with the increase of packet loss.
CN 200510102176 2005-12-05 2005-12-05 Video-code-flow grouped transmission method and system Pending CN1852429A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200510102176 CN1852429A (en) 2005-12-05 2005-12-05 Video-code-flow grouped transmission method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200510102176 CN1852429A (en) 2005-12-05 2005-12-05 Video-code-flow grouped transmission method and system

Publications (1)

Publication Number Publication Date
CN1852429A true CN1852429A (en) 2006-10-25

Family

ID=37133896

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200510102176 Pending CN1852429A (en) 2005-12-05 2005-12-05 Video-code-flow grouped transmission method and system

Country Status (1)

Country Link
CN (1) CN1852429A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010063147A1 (en) * 2008-12-03 2010-06-10 中兴通讯股份有限公司 Method and mobile terminal for sharing mobile phone television program
CN101834964A (en) * 2010-03-31 2010-09-15 耿直 Voice data transmission processing method and voice data transmission processor
CN101394557B (en) * 2007-09-20 2010-10-13 奇景光电股份有限公司 Decoder and method of operating the same
CN102647337A (en) * 2011-02-17 2012-08-22 宏碁股份有限公司 Network packet transmission method and system
CN103108186A (en) * 2013-02-21 2013-05-15 中国对外翻译出版有限公司 Method of achieving high-definition transmission of videos
CN104038759A (en) * 2014-06-09 2014-09-10 华为技术有限公司 Video coding method and decoding method and related devices
CN104080015A (en) * 2014-06-19 2014-10-01 宁波公众信息产业有限公司 Video coding method
CN104506959A (en) * 2014-12-15 2015-04-08 广东威创视讯科技股份有限公司 Packet transmission method and packet transmission system for H264 code streams
CN105142180A (en) * 2015-07-29 2015-12-09 大连理工大学 A Multi-channel Concurrent Image Transmission Method Based on IEEE802.11p Protocol
CN106604060A (en) * 2016-12-28 2017-04-26 桂林龙隐科技有限公司 Distribution method and distributer of wireless WiFi multimedia broadcast system
CN106791941A (en) * 2016-12-28 2017-05-31 桂林龙隐科技有限公司 Wireless WiFi multi-media broadcasting systems and method
CN106790143A (en) * 2016-12-28 2017-05-31 桂林龙隐科技有限公司 The self adaptation group deinterleaving method and device of wireless WiFi multi-media broadcasting systems
CN111435991A (en) * 2019-01-11 2020-07-21 上海交通大学 Point cloud code stream packaging method and system based on grouping
CN114333862A (en) * 2021-11-10 2022-04-12 腾讯科技(深圳)有限公司 Audio encoding method, decoding method, device, equipment, storage medium and product
CN115174567A (en) * 2022-06-22 2022-10-11 浙江大华技术股份有限公司 Code sending method, device, equipment and storage medium
CN118338088A (en) * 2024-06-17 2024-07-12 江苏北弓智能科技有限公司 A method for transmitting AVS3 video based on RTP protocol
CN118802873A (en) * 2023-08-23 2024-10-18 咪咕文化科技有限公司 A video code stream processing method, device, equipment and readable storage medium
CN119135665A (en) * 2024-09-05 2024-12-13 京东方科技集团股份有限公司 Data processing method, device, equipment, chip and storage medium
CN119155287A (en) * 2024-08-21 2024-12-17 咪咕文化科技有限公司 Video bitstream encapsulation method, apparatus, electronic device and program product
WO2025020560A1 (en) * 2023-07-24 2025-01-30 中兴通讯股份有限公司 Method and apparatus for transmitting avs3 video code stream

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394557B (en) * 2007-09-20 2010-10-13 奇景光电股份有限公司 Decoder and method of operating the same
WO2010063147A1 (en) * 2008-12-03 2010-06-10 中兴通讯股份有限公司 Method and mobile terminal for sharing mobile phone television program
KR101302880B1 (en) * 2008-12-03 2013-09-05 지티이 코포레이션 Method and mobile terminal for sharing mobile phone television program
CN101834964B (en) * 2010-03-31 2013-07-03 耿直 Voice data transmission processing method
CN101834964A (en) * 2010-03-31 2010-09-15 耿直 Voice data transmission processing method and voice data transmission processor
CN102647337A (en) * 2011-02-17 2012-08-22 宏碁股份有限公司 Network packet transmission method and system
CN102647337B (en) * 2011-02-17 2015-02-11 宏碁股份有限公司 Network packet transmission method and system
CN103108186A (en) * 2013-02-21 2013-05-15 中国对外翻译出版有限公司 Method of achieving high-definition transmission of videos
CN104038759A (en) * 2014-06-09 2014-09-10 华为技术有限公司 Video coding method and decoding method and related devices
WO2015188729A1 (en) * 2014-06-09 2015-12-17 华为技术有限公司 Video coding method and video decoding method and related device
CN104038759B (en) * 2014-06-09 2017-11-17 华为技术有限公司 Method for video coding and coding/decoding method and relevant apparatus
CN104080015A (en) * 2014-06-19 2014-10-01 宁波公众信息产业有限公司 Video coding method
CN104506959A (en) * 2014-12-15 2015-04-08 广东威创视讯科技股份有限公司 Packet transmission method and packet transmission system for H264 code streams
CN105142180A (en) * 2015-07-29 2015-12-09 大连理工大学 A Multi-channel Concurrent Image Transmission Method Based on IEEE802.11p Protocol
CN105142180B (en) * 2015-07-29 2018-12-21 大连理工大学 A Multi-channel Concurrent Image Transmission Method Based on IEEE802.11p Protocol
CN106791941A (en) * 2016-12-28 2017-05-31 桂林龙隐科技有限公司 Wireless WiFi multi-media broadcasting systems and method
CN106604060B (en) * 2016-12-28 2023-08-11 桂林龙隐科技有限公司 Distribution method and distributor of wireless WiFi multimedia broadcasting system
CN106604060A (en) * 2016-12-28 2017-04-26 桂林龙隐科技有限公司 Distribution method and distributer of wireless WiFi multimedia broadcast system
CN106791941B (en) * 2016-12-28 2023-08-11 桂林龙隐科技有限公司 Wireless WiFi multimedia broadcasting system and method
CN106790143A (en) * 2016-12-28 2017-05-31 桂林龙隐科技有限公司 The self adaptation group deinterleaving method and device of wireless WiFi multi-media broadcasting systems
CN111435991B (en) * 2019-01-11 2021-09-28 上海交通大学 Point cloud code stream packaging method and system based on grouping
CN111435991A (en) * 2019-01-11 2020-07-21 上海交通大学 Point cloud code stream packaging method and system based on grouping
CN114333862A (en) * 2021-11-10 2022-04-12 腾讯科技(深圳)有限公司 Audio encoding method, decoding method, device, equipment, storage medium and product
CN114333862B (en) * 2021-11-10 2024-05-03 腾讯科技(深圳)有限公司 Audio encoding method, decoding method, device, equipment, storage medium and product
CN115174567A (en) * 2022-06-22 2022-10-11 浙江大华技术股份有限公司 Code sending method, device, equipment and storage medium
WO2025020560A1 (en) * 2023-07-24 2025-01-30 中兴通讯股份有限公司 Method and apparatus for transmitting avs3 video code stream
CN118802873A (en) * 2023-08-23 2024-10-18 咪咕文化科技有限公司 A video code stream processing method, device, equipment and readable storage medium
WO2025040105A1 (en) * 2023-08-23 2025-02-27 咪咕文化科技有限公司 Video bitstream processing method and apparatus, and device and readable storage medium
CN118338088A (en) * 2024-06-17 2024-07-12 江苏北弓智能科技有限公司 A method for transmitting AVS3 video based on RTP protocol
CN119155287A (en) * 2024-08-21 2024-12-17 咪咕文化科技有限公司 Video bitstream encapsulation method, apparatus, electronic device and program product
CN119135665A (en) * 2024-09-05 2024-12-13 京东方科技集团股份有限公司 Data processing method, device, equipment, chip and storage medium

Similar Documents

Publication Publication Date Title
CN1852429A (en) Video-code-flow grouped transmission method and system
KR101292490B1 (en) A method comprising encapsulating BC-1 information in an RTP packet, a computer readable medium for implementing the RTP data structure, an access unit data structure, a source module, a decoder module, a source module and a decoder module, and a target module.
CN1165138C (en) Method and device for transmitting data packet with compressed header
US20200029130A1 (en) Method and apparatus for configuring content in a broadcast system
CN1196339C (en) Method and apparatus for streaming scalable video
CN1217530C (en) Server, system and method for transmitting a data signal having a sequence of data units
CN1242623C (en) Video encoding method, decoding method, and related encoder and decoder
US20090103635A1 (en) System and method of unequal error protection with hybrid arq/fec for video streaming over wireless local area networks
CN1640076A (en) Media Streaming Distribution System
CN1643875A (en) Data streaming system and method
CN1751517A (en) image decoding method
CN1449628A (en) Video fault tolerance control
CN103051978A (en) H264-based real-time mobile video service control method
CN1171158C (en) Flowing Method of Moving Images in Video-on-Demand System
CN101589616B (en) Error filter to differentiate between reverse link and forward link video data errors
CN1781314A (en) Picture coding method
CN1717047A (en) Data streaming file, method and system for moving data streaming service
CN1781313A (en) Picture coding method
CN1717935A (en) I-picture insertion on request
CN101068210A (en) Multimedia data transmitting method
CN1643932A (en) Data structure for data streaming system
CN101742271B (en) Method, system and device for transmitting stream media data
CN1864409A (en) Medium signal transmission method, reception method, transmission/reception method, and device
CN1960260A (en) Method for providing IPTV service for different type terminals, and IPTV service system
CN1668110A (en) Method and apparatus for increasing the average image refresh rate in a compressed video bitstream

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication