CN1852429A - Video-code-flow grouped transmission method and system - Google Patents
Video-code-flow grouped transmission method and system Download PDFInfo
- Publication number
- CN1852429A CN1852429A CN 200510102176 CN200510102176A CN1852429A CN 1852429 A CN1852429 A CN 1852429A CN 200510102176 CN200510102176 CN 200510102176 CN 200510102176 A CN200510102176 A CN 200510102176A CN 1852429 A CN1852429 A CN 1852429A
- Authority
- CN
- China
- Prior art keywords
- rtp
- video
- code
- code stream
- grouping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
本发明涉及一种视频码流分组传输方法,包括以下步骤:(a)在服务端将编码器生成的码流根据网络状况封装为RTP分组,并将所述RTP分组传送到接收端;(b)所述接收端将接收的RTP分组解码获得视频数据。本发明还提供一种对应的视频码流分组传输系统。本发明通过根据网络状况将码流封装为大小不同的RTP分组,提高了传输效率,使端到端的延时最小化,从而提高视频传输质量。此外,本发明通过设置重要等级参数,保证了视频质量。
The present invention relates to a video code stream packet transmission method, comprising the following steps: (a) encapsulating the code stream generated by an encoder into RTP packets at the server end according to network conditions, and transmitting the RTP packets to the receiving end; (b) ) The receiving end decodes the received RTP packet to obtain video data. The invention also provides a corresponding video code stream packet transmission system. The invention improves the transmission efficiency by encapsulating code streams into RTP packets of different sizes according to network conditions, minimizes end-to-end delay, and improves video transmission quality. In addition, the present invention ensures the video quality by setting important level parameters.
Description
技术领域technical field
本发明涉及数据传输领域,更具体地说,涉及一种视频码流分组传输方法及系统。The present invention relates to the field of data transmission, and more specifically, to a method and system for packet transmission of video streams.
背景技术Background technique
随着IP网络技术和视频、音频编码技术的发展,越来越多种编码格式的视频、音频内容通过IP网络进行传输。With the development of IP network technology and video and audio coding technology, more and more video and audio content in various coding formats are transmitted through the IP network.
现有的视频编码标准技术包括有ITU-T的H.261、H.263、H.264和ISO/IEC的MPEG1的第2部分、MPEG2的第2部分以及MPEG4的第2部分等。现有的视频传输系统包括视频会议和视频电话。这些系统包含了ITU-T的建议H.320、H.323和H.324等,其分别规定了视频会议和视频电话系统在网络上传输的操作方法。Existing video coding standard technologies include H.261, H.263, H.264 of ITU-T and Part 2 of MPEG1, Part 2 of MPEG2 and Part 2 of MPEG4 of ISO/IEC. Existing video transmission systems include video conferencing and video telephony. These systems include ITU-T recommendations H.320, H.323, and H.324, etc., which respectively stipulate the operation methods of video conferencing and video telephone system transmission on the network.
AVS(Audio Videocoding Standard,数字音视频编解码技术标准)是为了适应数字电视广播、因特网流媒体和多媒体通讯等应用中对运动图像压缩技术的需要而制定的,其中第2部分(P2)涉及视频编码技术。AVS-P2本身通过把原始视频数据划分成条带,以宏块为基本编码单位,经过预测、运动估计、差分变换、频域变换、量化和熵编码等功能模块压缩输出码流,此码流在语法上采用了分层结构,可分成图像序列层、图像层、条带层和宏块层等。在每一语法层,都有一个4字节起始码标志符。其中条带是对数据丢失或损坏进行恢复的单元。在此码流中还包含了编解码参数,如图像尺寸、参考图像列表、初始量化参数等。在远程视频通讯中,经过压缩的AVS-P2视频码流通过网络传输到接收端,由接收端根据码流中的参数解码并播放。AVS (Audio Videocoding Standard, digital audio and video codec technology standard) is formulated to meet the needs of motion image compression technology in applications such as digital TV broadcasting, Internet streaming media, and multimedia communications. Part 2 (P2) involves video Coding technology. AVS-P2 itself divides the original video data into strips, takes macroblock as the basic coding unit, and compresses the output code stream through functional modules such as prediction, motion estimation, differential transformation, frequency domain transformation, quantization and entropy coding. Grammatically, a layered structure is adopted, which can be divided into image sequence layer, image layer, strip layer, and macroblock layer. At each syntax level, there is a 4-byte start code identifier. A stripe is a unit for recovering from data loss or corruption. This code stream also includes codec parameters, such as image size, reference image list, initial quantization parameters, etc. In remote video communication, the compressed AVS-P2 video code stream is transmitted to the receiving end through the network, and the receiving end decodes and plays it according to the parameters in the code stream.
为了适应IP网络特点,有效地传输上述视频、音频内容,出现了MPEG2编码内容的IP传输分组方法、MPEG4编码内容的IP传输分组方法、H.263和H.263+编码内容的IP传输分组方法、H.264编码内容的IP传输分组方法等。这些技术通过适配视频内容的特征来最小化端到端的延时,从而提高视频通讯质量。In order to adapt to the characteristics of the IP network and effectively transmit the above-mentioned video and audio content, the IP transmission grouping method of the MPEG2 coded content, the IP transmission grouping method of the MPEG4 coded content, and the IP transmission grouping method of the H.263 and H.263+ coded content have emerged , IP transmission grouping method of H.264 coded content, etc. These technologies minimize the end-to-end delay by adapting to the characteristics of the video content, thereby improving the quality of video communication.
例如,RFC 2250提供了一种主要针对MPEG2的视频分组方案。但该方案的主要缺点是视频分组的信息头参数过多,影响了传输效率的进一步提高。此外,该法案主要依靠底层传输协议来保证传输的质量,缺少针对视频特点的重要内容重点保护等措施。For example, RFC 2250 provides a video packetization scheme primarily for MPEG2. But the main disadvantage of this scheme is that there are too many information header parameters in the video packet, which affects the further improvement of transmission efficiency. In addition, the Act mainly relies on the underlying transmission protocol to ensure the quality of transmission, and lacks measures such as key content protection for video characteristics.
RFC 3984提供了一种主要针对H.264标准的视频分组方案,该方案充分利用了H.264标准规定的网络抽象层单元头(NALU)来构成不同结构的分组。但该方案主要针对符合H.264语法的视频数据,其用于传输非H.264标准的视频数据时,信息头的参数比较少,影响了视频数据的有效传输,特别是一些视频扩展数据的传输。在分组前,必须对非H.264视频数据做一定的转换,接收端的解码器也必须重构这些数据。RFC 3984 provides a video grouping scheme mainly for the H.264 standard, which makes full use of the network abstraction layer unit header (NALU) specified by the H.264 standard to form packets of different structures. However, this solution is mainly aimed at video data that conforms to the H.264 syntax. When it is used to transmit non-H.264 standard video data, the parameters of the information header are relatively small, which affects the effective transmission of video data, especially some video extension data. transmission. Before grouping, non-H.264 video data must be converted to a certain extent, and the decoder at the receiving end must also reconstruct these data.
发明内容Contents of the invention
本发明要解决的技术问题在于,针对现有技术的上述流媒体传输效率较低的缺陷,提供一种新的视频码流分组传输方法及系统。The technical problem to be solved by the present invention is to provide a new video stream packet transmission method and system for the above-mentioned defects of low streaming media transmission efficiency in the prior art.
本发明解决其技术问题所采用的技术方案是:构造一种视频码流分组传输方法,包括以下步骤:The technical solution adopted by the present invention to solve its technical problems is: construct a kind of video stream grouping transmission method, comprise the following steps:
(a)在服务端将编码器生成的码流根据网络状况封装为RTP分组,并将所述RTP分组传送到接收端;(a) encapsulating the code stream generated by the encoder into RTP packets according to network conditions at the server end, and sending the RTP packets to the receiving end;
(b)所述接收端将接收的RTP分组解码获得视频数据。(b) The receiving end decodes the received RTP packet to obtain video data.
在本发明所述的视频码流分组传输方法中,所述步骤(a)包括:In the video code stream packet transmission method of the present invention, said step (a) includes:
(a1)在服务端根据接收端的服务请求将来自编码器的码流置入位于服务端的打包缓冲区;(a1) At the server end, according to the service request of the receiving end, the code stream from the encoder is placed into the packaging buffer located at the server end;
(a2)在服务端通过应用控制器监测网络状况,并使用打包器根据所述网络状况将编码器生成的码流封装为RTP分组;(a2) monitor the network condition through the application controller at the server end, and use the packer to encapsulate the code stream generated by the encoder into RTP packets according to the network condition;
(a3)将所述RTP分组传送到所述接收端。(a3) Transmitting the RTP packet to the receiving end.
在本发明所述的视频码流分组传输方法中,所述步骤(b)包括:In the video code stream packet transmission method of the present invention, said step (b) includes:
(b1)在所述接收端将接收的RTP分组置入位于接收端的接收缓冲区并等待指定时间;(b1) placing the received RTP packet into the receiving buffer at the receiving end at the receiving end and waiting for a specified time;
(b2)将所述接收缓冲区中的RTP分组发送到解码器解码。(b2) Send the RTP packet in the receiving buffer to the decoder for decoding.
在本发明所述的视频码流分组传输方法中,所述步骤(a)中包括向RTP分组中加入重要等级参数以及根据重要等级传送RTP分组的步骤,所述步骤(b)包括有根据RTP分组中的重要等级参数优先解码重要等级高的RTP分组的步骤。In the video code stream packet transmission method of the present invention, said step (a) includes the steps of adding an importance level parameter to the RTP packet and transmitting the RTP packet according to the importance level, and said step (b) includes the step of adding an important level parameter according to the RTP The importance level parameter in the packet preferentially decodes the RTP packet with high importance level.
在本发明所述的视频码流分组传输方法中,所述码流为AVS-P2码流,所述RTP分组中包括有RTP头文件、AVS-P2码流的语法层元素和媒体数据。In the video code stream packet transmission method of the present invention, the code stream is an AVS-P2 code stream, and the RTP packet includes RTP header files, syntax layer elements of the AVS-P2 code stream and media data.
在本发明所述的视频码流分组传输方法中,所述网络状况包括网络带宽、码率及丢包率中的一个或多个,在所述步骤(a)中,服务端所生成的RTP分组的大小随着网络带宽的增大而增大、随着码率的增大而增大、随着丢包率的增大而减小。In the video code stream packet transmission method of the present invention, the network conditions include one or more of network bandwidth, code rate and packet loss rate, and in the step (a), the RTP generated by the server The size of the packet increases with the increase of the network bandwidth, increases with the increase of the code rate, and decreases with the increase of the packet loss rate.
在本发明所述的视频码流分组传输方法中,所述RTP分组包括RTP头和RTP净载,其中RTP净载包括有RTP净载头信息和媒体数据。In the video code stream packet transmission method of the present invention, the RTP packet includes an RTP header and an RTP payload, wherein the RTP payload includes RTP payload header information and media data.
在本发明所述的视频码流分组传输方法中,所述RTP净载头信息包括有首场优先标志、重要首场标志以及逐行帧标志参数。In the video code stream packet transmission method of the present invention, the RTP payload header information includes first field priority flag, important first field flag and progressive frame flag parameters.
在本发明所述的视频码流分组传输方法中,所述步骤(a)中包括使用传递编码时间信息和多视频数据分组封装进行交错分组和视频源切换的步骤。In the video code stream packet transmission method of the present invention, the step (a) includes the steps of using the transfer encoding time information and multi-video data packet encapsulation to perform interleaved grouping and video source switching.
本发明还提供一种视频码流分组传输系统,包括通过网络相连接的服务端和接收端,所述服务端包括有提供码流的码流源、用于监测网络状况的应用控制器以及将来自码流源的码流封装为RTP分组的打包器,所述接收端包括解码来自服务端的所述RTP分组的解码器,其中所述打包器根据应用控制器的监测网络的结果将所述码流封装为特定大小的RTP分组。The present invention also provides a video code stream grouping transmission system, including a server and a receiving end connected through a network, the server includes a code stream source for providing a code stream, an application controller for monitoring network conditions, and a The code stream from the code stream source is encapsulated into a packer for RTP packets, and the receiving end includes a decoder for decoding the RTP packets from the server, wherein the packer converts the code stream according to the results of monitoring the network of the application controller Streams are encapsulated into RTP packets of a certain size.
在本发明所述的视频码流分组传输系统中,所述码流源为将视频文件编码为码流的编码器或编码器组,或者为存储有码流的存储装置。In the video code stream packet transmission system of the present invention, the code stream source is an encoder or an encoder group that encodes a video file into a code stream, or a storage device storing a code stream.
在本发明所述的视频码流分组传输系统中,所述接收端包括有缓存来自服务端的RTP分组的接收缓冲区,所述接收缓冲区将接收的RTP分组缓存预定时间后发送到所述解码器解码。In the video code stream packet transmission system of the present invention, the receiving end includes a receiving buffer for buffering RTP packets from the server, and the receiving buffer buffers the received RTP packets for a predetermined time and sends them to the decoder device decoding.
在本发明所述的视频码流分组传输系统中,所述RTP分组包括RTP头和RTP净载,其中RTP净载包括有RTP净载头信息和媒体数据。In the video code stream packet transmission system of the present invention, the RTP packet includes an RTP header and an RTP payload, wherein the RTP payload includes RTP payload header information and media data.
在本发明所述的视频码流分组传输系统中,所述RTP分组中包括有标识RTP分组重要等级的参数,所述编码器优先解码重要等级高的RTP分组。In the video stream packet transmission system of the present invention, the RTP packet includes a parameter identifying the importance level of the RTP packet, and the encoder preferentially decodes the RTP packet with a high importance level.
在本发明所述的视频码流分组传输系统中,所述码流为AVS-P2码流,所述RTP分组中包括有RTP头文件、AVS-P2码流的语法层元素和媒体数据In the video code stream packet transmission system of the present invention, the code stream is an AVS-P2 code stream, and the RTP packet includes RTP header files, syntax layer elements and media data of the AVS-P2 code stream
在本发明所述的视频码流分组传输系统中,所述RTP分组中包括标识扩展数据出现的参数,所述网络状况包括网络带宽、码率及丢包率中的一个或多个,服务端所生成的RTP分组的大小随着网络带宽的增大而增大、随着码率的增大而增大、随着丢包率的增大而减小。In the video code stream packet transmission system according to the present invention, the RTP packet includes parameters identifying the occurrence of extended data, and the network conditions include one or more of network bandwidth, code rate and packet loss rate, and the server The size of the generated RTP packet increases with the increase of the network bandwidth, increases with the increase of the code rate, and decreases with the increase of the packet loss rate.
本发明的视频码流分组传输和系统,通过根据网络状况将码流封装为大小不同的RTP分组,提高了传输效率,使端到端的延时最小化,从而提高视频传输质量。此外,本发明通过设置重要等级参数,保证了视频质量。The video code stream packet transmission and system of the present invention, by encapsulating the code stream into RTP packets of different sizes according to network conditions, improves transmission efficiency, minimizes end-to-end delay, and improves video transmission quality. In addition, the present invention ensures the video quality by setting important level parameters.
此外,本发明通过传递编码时间信息和多视频数据分组封装进行交错分组和视频源切换的方法,提高了错误掩盖和服务系统的负载均衡能力。In addition, the present invention improves the error concealment and the load balancing ability of the service system by transmitting the encoding time information and encapsulating multiple video data packets to perform interleaved grouping and video source switching.
附图说明Description of drawings
下面将结合附图及实施例对本发明作进一步说明,附图中:The present invention will be further described below in conjunction with accompanying drawing and embodiment, in the accompanying drawing:
图1是本发明视频码流分组传输系统的结构示意图;Fig. 1 is the structural representation of video code stream packet transmission system of the present invention;
图2是本发明视频码流分组传输系统中的RTP分组的第一实施例结构示意图;Fig. 2 is the structural representation of the first embodiment of the RTP packet in the video code stream packet transmission system of the present invention;
图3是本发明视频码流分组传输系统中的RTP分组的第二实施例结构示意图;Fig. 3 is the second embodiment structural representation of the RTP packet in the video code stream packet transmission system of the present invention;
图4是本发明视频码流分组传输系统中的切换视频源的RTP分组示意图;Fig. 4 is the RTP packet schematic diagram of switching video source in the video stream packet transmission system of the present invention;
图5是本发明视频码流分组传输系统中RTP净载头的示意图;Fig. 5 is the schematic diagram of the RTP payload header in the video stream packet transmission system of the present invention;
图6是本发明视频码流分组传输方法的流程图;Fig. 6 is the flow chart of the video code stream packet transmission method of the present invention;
图7是图6中封装AVS-P2码流步骤的流程图;Fig. 7 is the flow chart of encapsulation AVS-P2 stream step among Fig. 6;
图8是图6中接收并解码播放RTP分组步骤的流程图。FIG. 8 is a flow chart of the steps of receiving and decoding the playing RTP packet in FIG. 6 .
具体实施方式Detailed ways
如图1所示,是本发明的视频码流分组传输系统的结构示意图。以下以AVS-P2码流为例,来说明本发明的视频码流分组传输系统。As shown in FIG. 1 , it is a schematic structural diagram of the video code stream packet transmission system of the present invention. In the following, an AVS-P2 code stream is taken as an example to illustrate the video code stream packet transmission system of the present invention.
在本实施例中,本发明的视频码流分组传输系统是基于AVS-P2的视频通讯系统,其包括一个AVS-P2视频互联网服务系统(简称服务端)11和多个通过网络与服务端连接的AVS-P2视频互联网接收终端系统(简称接收端,图中仅示出一个)12。其中,服务端11用于根据接收端的请求发送流媒体,而接收端12则解码来自服务端11的流媒体,从而播放视频或音频文件。在服务端11也可包括多个后备视频互联网服务系统。In the present embodiment, the video stream packet transmission system of the present invention is based on the AVS-P2 video communication system, which includes an AVS-P2 video Internet service system (abbreviated as the server) 11 and a plurality of devices connected to the server through the network. The AVS-P2 video Internet receiving terminal system (abbreviated as the receiving end, only one is shown in the figure) 12. Among them, the
服务端11包括有编码器112、打包器113以及应用服务器111。其中编码器112用于将原始图像编码为AVS-P2码流,并将生成的码流传送到打包器113。应用控制器111用于监测网络13的状况,该网络状况可以是网络13的带宽、码率、丢包率中的一个或多个。打包器113用于根据应用控制器111的监测结果将来自编码器112的码流,按照RTP净载格式(请参考图5及相关描述)封装为具有不同大小的RTP(Real Time Transport Protocol,实时传输协议)分组。例如,当应用控制器111监测到网络带宽不足时,打包器113生成的每一RTP分组包含较小的数据量,而在网络带宽较大时,打包器113生成的每一RTP分组包含较大的数据量。封装完成后,服务端11将封装完的RTP分组通过网络13发送到接收端12。在本实施例中,打包器113所生成的RTP分组的大小随着网络带宽的增大而增大,随着码率的增大而增大,随着丢包率的增大而减小。RTP分组的结构将在图2和图3中详细描述。此外,服务端11可通过重复传输来提高接收端12的正确解码能力。The
当然,服务端11也可包括多个编码器;或者不包括编码器112,而通过存储器直接存储AVS-P2码流,打包器113直接打包存储器中的AVS-P2码流。Of course, the
打包器113与编码器112之间还可设置一个打包缓冲区,用来缓存码流,打包器113依次从打包缓冲区中取出码流进行封装。A packing buffer may also be set between the
接收端12包括解码器122和播放器123。其中解码器122用于解码接收的RTP分组,并将解码后的视频数据传送到播放器123播放。The
为提高播放器123的播放效果,可在接收端12设置一个接收缓冲区121。通过该接收缓冲区121将来自服务端11的RTP分组缓存一个预定的时间(可根据网络状况设置),再传送到解码器122解码,从而避免了由于网络延时和丢包等原因造成的播放停顿,保证了视频数据播放的连续性。In order to improve the playback effect of the
由于接收端11接收到的RTP分组的编码时间可能是交错的,因此接收缓冲区121所需要的内存可能比AVS-P2视频标准中相应档次级别所规定的解码缓冲区大。该接收缓冲区121的初始大小可以由服务端11根据分组生成方法估计,然后通过MIME参数的形式传送给接收端12。解码器122取得缓存在接收缓冲区121中的RTP分组后,将根据伴随的参数信息,按时间顺序解码重组。Since the encoding time of the RTP packets received by the receiving
如图2、图3、图5所示,是本发明视频码流分组传输系统中的RTP分组的结构示意图。As shown in FIG. 2 , FIG. 3 , and FIG. 5 , they are schematic structural diagrams of RTP packets in the video code stream packet transmission system of the present invention.
服务端11接收到接收端12发出的服务请求以后,从编码器112中得到AVS-P2码流(或者从存储器中得到预先生成的AVS-P2码流)。由于AVS-P2的图像一般比较大,而网络带宽是有限的,因此需将码流进行分组传送。正常情况下,码流将被分割成几个RTP分组。如果不考虑AVS-P2压缩编码的特点,盲目分组,将影响传输的效率和质量,既有可能因为无法适应底层分组数据单元(PDU)的大小而被重新强制分割造成传输效率低下,也有可能因为前面传输数据的丢失,而影响后面数据的播放。因此在发送到网络上之前,使生成的AVS-P2码流进入打包器113。After receiving the service request sent by the receiving
由于AVS-P2码流是分层结构的,因此可采用不同的分组结构,并使用参数来指示分组中的码流内容。在每一RTP分组中,其通过参数的组合来指示分组中的内容中是否包含AVS-P2的各语法层元素,如序列头信息、图像头信息、条带数据或者在一个RTP分组中包含多种类型内容等,以头部参数信息加随后媒体数据形式构成分组。这样,就可以充分利用带宽,提高传输效率。Since the AVS-P2 code stream has a hierarchical structure, different packet structures can be used, and parameters are used to indicate the content of the code stream in the group. In each RTP packet, it uses a combination of parameters to indicate whether the contents of the packet contain AVS-P2 syntax layer elements, such as sequence header information, image header information, slice data, or multiple Various types of content, etc., are grouped in the form of header parameter information plus subsequent media data. In this way, the bandwidth can be fully utilized and the transmission efficiency can be improved.
当网络资源比较紧张时,可以把一个码流(甚至一个条带)分成几个分组来传输,防止因为带宽的不足而无法承载大数据。如图2所示,参数1、参数2等为AVS-P2码流的语法元素(例如序列头信息、图像头信息、条带数据等),而媒体信息则为上述语法元素组合对应的码流片段包含的视频数据,该情况下,一个RTP分组可包括一个或多个参数。当带宽允许时,也可以把多个码流封装在一个RTP分组内,其也可以通过参数来指示。如图3所示,参数1’、2’等为视频数据序列号,而媒体信息1’、2’则为码流对应的视频数据。这种依据网络状况的实时封装提高了数据的传输效率。When network resources are relatively tight, a code stream (or even a strip) can be divided into several packets for transmission to prevent large data from being unable to be carried due to insufficient bandwidth. As shown in Figure 2,
当带宽允许并且服务段11和接收端12的处理内存足够时,甚至可以把不同编码时序的多个码流封装在一个RTP分组中,通过码流前的一个时间参数来指示该段数据的解码顺序。例如:在一般情况下,分组中的内容按照原来码流的编码时间顺序依次封装后发送到网络上,“1,2,3,4,5,6,7,8,9,…”;为提高错误掩盖能力,通过设定参数,可以在时间上交错的封装码流,如按以下编码顺序来发送分组:“1,4,2,5,3,6,7,10,8,…”。When the bandwidth allows and the processing memory of the
当有多个服务请求时,为了均衡服务端11的负载,视频源需要进行切换时,也可以通过周期传送序列头信息的方法,在任意开始点连续中继的传输AVS-P2码流,如图4所示。序列头随后的码流由该序列头负责解释。When there are multiple service requests, in order to balance the load of the
如图5所示,为一个具体的RTP净载头的示意图。RTP净载由RTP净载头和媒体数据构成。RTP净载头中的各参数说明如下:As shown in FIG. 5 , it is a schematic diagram of a specific RTP payload header. The RTP payload consists of the RTP payload header and media data. The parameters in the RTP payload header are described as follows:
PD:用于标识当前图像的显示时间顺序(8位),其值的范围是0-255,对于同一图像的所有RTP分组,该参数值是相同。PD: It is used to identify the display time sequence of the current image (8 bits), and its value ranges from 0 to 255. For all RTP packets of the same image, the value of this parameter is the same.
AN:用于启动位N(1位),当随后的位N被用作传递AVS-P2净载中的图像头信息发生变化的情况时该位设置为1;当随后的位N不用时此位设置为0。AN: It is used to start bit N (1 bit). When the subsequent bit N is used to convey the change of the image header information in the AVS-P2 payload, this bit is set to 1; when the subsequent bit N is not used, this bit is set to 1. bit is set to 0.
N:用于标识新图像头的出现(1位)。当包含在上一图像头中的信息不能用来为当前图像重建图像头时(即上一相同类型的图像与当前图像采用不同的参数集编码),此位设置为1。对于属于同一图像的所有RTP包,该位保持不变。这样,重建一幅图像(一场或一帧)时,可通过检测组成该图像的任何一个RTP包中的位N,来判断重建所需要的信息是包含在当前图像(N=1)还是以前的图像中(N=0)。N: Used to identify the presence of a new picture header (1 bit). This bit is set to 1 when the information contained in the previous picture header cannot be used to reconstruct the picture header for the current picture (ie, the previous picture of the same type was encoded with a different parameter set than the current picture). This bit remains unchanged for all RTP packets belonging to the same image. In this way, when reconstructing an image (one field or one frame), it can be judged whether the information required for reconstruction is contained in the current image (N=1) or before by detecting the bit N in any RTP packet that makes up the image. in the image (N=0).
S:用于标识序列头是否出现(1位)。通常设置为0,只有当每次AVS-P2的序列头出现时,该位才设置为1。S: Used to identify whether the sequence header appears (1 bit). Normally set to 0, this bit is only set to 1 each time the AVS-P2 sequence header is present.
B:用于标识条带的开始(1位)。当RTP净载的开头是条带开始码,或者当条带开始码前面只有一个或多个序列头和/或图像头时,该位设置为1。B: Used to identify the start of a stripe (1 bit). This bit is set to 1 when the beginning of the RTP payload is a slice start code, or when the slice start code is preceded by only one or more sequence headers and/or picture headers.
E:用于标识条带的结束(1位)。当RTP净载的最后一字节是AVS-P2的条带的结束码时,该位设置为1。E: used to identify the end of the stripe (1 bit). This bit is set to 1 when the last byte of the RTP payload is the slice end code for AVS-P2.
P:用于标识图像类型(3位)。例如值1表示I帧,值2表示P帧,值3表示B帧。对于一个给定图像的每个RTP包,这个值是不变的。值000禁止,值100-111保留用于支持AVS规定在以后的扩展。P: Used to identify the image type (3 bits). For example, a value of 1 indicates an I frame, a value of 2 indicates a P frame, and a value of 3 indicates a B frame. This value is constant for each RTP packet of a given image. A value of 000 is prohibited, and a value of 100-111 is reserved to support future extensions specified by AVS.
PS:用于标识图像结构(2位)。PS为“0”表示当前图像的两场的编码数据依次出现;值为“1”表示当前图像的两场的编码数据交替出现(请参考AVS-P2中对picture_structure的解释)。PS: Used to identify the image structure (2 bits). When PS is "0", it means that the encoded data of the two fields of the current image appears sequentially; when the value is "1", it means that the encoded data of the two fields of the current image appears alternately (please refer to the explanation of picture_structure in AVS-P2).
TF:首场优先标志(1位)(请参考AVS-P2中对top_field_first字段的解释)。TF: First field priority flag (1 bit) (please refer to the explanation of the top_field_first field in AVS-P2).
R:重要首场标志(1位)(请参考AVS-P2中对repeat_first_field字段的解释)。R: important first field flag (1 bit) (please refer to the explanation of the repeat_first_field field in AVS-P2).
G:逐行帧标志位(1位)。值为“0”表示该帧的两行是隔行场,这两场之间存在一个场时间间隔。如果该位值为“1”,则说明该帧的两场实际来自同一时刻(请参考AVS-P2中对progressive_frame字段的规定)。G: Progressive frame flag (1 bit). A value of "0" indicates that the two lines of the frame are interlaced fields with a field time gap between them. If the bit value is "1", it means that the two fields of the frame actually come from the same moment (please refer to the provisions of the progressive_frame field in AVS-P2).
PHD:图像头出现标志位(1位)。通常设置为0,仅当每次AVS-P2的图像头(i_piciture_header或者pb_picture_header)出现时,该位才设置为1。这一位用来检测RTP包中图像头是否出现。PHD: The flag bit (1 bit) appears in the image header. Normally set to 0, this bit is only set to 1 every time an AVS-P2 picture header (i_picture_header or pb_picture_header) appears. This bit is used to detect whether the image header is present in the RTP packet.
T:扩展数据出现标志位(1位),该参数关系到RTP分组的大小。AVS-P2规定的sequence_display_extension,copyright_extenstion,camera_parameter_extenstion等扩展出现标志。当RTP净载中有这些扩展数据出现的时候,该位设置为1。尽管扩展数据可以改进视频性能,但是它们是否包含在RTP净载中是可选的。T: Extended data occurrence flag (1 bit), this parameter is related to the size of the RTP packet. AVS-P2 stipulated sequence_display_extension, copyright_extenstion, camera_parameter_extenstion and other extended signs. When these extended data appear in the RTP payload, this bit is set to 1. Although extension data can improve video performance, their inclusion in the RTP payload is optional.
I:交织模式标志位(1位)。表示在同一RTP包中当前净载头和净载媒体数据之后,将跟随另一个净载头和媒体数据。I: Interleaving mode flag bit (1 bit). Indicates that after the current payload header and payload media data in the same RTP packet, another payload header and media data will follow.
RSV:保留(6位)。保留用于将来的扩展应用。RSV: Reserved (6 bits). Reserved for future extended applications.
本实施例中,通过AN、N、S、B、E以及PD、PS、TF、R、G、PHD、T、I、PR等参数,使RTP分组内容能在有效传输的基础上被充分理解并有助于接收端解码。通过参数S、PHD、B、E、T和I所赋值的组合,实时把视频数据封装成大小尺寸适当的分组,以提高传输效率。例如,当这几个参数都设置为1时,在一个RTP分组中就可能封装一个视频序列和一些用户数据。通过S,PD和I参数的组合,可以在一个RTP分组内封装多个视频数据单元,每个视频数据单元之前的净载信息中PD标识了该码流的解码时间。例如以下列形式封装RTP分组:“RTP头+序列头1+时序1+码流1+时序2+码流2+序列头2+时序3+码流3”。这样可以把多源视频数据封装在一个RTP分组中,进行交错分组和视频源的切换。从而提高传输的错误掩盖能力和服务端的负载均衡能力。通过TF、R、G参数实现重复传输,从而提高正确解码的能力。In this embodiment, through parameters such as AN, N, S, B, E and PD, PS, TF, R, G, PHD, T, I, PR, etc., the RTP packet content can be fully understood on the basis of effective transmission And help the receiving end to decode. Through the combination of the assigned values of parameters S, PHD, B, E, T and I, the video data is encapsulated into packets of appropriate size in real time to improve transmission efficiency. For example, when these parameters are all set to 1, a video sequence and some user data may be encapsulated in one RTP packet. Through the combination of S, PD and I parameters, multiple video data units can be encapsulated in one RTP packet, and the payload information before each video data unit indicates the decoding time of the code stream in PD. For example, the RTP packet is encapsulated in the following form: "RTP header +
由于AVS-P2是一种运动图像的压缩技术,图像之间的时间依赖性比较强,当前面的图像发生错误时,有可能影响后续图像的解码。通常B帧不参加预测,因此其损坏并不会造成错误扩散,而I帧和P帧则不同,它们的损坏将引起错误扩散,从而影响播放质量。在观看视频时,主观感觉是一个很重要的指标,在一幅图像中,观众对每部分的兴趣点是不同的。在一序列图像中,有些图像的相似程度较高,它们的损坏或丢失对主观感受的影响比较小,而有些图像是场景转换点或者是观众的兴趣点,是比较重要的。因此在分组时,可以依据分组控制器对内容的判断,通过一个参数来标志该分组的重要性。对重要性标志等级比较高的分组,传输系统优先发送传输,或者在一定时间范围内向接收端重复传输。Since AVS-P2 is a moving image compression technology, the time dependence between images is relatively strong. When an error occurs in the previous image, it may affect the decoding of subsequent images. Usually the B frame does not participate in the prediction, so its damage will not cause error diffusion, but the I frame and P frame are different, their damage will cause error diffusion, thus affecting the playback quality. When watching a video, subjective feeling is a very important indicator. In an image, the audience's interest points for each part are different. In a sequence of images, some images have a high degree of similarity, and their damage or loss has relatively little impact on subjective experience, while some images are scene transition points or points of interest of the audience, which are more important. Therefore, when grouping, according to the judgment of the grouping controller on the content, a parameter can be used to mark the importance of the grouping. For packets with a relatively high level of importance, the transmission system sends the transmission first, or repeats the transmission to the receiving end within a certain time range.
因此可依据内容重要性和兴趣点,在RTP分组中设置优先级标志位PR(2位),以适配网络状况和平衡接收端负载。例如当00级为最高优先级,11级为最低优先级。当网络资源紧张时,将优先传送参数和满足基本传输带宽的视频数据(优先级较高的数据);在网络队列中或在接收端超负荷时,尽量先处理高优先级数据而丢弃低优先级数据。在接收端12,对于标志为重要等级高的分组,接收缓冲区121接收到后,将优先交付解码播放。当由于延时超过缓冲区大小时,可丢弃标志为较低优先级的分组,保证高优先级分组的实时解码播放。Therefore, the priority flag bit PR (2 bits) can be set in the RTP packet according to the importance of the content and the point of interest, so as to adapt to the network condition and balance the load of the receiving end. For example, when level 00 is the highest priority,
当然,上述分组格式中各参数的命名除了以上的形式外,也可以采用其它的命名形式。Of course, besides the above-mentioned forms, other naming forms may also be used for the naming of each parameter in the above grouping format.
以下以AVS-P2码流为例,描述本发明的视频码流分组传输方法。The video code stream packet transmission method of the present invention is described below by taking an AVS-P2 code stream as an example.
如图6所示,为本发明视频码流分组传输方法的流程图。As shown in FIG. 6 , it is a flow chart of the video code stream packet transmission method of the present invention.
首先,在服务端11,其根据接收端12的服务请求(即播放视频数据的请求),使用编码器112将指定的视频文件编码为AVS-P2码流,或者直接从存储有AVS-P2码流的存储装置取出AVS-P2码流,并将上述码流根据网络状况按照《AVS-P2RTP净载格式》封装为RTP分组。然后,服务端11将生成的RTP分组通过网络传送到接收端12(步骤S61)。First, at the
在接收端12接收到RTP分组后,将接收的RTP分组解码为视频数据,并通过播放器播放视频数据(步骤S62)。After receiving the RTP packet, the
如图7所示,为图6中封装AVS-P2码流步骤的流程图。As shown in FIG. 7 , it is a flow chart of the steps of encapsulating the AVS-P2 code stream in FIG. 6 .
首先服务端11根据来自接收端12的服务请求,将请求的视频文件编码为AVS-P2码流;或者直接从存储装置中取出AVS-P2码流,并将码流置入打包缓冲区(步骤S71)。At
服务端11还通过应用控制器111获取网络13的实时状况,具体包括网络带宽、码率、丢包率中的一个或多个(步骤S72)。The
然后,服务端11使用打包器113根据应用控制器111监测的网络状况,将打包缓冲区中的AVS-P2码流按照RTP净载格式封装为具有不同大小的RTP分组。例如,当应用控制器111监测到网络带宽不足时,打包器113生成的每一RTP分组包含较小的数据量,而在网络带宽较大时,打包器113生成的每一RTP分组包含较大的数据量。封装完成后,服务端11将封装完的RTP分组通过网络13发送到接收端12。RTP分组的结构如图2、图3、图5所示(步骤S73)。此外,还可通过重复传输来提高接收端12的正确解码能力。Then, the
最后,服务端11将生成的RTP分组通过网络13传送到接收端12(步骤S74)。Finally, the
如图8所示,为图6中接收并解码播放RTP分组步骤的流程图。As shown in FIG. 8 , it is a flowchart of the steps of receiving and decoding the RTP packet in FIG. 6 .
首先接收端12将来自服务端11的RTP分组置入接收缓冲区121,并等待一个预定的时间。该预定的时间避免了因网络延时和包的丢失等造成的播放停顿,保证了播放的连续性(直接播放则有可能因后续RTP分组未接收到而使解码暂停),其值可根据网络状况预先设定,例如网络带宽较小时等待时间较长,而网络带宽较大时等待时间较短(步骤S81)。First, the receiving
然后将接收缓冲区121中的RTP分组发送到解码器122进行解码,从而获得视频数据,并使用播放器123进行播放(步骤S82)。Then send the RTP packet in the receiving
以上所述,仅为本发明较佳的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应该以权利要求的保护范围为准。The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present invention can easily think of changes or Replacement should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.
Claims (16)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510102176 CN1852429A (en) | 2005-12-05 | 2005-12-05 | Video-code-flow grouped transmission method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510102176 CN1852429A (en) | 2005-12-05 | 2005-12-05 | Video-code-flow grouped transmission method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1852429A true CN1852429A (en) | 2006-10-25 |
Family
ID=37133896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200510102176 Pending CN1852429A (en) | 2005-12-05 | 2005-12-05 | Video-code-flow grouped transmission method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1852429A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010063147A1 (en) * | 2008-12-03 | 2010-06-10 | 中兴通讯股份有限公司 | Method and mobile terminal for sharing mobile phone television program |
| CN101834964A (en) * | 2010-03-31 | 2010-09-15 | 耿直 | Voice data transmission processing method and voice data transmission processor |
| CN101394557B (en) * | 2007-09-20 | 2010-10-13 | 奇景光电股份有限公司 | Decoder and method of operating the same |
| CN102647337A (en) * | 2011-02-17 | 2012-08-22 | 宏碁股份有限公司 | Network packet transmission method and system |
| CN103108186A (en) * | 2013-02-21 | 2013-05-15 | 中国对外翻译出版有限公司 | Method of achieving high-definition transmission of videos |
| CN104038759A (en) * | 2014-06-09 | 2014-09-10 | 华为技术有限公司 | Video coding method and decoding method and related devices |
| CN104080015A (en) * | 2014-06-19 | 2014-10-01 | 宁波公众信息产业有限公司 | Video coding method |
| CN104506959A (en) * | 2014-12-15 | 2015-04-08 | 广东威创视讯科技股份有限公司 | Packet transmission method and packet transmission system for H264 code streams |
| CN105142180A (en) * | 2015-07-29 | 2015-12-09 | 大连理工大学 | A Multi-channel Concurrent Image Transmission Method Based on IEEE802.11p Protocol |
| CN106604060A (en) * | 2016-12-28 | 2017-04-26 | 桂林龙隐科技有限公司 | Distribution method and distributer of wireless WiFi multimedia broadcast system |
| CN106791941A (en) * | 2016-12-28 | 2017-05-31 | 桂林龙隐科技有限公司 | Wireless WiFi multi-media broadcasting systems and method |
| CN106790143A (en) * | 2016-12-28 | 2017-05-31 | 桂林龙隐科技有限公司 | The self adaptation group deinterleaving method and device of wireless WiFi multi-media broadcasting systems |
| CN111435991A (en) * | 2019-01-11 | 2020-07-21 | 上海交通大学 | Point cloud code stream packaging method and system based on grouping |
| CN114333862A (en) * | 2021-11-10 | 2022-04-12 | 腾讯科技(深圳)有限公司 | Audio encoding method, decoding method, device, equipment, storage medium and product |
| CN115174567A (en) * | 2022-06-22 | 2022-10-11 | 浙江大华技术股份有限公司 | Code sending method, device, equipment and storage medium |
| CN118338088A (en) * | 2024-06-17 | 2024-07-12 | 江苏北弓智能科技有限公司 | A method for transmitting AVS3 video based on RTP protocol |
| CN118802873A (en) * | 2023-08-23 | 2024-10-18 | 咪咕文化科技有限公司 | A video code stream processing method, device, equipment and readable storage medium |
| CN119135665A (en) * | 2024-09-05 | 2024-12-13 | 京东方科技集团股份有限公司 | Data processing method, device, equipment, chip and storage medium |
| CN119155287A (en) * | 2024-08-21 | 2024-12-17 | 咪咕文化科技有限公司 | Video bitstream encapsulation method, apparatus, electronic device and program product |
| WO2025020560A1 (en) * | 2023-07-24 | 2025-01-30 | 中兴通讯股份有限公司 | Method and apparatus for transmitting avs3 video code stream |
-
2005
- 2005-12-05 CN CN 200510102176 patent/CN1852429A/en active Pending
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101394557B (en) * | 2007-09-20 | 2010-10-13 | 奇景光电股份有限公司 | Decoder and method of operating the same |
| WO2010063147A1 (en) * | 2008-12-03 | 2010-06-10 | 中兴通讯股份有限公司 | Method and mobile terminal for sharing mobile phone television program |
| KR101302880B1 (en) * | 2008-12-03 | 2013-09-05 | 지티이 코포레이션 | Method and mobile terminal for sharing mobile phone television program |
| CN101834964B (en) * | 2010-03-31 | 2013-07-03 | 耿直 | Voice data transmission processing method |
| CN101834964A (en) * | 2010-03-31 | 2010-09-15 | 耿直 | Voice data transmission processing method and voice data transmission processor |
| CN102647337A (en) * | 2011-02-17 | 2012-08-22 | 宏碁股份有限公司 | Network packet transmission method and system |
| CN102647337B (en) * | 2011-02-17 | 2015-02-11 | 宏碁股份有限公司 | Network packet transmission method and system |
| CN103108186A (en) * | 2013-02-21 | 2013-05-15 | 中国对外翻译出版有限公司 | Method of achieving high-definition transmission of videos |
| CN104038759A (en) * | 2014-06-09 | 2014-09-10 | 华为技术有限公司 | Video coding method and decoding method and related devices |
| WO2015188729A1 (en) * | 2014-06-09 | 2015-12-17 | 华为技术有限公司 | Video coding method and video decoding method and related device |
| CN104038759B (en) * | 2014-06-09 | 2017-11-17 | 华为技术有限公司 | Method for video coding and coding/decoding method and relevant apparatus |
| CN104080015A (en) * | 2014-06-19 | 2014-10-01 | 宁波公众信息产业有限公司 | Video coding method |
| CN104506959A (en) * | 2014-12-15 | 2015-04-08 | 广东威创视讯科技股份有限公司 | Packet transmission method and packet transmission system for H264 code streams |
| CN105142180A (en) * | 2015-07-29 | 2015-12-09 | 大连理工大学 | A Multi-channel Concurrent Image Transmission Method Based on IEEE802.11p Protocol |
| CN105142180B (en) * | 2015-07-29 | 2018-12-21 | 大连理工大学 | A Multi-channel Concurrent Image Transmission Method Based on IEEE802.11p Protocol |
| CN106791941A (en) * | 2016-12-28 | 2017-05-31 | 桂林龙隐科技有限公司 | Wireless WiFi multi-media broadcasting systems and method |
| CN106604060B (en) * | 2016-12-28 | 2023-08-11 | 桂林龙隐科技有限公司 | Distribution method and distributor of wireless WiFi multimedia broadcasting system |
| CN106604060A (en) * | 2016-12-28 | 2017-04-26 | 桂林龙隐科技有限公司 | Distribution method and distributer of wireless WiFi multimedia broadcast system |
| CN106791941B (en) * | 2016-12-28 | 2023-08-11 | 桂林龙隐科技有限公司 | Wireless WiFi multimedia broadcasting system and method |
| CN106790143A (en) * | 2016-12-28 | 2017-05-31 | 桂林龙隐科技有限公司 | The self adaptation group deinterleaving method and device of wireless WiFi multi-media broadcasting systems |
| CN111435991B (en) * | 2019-01-11 | 2021-09-28 | 上海交通大学 | Point cloud code stream packaging method and system based on grouping |
| CN111435991A (en) * | 2019-01-11 | 2020-07-21 | 上海交通大学 | Point cloud code stream packaging method and system based on grouping |
| CN114333862A (en) * | 2021-11-10 | 2022-04-12 | 腾讯科技(深圳)有限公司 | Audio encoding method, decoding method, device, equipment, storage medium and product |
| CN114333862B (en) * | 2021-11-10 | 2024-05-03 | 腾讯科技(深圳)有限公司 | Audio encoding method, decoding method, device, equipment, storage medium and product |
| CN115174567A (en) * | 2022-06-22 | 2022-10-11 | 浙江大华技术股份有限公司 | Code sending method, device, equipment and storage medium |
| WO2025020560A1 (en) * | 2023-07-24 | 2025-01-30 | 中兴通讯股份有限公司 | Method and apparatus for transmitting avs3 video code stream |
| CN118802873A (en) * | 2023-08-23 | 2024-10-18 | 咪咕文化科技有限公司 | A video code stream processing method, device, equipment and readable storage medium |
| WO2025040105A1 (en) * | 2023-08-23 | 2025-02-27 | 咪咕文化科技有限公司 | Video bitstream processing method and apparatus, and device and readable storage medium |
| CN118338088A (en) * | 2024-06-17 | 2024-07-12 | 江苏北弓智能科技有限公司 | A method for transmitting AVS3 video based on RTP protocol |
| CN119155287A (en) * | 2024-08-21 | 2024-12-17 | 咪咕文化科技有限公司 | Video bitstream encapsulation method, apparatus, electronic device and program product |
| CN119135665A (en) * | 2024-09-05 | 2024-12-13 | 京东方科技集团股份有限公司 | Data processing method, device, equipment, chip and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1852429A (en) | Video-code-flow grouped transmission method and system | |
| KR101292490B1 (en) | A method comprising encapsulating BC-1 information in an RTP packet, a computer readable medium for implementing the RTP data structure, an access unit data structure, a source module, a decoder module, a source module and a decoder module, and a target module. | |
| CN1165138C (en) | Method and device for transmitting data packet with compressed header | |
| US20200029130A1 (en) | Method and apparatus for configuring content in a broadcast system | |
| CN1196339C (en) | Method and apparatus for streaming scalable video | |
| CN1217530C (en) | Server, system and method for transmitting a data signal having a sequence of data units | |
| CN1242623C (en) | Video encoding method, decoding method, and related encoder and decoder | |
| US20090103635A1 (en) | System and method of unequal error protection with hybrid arq/fec for video streaming over wireless local area networks | |
| CN1640076A (en) | Media Streaming Distribution System | |
| CN1643875A (en) | Data streaming system and method | |
| CN1751517A (en) | image decoding method | |
| CN1449628A (en) | Video fault tolerance control | |
| CN103051978A (en) | H264-based real-time mobile video service control method | |
| CN1171158C (en) | Flowing Method of Moving Images in Video-on-Demand System | |
| CN101589616B (en) | Error filter to differentiate between reverse link and forward link video data errors | |
| CN1781314A (en) | Picture coding method | |
| CN1717047A (en) | Data streaming file, method and system for moving data streaming service | |
| CN1781313A (en) | Picture coding method | |
| CN1717935A (en) | I-picture insertion on request | |
| CN101068210A (en) | Multimedia data transmitting method | |
| CN1643932A (en) | Data structure for data streaming system | |
| CN101742271B (en) | Method, system and device for transmitting stream media data | |
| CN1864409A (en) | Medium signal transmission method, reception method, transmission/reception method, and device | |
| CN1960260A (en) | Method for providing IPTV service for different type terminals, and IPTV service system | |
| CN1668110A (en) | Method and apparatus for increasing the average image refresh rate in a compressed video bitstream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |