[go: up one dir, main page]

WO2012094980A1 - Procédé et système de transmission multimédia en continu, et serveur de transfert multimédia - Google Patents

Procédé et système de transmission multimédia en continu, et serveur de transfert multimédia Download PDF

Info

Publication number
WO2012094980A1
WO2012094980A1 PCT/CN2012/070174 CN2012070174W WO2012094980A1 WO 2012094980 A1 WO2012094980 A1 WO 2012094980A1 CN 2012070174 W CN2012070174 W CN 2012070174W WO 2012094980 A1 WO2012094980 A1 WO 2012094980A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
packet size
information
adaptation
size adaptation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2012/070174
Other languages
English (en)
Chinese (zh)
Inventor
陈光亮
王芳
刘继年
孙健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Publication of WO2012094980A1 publication Critical patent/WO2012094980A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/765—Media network packet handling intermediate

Definitions

  • the present invention relates to the field of multimedia data transmission technologies, and in particular, to a multimedia data transmission method, system and media forwarding server for packet size adaptation in a multimedia real-time transmission process.
  • the streaming media server packs media content such as audio, video, subtitles or animation into a media stream, and the media stream is continuously transmitted in real time on the network in groups.
  • the client does not have to wait for the media content to be completely downloaded, and only needs to delay a few seconds or ten. Playback can be started in a few seconds, while the media stream is played and played until the media content is played or the client aborts.
  • Application of streaming media transmission technology can significantly shorten media playback latency and reduce client cache requirements.
  • Streaming media is facing new application scenarios across networks or heterogeneous networks.
  • the same media streams need to support services on different networks.
  • the packet adaptation (PacketSize) adaptation is a transmission adaptation measure.
  • the optimal transmission efficiency can be obtained, and the packet loss rate can be controlled to a medium and low level, and the bandwidth utilization rate can be increased without wasting limited bandwidth resources, thereby providing better quality of service.
  • the Internet Protocol (Internet Protocal, IP) uses a method of segmentation and assembly for packet size adaptation, and assigns a unique identifier to each IP data packet, that is, an IP data packet.
  • the header portion also has segmentation and assembly.
  • Related segmentation marks and displacements When an IP packet is segmented, each segment needs to contain the original identifier.
  • segmentation and reassembly are usually provided by the IP source and destination, and the router does not perform IP layer segmentation and reassembly.
  • IPv6 The Internet Protocol Version 6, IPv6, includes a segment offset value, a "more segment” flag, and an identification field through the segmentation extension header. The length of the source node pair exceeds the source and destination. Maximum Transmission Unit (Maximum Transmission Unit, The MTU) packet is segmented. IPv6 only allows the source node to segment the packet, which simplifies the processing of the packet by the intermediate node.
  • MTU Maximum Transmission Unit
  • the packet size has been determined.
  • the router cannot perform packet size adaptation, so the optimal transmission efficiency cannot be achieved.
  • the technical problem to be solved by the present invention is to provide a streaming media transmission method and system to improve network transmission efficiency.
  • the present invention provides a streaming media transmission method, the method comprising: a streaming media server sending a media stream, where the media packet size adaptation information is carried;
  • the media forwarding server forwards the media stream after the packet size adaptation process.
  • the media packet size adaptation information includes adaptation range information, load layout information, and adaptation load information; the adaptation range information includes a maximum transmission unit (MTU) corresponding to an available packet size; the load layout information. The number of load packets corresponding to each packet size is included, and load header and load data positioning information of each load packet; and the adapted load information includes load header data and data length.
  • MTU maximum transmission unit
  • the media packet size adaptation information further includes descrambling information, which is used to provide descrambling required information for the packet size-adapted scrambled data.
  • the media packet size adaptation information is carried by a transport header or data portion.
  • Performing the packet size adaptation process according to the media packet size adaptation information includes: segmenting or reorganizing the media stream to be forwarded according to the media packet size adaptation information and combining the underlying transmission link state, and completing the adaptation process. .
  • the media stream forwarded by the media forwarding server carries the original media packet size adaptation information or the updated media packet size adaptation information; or the media packet size adaptation information is filtered out in the media stream.
  • the present invention also provides a streaming media transmission system, the system comprising a streaming media server and a media forwarding server, wherein:
  • the streaming server is configured to: send a media stream, where the media packet size adaptation information is carried; the media forwarding server includes:
  • a receiving module configured to: receive the media stream
  • an adaptation processing module configured to: perform packet size adaptation processing on the media stream according to media packet size adaptation information in the received media stream;
  • the forwarding module is configured to: forward the packet size to process the processed media stream.
  • the media packet size adaptation information includes adaptation range information, load layout information, and adaptation load information; the adaptation range information includes a maximum transmission unit (MTU) corresponding to an available packet size; the load layout information. The number of load packets corresponding to each packet size is included, and load header and load data positioning information of each load packet; and the adapted load information includes load header data and data length.
  • MTU maximum transmission unit
  • the present invention also provides a media forwarding server, which includes:
  • a receiving module configured to receive a media stream sent by the streaming media server
  • an adaptation processing module configured to perform packet size adaptation processing on the media stream according to the received media packet size adaptation information in the media stream
  • a forwarding module configured to forward the media stream after the packet size adaptation process.
  • the media stream sent by the streaming media server carries the media packet size adaptation information; in the network transmission process of the media stream, the media forwarding server adapts the information and the link status according to the media packet size in the media stream. Provide packet size adaptation for optimal network transmission efficiency.
  • FIG. 1 is a schematic diagram of a streaming media transmission method according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a streaming media transmission system according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a specific example of a communication system
  • FIG. 4 depicts an example of media packet size adaptation information of the present invention being transmitted in a separate stream
  • FIG. 5 depicts an example of media packet size adaptation information for media packets of the present invention to be placed in separate streams for transmission;
  • Figure 6 is a diagram showing an example of media packet size adaptation information of the present invention placed in a media transport header for transmission;
  • Figure 7 illustrates the processing flow of the media forwarding server in the packet size adaptation embodiment
  • Figure 8 depicts a media client endpoint broadcast procedure in a packet size adaptation embodiment.
  • a logical or physical device that provides a media transport layer forwarding function in a media stream transmission process is referred to as a media forwarding server.
  • the real-time segmentation or assembly of the media stream by the media forwarding server is an application layer solution for realizing media packet size adaptation.
  • MPEG Moving Pictures Experts Group
  • TS Transport Stream
  • Real-time transmission protocol
  • Transport protocol supports variable length packets and specifies various load formats.
  • the media forwarding server needs to parse the RTP payload and perform real-time segmentation or assembly according to the payload format.
  • the media forwarding server needs to support various encoding formats with high complexity; on the other hand, real-time segmentation and assembly can affect the efficiency of the media forwarding server.
  • the media forwarding server cannot perform arbitrary on the media stream. Segmentation or assembly, otherwise it may affect the descrambling of the code stream at the terminal.
  • an embodiment of the present invention provides a streaming media transmission method and system, where a streaming media server sends a media stream, which carries media packet size adaptation information; in a network transmission process of the media stream, the media forwarding server is based on the media stream.
  • Media packet size adaptation information and link conditions provide packet size adaptation for optimal network transmission efficiency.
  • the streaming media transmission method of the embodiment of the present invention includes:
  • Step 101 The media server sends a media stream, where the media packet size adaptation information is carried.
  • the media packet size adaptation information in the embodiment of the present invention includes, but is not limited to, adaptation range information, load layout information, and adaptation load information.
  • the media packet size adaptation information further includes adding descrambling information.
  • the media packet is large, and the adaptation information includes but is not limited to the following four types of information:
  • the adaptation range information provides a description of the packet size adaptation range, the total number of choices available for packet size adaptation, and the MTU for each selection.
  • the load layout information is selected according to each packet size, and the number of load packets is provided, as well as the load header and load data location information of each load packet.
  • a media frame When aligned according to the frame, a media frame may be split into multiple packets for transmission.
  • the load layout information indicates how many load packets the media frame is split into, the load header and the corresponding load data start position.
  • the load layout information indicates how many load packets, the load headers, and the corresponding load data start positions that the GOP is split into.
  • the starting position is a byte offset based on the alignment point, and the specific description corresponds to the specific transmission format of the media packet size information, which is not limited herein.
  • the payload header uses the agreed load transfer format, such as the load format defined by the RTP series transmission standard defined by the standard organization IETF, or other restrictions.
  • the descrambling information is transmitted, and the information required for descrambling is provided for the packet data after the packet size is adapted.
  • a streaming media packet carried on the underlying network usually consists of a transmission header, a payload header, and data.
  • the media packet size adaptation information may be placed in a transport header to carry.
  • extensions are made for RTP and MPEG-TS.
  • the existing standard media transport protocols RTP and MPEG-TS represent two different transport ideas, respectively.
  • RTP supports variable length.
  • MPEG-2 TS is defined as a fixed byte of 188 due to the early impact of early transmission network technology. With the development of network technology, it is evolving.
  • TS' a variable length transmission method based on MPEG-2 TS is referred to as TS'.
  • the media group can be carried in the extension field. Size adaptation information, as shown in Figure 5 below.
  • the media packet size adaptation information may also be placed in the data part, for example, for the TS' transmission mode, a PID (Program Identification) is added to the PMT (Program Map Table) to transmit the media packet size.
  • PID Program Identification
  • PMT Program Map Table
  • the information flow is adapted, and the media packet size adaptation information is delivered through a custom format, as shown in FIG. 4 subsequently.
  • the redundant content in the media packet size adaptation information such as the adaptation range, may also be carried in a user-defined descriptor ( Private descriptors) in the PMT that describes the transport size adaptation information stream.
  • Step 102 The media forwarding server receives the media stream according to the media in the received media stream.
  • the packet size adaptation information performs packet size adaptation processing on the media stream;
  • the media forwarding server applies media packet size adaptation information to provide fast packet and assembly adaptation functions.
  • Step 103 The media forwarding server forwards the media stream after the packet size adaptation process.
  • the media layer adaptation is performed by the media forwarding server in the transport network according to the media packet size adaptation information in the media stream.
  • a media forwarding server such as a media forwarding server located at the edge of the network, identifies the adaptation requirements for the packet size. Then, according to the adaptation of the underlying transmission link status, the media stream carries the media packet size adaptation information, and the media stream is segmented or reorganized to complete the adaptation process.
  • the media forwarding server may choose to transparently forward the media packet size adaptation information during the forwarding process, or modify the media packet size adaptation information and then forward the packet, or filter the media packet size adaptation information.
  • the embodiment of the present invention further provides a streaming media transmission system.
  • the system includes a streaming media server and a media forwarding server, where:
  • the streaming media server is configured to send a media stream, where the media packet size adaptation information is carried;
  • the media forwarding server includes:
  • a receiving module configured to receive the media stream
  • the adaptation processing module is configured to perform packet size adaptation processing on the media stream according to media packet size adaptation information in the received media stream;
  • the forwarding module is configured to forward the media stream after the packet size adaptation process.
  • the media packet size adaptation information includes adaptation range information, load layout information, and adaptation load information;
  • the adaptation range information includes a maximum transmission unit (MTU) corresponding to an available packet size.
  • the load layout information includes the number of load packets corresponding to each packet size, and load header and load data positioning information of each load packet;
  • the adapted load information includes load header data and data length.
  • the media packet size adaptation information further includes descrambling information, and is used to provide descrambling required information for the packet size-adapted scrambled data.
  • the media packet size adaptation information may be, but is not limited to, being carried by a transport header or a data part. Belt.
  • Performing the packet size adaptation process according to the media packet size adaptation information includes: segmenting or reorganizing the media stream to be forwarded according to the media packet size adaptation information and combining the underlying transmission link state, and completing the adaptation process. .
  • the media stream forwarded by the media forwarding server carries the original media packet size adaptation information or the updated media packet size adaptation information; or the media packet size adaptation information is filtered out in the media stream.
  • Fig. 3 shows a specific example of a communication system in which the network 1 includes a streaming server 10, a router 11, a router 12a and a media forwarding server 12b, the network 2 includes a router 13, and the network 3 includes a router 14.
  • the communication system is used for network transmission and forwarding of packet data such as audio, video, subtitle, data, and the like.
  • the network layer of the communication system uses the IP protocol, and the data link layer uses Dense Wavelength Division Multiplexing (DWDM) or Asynchronous Transfer Mode (ATM).
  • DWDM Dense Wavelength Division Multiplexing
  • ATM Asynchronous Transfer Mode
  • the forwarding steps of the media stream in the communication system are as follows:
  • Step A In the network 1, the streaming server 10 outputs various media streams in real time.
  • the link of the streaming server 10 is configured to transmit at least 1500 bytes of network packets.
  • Figures 4 and 5 show an example of media packet size adaptation information being transmitted in a separate stream.
  • the example uses a variable length TS' media transport format based on MPEG-2 TS.
  • Figure 4 depicts the media streaming situation
  • TS Program Association Table
  • program_number program number of 0x0001
  • PID program ID of 0x0100.
  • Figure 5 shows an example of the adaptation information format.
  • the specific structure is defined as shown in Table 1:
  • the above structure definition contains the following information:
  • Adaptation range information MTU_num and MTU fields
  • Load layout information Fields in the second For Loop;
  • Adaptation load information header-len and header-data-byte fields point to the payload header; the bytes between payload-start-offset and payload-end-offset are payloads; Scrambling information: is—conditional access field. If the value 1 indicates that the media is scrambled, no segmentation or combination is allowed.
  • Figure 6 shows an example of media packet size adaptation information placed in the media transport header for transmission. The difference from Figure 4 is:
  • TS, ⁇ only one media stream with stream type 0xlB and PID 0x0111, and media packet size adaptation information is placed in the TS' header of the video stream.
  • the media packet size adaptation information is carried at the alignment point where the PID is 0x0111 (not shown in this figure.
  • the method of header extension is standard, and the information field is embodied in Figure 5 and Table 1, no longer here. Brief description). If the alignment point is a frame boundary, the packet size of the TS' packet containing the first bit of each video frame carries the media packet size adaptation information.
  • Figure 5 shows the adaptation information format PacketSizeAdaptation—Private—data is also applicable, and it needs to be optimized in terms of byte length.
  • Step B The media stream flows through the router 11 to the router 12a, and the router 12a receives the media stream and forwards it to the 12b media forwarding server of the same node;
  • Step C The media forwarding server 12b performs packet size adaptation on the media stream according to the MTU or link status of the network 2 and the network 3.
  • the terminals facing network 2 are mobile handheld devices such as 15a and 15b, and the MTU is configured to be 500 bytes.
  • Network 3 is for PCs and TV devices such as 15d and 15e, and the MTU is configured to be 1000 bytes.
  • 15c is a high-definition television device, and the MTU is configured as 1500 bytes. If the media packet size adaptation information provides four MTU options of 250 bytes, 500 bytes, 1000 bytes, and 1500 bytes, the MTU of the 1500-byte original media stream after being adapted by the media forwarding server 12b is 500 words. Section, 1000 bytes. For 15c, the media forwarding server 12b does not need to perform packet size adaptation.
  • Step D the adapted media stream is transmitted to the router 13 of the network 2 and the router 14 of the network 3 through the router 12a;
  • Step E the router 13 transmits the media stream QoS to the network nodes 15a and 15b, and the router 14 transmits the media stream QoS to the network nodes 15d and 15e for media playback.
  • Figure 7 depicts the processing flow of the streaming media forwarding server. The process is as follows:
  • Step 701 The streaming media server 10 sends the foregoing example media stream.
  • Step 702 The media forwarding server 12b receives the media stream, and the media forwarding server 12b identifies the media packet size adaptation information PacketSizeAdaptation_Private_data;
  • Step 703 The media forwarding server 12b performs adaptation according to PacketSizeAdaptation-Private-data. Specifically, the step includes:
  • the link MTU select an appropriate MTU from the adaptation range information (such as the MTU_num and MTU fields in Table 1);
  • 703d Determine an adaptation load according to the determined load layout information: sequentially execute a third For loop in the second For loop that has been located. Read header-len and header-data to get the payload header, read bytepayload_start_offset and payload-end-offset to get the load from the media data;
  • 703e segment or assemble the adapted load according to the load layout information into a complete transport packet and forward it to the underlying network for forwarding;
  • Step 704 the media forwarding server 12b detects whether the program information changes, if there is no change, step 707 is performed, otherwise step 705 is performed;
  • Step 705 Cache the changed program information, and send the updated program information.
  • Step 705 The media forwarding server 12b forwards the adapted media stream, and filters the media packet size adaptation information when the transmission efficiency is forwarded.
  • FIG 8 illustrates the client endpoint broadcast process in the IPTV multicast live broadcast scenario.
  • the process is as follows: Step 801: The client 15a selects an IPTV multicast live broadcast;
  • Step 802 The client 15c joins the multicast group.
  • Step 803 the router 12a notifies the media forwarding server 12b;
  • Step 804 The media forwarding server 12b sends the buffered program information that changes according to the packet size adaptation.
  • Step 805 The client 15c initializes the decoding resource according to the program information.
  • Step 806 the media forwarding server 12b forwards the packet size-adapted code stream to the router 12a;
  • Step 807 The router 12a forwards the media stream to the 15c client.
  • Step 808 The client 15c decodes and presents the received multicast media stream.
  • the streaming media transmission method and system provided by the embodiments of the present invention perform media layer packet size adaptation on the media forwarding device by means of media stream inband information, and are applicable to scenarios in which streaming media is transmitted across networks and heterogeneous networks, and can be effective. Improve transmission efficiency.
  • the media stream transmission method and the media stream sent by the streaming media server in the system carry the media packet size adaptation information; in the network transmission process of the media stream, the media forwarding server provides the media packet size adaptation information and the link status according to the media stream.
  • the packet size is adapted to achieve optimal network transmission efficiency.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

La présente invention porte sur un procédé et un système de transmission multimédia en continu, et sur un serveur de transfert multimédia. Le procédé comprend les opérations suivantes : un serveur de transmission multimédia en continu envoie un flux multimédia contenant des informations d'adaptation de taille de paquet multimédia ; un serveur de transfert multimédia reçoit le flux multimédia et effectue un traitement d'adaptation de taille de paquet sur le flux multimédia, conformément aux informations d'adaptation de taille de paquet multimédia figurant dans le flux multimédia reçu ; et le serveur de transfert multimédia transfère le flux multimédia après traitement d'adaptation de taille de paquet. Le procédé et le système de transmission multimédia en continu de la présente invention peuvent améliorer l'efficacité de transmission du réseau.
PCT/CN2012/070174 2011-01-11 2012-01-10 Procédé et système de transmission multimédia en continu, et serveur de transfert multimédia Ceased WO2012094980A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2011100046800A CN102594775A (zh) 2011-01-11 2011-01-11 流媒体传输方法与系统
CN201110004680.0 2011-01-11

Publications (1)

Publication Number Publication Date
WO2012094980A1 true WO2012094980A1 (fr) 2012-07-19

Family

ID=46482983

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/070174 Ceased WO2012094980A1 (fr) 2011-01-11 2012-01-10 Procédé et système de transmission multimédia en continu, et serveur de transfert multimédia

Country Status (2)

Country Link
CN (1) CN102594775A (fr)
WO (1) WO2012094980A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101253771A (zh) * 2005-08-30 2008-08-27 汤姆森许可贸易公司 用于ieee802.11无线局域网上的可扩展视频组播的跨层优化
CN101494655A (zh) * 2009-03-12 2009-07-29 中国电信股份有限公司 Rtp分布式流媒体服务系统及方法
US20090310622A1 (en) * 2008-06-12 2009-12-17 Alcatel Lucent Minimal GAN RTP packet length via multi-level header compression

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101253771A (zh) * 2005-08-30 2008-08-27 汤姆森许可贸易公司 用于ieee802.11无线局域网上的可扩展视频组播的跨层优化
US20090310622A1 (en) * 2008-06-12 2009-12-17 Alcatel Lucent Minimal GAN RTP packet length via multi-level header compression
CN101494655A (zh) * 2009-03-12 2009-07-29 中国电信股份有限公司 Rtp分布式流媒体服务系统及方法

Also Published As

Publication number Publication date
CN102594775A (zh) 2012-07-18

Similar Documents

Publication Publication Date Title
US11621984B2 (en) Interface apparatus and method for transmitting and receiving media data
CN105264846B (zh) 发送装置、传输流的发送方法以及处理装置
US10911510B2 (en) Apparatus and method for transmitting multimedia data in a broadcast system
CN109347815B (zh) 用于在混合网络中传送多媒体数据的装置和方法
US20090022154A1 (en) Reception device, reception method, and computer-readable medium
EP1965561A2 (fr) Système et procédé de transmission de contenu numérique en utilisant une architecture de dérivation de système de terminaison de modem à câble (CMTS)
US8341244B2 (en) Data distribution communication apparatus and data distribution system
TWI477126B (zh) 用於最大限度地利用訊框突發的電纜數據機及其方法與終端系統
WO2012094998A1 (fr) Procédé, système et dispositif pour transférer un multimédia en flux continu
KR101567991B1 (ko) 고속 인터넷 프로토콜 네트워크에서의 데이터 전송을 위한 데이터 운반 컨테이너
US9288150B2 (en) Method and apparatus for supporting class of service over bonded digital subscriber line (DSL) links
JP2024120983A (ja) 送信方法および送信装置
WO2012094980A1 (fr) Procédé et système de transmission multimédia en continu, et serveur de transfert multimédia
MX2008002770A (es) Sistema y metodo para transmitir contenido digital utilizando arquitectura de derivacion de sistema de terminacion de modem de cable (cmts).

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12733922

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12733922

Country of ref document: EP

Kind code of ref document: A1