CN101938324B - Network media stream playing method and device - Google Patents

Abstract

An embodiment of the present invention provides a method and device for playing network media streams, the method comprising: receiving the network media stream sent by the media data source from the first port; receiving the network media stream sent by the media data source from the second port forward error correction redundancy information; play the network media stream according to the forward error correction redundancy information. The method and device for playing network media streams in the embodiments of the present invention use another port different from the media data port to receive forward error correction redundant information, which is naturally compatible with terminals that do not integrate forward error correction functions, and realizes the largest terminal compatibility.

Description

Method and device for playing network media stream

technical field

The present invention relates to the communication field, in particular to a method and device for playing network media streams.

Background technique

IPTV (Internet Protocol Television) is a technology that uses broadband IP networks to provide home users with a variety of interactive services, including digital TV. Users enjoy interactive Internet TV services through STB (Set Top Box, Internet set-top box) and ordinary TV sets at home.

The CDN (Content Distribution Network, Content Distribution Network) and the terminal are interconnected through a traditional IP network, and generally use connectionless UDP (User Datagram Protocol, User Datagram Protocol) messages to transmit media content. UDP packets will be randomly lost after passing through multiple bearer network devices, which may cause picture damage or sound pause for streaming media content. In order to solve this problem, TCP (Transmission Control Protocol) can be used to transmit media content, but the packet-by-packet confirmation mechanism has a large overhead on the server and network, and is not suitable for large-scale applications.

FIG. 1 is a structural diagram of a network media stream transmission system based on forward error correction technology in the prior art. As shown in Figure 1, the principle of FEC (Forward Error Correction) technology is that the network media streaming server performs forward error correction encoding on the original media content, and adds a certain amount of forward error correction redundancy to the original media content. After the information is sent out together; the client performs reverse FEC forward error correction decoding to recover the lost message, so as to improve the video quality.

There are many algorithms for FEC forward error correction encoding and decoding, such as "Raptor", "ReedSolomon", etc., with different complexity and erasure correction performance. In this field, erasure correction means recovering packet fragments lost during network transmission of network media streams, and the erasure correction function is completed by the FEC decoding module. The FEC decoding module is generally integrated into the STB and requires some customization. In practical applications, there are various manufacturers of set-top boxes, and the software and hardware versions are also different. Some set-top boxes have not completed the integration of FEC decoding algorithms due to the development progress of manufacturers or hardware performance limitations. Therefore, how to provide streaming services of the same content to these set-top boxes has become a very real problem.

In view of this, the existing technology multiplexes the FEC redundant data of the network media stream into the RTP (Real-time Transport Protocol, real-time transport protocol) stream, and uses the reserved PT (Payload Type, payload type) field for transmission. The PT field is used to indicate the format and type of the RTP payload and to determine the analysis method adopted by the terminal application layer program for this payload. The reserved PT field can be used to identify the type of the RTP message as FEC redundant data of the network media stream.

In the prior art, a single data channel is used to transmit network media streams and their FEC redundant data in time-sharing, for example, an alternate transmission mode in which multiple network media stream messages are transmitted first and then a FEC redundant data message is transmitted. In the prior art, when an RTP stream is used as an FEC redundant data transmission channel, a terminal not integrated with a corresponding FEC function must actively discard an RTP packet of a specific payload type that cannot be identified or parsed. For the terminal, the processing of the FEC redundant message needs to be explicitly perceived, that is, the terminal needs to receive the FEC redundant message from the network and send it to the application layer before making judgment and processing.

Contents of the invention

Embodiments of the present invention provide a method and device for playing network media streams, a method and device for sending network media streams, and a method and device for playing network media streams in embodiments of the present invention receive forward The error correction redundant information recovers the lost data message fragments in the network media stream according to the received forward error correction redundant information, and plays the restored network media stream.

On the one hand, an embodiment of the present invention provides a method for playing a network media stream, the method comprising: receiving the network media stream sent by the media data source from the first port; receiving the network media stream sent by the media data source from the second port forward error correction redundancy information of the network media stream; playing the network media stream according to the forward error correction redundancy information.

On the other hand, an embodiment of the present invention provides a device for playing network media streams, the device comprising: a first receiving unit configured to receive a network media stream sent by a media data source from a first port; a second receiving unit configured to receiving from the second port the forward error correction redundancy information of the network media stream sent by the media data source; a playing unit configured to play the network media stream according to the forward error correction redundancy information.

In yet another aspect, an embodiment of the present invention provides a method for sending a network media stream, the method comprising: sending the network media stream to a first port of a terminal device; sending forward error correction redundancy information of the network media stream to sent to the second port of the terminal device.

In yet another aspect, an embodiment of the present invention provides an apparatus for sending a network media stream, the apparatus comprising: a first sending unit, configured to send the network media stream to a first port of a terminal device; a second sending unit, configured to sending the forward error correction redundancy information of the network media stream to the second port of the terminal device.

The embodiments of the present invention have the following beneficial technical effects: the media data sending method and device of the embodiments of the present invention do not interweave forward error correction redundancy information into the network media stream, but interweave the network media stream and its forward error correction redundancy The remaining information is sent to different ports of the terminal device, and the terminal application layer does not need to display and perceive the FEC redundant message, which effectively avoids the failure of the terminal device to play because it does not support the decoding function of the corresponding forward error correction redundant information message Defects, to achieve compatibility with various terminal equipment.

Description of drawings

Fig. 1 is the frame diagram of the network media stream transmission system based on forward error correction technology of prior art;

Fig. 2 is the overall flow chart of the network media stream playing method of the embodiment of the present invention;

Fig. 3 is the functional block diagram of the network media stream player of the embodiment of the present invention;

4 is an overall flowchart of a method for sending a network media stream according to an embodiment of the present invention;

FIG. 5 is a functional block diagram of a device for sending network media streams according to an embodiment of the present invention;

Fig. 6 is a system schematic diagram of an embodiment of the present invention;

FIG. 7 is a flow chart of a specific implementation method for compatible playback according to an embodiment of the present invention;

FIG. 8 is one of the flow charts of media playing signaling in an embodiment of the present invention;

FIG. 9 is the second flow chart of media playing signaling in the embodiment of the present invention;

FIG. 10 is the third flow chart of media playing signaling in the embodiment of the present invention.

Detailed ways

The embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. The following exemplary description should be interpreted as an explanation of the claims of the present invention rather than a limitation of the claims of the present invention.

In the prior art, a data channel is used to time-divisionally transmit network media streams and forward error correction redundant data of the network media streams. The terminal needs to send the received RTP message to the application layer for identification, judgment or analysis. For a terminal that does not integrate the corresponding FEC function, it must actively For discarding, the terminal needs to be aware of the FEC redundant RTP packets that retain the PT value. The method and device provided by the embodiments of the present invention use two ports to respectively receive the network media stream and the redundant information of the network media stream. The defect that the redundant information message cannot be played due to the decoding function of error correction has realized the compatibility with various terminal equipments.

FIG. 2 is an overall flowchart of a method for playing network media streams according to an embodiment of the present invention. As shown in Figure 2, a kind of playing method of network media stream of the embodiment of the present invention comprises the following steps:

Step S201, receiving a network media stream sent by a media data source from a first port;

Step S202, receiving the forward error correction redundancy information of the network media stream sent by the media data source from the second port;

Step S203, playing the network media stream according to the forward error correction redundancy information.

Specifically, in practical applications, step S201 also includes step 200:

Step 200, open the first port for receiving the network media stream and the second port for receiving the forward error correction redundancy information of the network media stream;

Optionally, step S203 may specifically include: recovering lost data packet fragments in the network media stream according to the forward error correction redundancy information, and playing the recovered network media stream;

Optionally, step S201 may be located after step S202; optionally, step S201 and step S202 may occur simultaneously.

Optionally, the method further includes: agreeing on the second port through dynamic negotiation with the media data source; or determining the second port according to configuration information. For example, the way of dynamic negotiation can be to transmit the second port number through the "SETUP" command of RTSP (Real Time Streaming Protocol, real-time streaming protocol) between the media data source and the terminal equipment. The manner of obtaining the first port may optionally be obtained through RTSP signaling interaction between the media data source and the terminal device.

FIG. 3 is a functional block diagram of an apparatus for playing network media streams according to an embodiment of the present invention, and the apparatus may be located in an STB. As shown in FIG. 3 , a playback device 30 of a network media stream according to an embodiment of the present invention includes: a port monitoring unit 31 configured to open a first port for receiving a network media stream and a forward error correction device for receiving the network media stream. The second port of redundant information is used for port monitoring; the first receiving unit 32 is used to receive the network media stream sent by the media data source from the first port; the second receiving unit 33 is used to receive the network media stream from the second port The forward error correction redundancy information of the network media stream sent by the media data source is received; the playing unit 34 is configured to play the network media stream according to the forward error correction redundancy information. Optionally, the playing unit 34 may recover the lost data packet fragments in the network media stream according to the forward error correction redundancy information, and then play the recovered network media stream.

Optionally, the playing device of the network media stream also has a port setting unit 35, which is used to agree on the second port through dynamic negotiation with the media data source; or determine the second port according to configuration information. port. The method of obtaining the first port may follow the method of the prior art, for example, obtain through RTSP signaling interaction between the media data source and the terminal device.

FIG. 4 is a flow chart of an overall method of a method for sending a network media stream according to an embodiment of the present invention. As shown in Figure 4, a method for sending a network media stream according to an embodiment of the present invention includes:

Step S401, sending the network media stream to the first port of the terminal device;

Step S402, sending the forward error correction redundancy information of the network media stream to the second port of the terminal device.

Optionally, step S401 may be located after step S402; optionally, step S401 and step S402 may be performed simultaneously.

Optionally, the method further includes: agreeing on the second port through dynamic negotiation with the terminal; or determining the second port according to configuration information. For example, the manner of dynamic negotiation may be to transfer the second port number between the media data source and the terminal device through an RTSP "SETUP" command. The manner of acquiring the first port may be, for example, acquiring through RTSP signaling interaction between the media data source and the terminal device.

Fig. 5 is a functional block diagram of an apparatus for sending a network media stream according to an embodiment of the present invention, and the apparatus may be located in an MS. As shown in FIG. 5 , a network media stream sending device 50 according to an embodiment of the present invention includes: a first sending unit 51, configured to send the network media stream to a first port of a terminal device; a second sending unit 52, configured to Send the forward error correction redundancy information of the network media stream to the second port of the terminal device.

Optionally, the network media stream sending device 50 in this embodiment further includes a port setting unit 53, configured to agree on the second port through dynamic negotiation with the terminal; or determine the second port according to configuration information. Optionally, the manner of dynamic negotiation may be to transmit the first port number and the second port number through an RTSP "SETUP" command between the network media stream sending apparatus and the terminal device. The manner of acquiring the first port is, for example, acquiring through RTSP signaling interaction between the media data source and the terminal device.

FIG. 6 is a system schematic diagram of an embodiment of the present invention. As shown in FIG. 6 , the system of the embodiment of the present invention includes: a network media stream sending device 61 and a network media stream playing device 62 . The network media stream sending device 61 is optionally MS or a media content source, and the media content source optionally has a FEC encoder; the network media stream sending device 61 is connected to the network media stream playing device 62 through an IP network, and the playing device 62 can It is a set-top box STB, optionally, the STB has a FEC decoder; the display device 63 connected to the set-top box 62 is optionally a TV, a monitor or a computer.

FIG. 7 is a flow chart of a specific implementation method for compatible playback according to an embodiment of the present invention. As shown in Figure 7, the compatible playing method of the present embodiment includes the following steps:

Step S701, the network media stream playing device according to the embodiment of the present invention opens a first port for receiving the network media stream and a second port for receiving forward error correction redundancy information of the network media stream;

Step S702, the network media stream playing device according to the embodiment of the present invention receives the network media stream sent by the media data source from the first port;

Step S703, the network media stream playing device of the embodiment of the present invention judges whether the forward error correction redundancy information received from the second port of the network media stream exceeds the preset waiting time, if yes, proceed to step S704, if not, proceed to Step S706;

Step S704, giving up receiving the FEC redundant information, and giving up decoding the FEC redundant information;

Step S705, the terminal device directly plays the received network media stream, presenting a normal image quality;

Step S706, the terminal device judges whether the software and hardware version of its own FEC decoder has a corresponding FEC redundant information decoding function, if yes, proceed to step S707, if not, proceed to step S709;

Step S707, the terminal device decodes the forward error correction redundant information;

Step S708, the terminal device plays the media data according to the forward error correction redundancy information, presenting a smooth picture quality; this step may further include: recovering the lost data packets in the network media stream according to the forward error correction redundancy information Fragmentation, playing the restored network media stream;

Step S709, the terminal device gives up decoding the forward error correction redundant information;

Step S710, the terminal device directly plays the received network media stream, presenting a normal image quality.

The method and device for sending network media streams according to the embodiments of the present invention configure the network media streams and their forward error correction redundancy information with different target port numbers and send them to corresponding ports of terminal equipment without destroying the original network media streams. In the method and device for playing network media streams in the embodiments of the present invention, two ports are opened to respectively receive network media streams and forward error correction redundancy information thereof, and play the network media streams according to the forward error correction redundancy information.

Fig. 8 is one of the flow charts of media playing signaling in the embodiment of the present invention. In this embodiment, the media data playing device is a set-top box, optionally a network set-top box suitable for interactive network television (IPTV). The media data sending device is a media content source, optionally a multimedia information server or media content source suitable for IPTV.

In this embodiment, the communication and interaction process between the set-top box and the media content source is as follows:

Step S801, the set-top box sends a content request to the media content source, such as RTSP, SIP (SessionInitial Protocol, session initiation protocol) request;

Step S802, the media content source replies a response message to the STB;

Step S803, the set-top box opens the first port for receiving the network media stream and the second port for receiving the forward error correction redundancy information of the network media stream;

In this embodiment, the second port is obtained through dynamic negotiation between the set-top box and the media content source or determined by pre-configuration between the set-top box and the media content source. In this embodiment, the first port and the second port are User Datagram Protocol (UDP) ports.

Step S804, the media content source sends the network media stream to the first port of the set-top box, and sends the forward error correction redundancy information of the network media stream to the second port of the set-top box;

Step S805, the set-top box receives the network media stream and the FEC redundant information of the network media stream, and uses the FEC redundant information to decode to restore the lost message and display smooth image quality.

Optionally, step S805 can also be step S805':

Step S805', if the set-top box does not integrate the corresponding decoding algorithm or function, then abandon the decoding, and directly play the network media stream to display common image quality and realize compatible playback.

In this embodiment, the media content source sends the network media stream to the first port of the set-top box, and sends the forward error correction redundancy information of the network media stream to the second port of the set-top box. Receive the network media stream, and receive the forward error correction redundant information of the network media stream from the second port, when the software and hardware version of the decoder of the set-top box supports decoding the forward error correction redundant information, decode and play the network media Stream, restore the lost message, and present a high-quality smooth image; on the contrary, the set-top box gives up decoding, and directly plays the network media stream and presents a normal image quality. In this way, the media content source in the embodiment of the present invention realizes compatibility with set-top boxes of different software and hardware versions in the embodiment of the present invention.

The method and device for playing network media streams in the embodiments of the present invention introduce a forward error correction redundant information receiving port different from the media data port, so that the forward error correction redundant information sent to the port can be actively monitored, and according to The FEC redundant information playing of the network media stream effectively realizes the compatible playing of network media streams provided by various media data sources. The method of the embodiment of the present invention can be widely applied to occasions where UDP is used for media transmission, such as IPTV, DTV interactive television, and the like.

Fig. 9 is the second flow chart of the media playing signaling in the embodiment of the present invention, the flow chart reveals that the network media stream playing device in the embodiment of the present invention and the media content source or media content source without forward error correction coding capability in the prior art Compatible playback methods between servers. In the method, a timeout processing mechanism is established on the second port of the network media stream playing device to realize compatible playing. The compatible playing method of Fig. 9 comprises the steps:

Step S901, the set-top box initiates a media content request to a media content source, such as an RTSP or SIP request;

Step S902, the media content source replies a response message to the STB;

Step S903, the set-top box opens the first port for receiving the network media stream and the second port for receiving the forward error correction redundancy information of the network media stream;

Step S904, the media content source only sends the network media stream to the first port; because the media content source does not have a forward error correction coding function, it cannot generate forward error correction redundant information of the network media stream, so only the network media stream is sent ;

Step S905, the set-top box receives the network media stream from the first port, and when the set-top box does not receive the forward error correction redundant information at the second port within the preset timeout period, it gives up receiving and forward error correction decoding at the same time, the set-top box Play network media streams directly for compatible playback with normal picture quality.

Optionally, the preset timeout time may be, for example, 100 milliseconds.

In this embodiment, when the set-top box communicates with a server that does not have a forward error correction coding function, the timeout waiting mechanism can also be used to give up receiving forward error correction redundant information from the second port of the set-top box, thereby also being able to The media content provided by the above server realizes the compatible playback of normal image quality.

FIG. 10 is the third flowchart of the media playing signaling method according to the embodiment of the present invention. The flow chart discloses the flow of a playback method of a network media stream sending device compatible with old-fashioned set-top boxes in this embodiment. The old set-top box does not have a second port dedicated to receiving forward error correction redundancy information of network media streams. The method of Fig. 10 comprises the steps:

Step S1001, the set-top box initiates a media content request to a media content source, such as an RTSP or SIP request;

Step S1002, the media content source replies a response message to the STB;

Step S1003, the set-top box opens the network media stream receiving port;

Step S1004, the media content source uses different ports to send the network media stream and the forward error correction redundancy information of the network media stream to the terminal respectively;

Step S1005 , since the set-top box only monitors one port, the set-top box only senses the network media stream, and naturally discards the FEC redundant information of the unmonitored port, and the set-top box directly plays the network media stream.

In this embodiment, the media content source sends the network media stream and the forward error correction redundancy information of the network media stream to the first port and the second port of the terminal set-top box respectively; Monitor and receive the network media stream, but the application program of the set-top box is completely unaware of the forward error correction redundant information of the unmonitored second port, so the forward error correction redundant information is naturally discarded, thus realizing The old-fashioned set-top box is compatible with the normal image quality of the network media stream sent by the media data source in the embodiment of the present invention.

To sum up, the method and device of the embodiments of the present invention achieve maximum terminal compatibility with minimum complexity. The media content source of the embodiment of the present invention can be compatible with set-top boxes with different decoding functions; at the same time, the set-top box of the embodiment of the present invention has not only been compatible with the media content source of the embodiment of the present invention, but also compatible with other media without forward error correction coding function content source.

Through the above description of the implementation manners, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary hardware platform, and of course can also be implemented entirely by hardware. Based on this understanding, all or part of the contribution made by the technical solution of the present invention to the background technology can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM, magnetic disks, optical disks, etc. , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of the present invention.

The above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, and are not intended to limit them; although the embodiments of the present invention have been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions recorded in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. network media method of putting of spreading is characterized in that described method comprises:

The network media stream that sends from the first port receiving media data source;

Receive the forward error correction redundant information of the described network media stream of described media data source transmission from the second port;

Whether the software and hardware version of judging the forward error correction decoder of self has corresponding forward error correction redundant information decoding function;

In this way, the described forward error correction redundant information of then decoding is play described network media stream according to described forward error correction redundant information;

As no, the described forward error correction redundant information of then abandoning decoding is play-overed the network media stream that receives.

2. method according to claim 1 is characterized in that, described method also comprises:

When in a preset period of time, not receiving described forward error correction redundant information, play-over described network media stream.

3. method according to claim 1 is characterized in that, described method also comprises:

By arranging described the second port with the dynamic negotiation of described media data source; Or

Determine described the second port according to configuration information.

4. a network media spreads and puts device, it is characterized in that, described device comprises:

The first receiving element is used for the network media stream that sends from the first port receiving media data source;

The second receiving element is for the forward error correction redundant information of the described network media stream that receives described media data source transmission from the second port;

Judge whether the software and hardware version of the forward error correction decoder of self has the unit of corresponding forward error correction redundant information decoding function;

Broadcast unit is yes if be used for judged result, and the described forward error correction redundant information of then decoding is play described network media stream according to described forward error correction redundant information; If the determination result is NO, the described forward error correction redundant information of then abandoning decoding is play-overed the network media stream that receives.

5. device according to claim 4 is characterized in that,

Described broadcast unit also is used for when not receiving described forward error correction redundant information in a preset period of time, play-overs described network media stream.

6. device according to claim 4 is characterized in that, described device also comprises:

The port setting unit is used for by arranging described the second port with the dynamic negotiation of described media data source; Or determine described the second port according to configuration information.

7. a network media flows sending method, it is characterized in that described method comprises:

Network media stream is sent to the first port of terminal equipment;

The forward error correction redundant information of described network media stream is sent to the second port of described terminal equipment;

Wherein, described terminal equipment judges whether the software and hardware version of the forward error correction decoder of self has corresponding forward error correction redundant information decoding function; In this way, the described forward error correction redundant information of then decoding is play described network media stream according to described forward error correction redundant information; As no, the described forward error correction redundant information of then abandoning decoding is play-overed the network media stream that receives.

8. method according to claim 7 is characterized in that, described method also comprises:

By determining described the second port with the dynamic negotiation of described terminal equipment; Or according to self disposing to determine described the second port.

9. a network media flow transmitting device is characterized in that, described device comprises:

The first transmitting element is for the first port that network media stream is sent to terminal equipment;

The second transmitting element is used for the forward error correction redundant information of described network media stream is sent to the second port of described terminal equipment;

Wherein, whether described terminal equipment has corresponding forward error correction redundant information decoding function for the software and hardware version of the forward error correction decoder of judging self; In this way, the described forward error correction redundant information of then decoding is play described network media stream according to described forward error correction redundant information; As no, the described forward error correction redundant information of then abandoning decoding is play-overed the network media stream that receives.

10. device according to claim 9 is characterized in that, described device also comprises:

The port setting unit is used for by arranging described the second port with the dynamic negotiation of described terminal equipment; Or determine described the second port according to configuration information.

Images