CN1937609B - Method, system and streaming media server for streaming media platform supporting multi-track content - Google Patents

Abstract

The invention discloses a method and system for a streaming media platform to support multi-track content, which is used to solve the problems of serious waste and difficult maintenance caused by using multiple encoders to process multi-track content in the prior art; the method Including: sending the processed data stream to the streaming media server by a live encoder, the data stream includes one channel of video data and corresponding multiple channels of audio data, wherein the live encoder specifies the audio track by the sequence number or label The corresponding relationship between tracks and languages; the streaming media server selects a channel of audio data through the sequence number or label of the track corresponding to the language specified by the user, copies the channel of audio data and the video data and sends it to the user. The invention simultaneously discloses a streaming media server and a streaming media platform supporting multi-track content processing system.

Description

Method, system and streaming media server for streaming media platform supporting multi-track content

technical field

The invention relates to the technical field of streaming media, in particular to a method, a system and a streaming media server for supporting multi-track content on a streaming media platform.

Background technique

At present, terminal equipment such as mobile phones can be based on such as GPRS (General Packet Radio Service, General Packet Radio Service), EDGE (Enhanced Data rates for Global Evolution, GSM Evolution Enhanced Data Rate), WCDMA (Wide-band Code Division Multiple Access, wideband code Division Multiple Access System), CDMA2000 (Code Division Multiple Addressing 2000, Code Division Multiple Access System 2000), TD-SCDMA (TD-SCDMA: Time Division Synchronized Code Division Multiple Access, Time Division Synchronized CDMA System), DVB-H (Digital VideoBroadcasting-Handhelds, digital TV network), DMB (Digital MultimediaBroadcasting, digital multimedia broadcasting), ISDB-T (Integrated Services DigitalBroadcasting-Terra, terrestrial integrated service digital broadcasting) and other wireless networks to surf the Internet freely, and watch movies and TV through the Internet and other streaming content.

Referring to FIG. 1A , the wireless network-based streaming media processing system includes: a live encoder 100 , a streaming media server 101 , a portal website 102 , a wireless network 103 and a terminal device 104 .

The live encoder 100 converts the input analog data into digital data, compresses it, and sends the compressed data stream to the streaming server 101 in real time; the input analog data includes one audio and one video, wherein , the dotted arrow in the figure indicates the audio data of one channel, and the solid arrow indicates the video data of one channel, the same below.

Described live coder 100 generates SDP (Session Descriptor Protocol, session description agreement) file, and this file is sent to streaming server 101; Include live coder in the described SDP file and send the compressed data flow to streaming server 101 port data and the video and audio description information of the data stream. A specific example of an SDP file is given below:

v=0

//The protocol version "v=" field gives the version of the session description protocol, excluding the minor version number.

o＝-2631350701 1507213 IN IP4 192.168.18.101

//Session origin; o＝<username><session id><version><network type><address type><address>; specific to this example: Username＝-; Session id＝2631350701; Version＝1507213; Networktype＝ IN; Address type = IP4; Address = 192.168.18.101

s=b314

//session name, s=<session name>

c＝IN IP4 236.130.128.182/1

//Connection data; c=<network type><address type><connection address>

t=00

//Time information: t=<start time><stop time>; the values of start time and stop time are decimal NTP (Network Time Protocol) time, if both are 0, it means a persistent session.

m=video 8686 RTP/AVP 96

//The media information starts with the "m=" field; m=<media><port><transport><fmt list>; media indicates the media type, for example, video indicates video, audio indicates audio, and port indicates the port for sending media streams , transport specifies the transport protocol, such as RTP/AVP, which refers to the IETF's Realtime Transport Protocol using the Audio/Video profile

carried over UDP

b=AS:1920

//"b="field describes the bandwidth of the stream: b=<modifier>:<bandwidth-value>; modifier specifies the bandwidth characteristics, which can have two values AS(Application-Specific Maximum), CT(Conference Total); bandwidth The unit of -value is kbps

a=rtpmap:96H264/90000

//The media attribute description field "a="; a=<attribute> or a=<attribute>:<value>; the "rtpmap" attribute describes the type, encoding method, sampling clock frequency, and encoding parameters of the RTP payload; a= rtpmap:<payload type><encodingname>/<clock rate>[/<encoding parameters>]; "fmtp" attribute gives the parameters of the type of special RTP payload; a=fmtp:<format><format specific parameters>

a=fmtp:96profile-level-id=4D3015;

sprop-parameter-sets=Z01AFZZWCwJNgyRAAAD6AAAYahgwADgnADqargAK, aO88gA==; packetization-mode=1

//Further give the parameters of payload type 96

a=cliprect:0,0,576,352

//Describe the screen coordinates from left to right 0-576, from top to bottom 0-352

a=framerate:25.

//Describe the frame rate. 25 frames per second

a=mpeg4-esid:201

//Corresponding to the stream numbered 201 (the video file may contain multiple video streams and audio streams, each stream is given a number, in this example the audio stream number is 201)

a=x-envivio-verid:0002229A

//Describe the version id of the envivio encoder

m=audio 8688 RTP/AVP 97

//Start audio media information description. Audio media data will be sent to port 8688, the sending protocol is UDP-based RTP protocol, the format is 97 (dynamic RTP payload type)

b=AS:32

//The bandwidth is 32kbps

a=rtpmap:97mpeg4-generic/16000/2

//Describe the payload type 97, which is mpeg4-generic encoding method, and the sampling clock is 16000HZ

a=fmtp:97 profile-level-id=15; config=1410; streamtype=5; ObjectType=64; mode=AAC-hbr; SizeLength=13; IndexLength=3; IndexDeltaLength=3

//Further, the parameters for payload type 97 are "profile-level-id=15; config=1410; streamtype=5; ObjectType=64; mode=AAC-hbr; SizeLength=13; IndexLength=3; IndexDeltaLength=3"

a=mpeg4-esid:101

//Corresponding to the stream numbered 101 (the video file may contain multiple video streams and audio streams, each stream is given a number, in this example the audio stream number is 101)

a=lang:eng

/ / Describe the identification of the input voice

a=x-envivio-verid:0002229A

//Describe the version id of the envivio encoder

Described terminal device 104 obtains the path URL (Uniform Resource Locator, Uniform Resource Locator) of streaming media content by visiting portal website 102 after surfing the Internet through wireless network 103, and initiates an access request to streaming media server 101 according to this path URL.

After the streaming media server 101 receives the access request of the terminal device 104, it parses the corresponding SDP file to obtain the port for receiving the data stream of the live encoder; data stream, copy it and send it to the terminal device for decoding and playback.

Referring to FIG. 1B, since the live encoder 100 only supports the input and output of a single channel of video data and a single channel of audio data, the streaming media server 101 only supports the output of a single channel of video data and a single channel of audio data to the terminal device 104 through the wireless network 103 , the terminal device 104 also only supports the input, decompression and playback of single-channel video data and single-channel audio data, and many streaming media contents are multilingual, that is, composed of one-channel video data and multiple-channel audio data, so when processing, One channel of video data needs to be copied by the video duplicator 105 and matched with multiple channels of audio data, and then A/D conversion and compression are performed by multiple live encoders 100 . In FIG. 1B , the portal website 102 is not shown, and its functions are the same as those described above. The above-mentioned processing requires a large number of live encoders, and the current price of live encoders is very high, which leads to a significant increase in the cost of the wireless streaming media platform, and is not convenient for subsequent maintenance.

Contents of the invention

The present invention provides a method, system and streaming media server for a streaming media platform supporting multi-track content, to solve the problems of serious waste and difficult maintenance caused by using multiple encoders to process multi-track content in the prior art .

The invention provides the following technical solutions:

A method for a streaming media platform to support multi-track content, the method comprising the steps of:

The processed data stream is sent to the streaming media server by a live coder, the data stream includes one channel of video data and corresponding multiple channels of audio data, wherein the live coder specifies the audio track and Language Correspondence;

The streaming media server selects a channel of audio data through the sequence number or label of the audio track corresponding to the language specified by the user, copies the channel of audio data and the video data, and sends them to the user.

According to the method above:

The live encoder indicates the port for receiving the one-way video data and the multiple ports for receiving the multi-channel audio data in the session description protocol SDP file sent to the streaming media server, and the streaming media server receives by listening to these ports the data stream.

The live encoder pre-specifies or specifies the correspondence between audio tracks and languages during encoding.

The streaming media server queries the user attribute database through the user ID reported by the user to obtain the sequence number or label of the audio track corresponding to the language specified by the user, and selects the audio data through the sequence number or label of the audio track.

The priority of the language specified by the user is set by the user; the streaming media server selects audio data by querying the sequence number or label of the audio track corresponding to the language with high priority.

The language specified by the user is set by the user through the portal website or obtained from the user equipment by the streaming media server, and the sequence number or label of the corresponding audio track is stored in the user attribute database.

The sequence number or label of the audio track corresponding to the language specified by the user is set in the access path of the terminal device to the streaming media server in the form of language parameters; The sequence number or label of the audio track, and select audio data by the sequence number or label of the track.

If the audio track corresponding to the language specified by the user does not contain audio data, the streaming media server selects one audio data from the received data stream, copies the audio data and the video data and sends it to the terminal device.

A streaming server, comprising:

The receiving unit is used to receive one channel of video data and corresponding multiple channels of audio data output by the live encoder;

A selection unit, configured to select one channel of audio data from the multiple channels of audio data according to the sequence number or label of the audio track corresponding to the language specified by the user;

a duplication unit, configured to duplicate the audio data and video data;

A sending unit, configured to send the copied audio data and video data.

A streaming media platform supports a processing system for multi-track content, comprising:

A live encoder, which is used to convert and compress one input analog video signal and multiple analog audio signals, and output a data stream containing one channel of video data and corresponding multiple channels of audio data;

The streaming media server is connected with the live encoder, and is used to receive the data stream output by the live encoder, and select a channel of audio data according to the sequence number or label of the audio track corresponding to the language specified by the user, copy and send the One channel of audio data and the video data;

The user attribute database is used to store the sequence number or label of the audio track corresponding to the language specified by the user, and provide it to the streaming media server for query.

The system also includes:

The portal website is used to provide an access path to the data stream in the streaming media server, and the user accesses the streaming media server through the access path.

The beneficial effects of the present invention are as follows:

1. The present invention sends the processed data stream containing one channel of video data and corresponding multi-channel audio data to the streaming media server through a live encoder, and the streaming media server selects one channel of audio data corresponding to the language according to the language specified by the user. Duplicate the audio data and the video data and send them to the user, so that the user can receive, decompress and play the data stream normally without using a video duplicator and too many live encoders, which saves network resources and reduces The cost is reduced, and the equipment maintenance is relatively simple.

2, the processing method of the present invention is not limited by the system, can be applied to the streaming media platform systems of wireless networks such as GPRS, EDGE, WCDMA, CDMA2000, TD-SCDMA, DVB-H, DMB, ISDB-T, and in mobile network The middle terminal equipment can also use the method by unicast or multicast, therefore, the present invention has the advantage of strong adaptability.

Description of drawings

FIG. 1A is a schematic structural diagram of a streaming media processing system for processing one-way video data and one-way audio data in the background technology;

Fig. 1B is a schematic structural diagram of a streaming media processing system for processing one channel of video data and multiple channels of audio data in the background technology;

Fig. 2 is a schematic structural diagram of a processing system for a streaming media platform supporting multi-track content in Embodiment 1 of the present invention;

FIG. 3 is a schematic structural diagram of a streaming media server in Embodiment 1 of the present invention;

4 is a flow chart of system processing when a user sets a favorite language in Embodiment 1 of the present invention;

5 is a flow chart of system processing when the streaming media server reads the language attribute of the user equipment in Embodiment 1 of the present invention;

FIG. 6 is a schematic structural diagram of a processing system for a streaming media platform supporting multi-track content in Embodiment 2 of the present invention;

Fig. 7 is a flow chart of the processing of the streaming media platform supporting multi-track content in the second embodiment of the present invention.

Detailed ways

The present invention uses a live encoder to send the processed data stream containing one channel of video data and corresponding multiple channels of audio data to the streaming media server, and the streaming media server selects one channel of audio data corresponding to the language according to the language specified by the user to output, so as to This supports multi-track content.

Embodiment one

In this embodiment, the stream media server queries the user attribute database for the language specified by the user, selects a channel of audio data corresponding to the language, copies the channel of audio data and the video data, and sends them to the terminal device as an example.

Referring to shown in Fig. 2, a kind of streaming media platform in the present embodiment supports the processing system of multi-track content to comprise: live coder 200, user attribute database 201, streaming media server 202, wireless network 203, terminal equipment 204; The processing system further includes a portal website, which is used to send the path URL of the streaming media content to the terminal device, and the portal website is not marked in FIG. 2 .

The live encoder 200 is used to perform analog/digital conversion and compression on the input analog data, and send the compressed data stream to the streaming server 202 in real time, and generate an SDP file and send it to the streaming server 202; The input analog data includes one channel of video data and multiple channels of audio data; the SDP file indicates the port receiving the one channel of video data and multiple ports receiving the multiple channels of audio data, and includes the video and audio of the data stream Description.

The video and audio description information includes the same number of audio description information as the number of audio tracks to identify different audio tracks, such as:

v=0

o＝-2631350701 1507213 IN IP4 192.168.18.101

s=b3 14

c＝IN IP4 236.130.128.182/1

b=RR:0

t=00

m=video 8686 RTP/AVP 96

b=AS:1920

a=rtpmap:96H264/90000

a=fmtp:96 profile-level-id=4D3015;

sprop-parameter-sets=Z01AFZZWCwJNgyRAAAD6AAAYahgwADgnADqargAK, aO88gA==; packetization-mode=1

a=cliprect:0,0,576,352

a=framerate:25.

a=mpeg4-esid:201

a=x-envivio-verid:0002229A

m=audio 8688RTP/AVP 97

b=AS:32

a=rtpmap:97mpeg4-generic/16000/2

a=fmtp:97 profile-level-id=15; config=1410; streamtype=5; ObjectType=64; mode=AAC-hbr; SizeLength=13; IndexLength=3; IndexDeltaLength=3

a=mpeg4-esid:101

a＝lang:eng//identification describing the input voice

a=x-envivio-verid:0002229A

m=audio 8690RTP/AVP 14

b=AS:48

a=rtpmap:14MPA/48000/2

a=mpeg4-esid:102

a＝lang:fra //Identifier describing the input voice

a=x-envivio-verid:0002229A

The live encoder 200 pre-specifies the corresponding relationship between the language and the audio track, and the corresponding relationship can be specified by the sequence number of the audio track, such as specifying that the first audio track is English, the second audio track is Chinese, and the third audio track is Chinese. The track is Cantonese, the fourth track is French, etc., as shown in Table 1, where the language ID value contains the track sequence number of the corresponding language; the corresponding relationship can also be encoded by the live encoder 200 as Each audio track is specified by adding a different label, as shown in Table 2, the labels are English, Chinese, German, French, this label does not necessarily represent a specific language, and can be replaced by other languages as needed. If Cantonese is required, you can Use German tags to represent Cantonese.

Table 1 Correspondence between language and track sequence number

serial number Language ID language description 1 001 English 2 002 Mandarin 3 003 Cantonese 4 004 French ... ... ...

Table 2 Correspondence between language and track label

serial number Label language description 1 English English 2 Chinese Mandarin 3 German Cantonese 4 French French ... ... ...

The user attribute database 201 is used to classify and store the sequence number or label of the audio track corresponding to the user's preferred language according to the user ID, or store the audio track sequence number of the language corresponding to the language attribute of the user device according to the user ID or label; the user identity can be the user's mobile phone number, MSN (Message Switching Network, message exchange network), ISDN (Integrated Services Digital Network, Integrated Services Digital Network) number, etc.; the user's favorite language can be accessed by the user portal When the website is set, the sequence number or label of its corresponding audio track is stored in the user attribute database; the language attribute of the user equipment can be obtained from the user equipment by the streaming media server, and the audio track order of its corresponding language No. or label is stored in described user attribute database; The sequential number of described audio track or label are one or more, and indicate different priorities; Described user attribute database 201 can be the database of present mainstream, as Oracle ( A database), SQLServer (Structured Query Language Server, Structured Query Language Server), DB2 (DataBase 2, a database), etc.

As shown in Table 3, the user prefers three languages, and the priority of language 1 is higher than that of language 2, and the priority of language 2 is higher than that of language 3. Adjust the number and priority of preferred languages.

Table 3 Language table of user preference

serial number User ID Language 1_ID Language2_ID Language 3_ID 1 13800138000 001 002 003 2 13800138004 002 001 003 3 13800138007 003 001 004 4 13800138002 001 002 003

The user's preferred language table shown in Table 3 uses the serial number of the audio track to identify the user's preferred language. Here, the audio track label can also be used to identify the user's preferred language.

The streaming media server 202 is used to receive the SDP file and the real-time data stream of the live coder, and the real-time data stream includes one channel of video data and multiple channels of audio data; Corresponding to one channel of audio data, copying the channel of audio data and the video data and sending them to the terminal device.

After receiving the access request of the terminal device, the streaming media server 202 parses the SDP file corresponding to the access request to obtain a port for receiving the real-time data stream of the live encoder. There are multiple ports corresponding to the one-way video data and multiple channels of audio data; the streaming media server 202 obtains the real-time data stream sent by the live encoder 200 by monitoring the multiple ports.

The streaming server 202 extracts the user identity from the received terminal device access request, and generates SQL (Structured Query Language, Structured Query Language) according to the user identity; The interface of database uses described structured query language SQL to inquire about the favorite language ID that user sets, and the interface of described streaming server 202 and user property database can be ODBC (Open DataBase Connectivity open database interconnection), ADO (Active Data Object , active data object), JDBC (Java DataBase ConnectivityJava, database connection) and other standard interfaces, this interface can be selected according to the implementation of streaming media server 202 own code.

According to the query result, the streaming media server 202 selects one path of audio data corresponding to the user preference language ID of the highest priority, copies the audio data of one path and the video data and sends it to the terminal device; if the highest priority If the audio track corresponding to the user's favorite language ID does not contain audio data, then the audio data corresponding to the user's preferred language ID of the next priority will be copied by the streaming server 202 to the audio data and the video data. and send it to the terminal device; if the audio tracks corresponding to all user favorite language IDs do not contain audio data, then select one audio data among the multiple audio data received, and copy the audio data and the video data and send it to the end device.

Referring to Fig. 3, the streaming media server 202 includes: a receiving unit 300, a selection unit 301, a copying unit 302, and a sending unit 303; the receiving unit 300 is configured to receive the data stream output by the live encoder, The data stream includes one channel of video data and corresponding multiple channels of audio data; the selection unit 301 is used to select one channel of audio data corresponding to the language specified by the user by querying the user attribute database; the copy unit 302 is used to copy the The one-way audio data and video data; the sending unit 303 is configured to send the copied one-way audio data and video data to the user.

The wireless network 203 is used for the wireless connection between the terminal device 204 and the portal website, and between the terminal device 204 and the streaming media server 202 .

The terminal device 204 is used to set the user preference language list, and request a real-time data stream to the streaming media server 202, the real-time data stream includes one road video data and one road audio data, and after receiving the real-time data stream Unzip and play.

After the user logs in to the portal website through the wireless network 203, the number and priority of language IDs corresponding to the language of setting preference are set, and the favorite language list is saved in the user attribute database 201; the user obtains streaming media by visiting the portal website. The path URL of the content, and initiate an access request to the streaming media server 202 according to the path by the terminal device 204; the terminal device 204 contains one road of video data and one road After real-time streaming of audio data, the data stream is decompressed and played.

Referring to Figure 4, taking the system structure shown in Figure 2 as an example, the processing flow of the streaming media platform supporting multi-track content is as follows:

Step 400, the live encoder performs analog/digital conversion and compression on the received analog data, and sends the compressed data stream to the streaming server in real time; and generates an SDP file and sends it to the streaming server; the received The analog data includes one channel of video data and multiple channels of audio data; the SDP file indicates the port receiving the channel of video data and multiple ports for receiving the multiple channels of audio data, and includes the video and audio description information of the data stream.

Step 401, when the terminal device accesses the portal website, set the user's preferred language and save it in the user attribute database.

Step 402, the terminal device requests the URL of the path link of the streaming media content from the portal website; the portal website responds to the request of the terminal device, and returns the URL of the path link of the streaming media content to the terminal device.

Step 403, the terminal device initiates an access request to the streaming media server according to the path link URL of the streaming media content.

Step 404, the streaming media server parses the corresponding SDP file according to the access request, obtains the port data for receiving in real time the data stream comprising one channel of video data and multiple channels of audio data, and obtains the port data comprising one channel of video data by monitoring corresponding multiple ports and real-time data streaming of multiplex audio data.

Step 405, the streaming media server extracts the user identity from the access request of the terminal device to generate a structured query language SQL, and uses this language to query the user attribute database for the preferred language set by the user.

Step 406, the streaming media server selects one channel of audio data according to the preferred language, copies the channel of audio data and the video data, and sends them to the terminal device.

Step 407, the terminal device receives the data stream, decompresses and plays it.

In the process shown in Figure 4, the user sets the user's preferred language when accessing the portal website through the terminal device and saves it in the user attribute database. Here, the streaming media server can also obtain the language attribute of the terminal device from the terminal device and Save it in the user attribute database, as shown in Figure 5, the processing flow is as follows:

Step 500, the live encoder performs analog/digital conversion and compression on the received analog data, and sends the compressed data stream to the streaming server in real time; and generates an SDP file and sends it to the streaming server; the received The analog data includes one channel of video data and multiple channels of audio data; the SDP file indicates the port receiving the channel of video data and multiple ports for receiving the multiple channels of audio data, and includes the video and audio description information of the data stream.

Step 501, the streaming media server obtains the language attribute of the terminal device.

Step 502, the streaming media server saves the language attribute in the user attribute database.

Step 503, the terminal device requests the URL of the path link of the streaming media content from the portal website; the portal website returns the path link URL of the streaming media content to the terminal device in response to the request of the terminal device.

Step 504, the terminal device initiates an access request to the streaming media server according to the path link URL of the streaming media content.

Step 505, the streaming media server parses the corresponding SDP file according to the access request, obtains the port data for receiving in real time the data stream comprising one channel of video data and multiple channels of audio data, and obtains the port data comprising one channel of video data by monitoring corresponding multiple ports and real-time data streaming of multiple audio data.

Step 506, the streaming media server extracts the user identity from the access request of the terminal device to generate a structured query language SQL, and uses this language to query the language attribute of the terminal device from the user attribute database.

Step 507: The streaming media server selects one channel of audio data according to the language corresponding to the language attribute, copies the channel of audio data and the video data, and sends them to the terminal device.

Step 508, the terminal device receives the data stream, decompresses and plays it.

Embodiment two

In this embodiment, the language parameter is added to the URL path of the access request initiated by the terminal device to the streaming media server to select a channel of audio data corresponding to the language specified by the user, copy the channel of audio data and the video data and send it to the terminal device Take this as an example.

Referring to Fig. 6, a kind of streaming media platform in the present embodiment supports the processing system of multi-track content to include: live coder 600, streaming media server 601, wireless network 602, terminal device 603; The audio track processing system also includes a portal website, which is used to send the path URL of the streaming media content to the terminal device, and the portal website is not marked in FIG. 6 .

The live encoder 600 is configured to perform analog/digital conversion and compression on the input analog data, and send the compressed data stream to the streaming server 601 in real time, and generate an SDP file and send it to the streaming server 601; The input analog data includes one channel of video data and multiple channels of audio data; the SDP file indicates the port receiving the one channel of video data and multiple ports receiving the multiple channels of audio data, and includes the video and audio of the data stream Description.

The video and audio description information includes the same number of audio description information as the number of audio tracks to identify different audio tracks, which is the same as that described in Embodiment 1; the live encoder 600 pre-specifies the corresponding relationship between languages and audio tracks, the The corresponding relationship can be specified by the sequence number of the track, or can be specified by adding a different tag to each track by the live encoder 600 during encoding, as described for the live encoder 200 in Embodiment 1.

The streaming media server 601 is used to receive the SDP file and the real-time data stream of the live coder, and the real-time data stream includes one channel of video data and multiple channels of audio data; and is used to obtain the language by analyzing the access request URL path of the terminal device 603 parameter, and select a channel of audio data corresponding to the language specified by the user according to the language parameter, copy the channel of audio data and the video data, and send it to the terminal device 603 .

After receiving the access request of the terminal device 603, the streaming media server 601 parses the SDP file corresponding to the access request to obtain a port for receiving the real-time data stream of the live encoder. There are multiple ports corresponding to the one-way video data and multiple channels of audio data; the streaming server 601 obtains the real-time data stream sent by the live encoder 600 by monitoring the multiple ports.

After the user logs in to the portal website through the wireless network 602, he specifies the language he wants to receive, and the language parameter in the URL path indicates the track sequence number corresponding to the language specified by the user, as shown in Table 4.

The language parameters in the URL path in Table 4 indicate the sequence numbers of different audio tracks

Sex and City (Chinese) RTSP://stream_ip/TV.SDP? audiotraceid=1 Sex and City (English) RTSP://stream_ip/TV.SDP? audiotraceid=2 Sex and City (Cantonese) RTSP://stream_ip/TV.SDP? audiotraceid=3 Sex and City (French) RTSP://stream_ip/TV.SDP? audiotraceid=4

Referring to Table 5, the language parameter in the URL path may also indicate the audio track label corresponding to the language specified by the user.

Table 5 Language parameters in the URL path indicate different audio track tags

Sex and City (Chinese) RTSP://stream_ip/TV.SDP? language=chinese Sex and City (English) RTSP://stream_ip/TV.SDP? language=english Sex and City (Cantonese) RTSP://stream_ip/TV.SDP? language=german Sex and City (French) RTSP://stream_ip/TV.SDP? language=franchise

For example, if the URL path format of the terminal device 603 access request received by the streaming media server 601 is: Rtsp://stream_ip/tv.sdp? audiotraceid=3, then parse out that what the user needs is the audio data of the third track; if the terminal device 603 access request URL path format received by the streaming media server 601 is: Rtsp://stream_ip/tv.sdp ? audiotraceid=Chinese, it is analyzed that what the user needs is audio data whose label is Chinese.

If the audio track corresponding to the sequence number of the user-specified audio track obtained by the analysis of the streaming server 601 or the label does not contain audio data, then the streaming server selects one audio data from the received data stream, and copies Send the one channel of audio data and the video data to the terminal device 603 .

The structure of the streaming media server 601 is the same as that of the streaming media server 202 in Embodiment 1. At this time, the selection unit 301 is used to obtain the language parameter by analyzing the URL path of the access request of the terminal device 603, and according to the language parameter Select a channel of audio data corresponding to the language specified by the user; the functions of the receiving unit 300, copying unit 302, and sending unit 303 are the same as those in the first embodiment.

The wireless network 602 is used for wireless connection between the terminal device 603 and the portal website, and between the terminal device 603 and the streaming media server 601 .

The terminal device 603 is used to set the language parameter in the URL path, and requests a real-time data stream from the streaming media server 601, the real-time data stream includes one road of video data and one road of audio data, and upon receiving the real-time data Unzip and play after streaming.

The user obtains the URL path of the streaming media content by visiting the portal website, and sets the language parameter in the URL path through the terminal device 603 to indicate different audio track sequence numbers or labels, and initiates an access request to the streaming media server 601; After the terminal device 603 receives the real-time data stream including one piece of video data and one piece of audio data obtained by the stream media server 601 according to the language parameters in the parsed URL path, it decompresses and plays the data stream.

Referring to Figure 7, taking the system structure shown in Figure 6 as an example, the processing flow of the streaming media platform supporting multi-track content is as follows:

Step 700, the live encoder performs analog/digital conversion and compression on the received analog data, and sends the compressed data stream to the streaming server in real time; and generates an SDP file and sends it to the streaming server; the received The analog data includes one channel of video data and multiple channels of audio data; the SDP file indicates the port receiving the channel of video data and multiple ports for receiving the multiple channels of audio data, and includes the video and audio description information of the data stream.

Step 701, the terminal device requests the URL path of the streaming media content from the portal website; the portal website returns the URL path of the streaming media content to the terminal device in response to the request of the terminal device.

Step 702, the terminal device sets the language parameter in the URL path of the streaming media content to indicate different languages or audio tracks.

Step 703, the terminal device initiates an access request to the streaming media server according to the URL path of the streaming media content.

Step 704, the streaming media server parses the corresponding SDP file according to the access request, obtains the port data for receiving in real time the data stream comprising one channel of video data and multiple channels of audio data, and obtains the port data comprising one channel of video data by monitoring the corresponding multiple ports and real-time data streaming of multiple audio data.

Step 705, the streaming media server parses out the language parameter in the URL path from the received terminal device access request, selects a channel of audio data corresponding to the language specified by the user according to the language parameter in the URL path, and copies the channel of audio data and the video data and send it to the terminal device.

Step 706, the terminal device receives the data stream, decompresses and plays it.

In the above two embodiments, the streaming media server selects a channel of audio data corresponding to the language according to the language specified by the user, copies the channel of audio data and the video data and sends it to a terminal device. Ways, such as DVB-H, DMB, MBMS (MultimediaBroadcast Multicast Service, Multimedia Broadcast Multicast Service), BCMCS (Broadcast andMulticast Services, Broadcast Multicast Service), etc., send the audio data and video data to multiple end users.

It can be seen from the above-mentioned embodiments that the present invention sends the processed data streams containing one channel of video data and corresponding multiple channels of audio data to the streaming media server through a live encoder, and the streaming media server selects the language corresponding to the language specified by the user. A channel of audio data, copying the channel of audio data and the video data and sending it to the user, without using a video duplicator and too many live encoders, the user can realize the normal reception, decompression and playback of the data stream, saving Network resources reduce costs, and equipment maintenance is relatively simple; in addition, the processing method of the present invention is not limited by the system, and can be applied to GPRS, EDGE, WCDMA, CDMA2000, TD-SCDMA, DVB-H, DMB, ISDB-T The streaming media platform system of the wireless network, and the terminal device in the mobile network can also use the method in a point-to-point (unicast technology) mode or a multicast mode, therefore, the present invention has the advantage of strong adaptability.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (11)

1. a streaming media platform supports the method for multi-track content, is characterized in that, the method comprises steps: The processed data stream is sent to the streaming media server by a live coder, the data stream includes one channel of video data and corresponding multiple channels of audio data, wherein the live coder specifies the audio track and Language Correspondence; The streaming media server selects a channel of audio data through the sequence number or label of the audio track corresponding to the language specified by the user, copies the channel of audio data and the video data, and sends them to the user. 2. The method according to claim 1, wherein the live coder indicates the port for receiving the one-way video data and receiving the multiple-way audio data in the session description protocol SDP file sent to the streaming media server A plurality of ports, and the streaming media server receives the data stream by listening to these ports. 3. The method according to claim 1, characterized in that the live encoder pre-specifies or specifies the correspondence between audio tracks and languages during encoding. 4. The method according to claim 3, wherein the stream media server queries the user attribute database to obtain the sequence number or the label of the corresponding audio track of the language specified by the user through the user ID reported by the user, and passes The sequence number or label of the track selects the audio data. 5. The method according to claim 4, wherein the language specified by the user is set by the user for its priority; the streaming server queries the sequence number or sequence number of the audio track corresponding to the language with high priority. Tab selects audio data. 6. The method according to claim 4, wherein the language specified by the user is set by the user through the portal website or obtained from the user equipment by the streaming media server, and the sequence number or label of the corresponding audio track is stored in In the user attribute database. 7. method as claimed in claim 3 is characterized in that, the sequence number or label of the audio track corresponding to the language specified by the user is set in the access path of the terminal equipment to the streaming media server in the form of language parameters; The streaming media server obtains the sequence number or label of the audio track corresponding to the language specified by the user by analyzing the access path, and selects audio data through the sequence number or label of the audio track. 8. The method according to any one of claims 3 to 7, wherein if the audio track corresponding to the language specified by the user does not contain audio data, then the stream media server from the received data stream A channel of audio data is selected, the channel of audio data and the video data are copied and sent to the terminal device. 9. A streaming media server, characterized in that, comprising: The receiving unit is used to receive one channel of video data and corresponding multiple channels of audio data output by the live encoder; A selection unit, configured to select one channel of audio data from the multiple channels of audio data according to the sequence number or label of the audio track corresponding to the language specified by the user; a duplication unit, configured to duplicate the audio data and video data; A sending unit, configured to send the copied audio data and video data. 10. A streaming media platform supports a processing system for multi-track content, characterized in that it comprises: A live encoder, which is used to convert and compress one input analog video signal and multiple analog audio signals, and output a data stream containing one channel of video data and corresponding multiple channels of audio data; The streaming media server is connected with the live encoder, and is used to receive the data stream output by the live encoder, and select a channel of audio data according to the sequence number or label of the audio track corresponding to the language specified by the user, copy and send the One channel of audio data and the video data; The user attribute database is used to store the sequence number or label of the audio track corresponding to the language specified by the user, and provide it to the streaming media server for query. 11. The system of claim 10, further comprising: The portal website is used to provide an access path to the data stream in the streaming media server, and the user accesses the streaming media server through the access path.

Images