CN104581424B - A kind of flow-medium transmission method, relevant device and system - Google Patents

Abstract

The embodiment of the present invention discloses a streaming media transmission method, related equipment and system, wherein, a streaming media transmission method includes: receiving video fragments from a streaming media server; detecting the wireless network throughput rate of a mobile terminal, wherein, The mobile terminal is the target receiving terminal of the video fragmentation; the scheduling priority of the video fragmentation is adjusted according to the wireless network throughput rate of the mobile terminal, wherein, within the preset wireless network throughput rate range, the video The scheduling priority of the slices decreases with the increase of the wireless network throughput rate of the mobile terminal; according to the scheduling priority of the video slices, the sending of the video slices to the mobile terminal is controlled. The technical solution provided by the invention can effectively solve the problem of unfair user experience.

Description

A streaming media transmission method, related equipment and system

technical field

The present invention relates to the technical field of streaming media, in particular to a streaming media transmission method, related equipment and system.

Background technique

The HTTP-based Dynamic Adaptive Streaming (DASH, Dynamic Adaptive Streaming of HTTP) technology divides a video file into multiple video fragments, and assigns an independent Uniform Resource Locator (URL, Uniform Resource Locator) to each video fragment. ,) addresses for Hypertext Transfer Protocol (HTTP, Hyper Text Transport Protocol) requests, responses, and caches. In addition, video files also provide multiple video bitrates. In a traditional broadband network, a terminal-based code rate adaptive method is used to transmit video fragments, that is, the streaming server sends video fragments with a specific video code rate to the client according to the network bandwidth resources of the terminal, so that the client can perform video file playback.

At present, with the rise of the mobile Internet, DASH technology is also applicable to mobile communication networks. In a mobile communication network, due to the scarcity of network bandwidth resources, network equipment adopts a centralized resource allocation strategy to allocate appropriate network bandwidth resources for each connected mobile terminal.

Since the network equipment adopts a centralized resource allocation strategy, the network bandwidth resources obtained by each mobile terminal are different, and the network bandwidth resources obtained by different mobile terminals may also be quite different. The terminal obtains less network bandwidth resources, while the mobile terminal at the center of the cell obtains more network bandwidth resources. For different mobile terminals with large differences in network bandwidth resources in the same cell, when the above-mentioned client-based code rate adaptive method is used to transmit video fragments, the difference in the video code rates of the video fragments received by the above-mentioned different mobile terminals will be different. As a result, the above-mentioned different mobile terminals have relatively large differences in fluency when playing video files, resulting in unfairness of user experience.

Contents of the invention

Embodiments of the present invention provide a streaming media transmission method, related equipment and system, which are used to solve the problem of unfair user experience.

The first aspect of the present invention provides a streaming media transmission method, including:

Receive video fragments from streaming media server;

Detecting the wireless network throughput rate of the mobile terminal, wherein the above-mentioned mobile terminal is the target receiving terminal of the above-mentioned video fragmentation;

Adjust the scheduling priority of the video fragmentation according to the wireless network throughput rate of the mobile terminal, wherein, within the preset wireless network throughput rate range, the scheduling priority of the video fragmentation increases with the wireless network throughput rate of the mobile terminal and reduce;

According to the scheduling priority of the video fragments, the sending of the video fragments to the mobile terminal is controlled.

Based on the first aspect of the present invention, in a first possible implementation manner,

The above-mentioned adjustment of the scheduling priority of the above-mentioned video slices according to the wireless network throughput rate of the above-mentioned mobile terminal includes:

The scheduling priority of the video slices is determined according to the throughput rate-scheduling priority relationship function and the wireless network throughput rate of the mobile terminal.

Based on the first possible implementation of the first aspect of the present invention, in the second possible implementation, the features of the above-mentioned throughput rate-scheduling priority relationship function include:

The definition domain is [0,+∞), and the value range is [0,1];

When the wireless network throughput rate is [0, a], the scheduling priority of video fragmentation is always equal to 1;

When the wireless network throughput rate is (a, b], the scheduling priority of video fragmentation decreases with the increase of the wireless network throughput rate;

When the wireless network throughput rate is (b,+∞), the scheduling priority of video fragmentation is always equal to 0;

Wherein, the above-mentioned a is the minimum video code rate provided by the above-mentioned streaming media server, and the above-mentioned b is the maximum video code rate provided by the above-mentioned streaming media server.

Based on the first aspect of the present invention, or the first possible implementation of the first aspect of the present invention, or the second possible implementation of the first aspect of the present invention, in the third possible implementation, the above received from The video fragmentation of the streaming media server also includes:

Select the video code rate of the video fragments to be downloaded according to the current video quality;

According to the selected video code rate, request video fragmentation to the above-mentioned streaming media server.

Based on the third possible implementation of the first aspect of the present invention, in the fourth possible implementation, the selection of the video code rate of the video segment to be downloaded according to the current video quality includes:

Calculate the square value of the difference between each video code rate provided by the streaming media server and the current average video code rate respectively;

The video code rate corresponding to the least square value is determined as the video code rate of the video segment to be downloaded.

Based on the first aspect of the present invention, or the first possible implementation of the first aspect of the present invention, or the second possible implementation of the first aspect of the present invention, in the fifth possible implementation,

The above-mentioned sending of the above-mentioned video fragments to the above-mentioned mobile terminal is controlled according to the scheduling priority of the above-mentioned video fragments, including:

sending the video fragment and the scheduling priority of the video fragment to the serving base station of the mobile terminal, so that the serving base station of the mobile terminal sends the data of the video fragment to the mobile terminal according to the scheduling priority of the video fragment Bag.

Based on the fifth possible implementation of the first aspect of the present invention, in the sixth possible implementation, if the scheduling priority of the above-mentioned video slices is a value in the interval [0, 1], then:

In the process of sending the data packets of the video fragments to the mobile terminal, the proportion of data packets in the video fragments for priority scheduling is equal to the scheduling priority of the video fragments multiplied by 100%.

Based on the first aspect of the present invention, or the first possible implementation of the first aspect of the present invention, or the second possible implementation of the first aspect of the present invention, in the seventh possible implementation, during system initialization , the above method also includes:

receiving the streaming media service request message sent by the mobile terminal, wherein the streaming media service request message includes the identifier of the requested video stream;

Forwarding the above-mentioned streaming media service request message to the above-mentioned streaming media server;

receiving the media presentation description MPD file responded by the streaming media server according to the streaming media service request message, wherein the MPD file is used to describe all video segments of the video stream requested by the streaming media service request message.

A second aspect of the present invention provides a streaming media transmission device, including:

The first receiving unit is used to receive video fragments from the streaming media server;

A detection unit, configured to detect the wireless network throughput rate of the mobile terminal, wherein the above mobile terminal is the target receiving terminal of the above video fragmentation;

A priority adjustment unit, configured to adjust the scheduling priority of the above-mentioned video slices according to the throughput rate of the wireless network of the mobile terminal detected by the above-mentioned detection unit, wherein, within the preset wireless network throughput rate range, the scheduling of the video slices The priority decreases with the increase of the wireless network throughput rate of the mobile terminal;

The control unit is configured to control the sending of the video slices to the mobile terminal according to the scheduling priority of the video slices adjusted by the priority adjusting unit.

Based on the second aspect of the present invention, in a first possible implementation manner, the above-mentioned priority adjustment unit is specifically configured to: detect the wireless network throughput rate of the above-mentioned mobile terminal according to the throughput-priority relationship function and the above-mentioned detection unit Determine the priority of the above video fragmentation;

The characteristics of the above-mentioned throughput rate-priority relationship function include:

The definition domain is [0,+∞), and the value range is [0,1];

When the wireless network throughput rate is [0, a], the scheduling priority of video fragmentation is always equal to 1;

When the wireless network throughput rate is (a, b], the scheduling priority of video fragmentation decreases with the increase of the wireless network throughput rate;

When the wireless network throughput rate is (b,+∞), the scheduling priority of video fragmentation is always equal to 0;

Wherein, the above-mentioned a is the minimum video code rate provided by the above-mentioned streaming media server, and the above-mentioned b is the maximum video code rate provided by the above-mentioned streaming media server.

Based on the second aspect of the present invention, or the first possible implementation of the second aspect of the present invention, in the second possible implementation, the streaming media transmission device further includes:

A code rate selection unit is used to select the video code rate of the video fragments to be downloaded according to the current video quality;

The requesting unit is configured to request video fragments from the above-mentioned streaming media server according to the selected video code rate.

Based on the second possible implementation of the second aspect of the present invention, in a third possible implementation, the code rate selection unit includes:

The calculation subunit is used to calculate the square value of the difference between each video code rate provided by the above-mentioned streaming media server and the current average video code rate;

The selection subunit is used to determine the video code rate corresponding to the least square value as the video code rate of the video fragment to be downloaded according to the calculation result of the calculation subunit.

Based on the second aspect of the present invention, or the first possible implementation of the second aspect of the present invention, in a fourth possible implementation, the above-mentioned control unit is specifically configured to: send the above-mentioned video analysis to the serving base station of the above-mentioned mobile terminal slice and the scheduling priority of the video slice, so that the serving base station of the mobile terminal sends the data packet of the video slice to the mobile terminal according to the scheduling priority of the video slice.

Based on the second aspect of the present invention, or the first possible implementation manner of the second aspect of the present invention, in a fifth possible implementation manner, the streaming media transmission device further includes:

The second receiving unit is configured to receive the streaming media service request message sent by the mobile terminal, wherein the streaming media service request message includes the identifier of the requested video stream;

A sending unit, configured to forward the above-mentioned streaming media service request message to the streaming media server;

The third receiving unit is configured to receive the media presentation description MPD file that the streaming media server responds to according to the streaming media service request message, wherein the MPD file is used to describe all video components of the video stream requested by the streaming media service request message piece.

A third aspect of the present invention provides a streaming media transmission system, including:

Streaming media transmission equipment, streaming media servers and mobile terminals;

Wherein, the above-mentioned streaming media server is used to provide video fragmentation of various video code rates of the video file to the above-mentioned mobile terminal through the above-mentioned streaming media transmission device;

The aforementioned streaming media transmission device is as described in the second aspect, the first possible implementation of the second aspect, the second possible implementation of the second aspect, the third possible implementation of the second aspect, the second possible implementation of the second aspect Any one of the above-mentioned streaming media transmission device in the fourth possible implementation manner of the second aspect and the fifth possible implementation manner of the second aspect.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

It can be seen from the above that the embodiment of the present invention adjusts the scheduling priority of video slices according to the wireless network throughput rate of the mobile terminal by detecting the wireless network throughput rate of the mobile terminal, and, within the preset wireless network throughput rate range, makes the video The scheduling priority of fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Since different mobile terminals with large differences in network bandwidth resources have large differences in wireless network throughput rates, therefore, through the present invention In this embodiment, the scheduling priority of video fragments of mobile terminals with a lower wireless network throughput rate can be higher, so that the video fragments of mobile terminals with a lower wireless network throughput rate can be preferentially scheduled, and the above-mentioned different mobile terminals can be reduced. The difference in fluency when playing video files solves the problem of unfair user experience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

Fig. 1-a is a schematic flow chart of an embodiment of the streaming media transmission method provided by the present invention;

Figure 1-b is a schematic diagram of the throughput rate-scheduling priority relationship function curve provided by the present invention;

Fig. 2 is a schematic flow chart of another embodiment of the streaming media transmission method provided by the present invention;

Fig. 3 is a flow diagram of another embodiment of the streaming media transmission method provided by the present invention;

FIG. 4 is a schematic structural diagram of an embodiment of a streaming media transmission device provided by the present invention;

FIG. 5 is a schematic structural diagram of another embodiment of a streaming media transmission device provided by the present invention;

FIG. 6 is a schematic structural diagram of yet another embodiment of the streaming media transmission device provided by the present invention;

Fig. 7 is a schematic structural diagram of an embodiment of a streaming media transmission system provided by the present invention.

Detailed ways

The embodiment of the present invention provides a streaming media transmission method, related equipment and system.

In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, various other embodiments obtained by persons of ordinary skill in the art without making creative efforts all belong to the protection scope of the present invention.

A streaming media transmission method provided by the embodiment of the present invention is described below, please refer to FIG. 1-a, the streaming media transmission method in the embodiment of the present invention includes:

101. Receive video fragments from a streaming media server;

In the embodiment of the present invention, a video segment refers to a video segment of a cut video file.

Usually, DASH technology cuts video files into multiple 2-10 second video clips, and assigns independent URLs to each video clip for HTTP requests, responses, and caching. For each video clip, the video source (such as the streaming media server in the embodiment of the present invention) can provide multiple different video code rates. For example, for a video file with a length of 1 hour, 10 seconds can be divided into 360 video segments. For each video segment, the video source provides three different video bit rates:

1. 320x240 resolution, 100kbps;

2. 640x480 resolution, 500kbps;

3. 640x480 resolution, 1Mbps;

In this way, from the perspective of the server, this video file corresponds to 360x3=1080 different URLs. The streaming server needs to store 1080 video fragments, corresponding to 1080 URL addresses.

Optionally, when the streaming media transmission device receives the message that the mobile terminal requests video fragments, it requests the corresponding video fragments from the streaming media server, and the streaming media transmission device receives the corresponding video fragments issued by the streaming media server, or , the streaming server actively sends the video fragments that need to be delivered to the mobile terminal to the streaming media transmission device, so that the video fragments can be sent to the mobile terminal through the streaming media transmission device.

102. Detecting the wireless network throughput rate of the mobile terminal;

Wherein, the above-mentioned mobile terminal is a target receiving terminal of the above-mentioned video segment.

In the embodiment of the present invention, the above-mentioned mobile terminal may be a terminal requesting to play a video segment, or the above-mentioned mobile terminal may also be a terminal selected to play a video segment, which is not limited here.

The streaming media transmission device detects the wireless network throughput rate of the mobile terminal.

Optionally, the streaming media transmission device detects the wireless network throughput rate of the above-mentioned mobile terminal by acquiring information such as the playback cache of the above-mentioned mobile terminal, wireless network service quality (QoS, Quality of Service), or, can also detect the above-mentioned For the wireless network throughput rate of the mobile terminal, the embodiment of the present invention does not limit the method for detecting the wireless network throughput rate of the mobile terminal.

103. Adjust the scheduling priority of the above-mentioned video slices according to the wireless network throughput rate of the above-mentioned mobile terminal;

Wherein, within a preset wireless network throughput rate range, the scheduling priority of the video fragments decreases as the wireless network throughput rate of the mobile terminal increases.

Optionally, the preset wireless network throughput rate range in the embodiment of the present invention is (a, b), wherein, a is the minimum video bit rate provided by the above-mentioned streaming media server, and the above-mentioned b is the maximum video rate provided by the above-mentioned streaming media server code rate, or, the preset wireless network throughput rate range in the embodiment of the present invention can also be (0, +∞), or, the above wireless network throughput rate range can also be based on actual conditions (such as user needs, user experience survey data etc.) to set, there is no limitation here.

Optionally, when the wireless network throughput rate of the above mobile terminal is less than the minimum value within the preset range of wireless network throughput rate, the scheduling priority of the above video fragments is set as the maximum threshold value, when the wireless network throughput of the above mobile terminal When the network throughput rate is greater than the maximum value within the preset range of the wireless network throughput rate, the scheduling priority of the above video fragments is set as the minimum threshold value. For example, as shown in Figure 1-b, the characteristics of the preset throughput rate-scheduling priority relationship function include: the definition domain is [0,+∞), the value range is [0,1], when the wireless network throughput is set When the rate value is [0, a], the scheduling priority of the video segment is always equal to 1. When the wireless network throughput rate is (a, b), the scheduling priority of the video segment varies with the wireless network throughput rate. increase and decrease, when the wireless network throughput rate is (b,+∞), the scheduling priority of video fragmentation is always equal to 0. Optionally, the above a is the minimum video bit rate provided by the above streaming media server, The above-mentioned b is the maximum video bit rate provided by the above-mentioned streaming media server, or, the above-mentioned a and b can also be set according to actual conditions (such as user needs, user experience survey data, etc.), which are not limited here.

104. According to the scheduling priority of the above-mentioned video fragments, control the sending of the above-mentioned video fragments to the above-mentioned mobile terminal;

Optionally, the streaming media transmission device sends the data packets of the above-mentioned video fragments to the above-mentioned mobile terminal through a preset scheduling algorithm (such as a weighted fair queue scheduling algorithm) according to the scheduling priorities of the above-mentioned video fragments. Or, the streaming media transmission device sends the video fragment and the scheduling priority of the video fragment to the serving base station of the mobile terminal, so that the serving base station of the mobile terminal sends the video fragment to the mobile terminal according to the scheduling priority of the video fragment For the data packets of the above-mentioned video fragments, specifically, after receiving the above-mentioned video fragments and the scheduling priorities of the above-mentioned video fragments from the streaming media transmission device, the serving base station of the above-mentioned mobile terminal may use a preset scheduling algorithm (such as weighted fair queue scheduling algorithm) to send the data packets of the above video fragments to the above mobile terminal.

Usually, a video segment is composed of multiple data packets. When the scheduling priority of the video segment is a value in the interval [0, 1], the above-mentioned streaming media transmission device sends the data of the above-mentioned video segment to the above-mentioned mobile terminal In the process of sending packets, or, in the process of sending the data packets of the above-mentioned video fragments to the above-mentioned mobile terminal by the serving base station of the above-mentioned mobile terminal, the proportion of the data packets for priority scheduling in the above-mentioned video fragments is equal to the scheduling of the above-mentioned video fragments Priority is multiplied by 100%. For example, assuming that the scheduling priority of the above video segment is 0.75, then in the process of sending the data packets of the above video segment to the above mobile terminal, the proportion of data packets in the above video segment for priority scheduling is equal to 75%.

Optionally, when the system is initialized, the streaming media transmission device acquires, saves and parses a media presentation description (MPD, Media Presentation Description) file of the video file from the streaming media server, and the MPD file is used to describe all video segments of the video file , so that the streaming media transmission information can obtain information such as the URL address, video format, duration (such as 10 seconds/slice) and video bit rate of each video segment of the above-mentioned video file through the MPD file.

It should be noted that the embodiment of the present invention is described by sending video fragments to one mobile terminal as an example. When there are multiple mobile terminals, the streaming media transmission for each mobile terminal can refer to the description in the embodiment of the present invention. streaming media delivery method.

It should be noted that the streaming media server in the embodiment of the present invention may specifically be a DASH video server, and the mobile terminal in the embodiment of the present invention may specifically be a mobile phone, a tablet computer or other mobile video playback devices, which are not limited here.

It can be seen from the above that the embodiment of the present invention adjusts the scheduling priority of video slices according to the wireless network throughput rate of the mobile terminal by detecting the wireless network throughput rate of the mobile terminal, and, within the preset wireless network throughput rate range, makes the video The scheduling priority of fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Since different mobile terminals with large differences in network bandwidth resources have large differences in wireless network throughput rates, therefore, through the present invention In this embodiment, the scheduling priority of video fragments of mobile terminals with a lower wireless network throughput rate can be higher, so that the video fragments of mobile terminals with a lower wireless network throughput rate can be preferentially scheduled, and the above-mentioned different mobile terminals can be reduced. The difference in fluency when playing video files solves the problem of unfair user experience.

The following uses another embodiment to describe the streaming media transmission method provided by the embodiment of the present invention. As shown in FIG. 2, the streaming media transmission method in the embodiment of the present invention includes:

201. Select the video code rate of the video fragments to be downloaded according to the current video quality;

In the embodiment of the present invention, since the video file is sent to the mobile terminal for playback in units of video fragments, the mobile terminal can feed back video quality information to the streaming media transmission device during the process of playing video fragments for streaming media transmission. The device knows the current video quality in real time, and selects the video bit rate of the video segment to be downloaded according to the current video quality (such as the video bit rate of the next video segment), or the streaming media transmission device can also detect the video quality in real time. In order to select the video code rate of the video segment to be downloaded according to the current video quality.

Optionally, the video quality is characterized by an average bit rate. When the average bit rate is high, the video quality is good, and when the average bit rate is low, the video quality is poor. The streaming media transmission device detects the current average code rate, and calculates the square value of the difference between each video code rate provided by the above-mentioned streaming media server and the current average video code rate, and determines the video code rate corresponding to the calculated minimum square value as The video bitrate of the video fragments to be downloaded.

202. Request video fragmentation from the above streaming media server according to the selected video code rate;

According to the video code rate selected in step 201, the streaming media transmission device requests the video fragmentation of the corresponding video code rate from the streaming media server.

Optionally, before the system is initialized, the streaming media transmission device obtains, saves and parses a media presentation description (MPD, Media Presentation Description) of the video file from the streaming media server, and the MPD file is used to describe all video segments of the video file, So that the streaming media transmission information can obtain the URL address, video format, duration (such as 10 seconds/piece) and video bit rate and other information of each video segment of the above-mentioned video file through the MPD file. After the streaming media transmission device selects the video bit rate, it downloads the video segment according to the URL address of the video segment of the corresponding video bit rate described in the MPD file.

203. Receive video fragments from the streaming media server;

In the embodiment of the present invention, a video segment refers to a video segment of a cut video file.

Optionally, when the streaming media transmission device receives the message that the mobile terminal requests video fragments, it requests the corresponding video fragments from the streaming media server, and the streaming media transmission device receives the corresponding video fragments issued by the streaming media server, or , the streaming server actively sends the video fragments that need to be delivered to the mobile terminal to the streaming media transmission device, so that the video fragments can be sent to the mobile terminal through the streaming media transmission device.

204. Detect the wireless network throughput rate of the mobile terminal;

Wherein, the above-mentioned mobile terminal is a target receiving terminal of the above-mentioned video segment.

In the embodiment of the present invention, the above-mentioned mobile terminal may be a terminal requesting to play a video segment, or the above-mentioned mobile terminal may also be a terminal selected to play a video segment, which is not limited here.

The streaming media transmission device detects the wireless network throughput rate of the mobile terminal.

Optionally, the streaming media transmission device detects the wireless network throughput rate of the above-mentioned mobile terminal by acquiring information such as the playback buffer and wireless network QoS of the above-mentioned mobile terminal, or may also detect the wireless network throughput rate of the above-mentioned mobile terminal in other ways, The embodiment of the present invention does not limit the method for detecting the wireless network throughput rate of the mobile terminal.

205. Adjust the scheduling priority of the video fragments according to the wireless network throughput rate of the mobile terminal;

Wherein, within a preset wireless network throughput rate range, the scheduling priority of the video fragments decreases as the wireless network throughput rate of the mobile terminal increases.

Optionally, the preset wireless network throughput rate range in the embodiment of the present invention is (a, b), wherein, a is the minimum video bit rate provided by the above-mentioned streaming media server, and the above-mentioned b is the maximum video rate provided by the above-mentioned streaming media server code rate, or, the preset wireless network throughput rate range in the embodiment of the present invention can also be (0, +∞), or, the above wireless network throughput rate range can also be based on actual conditions (such as user needs, user experience survey data etc.) to set, there is no limitation here.

Optionally, when the wireless network throughput rate of the above mobile terminal is less than the minimum value within the preset range of wireless network throughput rate, the scheduling priority of the above video fragments is set as the maximum threshold value, when the wireless network throughput of the above mobile terminal When the network throughput rate is greater than the maximum value within the preset range of the wireless network throughput rate, the scheduling priority of the above video fragments is set as the minimum threshold value. For example, as shown in Figure 1-b, the characteristics of the preset throughput rate-scheduling priority relationship function include: the definition domain is [0,+∞), the value range is [0,1], when the wireless network throughput rate is set When the value is [0, a], the scheduling priority of the video segment is always equal to 1. When the wireless network throughput rate is (a, b), the scheduling priority of the video segment increases with the wireless network throughput rate. When the wireless network throughput rate is (b,+∞), the scheduling priority of the video segment is always equal to 0. Optionally, the above a is the minimum video bit rate provided by the streaming media server above, and the above b is the maximum video bit rate provided by the above-mentioned streaming media server, or, the above-mentioned a and b can also be set according to actual conditions (such as user needs, user experience survey data, etc.), which are not limited here.

206. Control the sending of the above-mentioned video fragments to the above-mentioned mobile terminal according to the scheduling priority of the above-mentioned video fragments;

Optionally, the streaming media transmission device sends the data packets of the above-mentioned video fragments to the above-mentioned mobile terminal through a preset scheduling algorithm (such as a weighted fair queue scheduling algorithm) according to the scheduling priorities of the above-mentioned video fragments. Or, the streaming media transmission device sends the video fragment and the scheduling priority of the video fragment to the serving base station of the mobile terminal, so that the serving base station of the mobile terminal sends the video fragment to the mobile terminal according to the scheduling priority of the video fragment For the data packets of the above-mentioned video fragments, specifically, after receiving the above-mentioned video fragments and the scheduling priorities of the above-mentioned video fragments from the streaming media transmission device, the serving base station of the above-mentioned mobile terminal may use a preset scheduling algorithm (such as weighted fair queue scheduling algorithm) to send the data packets of the above video fragments to the above mobile terminal.

Usually, a video segment is composed of multiple data packets. When the scheduling priority of the video segment is a value in the interval [0, 1], the above-mentioned streaming media transmission device sends the data of the above-mentioned video segment to the above-mentioned mobile terminal In the process of sending packets, or, in the process of sending the data packets of the above-mentioned video fragments to the above-mentioned mobile terminal by the serving base station of the above-mentioned mobile terminal, the proportion of the data packets for priority scheduling in the above-mentioned video fragments is equal to the scheduling of the above-mentioned video fragments Priority is multiplied by 100%. For example, assuming that the scheduling priority of the above video segment is 0.75, then in the process of sending the data packets of the above video segment to the above mobile terminal, the proportion of data packets in the above video segment for priority scheduling is equal to 75%.

Optionally, before the system is initialized, the streaming media transmission device obtains, saves and parses a media presentation description (MPD, Media Presentation Description) of the video file from the streaming media server, and the MPD file is used to describe all video segments of the video file, So that the streaming media transmission device obtains information such as the URL address, video format, duration (such as 10 seconds/slice) and video bit rate of each video segment of the above-mentioned video file through the MPD file.

Optionally, when downloading the first video segment of the video file, the video segment of the corresponding video bit rate is downloaded according to the default video bit rate.

It should be noted that the embodiment of the present invention is described by sending video fragments to one mobile terminal as an example. When there are multiple mobile terminals, the streaming media transmission for each mobile terminal can refer to the description in the embodiment of the present invention. streaming media delivery method.

It should be noted that the streaming media server in the embodiment of the present invention may specifically be a DASH video server, and the mobile terminal in the embodiment of the present invention may specifically be a mobile phone, a tablet computer or other mobile video playback devices, which are not limited herein.

It can be seen from the above that the embodiment of the present invention adjusts the scheduling priority of video slices according to the wireless network throughput rate of the mobile terminal by detecting the wireless network throughput rate of the mobile terminal, and, within the preset wireless network throughput rate range, makes the video The scheduling priority of fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Since different mobile terminals with large differences in network bandwidth resources have large differences in wireless network throughput rates, therefore, through the present invention In this embodiment, the scheduling priority of video fragments of mobile terminals with a lower wireless network throughput rate can be higher, so that the video fragments of mobile terminals with a lower wireless network throughput rate can be preferentially scheduled, and the above-mentioned different mobile terminals can be reduced. The difference in fluency when playing video files solves the problem of unfair user experience. Moreover, the embodiment of the present invention selects the video code rate of the video fragments to be downloaded according to the current video quality, which limits the situation that the video quality fluctuates violently when the streaming media is played continuously.

The following takes a mobile terminal requesting a streaming media service as an example to describe the streaming media transmission method provided by the embodiment of the present invention. As shown in FIG. 3, the streaming media transmission method in the embodiment of the present invention includes:

301. Receive a streaming media service request message sent by a mobile terminal;

Wherein, the streaming media service request message includes the identifier of the requested video file.

Optionally, the identification of the video stream is a video file name, a video file number, or a video file code.

302. Forward the foregoing streaming media service request message to the streaming media server;

After receiving the streaming media service request message sent by the mobile terminal, the streaming media transmission device forwards the streaming media service request message to the streaming media server.

303. Receive the MPD file that the streaming media server responds to according to the streaming media service request message;

Wherein, the above-mentioned MPD file is used to describe all video segments of the video stream requested by the above-mentioned streaming media service request message.

In the embodiment of the present invention, when the streaming media server receives the streaming media service request message from the streaming media transmission device, the streaming media server will describe the MPD files of all video segments of the video stream requested by the streaming media service request message Send it to the streaming media transmission device so that the streaming media transmission device can learn the URL address, video format, duration (such as 10 seconds/piece) and video bit rate of each video segment of the video file requested by the mobile terminal through the MPD file .

For steps 304-309, reference may be made to the description of steps 201-206 in the embodiment shown in FIG. 2 , and details are not repeated here.

310. Detect whether the last video segment of the video file has been downloaded;

The streaming media transmission device detects whether the last video fragment of the above-mentioned video file has been obtained from the streaming media server, if the last video fragment of the video file has been downloaded, then, optionally, perform step 311, or immediately or wait for a predetermined If the last video fragment of the video file has not been downloaded, then return to step 304 to continue the download and sending process of the next video file.

311. Feed back information indicating that the video file has been sent to the mobile terminal.

Optionally, when downloading the first video segment of the video file, download the video segment of the corresponding video bit rate according to the default video bit rate.

It should be noted that the embodiment of the present invention is described by sending video fragments to one mobile terminal as an example. When there are multiple mobile terminals, the streaming media transmission for each mobile terminal can refer to the description in the embodiment of the present invention. streaming media delivery method.

It should be noted that in the embodiment of the present invention, the streaming media server can also directly deliver the video fragments with the default video code rate to the streaming media transmission device, and steps 304-311 can be replaced with 101 in the embodiment shown in FIG. 1 ~104.

It should be noted that the streaming media server in the embodiment of the present invention may specifically be a DASH video server, and the mobile terminal in the embodiment of the present invention may specifically be a mobile phone, a tablet computer or other mobile video playback devices, which are not limited here.

It can be seen from the above that the embodiment of the present invention adjusts the scheduling priority of video slices according to the wireless network throughput rate of the mobile terminal by detecting the wireless network throughput rate of the mobile terminal, and, within the preset wireless network throughput rate range, makes the video The scheduling priority of fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Since different mobile terminals with large differences in network bandwidth resources have large differences in wireless network throughput rates, therefore, through the present invention In this embodiment, the scheduling priority of video fragments of mobile terminals with a lower wireless network throughput rate can be higher, so that the video fragments of mobile terminals with a lower wireless network throughput rate can be preferentially scheduled, and the above-mentioned different mobile terminals can be reduced. The difference in fluency when playing video files solves the problem of unfair user experience. Moreover, the embodiment of the present invention selects the video code rate of the video fragments to be downloaded according to the current video quality, which limits the situation that the video quality fluctuates violently when the streaming media is played continuously.

The embodiment of the present invention also provides a streaming media transmission device. As shown in FIG. 4, the streaming media transmission device 400 includes:

The first receiving unit 401 is configured to receive video fragments from a streaming media server.

The detection unit 402 is configured to detect the wireless network throughput rate of the mobile terminal, wherein the above mobile terminal is the target receiving terminal of the above video fragmentation;

Optionally, the detection unit 402 detects the wireless network throughput rate of the mobile terminal by acquiring information such as the play cache and wireless network QoS of the mobile terminal, or the detection unit 402 may also detect the wireless network throughput of the mobile terminal in other ways. rate, the embodiment of the present invention does not limit the method for the detecting unit 402 to detect the wireless network throughput rate of the mobile terminal.

The priority adjustment unit 403 is configured to adjust the scheduling priority of the above-mentioned video slices according to the throughput rate of the wireless network of the mobile terminal detected by the detection unit 402, wherein, within the preset wireless network throughput rate range, the video slices The scheduling priority decreases with the increase of the wireless network throughput rate of the mobile terminal.

The control unit 404 is configured to control the sending of the video fragments to the mobile terminal according to the scheduling priority of the video fragments adjusted by the priority adjustment unit 403;

Optionally, the control unit 404 is specifically configured to: send the above-mentioned video slice and the scheduling priority of the above-mentioned video slice to the base station, so that the base station sends the above-mentioned video slice to the above-mentioned mobile terminal according to the scheduling priority of the above-mentioned video slice. data pack.

Optionally, the priority adjustment unit 403 is specifically configured to determine the priority of the above-mentioned video slices according to the throughput rate-priority relationship function and the wireless network throughput rate of the above-mentioned mobile terminal detected by the detection unit 402; wherein, the above-mentioned throughput rate- The characteristics of the priority relationship function include: the definition domain is [0,+∞), and the value range is [0,1]; when the wireless network throughput rate is [0,a], the scheduling priority of the video segment is constant Equal to 1; when the wireless network throughput rate is (a, b], the scheduling priority of video fragmentation decreases as the wireless network throughput rate increases; when the wireless network throughput rate is (b, + ∞) , the scheduling priority of the video segment is always equal to 0; wherein, the above-mentioned a is the minimum video code rate provided by the above-mentioned streaming media server, and the above-mentioned b is the maximum video code rate provided by the above-mentioned streaming media server.

Optionally, on the basis of the embodiment shown in FIG. 4, as shown in FIG. 5, the streaming media transmission device 500 further includes: a code rate selection unit 405, which is used to select the video code of the video segment to be downloaded according to the current video quality. rate; the requesting unit 406 is configured to request video fragmentation from the above-mentioned streaming media server according to the video bit rate selected by the bit rate selection unit 405.

Optionally, the code rate selection unit 405 includes: a calculation subunit, which is used to calculate the square value of the difference between each video code rate provided by the above-mentioned streaming media server and the current average video code rate; The calculation result of the calculation subunit determines the video code rate corresponding to the least square value as the video code rate of the video segment to be downloaded.

Optionally, the streaming media transmission device in the embodiment of the present invention further includes: a second receiving unit, configured to receive the streaming media service request message sent by the mobile terminal, wherein the streaming media service request message includes the requested video stream The identification of; the sending unit is used to forward the above-mentioned streaming media service request message to the streaming media server; the third receiving unit is used to receive the media presentation description MPD file that the above-mentioned streaming media server responds according to the above-mentioned streaming media service request message, wherein the above-mentioned The MPD file is used to describe all video fragments of the video stream requested by the streaming media service request message.

It should be noted that the streaming media server in the embodiment of the present invention may specifically be a DASH video server, and the mobile terminal in the embodiment of the present invention may specifically be a mobile phone, a tablet computer or other mobile video playback devices, which are not limited here.

It should be noted that the streaming media transmission device in the embodiment of the present invention can be like the streaming media transmission device in the above method embodiment, and can be used to realize all the technical solutions in the above method embodiment, and the functions of each functional module can be based on The methods in the above method embodiments are specifically implemented, and the specific implementation process may refer to relevant descriptions in the above embodiments, and details are not repeated here.

As can be seen from the above, the streaming media transmission device in the embodiment of the present invention detects the wireless network throughput rate of the mobile terminal, adjusts the scheduling priority of video fragmentation according to the wireless network throughput rate of the mobile terminal, and, within the preset wireless network throughput rate range , so that the scheduling priority of video fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Due to different mobile terminals with large differences in network bandwidth resources, the difference in wireless network throughput rate is bound to be large. Therefore, , through the embodiment of the present invention, the scheduling priority of the video slices of the mobile terminal with a low wireless network throughput rate is higher, so that the video slices of the mobile terminal with a lower wireless network throughput rate can be preferentially scheduled, reducing the above-mentioned The difference in fluency when different mobile terminals play video files solves the problem of unfair user experience. Moreover, the embodiment of the present invention selects the video code rate of the video fragments to be downloaded according to the current video quality, which limits the situation that the video quality fluctuates violently when the streaming media is played continuously.

An embodiment of the present invention also provides a computer storage medium, wherein the computer storage medium stores a program, and the program executes part or all of the arrangements described in the above method embodiments.

Another device applied to a peer-to-peer network in the implementation of the present invention is described below. Please refer to FIG. 6. The streaming media transmission device 600 in the embodiment of the present invention includes:

An input device 601 , an output device 602 , a memory 603 and a processor 604 (the number of processors 604 in the streaming media transmission device 600 may be one or more, one processor is taken as an example in FIG. 6 ). In some embodiments of the present invention, the input device 601 , the output device 602 , the memory 603 and the processor 604 may be connected through a bus or in other ways, as shown in FIG. 6 , the connection through a bus is taken as an example. Among them, the memory 603 is used to store the data input from the input device 601, and can also store information such as necessary files for the processor 604 to process the data; ports, and may also include output devices connected to the streaming media transmission device 600 such as monitors, keyboards, mice, and printers. Specifically, the input device 601 may include a mouse and a keyboard, and the output device 602 may include a display. The ports for communicating with other devices in the input device 601 and the output device 602 are antennas and/or communication cables.

Wherein, the processor 604 performs the following steps:

Receive video fragments from streaming media server;

Detecting the wireless network throughput rate of the mobile terminal, wherein the above-mentioned mobile terminal is the target receiving terminal of the above-mentioned video fragmentation;

Adjust the scheduling priority of the above-mentioned video fragmentation according to the wireless network throughput rate of the above-mentioned mobile terminal, wherein, within the preset range of wireless network throughput rate, the scheduling priority of the above-mentioned video fragmentation varies with the wireless network throughput rate of the mobile terminal increase and decrease;

According to the scheduling priority of the above-mentioned video fragments, control the sending of the above-mentioned video fragments to the above-mentioned mobile terminal;

Optionally, the processor 604 sends the data packets of the above-mentioned video fragments to the above-mentioned mobile terminal through a preset scheduling algorithm (such as a weighted fair queue scheduling algorithm) according to the scheduling priorities of the above-mentioned video fragments. Alternatively, the processor 604 sends the video slice and the scheduling priority of the video slice to the serving base station of the mobile terminal, so that the serving base station of the mobile terminal sends the above-mentioned video slice to the mobile terminal according to the scheduling priority of the video slice The data packets of the video fragments, specifically, after the serving base station of the above-mentioned mobile terminal receives the above-mentioned video fragments and the scheduling priorities of the above-mentioned video fragments from the streaming media transmission device, it can use a preset scheduling algorithm (such as weighted Fair Queue Scheduling Algorithm) Send the data packets of the above video fragments to the above mobile terminal.

Optionally, the processor 604 is also used for: when the system is initialized, obtain, save and parse the MPD file of the video file from the streaming media server, the MPD file is used to describe all video segments of the video file, so that the streaming media transmits information Information such as the URL address, video format, duration (such as 10 seconds/piece) and video bit rate of each video segment of the above-mentioned video file is obtained through the MPD file.

It should be noted that the streaming media server in the embodiment of the present invention may specifically be a DASH video server, and the mobile terminal in the embodiment of the present invention may specifically be a mobile phone, a tablet computer or other mobile video playback devices, which are not limited here.

It should be noted that the streaming media transmission device in the embodiment of the present invention can be like the streaming media transmission device in the above method embodiment, and can be used to realize all the technical solutions in the above method embodiment, and the functions of each functional module can be based on The methods in the above method embodiments are specifically implemented, and the specific implementation process may refer to relevant descriptions in the above embodiments, and details are not repeated here.

As can be seen from the above, the streaming media transmission device in the embodiment of the present invention detects the wireless network throughput rate of the mobile terminal, adjusts the scheduling priority of video fragmentation according to the wireless network throughput rate of the mobile terminal, and, within the preset wireless network throughput rate range , so that the scheduling priority of video fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Due to different mobile terminals with large differences in network bandwidth resources, the difference in wireless network throughput rate is bound to be large. Therefore, , through the embodiment of the present invention, the scheduling priority of the video slices of the mobile terminal with a low wireless network throughput rate is higher, so that the video slices of the mobile terminal with a lower wireless network throughput rate can be preferentially scheduled, reducing the above-mentioned The difference in fluency when different mobile terminals play video files solves the problem of unfair user experience.

The embodiment of the present invention also provides a streaming media transmission system, as shown in Figure 7, the streaming media transmission system 700 in the embodiment of the present invention includes:

A streaming media transmission device 701, a streaming media server 702 and a mobile terminal 703.

Wherein, the streaming media server 702 is used to provide the mobile terminal 703 with video fragments of various video code rates of the video file through the streaming media transmission device 701 .

Optionally, the streaming media transmission device 701 and the streaming media server 702 are connected through a wired network, and communicate using a wired transmission control protocol (TCP, Transmission Control Protocol), and the streaming media transmission device 701 and the mobile terminal 703 are connected through a wireless network, using Communication via wireless TCP.

Optionally, the streaming media transmission device 701 implements information interaction with the mobile terminal 703 through the serving base station of the mobile terminal 703 .

The streaming media transmission device 701 in the embodiment of the present invention can be like the streaming media transmission device in the above-mentioned method embodiment, and can be used to realize all the technical solutions in the above-mentioned method embodiment, and the functions of each functional module can be according to the above-mentioned method embodiment The method in is specifically implemented, and the specific implementation process can refer to the relevant description in the above-mentioned embodiments, and details are not repeated here.

As can be seen from the above, in the streaming media transmission system of the embodiment of the present invention, the streaming media transmission device adjusts the scheduling priority of video fragments according to the wireless network throughput rate of the mobile terminal by detecting the wireless network throughput rate of the mobile terminal, and, in Within the preset wireless network throughput rate range, the scheduling priority of video fragmentation decreases with the increase of the wireless network throughput rate of the mobile terminal. Due to the large difference in network bandwidth resources of different mobile terminals, the wireless network throughput rate Therefore, through the embodiment of the present invention, the scheduling priority of video slices of mobile terminals with a lower wireless network throughput rate can be made higher, so that mobile terminals with a lower wireless network throughput rate can be preferentially scheduled The video fragmentation reduces the difference in the smoothness of the above-mentioned different mobile terminals when playing video files, and solves the problem of unfair user experience.

Those of ordinary skill in the art can understand that all or part of the steps in the method of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the above-mentioned storage The medium can be read-only memory, magnetic or optical disk, etc.

A streaming media transmission method, related equipment and system provided by the present invention have been introduced in detail above. For those of ordinary skill in the art, according to the idea of the embodiment of the present invention, there will be changes in the specific implementation and application scope In summary, the content of this specification should not be construed as limiting the present invention.

Claims (13)

1. A streaming media transmission method, characterized in that, comprising: Receive video fragments from streaming media server; Detecting the wireless network throughput rate of the mobile terminal, wherein the mobile terminal is the target receiving terminal of the video fragmentation; Adjust the scheduling priority of the video fragmentation according to the wireless network throughput rate of the mobile terminal, wherein, within the preset wireless network throughput rate range, the scheduling priority of the video fragmentation varies with the wireless network throughput rate of the mobile terminal Increase and decrease, the wireless network throughput rate range is set according to the video code rate of the video fragmentation; Sending the video fragment and the scheduling priority of the video fragment to the serving base station of the mobile terminal, so that the serving base station of the mobile terminal sends to the mobile terminal according to the scheduling priority of the video fragment The data packet of the video fragment. 2. The method according to claim 1, wherein the adjusting the scheduling priority of the video slice according to the wireless network throughput rate of the mobile terminal comprises: The scheduling priority of the video slices is determined according to the throughput rate-scheduling priority relationship function and the wireless network throughput rate of the mobile terminal. 3. The method according to claim 2, wherein the characteristics of the throughput rate-scheduling priority relationship function include: The definition domain is [0,+∞), and the value range is [0,1]; When the wireless network throughput rate is [0, a], the scheduling priority of video fragmentation is always equal to 1; When the wireless network throughput rate is (a, b], the scheduling priority of video fragmentation decreases as the wireless network throughput rate increases; When the wireless network throughput rate is (b,+∞), the scheduling priority of video fragmentation is always equal to 0; Wherein, the a is the minimum video code rate provided by the streaming media server, and the b is the maximum video code rate provided by the streaming media server. 4. The method according to any one of claims 1 to 3, wherein, before receiving the video fragments from the streaming media server, the method also includes: Select the video code rate of the video fragments to be downloaded according to the current video quality; Requesting video fragmentation from the streaming media server according to the selected video code rate. 5. The method according to claim 4, wherein the selection of the video code rate of the video fragments to be downloaded according to the current video quality comprises: Calculate respectively the square value of the difference between each video code rate provided by the streaming media server and the current average video code rate; The video code rate corresponding to the least square value is determined as the video code rate of the video segment to be downloaded. 6. The method according to any one of claims 1 to 3, characterized in that, If the scheduling priority of the video slice is a value in the interval [0, 1], then: In the process of sending the data packets of the video slices to the mobile terminal, the proportion of the data packets in the video slices for priority scheduling is equal to the scheduling priority of the video slices multiplied by 100%. 7. The method according to any one of claims 1 to 3, wherein when the system is initialized, the method further comprises: receiving the streaming media service request message sent by the mobile terminal, wherein the streaming media service request message includes the identifier of the requested video stream; Forwarding the streaming media service request message to the streaming media server; receiving the media presentation description MPD file responded by the streaming media server according to the streaming media service request message, wherein the MPD file is used to describe all video segments of the video stream requested by the streaming media service request message. 8. A streaming media transmission device, characterized in that, comprising: The first receiving unit is used to receive video fragments from the streaming media server; A detection unit, configured to detect a wireless network throughput rate of a mobile terminal, wherein the mobile terminal is a target receiving terminal of the video fragmentation; A priority adjustment unit, configured to adjust the scheduling priority of the video slices according to the throughput rate of the wireless network of the mobile terminal detected by the detection unit, wherein, within the preset wireless network throughput rate range, the video slices The scheduling priority of the slice decreases with the increase of the wireless network throughput rate of the mobile terminal, and the range of the wireless network throughput rate is set according to the video code rate of the video slice; a control unit, configured to send the video slice and the scheduling priority of the video slice to the serving base station of the mobile terminal, so that the serving base station of the mobile terminal sends the video slice to the mobile terminal according to the scheduling priority of the video slice The mobile terminal sends data packets of the video fragments. 9. The streaming media transmission device according to claim 8, wherein the priority adjustment unit is specifically configured to: be used for the mobile terminal detected according to the throughput rate-priority relationship function and the detection unit The wireless network throughput rate determines the priority of the video fragmentation; The characteristics of the throughput rate-priority relationship function include: The definition domain is [0,+∞), and the value range is [0,1]; When the wireless network throughput rate is [0, a], the scheduling priority of video fragmentation is always equal to 1; When the wireless network throughput rate is (a, b], the scheduling priority of video fragmentation decreases as the wireless network throughput rate increases; When the wireless network throughput rate is (b,+∞), the scheduling priority of video fragmentation is always equal to 0; Wherein, the a is the minimum video code rate provided by the streaming media server, and the b is the maximum video code rate provided by the streaming media server. 10. The streaming media transmission device according to claim 8 or 9, characterized in that, The streaming media transmission equipment also includes: A code rate selection unit is used to select the video code rate of the video fragments to be downloaded according to the current video quality; The requesting unit is configured to request video fragments from the streaming server according to the selected video code rate. 11. The streaming media transmission device according to claim 10, wherein the code rate selection unit comprises: A calculation subunit is used to calculate the square value of the difference between each video bit rate provided by the streaming media server and the current average video bit rate; The selection subunit is used to determine the video code rate corresponding to the least square value as the video code rate of the video fragment to be downloaded according to the calculation result of the calculation subunit. 12. The streaming media transmission device according to claim 8 or 9, wherein the streaming media transmission device further comprises: The second receiving unit is configured to receive the streaming media service request message sent by the mobile terminal, wherein the streaming media service request message includes the identifier of the requested video stream; a sending unit, configured to forward the streaming media service request message to a streaming media server; A third receiving unit, configured to receive a media presentation description MPD file responded by the streaming media server according to the streaming media service request message, wherein the MPD file is used to describe the video stream requested by the streaming media service request message All video segments for . 13. A streaming media transmission system, comprising: Streaming media transmission equipment, streaming media servers and mobile terminals; Wherein, the streaming media server is used to provide video slices of various video bit rates of the video file to the mobile terminal through the streaming media transmission device; The streaming media transmission device is the streaming media transmission device described in any one of claims 8 to 12.