WO2018032361A1 - Video quality assessment method and device - Google Patents

Abstract

A video quality assessment method and device, comprising: a network device determining an average video download speed, a best effort video download speed and a video download speed fluctuation rate of a terminal device, the average video download speed being the average download speed of a video within a playback duration of the video, the best effort video download speed being an average download speed of the video within an effective download time period during the playback duration, the effective download time period being the sum of all time periods within the playback duration during which the download speed is greater than a threshold; the video download speed fluctuation rate being a ratio of a buffering time period to the playback duration, and the buffering time period being the sum of all time periods within the playback duration during which download speed is less than the average video download speed; and the network device determining a video mean opinion score (vMOS) of the video according to the average video download speed, the best effort video download speed and the video download speed fluctuation rate.

Description

Video quality evaluation method and device Technical field

The present application relates to the field of video technologies, and in particular, to a video quality assessment method and apparatus.

Background technique

With the development of mobile communication networks, mobile Internet has become an indispensable part of people's lives. According to the latest research, operators account for more than 50% of video traffic. How to evaluate video services in wireless networks is very important for network construction and evaluation.

At present, the International Telecommunication Union proposes an evaluation method for video quality from the perspective of user experience. The evaluation method determines a vMOS (Video Mean Opinion Score) value of the video according to the quality of the video source and the playback delay. The higher the vMOS value, the higher the quality of the video. The quality of the video source depends on the screen resolution, video resolution, video coding technology, video bit rate, and quality of the video source itself of the terminal device that plays the video.

The above evaluation method mainly evaluates the video quality on the user side. For the video data forwarding device, since the network security problem is involved, the video data is generally encrypted and transmitted, so that the user plane video data cannot be deeply analyzed, and the video cannot be obtained. Source information, such as video resolution, video encoding technology, video bitrate, etc., makes it impossible to evaluate video quality.

Summary of the invention

The embodiment of the present application provides a video quality evaluation method and apparatus for evaluating video quality in the case of video encryption transmission.

An embodiment of the present application provides a video quality assessment method, including:

The network device determines a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, wherein the video average download speed is an average download speed of the video during a playback duration of the video, The video tries to download the speed for the video in the Playing an average download speed in a valid download period during a duration period, wherein the valid download period is a sum of all time periods in which the download speed is greater than a threshold in the playback duration; the video download speed fluctuation rate is buffer a ratio of the time period to the playing duration period, wherein the buffering time period is a sum of all time periods in which the download speed is less than the video average download speed in the playing duration period;

The network device determines a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility.

According to the method provided by the embodiment of the present application, after determining the video average download speed, the video best download speed, and the video download speed fluctuation rate of the video, the network device may determine, according to the video average download speed, the video best download speed, and the video download speed fluctuation rate. The quality of the video, thereby enabling evaluation of video quality in the case of video encrypted transmission.

Optionally, the network device determines, according to the video average download speed, the video best download speed, and the video download speed fluctuation rate, that the vMOS of the video meets the following formula:

vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation)

Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate.

Optionally, after determining, by the network device, the video quality metric vMOS of the video according to the video average download speed, the video best download speed, and the video download speed volatility, the method further includes:

The network device determines a video quality level corresponding to the video according to a vMOS of the video.

Optionally, the threshold is 0.

An embodiment of the present application provides a video quality evaluation apparatus, where the apparatus includes:

a first determining unit, configured to determine a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, where the video average download speed is the video in the An average download speed during a playback duration of the video, the video best download speed being an average download speed of the video during a valid download period of the playback duration, the valid download period being a sum of all time periods in which the download speed is greater than a threshold in a playback duration period; the video download speed fluctuation rate is a ratio of a buffer time period to the playback duration period, and the buffer time period is the playback duration period The sum of all time periods in which the internal download speed is less than the average download speed of the video;

And a second determining unit, configured to determine a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility.

Optionally, the second determining unit is specifically configured to:

Determine vMOS according to the following formula:

vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation)

Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate.

Optionally, the second determining unit is further configured to:

The network device determines a video quality level corresponding to the video according to a vMOS of the video.

Optionally, the threshold is 0.

An embodiment of the present application provides a video quality evaluation apparatus, where the apparatus includes:

a processor, configured to determine a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device; wherein the video average download speed is an average download of the video during a playback duration of the video Speed, the video best download speed is an average download speed of the video during an effective download period of the playback duration period, and the effective download period is a download speed greater than a threshold in the playback duration period a sum of all the time periods; the video download speed fluctuation rate is a ratio of the buffer time period to the play duration period, and the buffer time period is that the download speed is less than the average video download speed in the playback duration period All a sum of time periods; determining a video quality metric vMOS of the video based on the video average download speed, the video best effort download speed, and the video download speed volatility.

Optionally, the processor is specifically configured to:

Determine vMOS according to the following formula:

vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation)

Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate.

Optionally, the processor is further configured to:

The network device determines a video quality level corresponding to the video according to a vMOS of the video.

Optionally, the threshold is 0.

DRAWINGS

FIG. 1 is a schematic flowchart of a video quality assessment method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a video data transmission rate according to an embodiment of the present application;

FIG. 3 is a schematic structural diagram of a video quality evaluation apparatus according to an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a video quality evaluation apparatus according to an embodiment of the present application.

detailed description

The embodiments of the present application are described in detail below with reference to the accompanying drawings.

The embodiments of the present application can be applied to communication systems such as WLAN (Wireless Local Area Networks), LTE (Long Term Evolution), and 5G.

In the embodiment of the present application, the term "network device" includes but is not limited to a base station, a node, a base station controller, an access point (AP), a mobile station, or any other type capable of working in a wireless or wired environment. Interface device.

At present, in the prior art, when evaluating video quality, it is necessary to obtain the screen resolution, video resolution, video encoding technology, video bit rate, quality of the video source itself, and playback delay of the video device, etc. of the terminal device that plays the video. information. However, for video data subjected to operations such as encryption, in the process of transmission, since the network security problem is considered, the data packets cannot be deeply analyzed, and the above information cannot be obtained, so that the video quality cannot be determined. For example, while transmitting video data to the terminal device, the base station cannot determine the video resolution, video coding technology, video bit rate, and the like of the video data being played by the terminal device, and thus cannot determine the video quality of the video that the terminal device is playing.

Based on the above discussion, as shown in FIG. 1 , a schematic diagram of a video quality assessment method according to an embodiment of the present application is shown.

Referring to FIG. 1, the method specifically includes the following steps:

Step 101: The network device determines a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, where the average video download speed is an average download of the video during a duration of playing of the video. Speed, the video best download speed is an average download speed of the video during an effective download period of the playback duration period, and the effective download period is a download speed greater than a threshold in the playback duration period a sum of all the time periods; the video download speed fluctuation rate is a ratio of the buffer time period to the play duration period, and the buffer time period is that the download speed is less than the average video download speed in the playback duration period The sum of all time periods;

Step 102: The network device determines a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility.

In step 101, the average video download speed may be an average download speed of the video during the playback duration of the video.

The average video download speed is related to the screen resolution of the terminal device, the video resolution, the video encoding technology, the video bit rate, and the quality of the video source itself. These factors mainly reflect the amount of data required for a video with a long time, the same. The larger the amount of data required for the video in the time period, the better the quality information of the video source, and the higher the average download speed of the video, and vice versa, and will not be described here.

In the existing streaming media transmission protocol, when transmitting video data to the terminal device, the network device does not transmit all the video data to the terminal device at one time, but determines the amount of video data required for the terminal device to play the video. The amount of video data transmitted to the terminal device to ensure how much video data is transmitted by the terminal device, so as to prevent the network device from transmitting all the video data to the terminal device, the terminal device is turned off before the video is played. The resources caused by the video being played are wasted. Therefore, during playback of the video by the terminal device, the network device does not continuously transmit video data to the terminal device, but only transmits a certain amount of video data at a time, and then stops transmitting the video data, and when determining that the terminal device needs video data, , the video data is transmitted to the terminal device again.

In conjunction with the above description, in the embodiment of the present application, the average download speed of the video during the effective download period of the playback duration is used as the video best download speed. The effective download time period is a sum of all time periods in which the download speed is greater than the threshold in the playback duration period. In the embodiment of the present application, the threshold value may be 0, and the threshold value may also take other values, which may be determined according to actual conditions, which is not limited by the embodiment of the present application.

Correspondingly, in the embodiment of the present application, the video download speed fluctuation rate is a ratio of the buffering time period to the playing duration period, and the buffering time period is that the downloading speed in the playing duration period is less than the average video downloading speed. The sum of all time periods.

For example, as shown in FIG. 2, it is a schematic diagram of a video data transmission rate provided by an embodiment of the present application. In FIG. 2, the playback playback duration period is T, and the average download speed A of the video during the playback duration period. At this time, the buffer time period is the sum of all the time periods in which the download speed is less than A in the playback duration period T, that is, The buffering period is the difference between T1 and T5, the difference between T2 and T6, the difference between T3 and T7, and the difference between T4 and T8. If the threshold is 0, the valid download period is the sum of T1, T2, T3, and T4. Based on the above information, the video quality of the video can be determined.

In step 102, the network device determines, according to the video average download speed, the video best effort download speed, and the video download speed fluctuation rate, that the quality of the video meets the following formula:

vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation)

Where vMOS is the quality of the video determined by the network device, and avgrate is the Video average download speed, P1 is a weight value corresponding to the average video download speed; striverate is the video best download speed, P2 is a weight value corresponding to the video best download speed; and fluctuation is the video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate.

The values of P1, P2, and P3 can be determined according to actual conditions, and are not illustrated here.

In the embodiment of the present application, the determined vMOS is equivalent to scoring the video, and the higher the vMOS, the higher the quality of the video.

In the embodiment of the present application, after determining the vMOS, the video quality level corresponding to the video may be determined according to the relationship between the pre-agreed video quality level and the vMOS.

For example, as shown in Table 1, the relationship between a video quality level and a vMOS provided by an embodiment of the present application.

Table 1

In Table 1, the user experience corresponding to the video quality level may also be included. For example, when the vMOS is greater than or equal to 5, the video quality level is excellent, and the user thinks that the video is played without delay and the playback is smooth. For another example, when the vMOS is greater than or equal to 3 and less than 4, the video quality level is medium. When the user watches the video, the delay is more obvious, and the playback is a bit stuck, but acceptable.

Of course, the above is only an example, and the relationship between the video quality level and the vMOS may be other forms, which is not limited by the embodiment of the present application.

According to the above method, after determining the video average download speed, the video best download speed, and the video download speed fluctuation rate of the video, the network device may determine the quality of the video according to the video average download speed, the video best download speed, and the video download speed fluctuation rate. In order to achieve video quality evaluation in the case of video encryption transmission.

Based on the same technical concept, the embodiment of the present application further provides a video quality evaluation apparatus, which can perform the method flow described in FIG.

As shown in FIG. 3, the embodiment of the present application provides a schematic structural diagram of a video quality assessment apparatus.

Referring to Figure 3, the apparatus includes:

a first determining unit 301, configured to determine a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, where the video average download speed is that the video is within a playback duration of the video Average download speed, the video best download speed is an average download speed of the video during a valid download period of the playback duration, and the effective download period is a download speed during the playback duration a sum of all time periods greater than a threshold; the video download speed fluctuation rate is a ratio of a buffer time period to the playback duration period, and the buffer time period is that the download speed is less than the video average during the playback duration period The sum of all time periods of the download speed;

The second determining unit 302 is configured to determine a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility.

Optionally, the second determining unit 302 is specifically configured to:

Determine vMOS according to the following formula:

vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation)

Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate.

Optionally, the second determining unit 302 is further configured to:

The network device determines a video quality level corresponding to the video according to a vMOS of the video.

Optionally, the threshold is 0.

Based on the same technical concept, the embodiment of the present application further provides a video quality evaluation apparatus, which can perform the method flow described in FIG.

As shown in FIG. 4, the embodiment of the present application provides a schematic structural diagram of a video quality evaluation apparatus.

Referring to FIG. 4, the apparatus includes a processor 401, a memory 402, and a transceiver 403. The transceiver 403 is coupled to the processor 401 for supporting communication between the video quality assessment device and the terminal. The memory 402 is for holding program instructions and is coupled to the processor 401.

The processor 401 is configured to determine a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, where the video average download speed is an average of the video during the playback duration of the video. a download speed, wherein the video download speed is an average download speed of the video during a valid download period of the playback duration period, and the effective download period is a download speed greater than a threshold during the playback duration period The sum of all the time periods; the video download speed fluctuation rate is a ratio of the buffer time period to the play duration period, and the buffer time period is that the download speed is less than the video average download speed during the play duration period The sum of all time periods; the video quality metric vMOS of the video is determined based on the video average download speed, the video best effort download speed, and the video download speed volatility.

Optionally, the processor 401 is specifically configured to:

Determine vMOS according to the following formula:

vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation)

Where avgrate is the average download speed of the video, and P1 is the average download speed of the video. The weight value is: the effortrate is the download speed of the video, the P2 is the weight value corresponding to the video best download speed; the fuctuation is the video download speed fluctuation rate, and P3 is the weight value corresponding to the video download speed fluctuation rate. .

Optionally, the processor 401 is further configured to:

The network device determines a video quality level corresponding to the video according to a vMOS of the video.

Optionally, the threshold is 0.

In Figure 4, the transceiver can be a wired transceiver, a wireless transceiver, or a combination thereof. The wired transceiver can be, for example, an Ethernet interface. The Ethernet interface can be an optical interface, an electrical interface, or a combination thereof. The wireless transceiver can be, for example, a wireless local area network transceiver, a cellular network transceiver, or a combination thereof. The processor may be a central processing unit (English: central processing unit, abbreviated: CPU), a network processor (English: network processor, abbreviated: NP) or a combination of CPU and NP. The processor may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (abbreviated as PLD), or a combination thereof. The above PLD can be a complex programmable logic device (English: complex programmable logic device, abbreviation: CPLD), field-programmable gate array (English: field-programmable gate array, abbreviation: FPGA), general array logic (English: generic array Logic, abbreviation: GAL) or any combination thereof. The memory may include a volatile memory (English: volatile memory), such as random access memory (English: random-access memory, abbreviation: RAM); the memory may also include non-volatile memory (English: non-volatile memory). For example, read-only memory (English: read-only memory, abbreviation: ROM), flash memory (English: flash memory), hard disk (English: hard disk drive, abbreviation: HDD) or solid state drive (English: solid-state drive, Abbreviation: SSD); the memory may also include a combination of the above types of memory.

Optionally, the bus interface may also be included in FIG. 4, and the bus interface may include any number of interconnected buses and bridges, specifically linked by one or more processors represented by the processor and various circuits of the memory represented by the memory. . The bus interface can also be used such as peripherals, voltage regulators and power Various other circuits, such as management circuits and the like, are linked together, which are well known in the art and, therefore, will not be further described herein. The bus interface provides an interface. The transceiver provides means for communicating with various other devices on a transmission medium. The processor is responsible for managing the bus architecture and the usual processing, and the memory can store the data that the processor uses when performing operations.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer usable memory channels (including but not limited to disk storage and optical storage, etc.) in which computer usable program code is embodied.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. The computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine instruction for generating instructions executed by a processor of a computer or other programmable data processing device Means for implementing the functions specified in one or more flows of the flowchart or in a block or blocks of the flowchart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the present disclosure. The spirit and scope of the application. Thus, it is intended that the present invention cover the modifications and variations of the present invention.

Claims (12)

A video quality assessment method, characterized in that the method comprises: The network device determines a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, wherein the video average download speed is an average download speed of the video during a playback duration of the video, The video downloading speed is an average download speed of the video during a valid download period within the playback duration period, and the valid download period is all time periods in which the download speed is greater than a threshold in the playback duration period. The video download speed fluctuation rate is a ratio of the buffer time period to the playback duration period, and the buffer time period is all time periods in which the download speed is less than the video average download speed in the playback duration period Sum; The network device determines a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility. The method according to claim 1, wherein the network device determines that the vMOS of the video meets the following formula according to the video average download speed, the video best download speed, and the video download speed fluctuation rate: vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation) Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate. The method according to any one of claims 1 to 2, wherein the network device determines a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility. After that, it also includes: The network device determines a video quality level corresponding to the video according to a vMOS of the video. The method according to any one of claims 1 to 3, characterized in that the threshold is zero. A video quality evaluation device, characterized in that the device comprises: a first determining unit, configured to determine a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device, where the video average download speed is the video during the playback duration of the video An average download speed, the video best download speed is an average download speed of the video during a valid download period of the playback duration period, and the effective download period is a download speed greater than the playback duration period a sum of all time periods of the threshold; the video download speed fluctuation rate is a ratio of the buffer time period to the play duration period, and the buffer time period is that the download speed is less than the video average download during the playback duration period The sum of all time periods of speed; And a second determining unit, configured to determine a video quality metric vMOS of the video according to the video average download speed, the video best effort download speed, and the video download speed volatility. The device according to claim 5, wherein the second determining unit is specifically configured to: Determine vMOS according to the following formula: vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation) Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate. The device according to any one of claims 5 to 6, wherein the second determining unit is further configured to: The network device determines a video quality level corresponding to the video according to a vMOS of the video. Apparatus according to any of claims 5 to 7, wherein said threshold is zero. A video quality evaluation device, characterized in that the device comprises: a processor, configured to determine a video average download speed, a video best download speed, and a video download speed fluctuation rate of the terminal device; wherein the video average download speed is the video in the video An average download speed during a playback duration period, the video best effort download speed being an average download speed of the video during a valid download time period of the playback duration period, the valid download time period being the playback a sum of all time periods in which the download speed is greater than the threshold value during the duration; the video download speed fluctuation rate is a ratio of the buffer time period to the playback duration period, and the buffer time period is downloaded during the playback duration period a speed that is less than a sum of all time periods of the average video download speed; determining a video quality metric vMOS of the video based on the video average download speed, the video best effort download speed, and the video download speed volatility. The device according to claim 9, wherein the processor is specifically configured to: Determine vMOS according to the following formula: vMOS=P1×avgrate×(P2×effortrate+P3×fluctuation) Where avgrate is the average download speed of the video, P1 is a weight value corresponding to the average download speed of the video; striverate is the best-effort download speed of the video, and P2 is a weight value corresponding to the best-effort download speed of the video; the Fluctuation is the The video download speed fluctuation rate, P3 is a weight value corresponding to the video download speed fluctuation rate. The device according to any one of claims 9 to 10, wherein the processor is further configured to: The network device determines a video quality level corresponding to the video according to a vMOS of the video. Apparatus according to any one of claims 9 to 11, wherein said threshold is zero.

Images