[go: up one dir, main page]

CN118803282B - Streaming media service performance evaluation system and its method, device and program product - Google Patents

Streaming media service performance evaluation system and its method, device and program product

Info

Publication number
CN118803282B
CN118803282B CN202310812543.2A CN202310812543A CN118803282B CN 118803282 B CN118803282 B CN 118803282B CN 202310812543 A CN202310812543 A CN 202310812543A CN 118803282 B CN118803282 B CN 118803282B
Authority
CN
China
Prior art keywords
streaming media
delay
frame
server
data packet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310812543.2A
Other languages
Chinese (zh)
Other versions
CN118803282A (en
Inventor
梁唯一
刘明宇
李智宇
盛凌志
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Group Beijing Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Group Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Group Beijing Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202310812543.2A priority Critical patent/CN118803282B/en
Publication of CN118803282A publication Critical patent/CN118803282A/en
Application granted granted Critical
Publication of CN118803282B publication Critical patent/CN118803282B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/222—Secondary servers, e.g. proxy server, cable television Head-end
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2408—Monitoring of the upstream path of the transmission network, e.g. client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The application relates to the technical field of communication and provides a streaming media service performance evaluation system, a method, equipment and a program product thereof. The core of the system is synchronous processing and index calculation based on an agent mechanism, and by introducing the related performance index of the mobile communication network, the characteristic of fusion of the streaming media and the mobile network is mainly considered, and the streaming media service and the mobile communication network are better used as an integral system for objective measurement. On the other hand, the method has stronger universality, is irrelevant to media formats, codecs, streaming media server software and mobile network systems, does not participate in the codecs, greatly reduces the development difficulty of performance index measurement, supports a plurality of main stream streaming media protocols, effectively solves the problems of complex streaming media performance measurement, insufficient universality, unsound network combination and high development difficulty, and improves the streaming media service performance evaluation efficiency based on the method.

Description

Stream media service performance evaluation system, method, equipment and program product thereof
Technical Field
The present application relates to the field of communications technologies, and in particular, to a system, a method, an apparatus, and a program product for evaluating performance of a streaming media service.
Background
At present, the streaming media performance index under the mobile network scene is mainly concentrated on the aspects of evaluation of image quality and analysis based on client package, and an overall system-level solution is not provided by combining with a network, so that the universality and objectivity are lacking. The method is characterized in that the method is based on evaluation research of the client, the packet grabbing analysis of the heavy client is not performed, comprehensive evaluation combined with the overall performance of the network is not performed, the evaluation universality based on pictures is insufficient, and the customizing development difficulty is high. Based on the above, the efficiency of evaluating the performance of the streaming media service is low.
Disclosure of Invention
The embodiment of the application provides a system, a method, equipment and a program product for evaluating the performance of a streaming media service, which are used for solving the problem of low efficiency of evaluating the performance of the streaming media service.
In a first aspect, an embodiment of the present application provides a system for evaluating performance of a streaming media service, including:
the system comprises a client subsystem, a mobile communication subsystem and a service subsystem, wherein the client subsystem and the service subsystem are in communication connection through the mobile communication subsystem;
The mobile communication subsystem comprises a clock synchronization system, the service subsystem comprises a proxy player, the client subsystem comprises a proxy server and a client scheduling controller connected with the proxy server;
The clock synchronization system is used for synchronizing the time of the client sub-system and the service sub-system;
The proxy player is used for collecting a first performance index of the streaming media service, generating downlink data based on the first performance index and sending the downlink data to the proxy server;
The proxy server is configured to receive downlink data sent by the proxy player, acquire the first performance index based on the downlink data, acquire a second performance index of the streaming media service, and send the first performance index and the second performance index to the client scheduling controller;
The client scheduling controller is configured to generate a performance evaluation report based on the received first performance index and the received second performance index, so as to evaluate the performance of the streaming media service based on the performance evaluation report.
In one embodiment, the client subsystem further comprises a streaming media player, wherein the client scheduling controller, the streaming media player and the proxy server are connected with each other;
The service terminal system also comprises a service terminal scheduling controller and a streaming media server, wherein the service terminal scheduling controller, the streaming media server and the proxy player are mutually connected;
The proxy server is further configured to receive a play request sent by the streaming media player, record a first receiving time of the play request, generate a first data packet based on the first receiving time and a play request data packet, and send the first data packet to the proxy player;
The proxy player is further configured to receive the first data packet, record a second receiving time of the first data packet, parse the first data packet to obtain the play request data packet, and send the play request data packet to the streaming media server;
The streaming media server is used for receiving the play request data packet and sending the streaming media data packet to the proxy player based on the play request data packet;
the proxy player is further configured to receive the streaming media data packet, record a third receiving time of the streaming media data packet if the type of the streaming media data packet is determined to be a video frame, determine an uplink transmission delay of a play instruction based on the first receiving time and the second receiving time, determine a processing delay of the streaming media data packet based on the third receiving time, generate a second data packet based on the streaming media data packet, the uplink transmission delay and the processing delay, and send the second data packet to the proxy server, wherein the first performance index includes the uplink transmission delay and the processing delay;
the proxy server is further configured to receive the second data packet and record a fourth receiving time of the second data packet to determine a second performance index.
In one embodiment, the proxy server is specifically configured to:
Analyzing the second data packet to obtain the first receiving time, the third receiving time and the processing time delay;
determining a downlink network transmission delay based on the third receiving time and the fourth receiving time;
determining a first packet delay based on the first reception time and the fourth reception time;
Determining a first frame delay based on the first packet delay, the downlink network transmission delay, the processing delay and the decoding delay;
Determining a frame delay based on the downlink network transmission delay, the processing delay and the decoding delay;
determining an average frame delay based on the played frame number, the first frame delay and the frame delay;
Determining a frame jitter based on the first frame delay and the frame delay, or determining a frame jitter based on the frame delay;
determining a code rate based on the size of each data packet and the fourth receiving time;
determining a frame loss rate based on the number of frame loss frames and the total number of video frames;
Determining a packet loss rate based on the packet loss number and the total number of data packets;
the second performance index includes a downlink network transmission delay, the first packet delay, the first frame delay, the average frame delay, the frame jitter, the code rate, the frame loss rate, and the packet loss rate.
In one embodiment, the client scheduling controller is configured to send a video source request to the server scheduling controller;
the server scheduling controller is used for receiving the video source request and sending video source information to the client scheduling controller based on the video source request;
The client scheduling controller is further used for receiving the video source information and sending a playing instruction to the streaming media player based on the video source information;
The streaming media player is used for receiving the playing instruction and sending a playing request to the proxy server based on the playing instruction.
In one embodiment, the client scheduling controller is further configured to send a connection instruction to the streaming media player;
the streaming media player is further configured to receive the connection instruction, and send a connection request to the streaming media server based on the connection instruction;
the proxy server is further configured to intercept the connection request and forward the connection request to the streaming media server;
the streaming media server is further configured to receive the connection request and send connection confirmation information to the proxy server;
the proxy server is further configured to send the connection confirmation information to the streaming media player and the client scheduling controller;
the client scheduling controller is further configured to receive the connection confirmation information and send a synchronization instruction to the proxy server;
The proxy server is further configured to receive the synchronization instruction, write an initial synchronization sequence number into a synchronization message based on the synchronization instruction, and send a synchronization request to the proxy player based on the synchronization message;
The proxy player is further configured to receive the synchronization request, update an initial synchronization sequence number in the synchronization request to a local location, write the confirmed initial synchronization sequence number into a synchronization response message, and send the synchronization response message to the proxy server;
the proxy server is further configured to receive the synchronization response message, update the initial synchronization sequence number in the synchronization response message to local, and send a synchronization confirmation message to the client scheduling controller.
In one embodiment, the first data packet and the second data packet include a proxy layer packet header, where the proxy layer packet header includes a message type, a message length, a timestamp, a synchronization sequence number, a frame sequence number, and a message body.
In a second aspect, an embodiment of the present application provides a method for evaluating performance of a streaming media service, including:
Receiving downlink data sent by a proxy player;
acquiring a first performance index based on the downlink data, and acquiring a second performance index of the streaming media service;
The client scheduling controller generates a performance evaluation report based on the first performance index and the second performance index to evaluate the performance of the streaming media service based on the performance evaluation report.
In one embodiment, the collecting the second performance index of the streaming media service includes:
based on the downlink data, acquiring a first receiving time, a third receiving time and a processing time delay;
Determining downlink network transmission delay based on the third receiving time and fourth receiving time, wherein the fourth receiving time is the time point when the proxy server receives the second data packet;
determining a first packet delay based on the first reception time and the fourth reception time;
Determining a first frame delay based on the first packet delay, the downlink network transmission delay, the processing delay and the decoding delay;
Determining a frame delay based on the downlink network transmission delay, the processing delay and the decoding delay;
determining an average frame delay based on the played frame number, the first frame delay and the frame delay;
Determining a frame jitter based on the first frame delay and the frame delay, or determining a frame jitter based on the frame delay;
determining a code rate based on the size of each data packet and the fourth receiving time;
determining a frame loss rate based on the number of frame loss frames and the total number of video frames;
Determining a packet loss rate based on the packet loss number and the total number of data packets;
the second performance index includes a downlink network transmission delay, the first packet delay, the first frame delay, the average frame delay, the frame jitter, the code rate, the frame loss rate, and the packet loss rate.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory storing a computer program, where the processor implements the steps of the method for evaluating performance of a streaming media service according to the first aspect when executing the program.
In a fourth aspect, an embodiment of the present application provides a computer program product, including a computer program, where the computer program when executed by a processor implements the steps of the method for evaluating performance of a streaming media service according to the first aspect.
The core of the system is synchronous processing and index calculation based on an agent mechanism, and the characteristics of fusion of streaming media and a mobile network are mainly considered by introducing the related performance indexes of the mobile communication network, so that the streaming media service and the mobile communication network are better objectively measured as a whole system. On the other hand, the method has stronger universality, is irrelevant to media formats, codecs, streaming media server software and mobile network systems, does not participate in the codecs, greatly reduces the development difficulty of performance index measurement, supports a plurality of main stream streaming media protocols, effectively solves the problems of complex streaming media performance measurement, insufficient universality, unsound network combination and high development difficulty, and improves the streaming media service performance evaluation efficiency based on the method.
Drawings
In order to more clearly illustrate the application or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the application, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a system for evaluating performance of a streaming media service according to an embodiment of the present application;
Fig. 2 is a second schematic structural diagram of a system for evaluating performance of a streaming media service according to an embodiment of the present application;
Fig. 3 is a schematic structural diagram of a proxy layer packet header according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of test initiation and connection synchronization provided by an embodiment of the present application;
fig. 5 is a schematic flow chart of playing processing and index obtaining according to an embodiment of the present application;
Fig. 6 is a flow chart of a method for evaluating performance of a streaming media service according to an embodiment of the present application;
Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Fig. 1 is a schematic structural diagram of a system for evaluating performance of a streaming media service according to an embodiment of the present application. Referring to fig. 1, an embodiment of the present application provides a system for evaluating performance of a streaming media service, including a client subsystem, a mobile communication subsystem, and a service subsystem, where the client subsystem and the service subsystem are connected in communication through the mobile communication subsystem;
The mobile communication subsystem comprises a clock synchronization system, a service subsystem comprises a proxy player, a client subsystem comprises a proxy server and a client scheduling controller connected with the proxy server;
A clock synchronization system for synchronizing the time of the client subsystem and the service subsystem;
The proxy player is used for collecting a first performance index of the streaming media service, generating downlink data based on the first performance index and sending the downlink data to the proxy server;
the proxy server is used for receiving the downlink data sent by the proxy player, acquiring a first performance index based on the downlink data, acquiring a second performance index of the streaming media service, and sending the first performance index and the second performance index to the client scheduling controller;
And the client scheduling controller is used for generating a performance evaluation report based on the received first performance index and the second performance index so as to evaluate the performance of the streaming media service based on the performance evaluation report.
It should be noted that, based on different division modes, the modules/devices included in the streaming media service performance evaluation system are different, for example, referring to fig. 2, from device type and software type division, the streaming media service performance evaluation system includes client performance evaluation software, server performance evaluation software, performance evaluation client, wireless access device, mobile communication network, performance evaluation server and beidou clock synchronization module, where connection relations of all the parts are shown in fig. 2. The performance evaluation client software is deployed at the evaluation client and connected with the wireless access equipment, 1 or more wireless equipment is accessed into the mobile communication network, the core network is connected with the performance evaluation server, and the performance evaluation client and the performance evaluation server are connected with the Beidou clock synchronization module for accurate clock alignment of the two parties and eliminating synchronous measurement errors.
The streaming media service performance evaluation system comprises three subsystems, namely a client subsystem, a service subsystem and a mobile communication subsystem, which are respectively divided from the functional modules, as shown in fig. 1. In order to accurately acquire the performance index key data of the streaming media, the client terminal system and the service terminal system are respectively provided with proxy service, so that the data packet is rapidly forwarded and the forwarded data packet is subjected to secondary processing, including time stamping, handshake control, synchronous control and the like, thereby not only completing the capture of the key performance data, but also not affecting the transmission of the real-time video stream.
The mobile communication subsystem comprises a clock synchronization system, a wireless access device and a mobile communication network, wherein the functions of the parts are as follows:
The clock synchronization system can be a Beidou system, is used for network clock synchronization, and synchronizes the time of the client terminal system and the service terminal system in the mobile communication subsystem, so that the two parties have a common reference clock when calculating performance indexes such as time delay, jitter, packet loss rate, video frame time delay, video frame jitter and the like, thereby eliminating errors.
The wireless access device is a mobile communication terminal, and can select a wireless router, a CPE (Customer Premise Equipment ), a mobile phone, a DTU (DATA TERMINAL unit) data transmission module and other mobile communication network access devices, and the wireless access device is used for accessing a client computer into a mobile communication network in a mobile communication subsystem, so that a wireless transmission channel of a client subsystem and a service subsystem is established.
The mobile communication network may select a 3G/4G/5G/WIFI network, for example, a 5G network may select SA (Standalone) and NSA (Non-Standalone) modes.
The client terminal system comprises a proxy server, a client terminal dispatching controller and a streaming media player, wherein the proxy server, the client terminal dispatching controller and the streaming media player are mutually connected, and the functions of each part are as follows:
The client scheduling controller is used for scheduling each module in the client, and starting and monitoring the running state of each module in the client.
The streaming media player is general streaming media playing software, such as Windows MEDIA PLAYER, FFPlayer, VLC player, REALPLAYER, RTSP player, FLV player, etc., for playing streaming media.
The proxy server module mainly comprises the functions of intercepting uplink data from a streaming media player, transmitting the uplink data to a service terminal system through a mobile communication subsystem, receiving downlink data from the service terminal system, processing the downlink data and transmitting the downlink data to the streaming media player, adding a proxy layer packet header to the uplink data, analyzing the received downlink data packet proxy layer packet header information, calculating related indexes, monitoring and analyzing network performance and streaming media service performance in real time, and generating a performance evaluation report, thereby providing basis for optimizing streaming media service performance. The data sent by the client terminal system to the service terminal system is called uplink data, and the data sent by the service terminal system to the client terminal system is called downlink data.
The service terminal system comprises a proxy player, a service terminal dispatch controller and a streaming media server, wherein the proxy player, the service terminal dispatch controller and the streaming media server are connected in a related manner, and the functions of the proxy player, the service terminal dispatch controller and the streaming media server are as follows:
the server scheduling controller is used for scheduling each module in the server, and starting and monitoring the running state of each module in the server.
The streaming media server is used for pushing RTMP, webRTC, HLS, HTTP-FLV, SRT and other video streams with various protocols, and is an efficient real-time video server.
The proxy player mainly comprises the functions of receiving and processing uplink data from a proxy server of a client, analyzing a proxy layer packet header, receiving and processing downlink data from a streaming media server, adding the proxy layer packet header, and forwarding the processed downlink data to the proxy server of the client.
It should be further noted that, the proxy player collects a first performance index of the streaming media service, generates downlink data based on the first performance index, and sends the downlink data to the proxy server, where the first performance index includes indexes such as delay, jitter, packet loss rate, etc., for example, uplink transmission delay of a play command and processing delay of a streaming media data packet.
After receiving the downlink data sent by the proxy player, the proxy server acquires a first performance index based on the downlink data, acquires a second performance index of the streaming media service, and sends the first performance index and the second performance index to the client scheduling controller. For example, after receiving the video stream containing the synchronous packet header transmitted by the service terminal system, the client terminal system analyzes the information carried in the packet header through the proxy server, the proxy server measures the performance indexes related to time, such as time delay, jitter, packet loss rate, frame loss number, first frame delay, average frame delay, frame jitter, first packet delay, etc., through the time stamp, and takes out the load data through the IP encapsulation head, analyzes the performance indexes related to the measurement and frame of the packet header of the streaming media data, calculates the frame rate, code rate, etc. by combining the time stamp, thereby comprehensively measuring the streaming media performance index.
The client scheduling controller generates a performance assessment report based on the received first performance index and second performance index to assess the streaming media service performance based on the performance assessment report.
It should be further noted that, because the streaming media service performance evaluation system introduces a proxy mechanism, the influence of the proxy layer packet header and the index calculation on performance index evaluation is increased. For example, a normal case is to add a 10-byte proxy layer packet header to a 1500-byte conventional IP packet transmission unit, the proxy layer packet header having a 0.67% ratio in the original IP packet. The index calculation is carried out on the processing agent layer packet header and the streaming media packet header according to the protocol rule, the time consumption is extremely short and is usually in nanosecond level, so that the addition of the agent layer packet header and the index calculation has no influence on the overall performance index evaluation.
It should be further noted that, the proxy layer header includes a message type, a message length, a timestamp, a synchronization sequence number, a frame sequence number, and a message body, and the structure thereof is shown in fig. 3. The message type field is 1 byte, the message type is divided into a control message and a performance index data message and is used for distinguishing a control and performance calculation intermediate result data packet, the message length field is 1 byte and is used for indicating the length of a whole proxy layer packet header, the timestamp field is 2 bytes, the synchronous sequence number field is 2 bytes, the frame sequence number is 2 bytes, the message body is used for storing a performance calculation result and a custom message, and the other fields are 2 bytes except that the first packet needs 4 bytes.
The core of the system is synchronous processing and index calculation based on an agent mechanism, and the characteristics of fusion of streaming media and a mobile network are mainly considered by introducing the related performance indexes of the mobile communication network, so that the streaming media service and the mobile communication network are better objectively measured as a whole system. On the other hand, the common performance evaluation tool is biased towards the encoding and decoding and image quality evaluation of the streaming media server and the player, and rarely considers the performance index related to network transmission, therefore, the method accurately measures the related objective index of the streaming media performance through a proxy mechanism, has stronger universality, is irrelevant to media formats, encoding and decoding devices, streaming media server software and mobile network systems, does not participate in encoding and decoding, and greatly reduces the development difficulty of performance index measurement; the method supports various main stream media protocols, effectively solves the problems of complex measurement of stream media performance, insufficient universality, unsmooth network combination and great development difficulty, and improves the evaluation efficiency of stream media service performance based on the problems.
In one embodiment, the evaluation of the performance of the streaming media service based on the streaming media service performance evaluation system includes four stages of test start, connection synchronization, play processing and index acquisition.
Referring to fig. 4, fig. 4 includes two phases of test initiation and connection synchronization, wherein steps 1.1-1.4 are test initiation phases and steps 2.1-2.12 are connection synchronization phases.
And in the first stage, the test is started. According to the priority starting principle of the service end, each module of the service subsystem and the client subsystem is sequentially started by the scheduling controller, so that a controllable and measurable data tunnel is prepared for the establishment of the client and the service end. The method mainly comprises the following steps:
1.1, starting a streaming media server;
1.2 starting a proxy player;
1.3, starting a streaming media player of the client;
1.4, starting a proxy server;
1.5 starting ping thread, collecting network performance index, and the proxy server periodically pings the proxy player, thereby collecting basic network performance index such as time delay, jitter and packet loss rate.
And in the second stage, connection synchronization. In order to count the packet loss condition of the streaming media service, the proxy server and the proxy client need to agree on the initial value of the sequence number of the packet, and the two parties complete handshake synchronization and state synchronization at the stage. The connection synchronization of the client and the server is realized specifically based on the following parts:
The client scheduling controller is also used for sending a connection instruction to the streaming media player;
the streaming media player is also used for receiving the connection instruction and sending a connection request to the streaming media server based on the connection instruction;
the proxy server is also used for intercepting the connection request and forwarding the connection request to the streaming media server;
the streaming media server is also used for receiving the connection request and sending connection confirmation information to the proxy server;
the proxy server is also used for sending the connection confirmation information to the streaming media player and the client scheduling controller;
the client scheduling controller is also used for receiving the connection confirmation information and sending a synchronization instruction to the proxy server;
the proxy server is also used for receiving a synchronization instruction, writing an initial synchronization sequence number into a synchronization message based on the synchronization instruction, and sending a synchronization request to the proxy player based on the synchronization message;
The proxy player is also used for receiving the synchronous request, updating the initial synchronous sequence number in the synchronous request to the local, writing the confirmed initial synchronous sequence number into a synchronous response message, and sending the synchronous response message to the proxy server;
The proxy server is further configured to receive the synchronization response message, update an initial synchronization sequence number in the synchronization response message to the local, and send a synchronization confirmation message to the client scheduling controller.
For example, the main steps are as follows:
2.1, the client scheduling controller sends a connection instruction to the streaming media player to instruct the streaming media player to connect with the streaming media server;
2.2 after receiving the connection instruction, the streaming media player sends a connection request to the streaming media server;
2.3 the proxy server intercepts the connection request and forwards the connection request to the streaming media server;
2.4 after receiving the connection request, the streaming media server sends a connection confirmation after authentication, and forwards the connection confirmation to the proxy server through a series of modules;
2.5 the proxy server forwards the connection acknowledgement to the streaming media player;
2.6 the proxy server forwards the connection acknowledgement to the client dispatch controller;
2.7 the client dispatch controller sends a synchronous instruction to the proxy server;
2.8 the proxy server writes the initial synchronous sequence number into the synchronous message and sends a synchronous request to the proxy player;
2.9 after receiving the synchronous request, the proxy player updates the initial synchronous sequence number to the local;
2.10 the proxy player writes the confirmed initial synchronous sequence number into a synchronous response message and returns to the proxy server;
2.11 the proxy server receives the synchronous response message and updates the initial synchronous sequence number confirmed finally to the local;
2.12 proxy server sends synchronization confirmation to client dispatcher, so far both sides enter into synchronization state.
Further, referring to fig. 5, fig. 5 includes two stages of playing processing and index obtaining, wherein steps 3.1-3.11 are the stages of playing processing, and steps 4.1-4.8 are the stages of index obtaining.
And third stage, playing processing. Before the streaming media player plays the video, firstly, a video file list of the streaming media server needs to be acquired, then, the playing file is requested according to the play list, wherein time points for measuring and evaluating metrics are acquired from the Beidou clock module. Wherein, the playing processing is realized specifically based on the following parts:
The proxy server is further used for receiving a playing request sent by the streaming media player, recording a first receiving time of the playing request, generating a first data packet based on the first receiving time and a playing request data packet, and sending the first data packet to the proxy player;
the proxy player is also used for receiving the first data packet, recording the second receiving time of the first data packet, analyzing the first data packet to obtain a play request data packet, and sending the play request data packet to the streaming media server;
The streaming media server is used for receiving the playing request data packet and sending the streaming media data packet to the proxy player based on the playing request data packet;
The proxy player is further configured to receive the streaming media data packet, record a third receiving time of the streaming media data packet if the type of the streaming media data packet is determined to be a video frame, determine an uplink transmission delay of the play command based on the first receiving time and the second receiving time, determine a processing delay of the streaming media data packet based on the third receiving time, generate a second data packet based on the streaming media data packet, the uplink transmission delay and the processing delay, and send the second data packet to the proxy server, wherein the first performance index includes the uplink transmission delay and the processing delay.
For example, the main steps are as follows:
3.1, the client scheduling controller sends a video source request to the server scheduling controller through an intermediate forwarding link to request for obtaining a play list;
3.2, the server scheduling controller returns the current video source information and transmits the current video source information to the client scheduling controller through an intermediate forwarding link;
3.3 the client dispatch controller selects a play source and sends a play instruction to the streaming media player;
3.4 the stream media player receives the playing instruction and sends a playing request to the stream media server;
3.5 recording the current point after intercepting the playing request by proxy server (First time of receipt) and adding a proxy layer header to the play request packet as shown in table 1, wherein the message type field is assigned to control message, the message length is assigned to 8, and the timestamp field is assigned to;
TABLE 1
3.6, The proxy server transmits the data packet added with the proxy layer packet header to the proxy player;
3.7 agent player receives data packet and records current time point (Second reception time);
3.8 agent player solves the packet header of the agent layer of the data packet, and takes out the time stamp ;
3.9, The proxy player takes out the original playing request data packet and forwards the original playing request data packet to the streaming media server;
3.10 the streaming media server pushes the streaming media data packet to the proxy player;
3.11 agent player receives the flow media data package, then judges the flow media data package type through untapper, if it is video frame, then records the current time point (Third reception time).
And fourth, index acquisition. The measurement indexes mainly comprise time delay, jitter, packet loss rate, frame loss number, frame jitter, first frame time delay, average frame time delay, code rate, frame rate, first packet time delay and the like. In order to accurately acquire the performance index, assuming that the current message synchronization sequence number is i, the four steps of 3.5, 3.7, 3.11 and 4.3 are respectively marked with an uplink packet time stamp T 1 of the playing request of the proxy server, an uplink time stamp T 2 of the playing request received by the proxy player, a time stamp T 3_i of a data packet pushed by the streaming media server received by the proxy player, and a time stamp T 4_i of the streaming media data packet received by the proxy server, so that the processing time delay T 3_i-T3_i-1 and the network transmission time delay T 4_i-T3_i of the data packet of the streaming media server can be calculated. The data of the same frame is marked with the same frame number, and the processing flow of the data packet timestamp in the playing process is shown in table 2.
TABLE 2
The index acquisition is realized specifically based on the following parts:
The proxy server is further configured to receive the second data packet and record a fourth receiving time of the second data packet to determine a second performance index.
The proxy server is specifically configured to:
Analyzing the second data packet to obtain a first receiving time, a third receiving time and a processing time delay;
Determining a downlink network transmission delay based on the third receiving time and the fourth receiving time;
Determining a first packet delay based on the first receiving time and the fourth receiving time;
determining a first frame delay based on the first packet delay, the downlink network transmission delay, the processing delay and the decoding delay;
Determining a frame delay based on the downlink network transmission delay, the processing delay and the decoding delay;
determining an average frame delay based on the played frame number, the first frame delay and the frame delay;
determining a frame jitter based on the first frame delay and the frame delay, or determining a frame jitter based on the frame delay;
determining a code rate based on the size of each data packet and the fourth receiving time;
determining a frame loss rate based on the number of frame loss frames and the total number of video frames;
Determining a packet loss rate based on the packet loss number and the total number of data packets;
the second performance index comprises downlink network transmission delay, first packet delay, first frame delay, average frame delay, frame jitter, code rate, frame loss rate and packet loss rate.
The method mainly comprises the following steps:
4.1, the proxy player performs performance index calculation pretreatment and adds a proxy layer packet header, and the method comprises the following steps:
(1) Calculating the uplink transmission time delay of the playing instruction: T 2-T1;
(2) Calculating the processing time delay of a media data packet of the streaming media server, wherein T 3_i-T3_i-1 is a time delay;
(3) For the first message, a message length field is assigned to be 12, a play instruction uplink transmission delay T 2-T1 and a streaming media server media data packet processing delay T 3_1-T2 are encoded into a message body of a proxy layer packet header, a timestamp field is assigned to be T 3_1, a synchronous sequence number field is assigned to be 1, and a frame sequence number field is assigned to be 1. The proxy layer header content is shown in table 3.
TABLE 3 Table 3
(4) For the first message, the message length field is assigned to be 10, the processing delay T 3_i-T3_i-1 of the streaming media server media data packet is encoded into the message body of the proxy layer packet header, the timestamp field is assigned to be T 3_i, the synchronization sequence number field is assigned to be i, and the frame sequence number field is assigned to be j. The proxy layer header contents are shown in table 4.
TABLE 4 Table 4
4.2 The proxy player forwards the data packet added with the proxy layer packet header to the proxy server;
4.3, after receiving the data packet, the proxy server records the current time point T 4_i;
4.4 the proxy server solves the proxy layer packet header;
4.5 the proxy server forwards the original streaming media data packet to the streaming media player;
and 4.6, the proxy server decodes the streaming media data packet header and calculates the performance index.
(1) Calculating the transmission delay of a downlink network, namely T 4_i-T3_i;
(2) For the first message, calculating a first packet delay: =T4_1-T1。
if the first frame contains n data packets, the first frame is delayed:
=(T4_1-T1)+++。
the decoding delay empirical value evaluation based on the typical configuration is shown in table 5:
TABLE 5
Typical configuration:
CPU 8 threads of Intel (R) Core (TM) i7@3.40GH 4 cores, memory 16G and integrated display card.
(3) Calculate frame delay (not first frame):
=++;
Assuming m frames have been played, the average frame delay:
;
Frame dithering:
=|-|;
obtaining the i Bao Yin th video packet size from the streaming media packet header Code rate:
。
And acquiring a frame rate from the streaming media data packet header, regarding the frame which is not confirmed after overtime as a lost frame, calculating the lost frame number and the lost frame rate by counting the frame sequence numbers, wherein the lost frame number is the sum of all lost frames, and the lost frame rate is the percentage obtained by dividing the lost frame number by the sum of played audio and video data frames.
And 4.7, the proxy server acquires the basic network performance indexes (time delay, jitter, packet loss rate and the like) and the calculated streaming media service performance indexes, and uniformly packages and forwards the streaming media service performance indexes to the client scheduling controller.
And 4.8, comprehensively analyzing all indexes by the client scheduling controller according to the time dimension, aligning the indexes according to time sequence by utilizing the time stamp, analyzing the numerical value of the performance index at each stage, finding out the bottleneck of the performance, and generating a performance evaluation report.
The performance index evaluation is completed through the steps, the problems of accurate time delay calculation and real-time rate acquisition are effectively solved, a proxy mechanism is introduced, video coding and decoding work is not participated, the protocol association degree is small, the development difficulty is low, and important data support is provided for video service performance measurement.
The embodiment of the application has the following advantages:
(1) And based on the current mainstream streaming media service architecture, performing end-to-end overall evaluation on the streaming media system.
Considering the streaming media client, the streaming media server and the mobile communication network as an integral system, the streaming media service is fully processed through fig. 4 to 5, and performance data are collected at each key point, so that the performance bottleneck can be assisted to the user positioning by the full-process real-time collection.
(2) The streaming media performance metrics are generalized independent of streaming media format.
The method does not need to participate in the decoding of the streaming media, greatly reduces the development difficulty, only needs to analyze the streaming media control message through a proxy mode, does not need to analyze the coded data packet, quantizes the performance index from the accurate message time angle through a Beidou synchronous server and a client, has simple realization, high reliability, completely objective index, abandons subjective influence, does not need complex operation, realizes generalization, simplification and objectification, and supports the main stream media format.
(3) Based on the real business measurement, the real-time acquisition index has high consistency with the user experience.
The application utilizes the real mobile terminal to connect the wireless network, based on the real service experience of the streaming media playing, objectively measures the performance index of the real service, is completely different from a plurality of simulation streaming media testing methods, is also different from a subjective evaluation-based index system, and based on the real service, the real service playing and the real service collecting and the real-time measuring analysis are carried out.
(4) The streaming media performance index and the network performance are jointly acquired and analyzed, the client and the server realize strict clock synchronization through the proxy module, and the measurement is more accurate.
The device and the system developed by the application are based on network and real service application scenes, and the streaming media performance and the network performance are inseparable, the application collects the streaming media performance and the network performance at the same time, and the application is based on strict time synchronization, has stronger practicality and more accurate measurement, and provides reliable basis for the analysis of streaming media performance indexes.
It is further noted that the application can be applied to security monitoring related projects, mobile law enforcement video acquisition, VR/AR video experience, automatic driving of the Internet of vehicles, remote medical treatment, ultra-high definition video live broadcast on demand and other video scenes, and meets the requirements of industry users for monitoring the performance index of streaming media in real time. The application supports multiple network transmission, multiple terminal access and multiple streaming media transmission protocols, can be made into a portable integrated universal tool, can be played while testing, can give out objective evaluation of the current streaming media performance in real time, and can be used as the basis of performance optimization.
For operators, the application can provide support for operator network optimization. The evaluation combines the network with the real service performance, so that the network is optimized more effectively. The evaluation flow accurately collects indexes such as processing delay, network delay, frame-related delay, packet loss, frame loss and the like of the streaming media server, and is beneficial to finding out weak points in various links, so that the network can better serve streaming media services.
For industry users, the application can help the users to compare the indexes and the differences of different network modes, and the users can intuitively judge the influence of the networks of different modes on the streaming media performance, thereby optimizing the network which is more suitable for the development of streaming media services.
Based on the above embodiments, referring to fig. 6, an embodiment of the present application provides a method for evaluating performance of a streaming media service, which is applied to a system for evaluating performance of a streaming media service, including:
step 100, receiving downlink data sent by a proxy player;
step 200, acquiring a first performance index based on downlink data, and acquiring a second performance index of the streaming media service;
and 300, transmitting the first performance index and the second performance index to a client scheduling controller, and generating a performance evaluation report by the client scheduling controller based on the first performance index and the second performance index so as to evaluate the performance of the streaming media service based on the performance evaluation report.
The client terminal system receives the video stream with synchronous packet head transmitted by the service terminal system, analyzes the information carried in the packet head by proxy server, the proxy server measures the time related performance index such as time delay, jitter, packet loss rate, frame loss number, first frame delay, average frame delay, frame jitter, first packet delay, etc. by resolving time stamp and comparing packet sequence number, takes out the load data by IP package head, analyzes the performance index related to the measurement and frame of the packet head of the streaming media data, calculates frame rate, code rate, etc. by combining time stamp, thus comprehensively measuring the streaming media performance index.
And the client scheduling controller comprehensively analyzes all indexes according to the time dimension, aligns the indexes according to time sequence by utilizing the time stamp, analyzes the numerical value of the performance index at each stage, finds out the bottleneck of the performance and generates a performance evaluation report.
The embodiment of the application effectively solves the problems of accurate time delay calculation and real-time rate acquisition, introduces a proxy mechanism, does not participate in video coding and decoding work, has small protocol association degree and low development difficulty, and provides important data support for video service performance measurement, thereby improving the efficiency of stream media service performance evaluation.
Based on the above embodiment, collecting the second performance index of the streaming media service includes:
Acquiring a first receiving time, a third receiving time and a processing time delay based on downlink data;
determining downlink network transmission delay based on third receiving time and fourth receiving time, wherein the fourth receiving time is the time point when the proxy server receives the second data packet;
Determining a first packet delay based on the first receiving time and the fourth receiving time;
determining a first frame delay based on the first packet delay, the downlink network transmission delay, the processing delay and the decoding delay;
Determining a frame delay based on the downlink network transmission delay, the processing delay and the decoding delay;
determining an average frame delay based on the played frame number, the first frame delay and the frame delay;
determining a frame jitter based on the first frame delay and the frame delay, or determining a frame jitter based on the frame delay;
determining a code rate based on the size of each data packet and the fourth receiving time;
determining a frame loss rate based on the number of frame loss frames and the total number of video frames;
Determining a packet loss rate based on the packet loss number and the total number of data packets;
the second performance index comprises downlink network transmission delay, first packet delay, first frame delay, average frame delay, frame jitter, code rate, frame loss rate and packet loss rate.
In the index acquisition stage, referring to fig. 5,4.1, the proxy player performs performance index calculation preprocessing, and adds a proxy layer packet header, including the following steps:
(1) Calculating the uplink transmission time delay of the playing instruction: T 2-T1;
(2) Calculating the processing time delay of a media data packet of the streaming media server, wherein T 3_i-T3_i-1 is a time delay;
(3) For the first message, a message length field is assigned to be 12, a play instruction uplink transmission delay T 2-T1 and a streaming media server media data packet processing delay T 3_1-T2 are encoded into a message body of a proxy layer packet header, a timestamp field is assigned to be T 3_1, a synchronous sequence number field is assigned to be 1, and a frame sequence number field is assigned to be 1. The proxy layer header content is shown in table 3.
TABLE 3 Table 3
(4) For the first message, the message length field is assigned to be 10, the processing delay T 3_i-T3_i-1 of the streaming media server media data packet is encoded into the message body of the proxy layer packet header, the timestamp field is assigned to be T 3_i, the synchronization sequence number field is assigned to be i, and the frame sequence number field is assigned to be j. The proxy layer header contents are shown in table 4.
TABLE 4 Table 4
4.2 The proxy player forwards the data packet added with the proxy layer packet header to the proxy server;
4.3, after receiving the data packet, the proxy server records the current time point T 4_i;
4.4 the proxy server solves the proxy layer packet header;
4.5 the proxy server forwards the original streaming media data packet to the streaming media player;
and 4.6, the proxy server decodes the streaming media data packet header and calculates the performance index.
(1) Calculating the transmission delay of a downlink network, namely T 4_i-T3_i;
(2) For the first message, calculating a first packet delay: =T4_1-T1。
if the first frame contains n data packets, the first frame is delayed:
=(T4_1-T1)+++。
the decoding delay empirical value evaluation based on the typical configuration is shown in table 5:
TABLE 5
Typical configuration:
CPU 8 threads of Intel (R) Core (TM) i7@3.40GH 4 cores, memory 16G and integrated display card.
(3) Calculate frame delay (not first frame):
=++;
Assuming m frames have been played, the average frame delay:
;
Frame dithering:
=|-|;
obtaining the i Bao Yin th video packet size from the streaming media packet header Code rate:
。
And acquiring a frame rate from the streaming media data packet header, regarding the frame which is not confirmed after overtime as a lost frame, calculating the lost frame number and the lost frame rate by counting the frame sequence numbers, wherein the lost frame number is the sum of all lost frames, and the lost frame rate is the percentage obtained by dividing the lost frame number by the sum of played audio and video data frames.
The embodiment of the application effectively solves the problems of accurate time delay calculation and real-time rate acquisition, introduces a proxy mechanism, does not participate in video coding and decoding work, has small protocol association degree and low development difficulty, and provides important data support for video service performance measurement, thereby improving the efficiency of stream media service performance evaluation.
Fig. 7 illustrates a physical schematic diagram of an electronic device, which may include a processor (processor) 710, a communication interface (Communication Interface) 720, a memory (memory) 730, and a communication bus 740, where the processor 710, the communication interface 720, and the memory 730 communicate with each other via the communication bus 740, as shown in fig. 7. Processor 710 may call a computer program in memory 730 to perform the steps of the streaming service performance assessment method, including, for example:
Receiving downlink data sent by a proxy player;
acquiring a first performance index based on the downlink data, and acquiring a second performance index of the streaming media service;
The client scheduling controller generates a performance evaluation report based on the first performance index and the second performance index to evaluate the performance of the streaming media service based on the performance evaluation report.
Further, the logic instructions in the memory 730 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. The storage medium includes a U disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, an optical disk, or other various media capable of storing program codes.
In another aspect, an embodiment of the present application further provides a computer program product, where the computer program product includes a computer program, where the computer program may be stored on a non-transitory computer readable storage medium, where the computer program when executed by a processor is capable of executing the steps of the method for evaluating performance of a streaming media service provided by the foregoing embodiments, where the method includes:
Receiving downlink data sent by a proxy player;
acquiring a first performance index based on the downlink data, and acquiring a second performance index of the streaming media service;
The client scheduling controller generates a performance evaluation report based on the first performance index and the second performance index to evaluate the performance of the streaming media service based on the performance evaluation report.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
It should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present application, and not for limiting the same, and although the present application has been described in detail with reference to the above-mentioned embodiments, it should be understood by those skilled in the art that the technical solution described in the above-mentioned embodiments may be modified or some technical features may be equivalently replaced, and these modifications or substitutions do not make the essence of the corresponding technical solution deviate from the spirit and scope of the technical solution of the embodiments of the present application.

Claims (9)

1.一种流媒体业务性能测评系统，其特征在于，包括：客户端子系统、移动通信子系统以及服务端子系统；所述客户端子系统和所述服务端子系统通过所述移动通信子系统进行通信连接；1. A streaming media service performance evaluation system, comprising: a client subsystem, a mobile communication subsystem, and a server subsystem; the client subsystem and the server subsystem are communicatively connected via the mobile communication subsystem; 所述移动通信子系统包括时钟同步系统；所述服务端子系统包括代理播放器；所述客户端子系统包括代理服务器以及与所述代理服务器连接的客户端调度控制器；The mobile communication subsystem includes a clock synchronization system; the server subsystem includes a proxy player; the client subsystem includes a proxy server and a client scheduling controller connected to the proxy server; 所述时钟同步系统，用于同步所述客户端子系统和所述服务端子系统的时间；The clock synchronization system is used to synchronize the time of the client subsystem and the server subsystem; 所述代理播放器，用于采集流媒体业务的第一性能指标，基于所述第一性能指标生成下行数据，并将所述下行数据发送至所述代理服务器；The proxy player is configured to collect a first performance indicator of a streaming media service, generate downlink data based on the first performance indicator, and send the downlink data to the proxy server; 所述代理服务器，用于接收所述代理播放器发送的下行数据，基于所述下行数据获取所述第一性能指标，并采集所述流媒体业务的第二性能指标，将所述第一性能指标和所述第二性能指标发送至所述客户端调度控制器；The proxy server is configured to receive downlink data sent by the proxy player, obtain the first performance indicator based on the downlink data, collect the second performance indicator of the streaming service, and send the first performance indicator and the second performance indicator to the client scheduling controller; 所述客户端调度控制器，用于基于接收到的所述第一性能指标和所述第二性能指标生成性能测评报告，以基于所述性能测评报告对流媒体业务性能进行测评；The client scheduling controller is configured to generate a performance evaluation report based on the received first performance indicator and the received second performance indicator, so as to evaluate the streaming service performance based on the performance evaluation report; 所述客户端子系统还包括流媒体播放器；所述客户端调度控制器、所述流媒体播放器以及所述代理服务器之间相互连接；The client subsystem also includes a streaming media player; the client scheduling controller, the streaming media player and the proxy server are interconnected; 所述服务端子系统还包括服务端调度控制器和流媒体服务器；所述服务端调度控制器、所述流媒体服务器以及所述代理播放器之间相互连接；The server subsystem further includes a server scheduling controller and a streaming media server; the server scheduling controller, the streaming media server and the proxy player are interconnected; 所述代理服务器，还用于接收所述流媒体播放器发送的播放请求，并记录所述播放请求的第一接收时间，以基于所述第一接收时间和播放请求数据包生成第一数据包，将所述第一数据包发送至所述代理播放器；The proxy server is further configured to receive a play request sent by the streaming media player, record a first reception time of the play request, generate a first data packet based on the first reception time and the play request data packet, and send the first data packet to the proxy player; 所述代理播放器，还用于接收所述第一数据包，并记录所述第一数据包的第二接收时间，解析所述第一数据包得到所述播放请求数据包，将所述播放请求数据包发送至所述流媒体服务器；The proxy player is further configured to receive the first data packet, record a second reception time of the first data packet, parse the first data packet to obtain the play request data packet, and send the play request data packet to the streaming media server; 所述流媒体服务器，用于接收所述播放请求数据包，基于所述播放请求数据包向所述代理播放器发送流媒体数据包；The streaming media server is configured to receive the play request data packet and send a streaming media data packet to the proxy player based on the play request data packet; 所述代理播放器，还用于接收所述流媒体数据包，若确定所述流媒体数据包的类型为视频帧，则记录所述流媒体数据包的第三接收时间；基于所述第一接收时间和所述第二接收时间，确定播放指令的上行传输时延；基于所述第三接收时间，确定所述流媒体数据包的处理时延；基于所述流媒体数据包、所述上行传输时延以及所述处理时延，生成第二数据包，并将所述第二数据包发送至所述代理服务器；所述第一性能指标包括所述上行传输时延和所述处理时延；The proxy player is further configured to receive the streaming data packet, and if it is determined that the type of the streaming data packet is a video frame, record a third reception time of the streaming data packet; determine an uplink transmission delay of the play instruction based on the first reception time and the second reception time; determine a processing delay of the streaming data packet based on the third reception time; generate a second data packet based on the streaming data packet, the uplink transmission delay, and the processing delay, and send the second data packet to the proxy server; the first performance indicator includes the uplink transmission delay and the processing delay; 所述代理服务器，还用于接收所述第二数据包，并记录所述第二数据包的第四接收时间，以确定第二性能指标。The proxy server is further configured to receive the second data packet and record a fourth receiving time of the second data packet to determine a second performance indicator. 2.根据权利要求1所述的流媒体业务性能测评系统，其特征在于，所述代理服务器，具体用于：2. The streaming media service performance evaluation system according to claim 1, wherein the proxy server is specifically configured to: 解析所述第二数据包，以获取所述第一接收时间、第三接收时间以及所述处理时延；Parsing the second data packet to obtain the first receiving time, the third receiving time, and the processing delay; 基于所述第三接收时间和所述第四接收时间，确定下行网络传输时延；Determine a downlink network transmission delay based on the third reception time and the fourth reception time; 基于所述第一接收时间和所述第四接收时间，确定首包时延；Determine a first packet delay based on the first receiving time and the fourth receiving time; 基于所述首包时延、所述下行网络传输时延、所述处理时延以及解码时延，确定首帧时延；Determining a first frame delay based on the first packet delay, the downlink network transmission delay, the processing delay, and the decoding delay; 基于所述下行网络传输时延，所述处理时延以及所述解码时延，确定帧时延；Determining a frame delay based on the downlink network transmission delay, the processing delay, and the decoding delay; 基于已播放的帧数、所述首帧时延以及所述帧时延，确定平均帧时延；Determining an average frame delay based on the number of frames played, the first frame delay, and the frame delay; 基于所述首帧时延和所述帧时延，确定帧抖动；或者基于所述帧时延，确定帧抖动；Determining frame jitter based on the first frame delay and the frame delay; or determining frame jitter based on the frame delay; 基于各数据包的大小和所述第四接收时间，确定码率；determining a bit rate based on the size of each data packet and the fourth reception time; 基于丢帧数和视频帧的总数量，确定丢帧率；Determine a frame loss rate based on the number of lost frames and the total number of video frames; 基于丢包数和数据包的总数量，确定丢包率；Determine the packet loss rate based on the number of lost packets and the total number of data packets; 所述第二性能指标包括下行网络传输时延、所述首包时延、所述首帧时延、所述帧时延、所述平均帧时延、所述帧抖动、所述码率、所述丢帧率以及所述丢包率。The second performance indicator includes the downlink network transmission delay, the first packet delay, the first frame delay, the frame delay, the average frame delay, the frame jitter, the bit rate, the frame loss rate and the packet loss rate. 3.根据权利要求1所述的流媒体业务性能测评系统，其特征在于，所述客户端调度控制器，用于向所述服务端调度控制器发送视频源请求；3. The streaming media service performance evaluation system according to claim 1, wherein the client scheduling controller is used to send a video source request to the server scheduling controller; 所述服务端调度控制器，用于接收所述视频源请求，并基于所述视频源请求向所述客户端调度控制器发送视频源信息；The server-side scheduling controller is configured to receive the video source request and send video source information to the client-side scheduling controller based on the video source request; 所述客户端调度控制器，还用于接收所述视频源信息，并基于所述视频源信息向所述流媒体播放器发送播放指令；The client scheduling controller is further configured to receive the video source information and send a play instruction to the streaming media player based on the video source information; 所述流媒体播放器，用于接收所述播放指令，并基于所述播放指令向所述代理服务器发送播放请求。The streaming media player is configured to receive the play instruction and send a play request to the proxy server based on the play instruction. 4.根据权利要求1所述的流媒体业务性能测评系统，其特征在于，所述客户端调度控制器，还用于向流媒体播放器发送连接指令；4. The streaming media service performance evaluation system according to claim 1, wherein the client scheduling controller is further configured to send a connection instruction to the streaming media player; 所述流媒体播放器，还用于接收所述连接指令，基于所述连接指令向所述流媒体服务器发送连接请求；The streaming media player is further configured to receive the connection instruction and send a connection request to the streaming media server based on the connection instruction; 所述代理服务器，还用于截取所述连接请求，并将所述连接请求转发至所述流媒体服务器；The proxy server is further configured to intercept the connection request and forward the connection request to the streaming media server; 所述流媒体服务器，还用于接收所述连接请求，并向所述代理服务器发送连接确认信息；The streaming media server is further configured to receive the connection request and send connection confirmation information to the proxy server; 所述代理服务器，还用于将所述连接确认信息发送至所述流媒体播放器和所述客户端调度控制器；The proxy server is further configured to send the connection confirmation information to the streaming media player and the client scheduling controller; 所述客户端调度控制器，还用于接收所述连接确认信息，并向所述代理服务器发送同步指令；The client scheduling controller is further configured to receive the connection confirmation information and send a synchronization instruction to the proxy server; 所述代理服务器，还用于接收所述同步指令，基于所述同步指令将初始同步序号写入同步消息中，并基于所述同步消息向所述代理播放器发送同步请求；The proxy server is further configured to receive the synchronization instruction, write an initial synchronization sequence number into a synchronization message based on the synchronization instruction, and send a synchronization request to the proxy player based on the synchronization message; 所述代理播放器，还用于接收所述同步请求，将所述同步请求中的初始同步序号更新至本地，并将确认后的所述初始同步序号写入同步响应消息，将所述同步响应消息发送至所述代理服务器；The proxy player is further configured to receive the synchronization request, update the initial synchronization sequence number in the synchronization request to the local device, write the confirmed initial synchronization sequence number into a synchronization response message, and send the synchronization response message to the proxy server; 所述代理服务器，还用于接收所述同步响应消息，将所述同步响应消息中的所述初始同步序号更新至本地，并向所述客户端调度控制器发送同步确认消息。The proxy server is further configured to receive the synchronization response message, update the initial synchronization sequence number in the synchronization response message to the local server, and send a synchronization confirmation message to the client scheduling controller. 5.根据权利要求1所述的流媒体业务性能测评系统，其特征在于，所述第一数据包和所述第二数据包中包括代理层包头，所述代理层包头包括消息类型、消息长度、时间戳、同步序号、帧序号和消息体。5. The streaming media service performance evaluation system according to claim 1 is characterized in that the first data packet and the second data packet include a proxy layer header, and the proxy layer header includes a message type, message length, timestamp, synchronization sequence number, frame sequence number and message body. 6.一种流媒体业务性能测评方法，其特征在于，应用于如权利要求1至5中任一项所述的流媒体业务性能测评系统，包括：6. A streaming media service performance evaluation method, characterized by being applied to a streaming media service performance evaluation system according to any one of claims 1 to 5, comprising: 接收代理播放器发送的下行数据；Receive downlink data sent by the proxy player; 基于所述下行数据获取第一性能指标，并采集所述流媒体业务的第二性能指标；Acquire a first performance indicator based on the downlink data, and collect a second performance indicator of the streaming media service; 将所述第一性能指标和所述第二性能指标发送至所述客户端调度控制器；所述客户端调度控制器基于所述第一性能指标和所述第二性能指标生成性能测评报告，以基于所述性能测评报告对流媒体业务性能进行测评。The first performance indicator and the second performance indicator are sent to the client scheduling controller; the client scheduling controller generates a performance evaluation report based on the first performance indicator and the second performance indicator to evaluate the streaming media service performance based on the performance evaluation report. 7.根据权利要求6所述的流媒体业务性能测评方法，其特征在于，所述采集所述流媒体业务的第二性能指标，包括：7. The streaming media service performance evaluation method according to claim 6, wherein collecting the second performance indicator of the streaming media service comprises: 基于所述下行数据，获取第一接收时间、第三接收时间以及处理时延；Based on the downlink data, obtaining a first receiving time, a third receiving time, and a processing delay; 基于所述第三接收时间和第四接收时间，确定下行网络传输时延；所述第四接收时间为代理服务器接收到第二数据包的时间点；Determine the downlink network transmission delay based on the third receiving time and the fourth receiving time; the fourth receiving time is the time point when the proxy server receives the second data packet; 基于所述第一接收时间和所述第四接收时间，确定首包时延；Determine a first packet delay based on the first receiving time and the fourth receiving time; 基于所述首包时延、所述下行网络传输时延、所述处理时延以及解码时延，确定首帧时延；Determining a first frame delay based on the first packet delay, the downlink network transmission delay, the processing delay, and the decoding delay; 基于所述下行网络传输时延，所述处理时延以及所述解码时延，确定帧时延；Determining a frame delay based on the downlink network transmission delay, the processing delay, and the decoding delay; 基于已播放的帧数、所述首帧时延以及所述帧时延，确定平均帧时延；Determining an average frame delay based on the number of frames played, the first frame delay, and the frame delay; 基于所述首帧时延和所述帧时延，确定帧抖动；或者基于所述帧时延，确定帧抖动；Determining frame jitter based on the first frame delay and the frame delay; or determining frame jitter based on the frame delay; 基于各数据包的大小和所述第四接收时间，确定码率；determining a bit rate based on the size of each data packet and the fourth reception time; 基于丢帧数和视频帧的总数量，确定丢帧率；Determine a frame loss rate based on the number of lost frames and the total number of video frames; 基于丢包数和数据包的总数量，确定丢包率；Determine the packet loss rate based on the number of lost packets and the total number of data packets; 所述第二性能指标包括下行网络传输时延、所述首包时延、所述首帧时延、所述帧时延、所述平均帧时延、所述帧抖动、所述码率、所述丢帧率以及所述丢包率。The second performance indicator includes the downlink network transmission delay, the first packet delay, the first frame delay, the frame delay, the average frame delay, the frame jitter, the bit rate, the frame loss rate and the packet loss rate. 8.一种电子设备，包括处理器和存储有计算机程序的存储器，其特征在于，所述处理器执行所述计算机程序时实现权利要求6至7任一项所述的流媒体业务性能测评方法的步骤。8. An electronic device comprising a processor and a memory storing a computer program, wherein the processor implements the steps of the streaming media service performance evaluation method according to any one of claims 6 to 7 when executing the computer program. 9.一种计算机程序产品，包括计算机程序，其特征在于，所述计算机程序被处理器执行时实现权利要求6至7任一项所述的流媒体业务性能测评方法的步骤。9. A computer program product, comprising a computer program, characterized in that when the computer program is executed by a processor, the steps of the streaming media service performance evaluation method according to any one of claims 6 to 7 are implemented.
CN202310812543.2A 2023-07-04 2023-07-04 Streaming media service performance evaluation system and its method, device and program product Active CN118803282B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310812543.2A CN118803282B (en) 2023-07-04 2023-07-04 Streaming media service performance evaluation system and its method, device and program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310812543.2A CN118803282B (en) 2023-07-04 2023-07-04 Streaming media service performance evaluation system and its method, device and program product

Publications (2)

Publication Number Publication Date
CN118803282A CN118803282A (en) 2024-10-18
CN118803282B true CN118803282B (en) 2025-10-03

Family

ID=93026737

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310812543.2A Active CN118803282B (en) 2023-07-04 2023-07-04 Streaming media service performance evaluation system and its method, device and program product

Country Status (1)

Country Link
CN (1) CN118803282B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019084972A1 (en) * 2017-11-06 2019-05-09 深圳市大疆创新科技有限公司 Streaming media live broadcast method and system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7010598B2 (en) * 2002-02-11 2006-03-07 Akamai Technologies, Inc. Method and apparatus for measuring stream availability, quality and performance
CN101741634A (en) * 2008-11-25 2010-06-16 中国联合网络通信集团有限公司 Streaming media performance testing method and system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019084972A1 (en) * 2017-11-06 2019-05-09 深圳市大疆创新科技有限公司 Streaming media live broadcast method and system

Also Published As

Publication number Publication date
CN118803282A (en) 2024-10-18

Similar Documents

Publication Publication Date Title
CN113037440B (en) Data retransmission processing method and device, computer equipment and storage medium
US7725576B2 (en) Method and apparatus for measuring stream availability, quality and performance
JP4000905B2 (en) Information processing system and method, information processing apparatus and method, recording medium, and program
EP2767039B1 (en) Quality of user experience testing for video transmissions
WO2020006912A1 (en) Method and device for analyzing network transmission quality, computer equipment and storage medium
CN103188236B (en) The appraisal procedure of media transmission quality and device
US20130091528A1 (en) Video reproduction system, receive terminal, home gateway device, and quality control system
CN107105224A (en) Method, device and system that a kind of quality of experience of video is assessed
CN114900662B (en) Video stream transmission quality information determining method, system, equipment and medium
JP2020184805A (en) Video service quality assessment method and apparatus
CN108235149B (en) Method and device for optimizing video playing fluency
CN109511011B (en) YouTube DASH encrypted video-oriented fingerprint database construction method
WO2021174879A1 (en) Ai video call quality analysis method and apparatus, computer device, and storage medium
CN104363511B (en) A kind of method and system of broadcasting F4v videos online in a mobile device
CN113676926A (en) User network perception portrait method and device
CN112565224B (en) Video processing method and device
CN100349449C (en) End-to-end network measuring method based on real-time transmission protocol
CN101459852B (en) Method and device for predicting video service occurrence delay
CN114401253B (en) A video transmission method in simulated networks based on WebRTC
JP2012050085A (en) Administrative server, image distribution control system, image distribution control method
Szilágyi et al. Network side lightweight and scalable YouTube QoE estimation
CN118803282B (en) Streaming media service performance evaluation system and its method, device and program product
CN107659856A (en) The acquisition method of mobile video business experience qualitative data collection based on user feedback
JP2008535333A (en) Large-scale analysis of push-to-talk traffic
CN112584134A (en) Method and device for testing video conference code stream, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant