CN101505237B - Network quality determination method, apparatus and communication system - Google Patents

Abstract

The invention relates to the field of communication technology, and discloses a network quality determination method, device and communication system; wherein, the network quality determination method includes: collecting raw data; processing the raw data to obtain index data; And the index data is calculated to obtain the highest level index evaluation score. By using the technical solutions provided by the embodiments of the present invention, a unitless parameter can be used to measure network quality.

Description

Network quality determination method, device and communication system

technical field

The invention relates to the technical field of communication, in particular to a network quality determination method, device and communication system.

Background technique

As users' demand and requirements for the network are getting higher and higher, network technology is also developing rapidly. At present, the network has involved all aspects of people's work and life. When people's work and life are increasingly inseparable from the network , the requirements for the network are getting higher and higher. Therefore, how to determine the network quality, so as to evaluate the network service quality, has become a very important task in network construction, upgrade or capacity expansion.

Taking broadband network as an example to introduce an existing technical solution for determining network quality, broadband network includes broadband access network, Internet Protocol (IP: Internet Protocol) metropolitan area network and IP backbone network. Broadband network has also developed from a single high-speed Internet service to an end-to-end bearer network for multiple services such as voice, video, and value-added services.

But the current broadband network is opaque to the business and the network, and many business systems are carried on the broadband network. On the one hand, there are many layers of the network, the scale of the second-tier network is huge, and the routing of the third-tier network is complicated. It is not clear which layers the business passes through. On the other hand, each service system is implemented through a unified bearer network, and various specific service types in network traffic are "mixed up", making it difficult to distinguish and plan. At present, the quality of service of a broadband network is mainly measured through three performance indicators: delay, jitter, and packet loss. These three performance indicators have different unit dimensions.

In the research of the prior art, the inventor found that: because the unit dimensions of the three performance indicators of delay, jitter and packet loss are different, and the impact of the three performance indicators on different services is different, the use of these three performance indicators The network quality under different services cannot be measured correctly.

Contents of the invention

Embodiments of the present invention provide a network quality determination method, device, and communication system. By using the technical solutions provided by the embodiments of the present invention, a unitless parameter can be used to measure network quality.

An embodiment of the present invention provides a method for determining network quality, including: collecting raw data, the raw data including: network reliability data, any one or any combination of network resource data, and network performance data; Raw data is processed to obtain index data; the highest-level index evaluation score is obtained by performing operations on the pre-selected segment function and the index data, and the highest-level index is obtained by performing operations on the pre-selected segment function and the index data The evaluation score includes: using the index data as the input of the segment function to calculate the index evaluation score of the lowest level; starting from the index evaluation score of the lowest level, performing a weighted average operation on the index evaluation scores of the same level to obtain the highest level. The indicator evaluation scores of each level are obtained until the highest level indicator evaluation score is obtained.

An embodiment of the present invention also provides a device for determining network quality, including: a collection unit configured to collect raw data, the raw data including: network reliability data, and any one of network resource data, network performance data, or Any combination; the processing unit is used to process the raw data collected by the acquisition unit to obtain index data; the operation unit is used to perform operations on the pre-selected segmented function and the index data processed by the processing unit to obtain the highest Hierarchical index evaluation scores, the computing unit includes: a first computing unit, configured to use the index data processed by the processing unit as the input of the segmentation function, and calculate and obtain the index evaluation score of the lowest level; the second computing unit , starting from the index evaluation score of the lowest level calculated by the first calculation unit, performing a weighted average operation on the index evaluation scores of the same level to obtain the index evaluation score of a higher level, until the highest level index is obtained Evaluation score.

The embodiment of the present invention also provides a communication system, including the device for determining network quality provided by the embodiment of the present invention.

From the above technical solutions provided by the embodiments of the present invention, it can be seen that since the embodiments of the present invention can process the collected raw data, and then obtain a dimensionless highest-level index evaluation score to evaluate the network quality, and then use the highest The evaluation scores of hierarchical indicators measure the network quality, so that maintenance personnel can determine the network quality only based on the evaluation scores of the highest-level indicators, which facilitates the evaluation of network quality. The technical solutions provided by the embodiments of the present invention can evaluate the improvement effect of network service quality after network construction or expansion; and can also pre-evaluate network service capabilities before service expansion or new service release, so as to avoid blind business development.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

FIG. 1 is a flowchart of an embodiment of a method for determining network quality in an embodiment of the present invention;

Fig. 2 is a functional schematic diagram of the first embodiment of the segmentation function in the embodiment of the present invention;

Fig. 3 is a functional schematic diagram of the second embodiment of the segmentation function in the embodiment of the present invention;

Fig. 4 is a structural diagram of an embodiment of an apparatus for determining network quality in an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

First introduce the network quality determination method provided by the embodiment of the present invention. Figure 1 describes the flow of the embodiment of the network quality determination method, including:

101. Collect raw data;

Specifically, the original data can be extracted from the monitoring data of the network management system, or can be extracted from the data reported by the network probe; of course, the original data can also be extracted from the monitoring data of the network management system and the data reported by the network probe. Of course, this is only the method of collecting raw data provided by the embodiment of the present invention, and it does not limit that raw data can only be collected through the aforementioned methods.

The raw data collected in the embodiment of the present invention may include: any one or any combination of network reliability data, network resource data, network performance data, and other data;

Among them, the network resource data may include: any one or any combination of data such as: equipment load value during busy hours, trunk bandwidth during busy hours, physical port usage, and the number of trunks exceeding the peak value;

Network reliability data can include: total time of network failure, total number of network failure secondary, network failure secondary density (NPR), equipment availability, trunk utilization, trunk physical resource utilization, equipment load compliance rate during busy hours, Any one or any combination of the data such as the relay utilization rate compliance rate during busy hours;

Network performance data can include: Internet access delay, jitter, packet loss compliance rate, IPTV (IPTV: Internet Protocol Television) delay, jitter, packet loss compliance rate, Internet phone (VOIP: Voiceover Internet Protocol) delay, jitter, Packet loss compliance rate, large customer virtual private network (VPN: Virtual Private Network) dedicated line delay, jitter, packet loss compliance rate, asymmetric digital subscriber line (ADSL: Asymmetric Digital Subscriber Line) abnormal dropped user rate, ADSL user port Any one or any combination of data such as speed compliance rate.

Of course, in order to meet the needs of users as much as possible, the collected raw data may also include any or any combination of Internet user experience, IPTV user experience, and VOIP user experience. Among them, Internet user experience can include: Domain Name Server (DNS: Domain Name Server) resolution time, Transmission Control Protocol (TCP: Transport Control Protocol) connection establishment time, Hypertext Transfer Protocol (HTTP: Hyper Text Transfer Protocol) first packet delay Any one or any combination of data such as , HTTP download delay, etc. IPTV user experience can include any or any of data such as IPTV-MDI: IPTV Media Deliver Index, channel switching time, and video average opinion evaluation score (V-MOS: Video Mean Opinion Score). combination. VOIP user experience may include Mean Opinion Score (MOS: Mean Opinion Score).

102. Process the raw data to obtain index data;

Since there may be a lot of raw data collected, it is necessary to process the raw data. Embodiments of the present invention provide the following processing methods:

1) Calculate the average value; calculate the average value for a plurality of collected raw data of the same type, and obtain the average value as the index data.

2) Calculate the ratio; divide the original data by the relevant total amount, and use the quotient or ratio as the index data. Specifically, this method can be used for raw data such as the secondary density of network faults, network availability, and physical port utilization.

3) Calculate the compliance rate; directly compare the original data or the average value of the original data with the relevant compliance or exceeding the standard value, and obtain the compliance rate according to the ratio of the number of samples exceeding the standard to the total number of samples, as the index data. When calculating the compliance rate, the compliance value/exceeding value must be defined first. Among them, raw data such as equipment load compliance rate during busy hours and relay occupancy compliance rate during busy hours can be averaged before calculating the compliance rate; trunk availability rate, network performance business delay, jitter, packet loss compliance rate, etc. The original data can be directly compared with the original data and the exceeding standard value to obtain the standard rate.

103. Obtain the highest-level index evaluation score by performing operations on the pre-selected segment function and index data.

Specifically, this step can be performed in the following manner: use the index data as the input of the segment function to calculate the index evaluation score at the lowest level; start from the index evaluation score at the lowest level, and perform a weighted average operation on the index evaluation scores at the same level to obtain the highest level. Level-by-level index evaluation scores until the highest-level index evaluation scores are obtained.

Specifically, since the network has different network layers, different services may focus on different network layers. Therefore, it may be determined which layer has the highest index evaluation score as required.

It can be seen from the above that this embodiment can process the collected raw data, and then obtain a dimensionless highest-level index evaluation score to evaluate the network quality, and then use the highest-level index evaluation score to measure the network quality, so that maintenance Personnel can determine the network quality only according to the evaluation score of the highest-level index, which facilitates the evaluation of the network quality. The method for determining network quality provided by the embodiments of the present invention can evaluate the improvement effect of network service quality after network construction or expansion; it can also pre-evaluate network service capabilities before service expansion or new service release, so as to avoid blind business development.

Furthermore, the network quality determination method provided by the embodiment of the present invention can also save the original data and the index evaluation scores of each level, so that the index evaluation scores of each level have a retrospective function, so when analyzing a certain index evaluation score, it can be layered The layer traces back to the original data, so that it can be determined which data has a problem, and the problem can be located and solved more precisely.

In the embodiment of the present invention, the segmentation function can be selected through a direct determination method or a dot modeling method; wherein, the direct determination method is suitable for indicators with strong objectivity such as network reliability indicators and network resource indicators, for example, a linear function can be used. The dot modeling method is suitable for highly subjective indicators such as user experience indicators. You can set a number of sampling data points, ask the sampled people to score the data points, obtain a series of "data-score" corresponding points, and then determine the corresponding function model based on the dots , the index evaluation scores calculated in this way are closer to the subjective experience of the crowd. In short, no matter which method is adopted, it can be guaranteed that the change trend of the index evaluation score is correct.

Assuming that in the segmentation function, the index data is the input x, and the index evaluation score at the lowest level is the output y, the segmentation function provided by the embodiment of the present invention can be based on the following three mathematical models:

y=ax+b

y=ax ² +bx+c

y=ax ^-1 +b

Taking the index data obtained from the original data as "HTTP first packet arrival delay" as an example, if the delay is less than or equal to 100ms, the score is 100 points, and if the delay is greater than 200ms, the score is 0 points.

Assuming that the index evaluation score of "HTTP first packet arrival delay" between 100 ms and 200 ms decreases linearly as the delay increases, the mathematical model y=ax+b is selected as the first embodiment of the segmentation function of the present invention. That is, the following equations can be obtained:

100=100a+b

0＝200a+b

The calculation can get a=-1, b=200;

Therefore, it is determined that the piecewise function is y=-x+200, (100≤x≤200).

Thus, the function schematic diagram of Embodiment 1 of the segmentation function can be determined as shown in Figure 2. Assuming that the arrival delay of the first HTTP packet in the statistical network is 168ms, then according to the above segmentation function and Figure 2, it can be obtained that the arrival time of the first HTTP packet is The extended index evaluation score is 32 points.

Assuming that the evaluation score drops sharply when the delay starts to increase from 100ms, and as the delay increases, the evaluation score declines gradually, and the mathematical model y=ax ^-1 +b can be selected between 100ms and 200ms is the second embodiment of the piecewise function of the present invention. That is, the following equations can be obtained:

$\mathrm{<span\; class="notranslate">\; 100</span>}<span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; 1</span>}}{\mathrm{<span\; class="notranslate">\; 100</span>}}\mathrm{<span\; class="notranslate">\; a</span>}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; b</span>}$

$\mathrm{<span\; class="notranslate">\; 0</span>}<span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; 1</span>}}{\mathrm{<span\; class="notranslate">\; 200</span>}}\mathrm{<span\; class="notranslate">\; a</span>}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; b</span>}$

The calculation can get a=20000, b=-100;

Thereby it is determined that the piecewise function is y=20000×x ^- 1-100, (100≤x≤200);

Thereby, the function schematic diagram of the second embodiment of the segmentation function can be determined as shown in Figure 3. Assuming that the first packet arrival delay of the statistical network HTTP is 168 milliseconds (ms), then according to the above segmentation function and Figure 3, it can be concluded that HTTP The evaluation score of the first packet arrival delay index is 19 points.

In the embodiment of the present invention, the values of coefficients a and b can be adjusted based on conditions such as business and customer needs, so that the final evaluation score of the highest level index can better meet the needs of business and customers; and when developing new business, the coefficients can be adjusted Modifications are made to make the network quality determination method oriented to this new service, and the network service quality can be evaluated immediately after the new service is released.

In an embodiment provided by the present invention, the evaluation score of the highest-level index can be obtained by a weighted average operation of network reliability index scores, network resource index scores, and network performance index scores.

Among them, the network reliability index score can be obtained through the secondary density of network faults, network availability and relay availability; the definition of a network reliability index provided by the embodiment of the present invention is shown in Table 1, where w represents the implementation of the present invention Example provided weights.

Table 1. Definition of network reliability indicators

The network resource index score can be obtained through the resource utilization rate of the physical port, the equipment compliance rate during busy hours, and the relay occupancy compliance rate during busy hours; the definition of a network resource index provided by the embodiment of the present invention is shown in Table 2, where w represents this Weights provided by invention embodiments.

Table 2. Definition of network resource indicators

In Table 2, the equipment load compliance rate during busy hours includes the original load data of access, aggregation, core layer, and service platform. The original data of load of access, aggregation, core layer, and service platform includes: the central processing of each network device processor (CPU) occupancy rate/memory occupancy rate; among them, for Broadband Routing Access Server (BRAS: Broad Bind Routing Access Server), it is necessary to increase the statistics of Point-to-Point Protocol (PPPOE: Point-to-Point Protocol) carried on Ethernet Protocol over Ethernet) user concurrency rate data (concurrency rate is the ratio of real-time PPPOE concurrent users to the maximum designed PPPOE concurrent users).

The scores of network performance indicators can be obtained through Internet access delay, jitter, and packet loss compliance rate, IPTV delay, jitter, and packet loss compliance rate, VOIP delay, jitter, and packet loss compliance rate, VIP customer VPN dedicated line delay, jitter, packet loss Compliance rate, ADSL abnormally dropped user rate, and ADSL user port speed compliance rate are obtained; a kind of network performance index definition provided by the embodiment of the present invention is shown in Table 3, wherein w represents the weight provided by the embodiment of the present invention.

Table 3. Definition of network performance indicators

In another embodiment provided by the present invention, the highest-level index evaluation score can be obtained by weighted average calculation of network reliability index scores, network resource index scores, network performance index scores, and user experience index scores; wherein, the network reliability index, See Tables 1-3 for definitions of network resource indexes and network performance indexes. Table 4 shows the definitions of user experience indexes provided by the embodiments of the present invention, where w represents the weight provided by the embodiments of the present invention.

Table 4. Definition of user experience indicators

Although Tables 1 to 4 all provide the weights provided by the embodiments of the present invention, it can be understood that the weights provided in Tables 1 to 4 are only an implementation mode provided by the embodiments of the present invention, and these weights can be based on different Business, environment, network and other factors are determined. Set weights for each raw data and indicator evaluation score, and modify the weight according to different business and customer needs, so that different emphasis can be measured, so that the obtained highest-level indicator evaluation scores can better meet business needs, and can also To meet the needs of customers; and when developing a new service, the weight can be modified, so that the network quality determination method can be oriented to this new service, and the network service quality can be evaluated immediately after the new service is issued.

Fig. 4 describes the structure of an embodiment of an apparatus for determining network quality provided by an embodiment of the present invention, including:

A collection unit 401, configured to collect raw data;

A processing unit 402, configured to process the raw data collected by the collection unit 401 to obtain index data;

The computing unit 403 is configured to perform operations on the pre-selected piecewise function and the index data processed by the processing unit 402 to obtain the highest-level index evaluation score.

Wherein, the calculation unit 403 may specifically include: a first calculation unit 4031, configured to use the index data processed by the processing unit 402 as an input of the segment function, and calculate an index evaluation score at the lowest level; a second calculation unit 4032, to obtain Starting from the index evaluation score of the lowest level calculated by the first calculation unit 4031, a weighted average operation is performed on the index evaluation scores of the same level to obtain the index evaluation score of a higher level until the index evaluation score of the highest level is obtained.

It can be seen from the above that this embodiment can process the collected raw data, and then obtain a dimensionless highest-level index evaluation score to evaluate the network quality, and then use the highest-level index evaluation score to measure the network quality, so that maintenance Personnel can determine the network quality only according to the evaluation score of the highest-level index, which facilitates the evaluation of the network quality. The network quality determination device provided by the embodiment of the present invention can evaluate the improvement effect of network service quality after network construction or expansion; it can also pre-evaluate network service capabilities before service expansion or new service release, so as to avoid blind business development.

As shown in FIG. 4 , the embodiment of the network quality determination device provided by the embodiment of the present invention may further include a storage unit 404 for storing the index evaluation score of the lowest level calculated by the first calculation unit 4031 and the index score calculated by the second calculation unit 4032. A higher-level indicator evaluation score.

Further, the storage unit 404 included in the embodiment of the network quality determination device provided by the embodiment of the present invention can also be used to save the original data collected by the collection unit 401; wherein the storage unit 404 can directly obtain the original data collected by the collection unit 401 from the collection unit 401 Data; since the raw data collected by the collection unit 401 will be sent to the processing unit 402 for processing, the storage unit 404 can also obtain the raw data collected by the collection unit 401 from the processing unit 402 .

The original data and the index evaluation scores of each level are saved by the storage unit, so that the index evaluation scores of each level have a retrospective function. Therefore, when analyzing a certain index evaluation score, it can be traced back to the original data layer by layer, so that it can be determined. If there is a problem with that data, the problem can be located and solved more precisely.

The embodiment of the present invention also provides a communication system, and the communication system includes the device for determining network quality provided by the embodiment of the present invention.

Wherein, the acquisition unit provided by the network quality determination device in the communication system provided by the embodiment of the present invention may be a network probe and a network manager distributed in the communication network, and the processing unit and the computing unit may be set in the same computer, or may be set up on a different computer.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

The network quality determination method, device, and communication system provided by the embodiments of the present invention are described above in detail, and the descriptions of the above embodiments are only used to help understand the methods and ideas of the present invention; at the same time, for those skilled in the art, According to the idea of the present invention, there will be changes in the specific implementation and scope of application. To sum up, the contents of this specification should not be construed as limiting the present invention.

Claims (11)

1. a network quality is confirmed method, it is characterized in that, comprising:

Gather initial data, said initial data comprises: any one in network reliability data and network resource data, the network performance data or combination in any;

Said initial data is handled, obtained achievement data;

Piecewise function and said achievement data through choosing in advance carry out computing acquisition highest level index evaluation mark; Saidly carry out computing through the piecewise function chosen in advance and said achievement data and obtain highest level index evaluation mark and comprise: use of the input of said achievement data, calculate the index evaluation mark of lowest hierarchical level as piecewise function; Begin from the index evaluation mark of said lowest hierarchical level, the index evaluation mark of same level is carried out the index evaluation mark that the weighted average computing obtains a high level, until obtaining said highest level index evaluation mark.

2. network quality as claimed in claim 1 is confirmed method, it is characterized in that, said method also comprises:

Preserve the index evaluation mark of said lowest hierarchical level and the index evaluation mark of a said high level.

3. network quality as claimed in claim 1 is confirmed method, it is characterized in that, said highest level index evaluation mark is obtained by network reliability index mark, Internet resources index mark and the computing of network performance index mark weighted average; Or

Said highest level index evaluation mark is obtained by network reliability index mark, Internet resources index mark, network performance index mark and the computing of user experience index mark weighted average.

4. network quality as claimed in claim 1 is confirmed method, it is characterized in that, further comprises after the collection initial data:

Preserve said initial data.

5. confirm method like the arbitrary described network quality of claim 1 to 4, it is characterized in that said collection initial data comprises:

The said initial data of extracting data of from the Monitoring Data of network management system, extracting said initial data and/or reporting from network probe.

6. confirm method like the arbitrary described network quality of claim 1 to 4, it is characterized in that said said initial data is handled comprises:

To the processing of averaging of said initial data; Or

Said initial data is asked rate process; Or

Ask compliance rate to handle to said initial data.

7. confirm method like the arbitrary described network quality of claim 1 to 4, it is characterized in that said piecewise function is chosen through directly confirming mode.

8. a network quality is confirmed device, it is characterized in that, comprising:

Collecting unit is used to gather initial data, and said initial data comprises: any one in network reliability data and network resource data, the network performance data or combination in any;

Processing unit is used for the initial data of said collecting unit collection is handled, and obtains achievement data;

Arithmetic element; Be used for carrying out computing and obtain highest level index evaluation mark through the achievement data that the piecewise function chosen in advance and said processing unit processes obtain; Said arithmetic element comprises: first computing unit; Be used to use the input of achievement data that said processing unit processes obtains, calculate the index evaluation mark of lowest hierarchical level as said piecewise function; Second computing unit; The index evaluation mark of the said lowest hierarchical level that is used for calculating from said first computing unit begins; Index evaluation mark to same level carries out the index evaluation mark that the weighted average computing obtains a high level, until obtaining said highest level index evaluation mark.

9. network quality as claimed in claim 8 is confirmed device, it is characterized in that, also comprises:

Preserve the unit, be used to preserve the index evaluation mark of said lowest hierarchical level and the index evaluation mark of a said high level.

10. network quality as claimed in claim 9 is confirmed device, it is characterized in that, said preservation unit also is used to preserve the initial data that said collecting unit is gathered.

11. a communication system is characterized in that, comprises like the arbitrary described network quality of claim 8 to 10 confirming device.

Images