KR20100062840A - System and method for measurement of voip qoe and compensation method - Google Patents

Abstract

The present invention relates to a system, a method and a post-processing method for measuring quality of Internet user experience.

The present invention relates to a method of real-time measuring the quality of customer experience for a Voice of IP (VoIP) telephone service, and to claim post processing based on this, and to measure the subjective or objective quality of the actual call. This can be linked with follow-up measures such as compensation. Thus, not only the actual quality of experience of the subscriber can be measured, but also the subscriber can be easily managed.

Description

System, method and measurement of VoIP QoE and compensation method

The present invention relates to a system, a method and a post-processing quality measurement system for Internet phone users, and more particularly, to a method for measuring the perceived quality of a customer's perceived quality of an internet phone in real time and performing post-processing such as compensation when the quality is not satisfied. will be.

In general, the quality measurement method for VoIP service is the most important objectivity, and the objective measurement method that evaluates only the measured results using the measurement module or the measurement module in the agent type is the mainstream.

In addition, there is a method for measuring the quality of the VoIP service based only on a test measurement method irrelevant to the actual call. For example, by measuring the call quality at a specific site, a test packet is sent to a specific server to measure the packet loss rate or delay, and the quality is determined using this value. Thus, many of the phenomena that appear in an actual call cannot be reflected.

There are three main ways to measure voice quality for VoIP services.

First, Perceptual Evaluation Speech Quality (PESQ) algorithm is mentioned. The PESQ algorithm measures the quality using standard audio quality measurement audio samples. While this method cannot measure the direct voice quality for the actual call, it is possible to measure the exact quality of a specific section. In addition, multiple repeatable quality measurements can be made.

However, most of the equipment employing this algorithm is expensive equipment, and it is used only when measuring the voice quality in the network when the network or voice telephony service network is in trouble.

Second, there is a single ended method for objective speech quality assessment (SMfOSQA) algorithm. This algorithm can directly measure the quality of the actual call without using standard audio quality measurement audio samples. On the other hand, since the voice quality is not measured using the standard voice quality measurement audio sample, the measurement error is very large.

In addition, there is a disadvantage that using this algorithm requires a considerable amount of hardware performance. However, since the voice quality can be measured directly for the call actually occurring, it is possible to deal with the actual voice subscriber quality more flexibly.

Third, there is an E-Model method. In this method, R-factor value is calculated and used only when measuring this value for VoIP service. This is because E-Model is assumed to be available only for VoIP service in IP network. This method is relatively simple to implement and is much cheaper than the PESQ or SMfOSQA methods, and most VoIP providers measure and manage quality in this way.

However, most of them do not reflect the many phenomena that appear in actual calls because they are measured and managed by test measurement methods regardless of the actual calls. In addition, even if this method is used to measure the quality of the actual call, most parameters have to be set to the default value.

In addition, since the performance of the VoIP terminal is already at a considerable level, it is not necessary to measure this parameter value. This is because most of the loss of voice quality assumes that packets are lost or delayed on the network. However, in reality, the performance of the VoIP terminal still has a significant effect on the user of the actual VoIP telephone service.

In recent years, although the problem of the terminal or the environment around the terminal, which degrades the user's quality of experience, is beyond the scope of the VoIP service provider, the VoIP service provider has been able to improve the subscriber's environment due to various factors such as competition among VoIP providers. We want to measure quality and manage subscribers. This requirement is accepted as a subjective part of VoIP service users that cannot be solved by conventional objective measurement methods.

Accordingly, the present invention provides a system, method, and post-mortem quality measurement system for Internet telephony users to manage quality by performing real-time measurement of the quality of customer experience for VoIP telephony service using an objective measurement method and a subjective measurement method. Provide a treatment method.

The system for measuring the user experience quality of the Internet telephony service which is one feature of the present invention for achieving the technical problem of the present invention,

A user haptic quality analysis unit configured to receive and analyze first quality measurement information collected through a preset measurement method for voice quality and second quality measurement information collected through a terminal; A subscriber management unit that performs subscriber management for post-processing based on the analysis of the user experience quality analysis unit; And an opening / closing management unit for collecting data to be used for analyzing the second quality measurement information in the user haptic quality analyzing unit.

Method for measuring the user experience quality of the Internet telephony service which is another feature of the present invention for achieving the technical problem of the present invention,

When the voice quality measurement request signal is input, checking a packet input through a session for voice quality measurement; If the input packet is a first packet, measuring a unidirectional delay value for the packet; Calculating an R-value value based on the measured delay value; And determining whether a quality evaluation value has been input, and if the SMS is input, providing measured user haptic quality information based on the R-value value and the quality evaluation value.

Method for measuring the user experience quality of the Internet telephony service which is another feature of the present invention for achieving the technical problem of the present invention,

Receiving a measurement result value including an R-value value and a quality evaluation value as a result of measuring user haptic quality from the terminal; Checking a number of claims for compensation for the terminal and determining a quality section based on the quality evaluation value; And generating a follow-up detail according to the determined quality section.

According to the present invention, it is possible to measure the real-time objective measurement and subjective customer experience quality for the Internet telephony service subscribers to provide more accurate quality measurement results for the Internet telephony service.

In addition, based on the objective quality measurement information and the subjective quality measurement information, it is possible to provide a post-process related to quality for each type of user.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted for simplicity of explanation, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise. In addition, the terms “… unit”, “… unit”, “module”, etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. have.

In the present specification, a terminal is a mobile station (MS), a mobile terminal (MT), a subscriber station (SS), a portable subscriber station (PSS), a user equipment (User Equipment). It may also refer to a user equipment (UE), an access terminal (AT), and the like, and may include all or some functions of a mobile terminal, a subscriber station, a portable subscriber station, a user device, and the like.

With reference to the drawings will be described for the QoE measurement and post-processing method of the real-time Internet phone through the quality evaluation in consideration of the direct subjective quality of the user according to an embodiment of the present invention.

1 is a system structural diagram according to an embodiment of the present invention.

As illustrated in FIG. 1, in order to measure and manage a quality of experience (QoE) of a real-time Internet telephony service, a soft phone type equipped with a module for measuring quality of customer's quality of experience of an internet telephony service user is provided. The terminal 100 and the QoE result analyzing unit 200 for receiving and analyzing the customer haptic quality measurement results and analyzing them are included. The sender and receiver terminals 100 are connected to the IP network 500.

In addition, the system includes a service opening / closing management unit 400 for collecting the base data to be used in the analysis of the customer quality experience measurement results in the QoE result analysis unit 200. In addition, it is also necessary to link with the subscriber management unit 300 that determines whether the violation of the customer experience quality measurement results on the basis of the terms and conditions agreed to when joining the service, claiming a corresponding compensation in case of violation or performing other types of subscriber management. .

Briefly described with reference to FIG. 1 for Internet telephony QoE measurement and post processing, a caller and a receiver initiate a call using a VoIP service already subscribed. If the caller thinks that the voice quality from the receiver is not good while making a call, the caller clicks the QoE measurement and compensation claim button 110 in the terminal 100.

In the embodiment of the present invention, the QoE measurement and compensation claim buttons are described as an example of mounting the terminal 100 as a separate button equipped with a module for measuring the subjective QoE, but several buttons already present in the terminal 100 One of the buttons can be selected and designed to perform the corresponding function. The QoE measurement and compensation claim button 110 is interlocked so that the QoE measurement module can be executed.

When the QoE measurement and compensation claim button 110 is clicked, the QoE measurement module mounted inside the terminal 100 is driven, and the QoE for the voice quality currently being talked is being measured on the screen of the caller terminal 100 in a call. The first message informing is displayed. At this time, the QoE measurement module built in the terminal 100 measures the packet delay and packet loss rate values among parameters used in the E-Model during the quality measurement method. The measurement of the packet delay and packet loss rate values will be described later.

When the call between the sender and the receiver is terminated, a second message for inducing subjective quality measurement is displayed on the terminal 100 of the caller who applied for QoE measurement and compensation claim, and the message may be transmitted by voice. According to the message, the caller receives the quality opinion by using the numeric buttons of the terminal 100 for the subjective quality evaluation of the caller. When the quality opinion is received for the user, a third message indicating that the opinion is received is displayed on the terminal 100 of the caller, and the corresponding message may be transmitted by voice.

The user's quality opinion (or "subjective measurement result") received in this way is transmitted to the QoE result analysis unit 200 along with the objective measurement result measured during the call. The QoE result analyzing unit 200 analyzes the received objective measurement result and the subjective measurement result, claims compensation according to the analysis result, or the subscriber management unit (QoE result analysis unit 200) for the subscriber who is a predefined management target. Transmit the corresponding data. Herein, a method for analyzing the objective measurement result and the subjective measurement result will be described with reference to FIGS. 2 to 5.

First, the QoE result analyzing unit 200 analyzes an objective measurement result and a subjective measurement result, and describes a policy of an internal function module that performs quality violation determination and evaluation with reference to FIG. 2.

2 is an exemplary view of a policy of an internal function module for performing a quality violation determination and evaluation in a QoE result analysis unit according to an embodiment of the present invention.

The policy decision reference graph shown in FIG. 2 is stored in the QoE result analysis unit 200 and the data of the part that manages the request and the reason for termination when the service opening / termination management unit 400 described in FIG. It is generated based on past QoE measurement history of customers who have been terminated by quality complaints.

The vertical axis (Y-axis) of the graph represents the objective measurement value (hereinafter referred to as R-value or first value) of the E-Model, which is an objective measurement method, and the unit is composed of a range of R-value values. . In the embodiment of the present invention, the E-Model method is used among various methods, but is not necessarily limited thereto. The horizontal axis (X axis) of the graph represents an input value of a subjective measurement method inputted by a subscriber.

Based on the graph model, when the QoE measurement of the method described in FIG. 1 is performed, a quality value display point for the subscriber may be displayed on the graph. The slope of the graph line where the value of the objective measurement method and the value of the subjective measurement method meet is already described in the form of a table in ITU-T G.107.

When the quality measurement is made by selecting the QoE measurement and claim button and displaying the result on the graph, the value input by most subscribers appears to be dissatisfied with the call quality. This is because the situation in which the QoE measurement and compensation claim button 110 of the terminal 100 is clicked is clicked when the caller determines that the actual quality is at least a little strange.

By plotting the quality measurements of many subscribers on a graph and analyzing them, it is possible to determine the range of subjective quality measures on which level the subscribers feel poor from when the objective quality measurement results. In particular, by analyzing the distribution of QoE measurement before termination of subscribers who terminated due to quality complaints, it can be seen that subscribers are more likely to terminate when the objective and subjective quality measurements are. The distinction of this range is provided to the VoIP service provider so that they can decide how to manage the subscribers who have complaints about the call quality.

In this case, the decision table for finally making a decision related to compensation using an internal function module policy for determining and evaluating quality violations is shown in Table 1 below.

TABLE 1

division R-value SMS QoE Measurements and Claims First section 50 ≤ R <70 4 to 5 × 2nd section 70 ≤ R <75 4 to 5 3 3rd section 50 ≤ R <70 2-3 4 4th section 70 ≤ R <75 2-3 8 5th section 50 ≤ R <70 × ×

Table 1 is used in the QoE result analysis unit 200, and the sections are classified according to the R-value, which is an objective quality measurement value, and a subjective measurement score (SMS), and the QoE measurement is performed for each classification. It combines the number of claims and compensation to provide VoIP service providers with subscriber management by QoE quality level. In the embodiment of the present invention, only parameters of the R-value, SMS, and QoE measurement and the number of compensation claims are used to distinguish the sections, but are not necessarily limited thereto.

Here, the divisions shown in the graphs of Table 1 and FIG. 2 will be described. First, the first interval 610 has quality values of subscribers having an R-value of 50 or more and less than 70 and a subjective quality measure of 4 or 5. This is the section that appeared. Among the quality dissatisfied subscribers who have not yet terminated, the subscribers who record the quality in the first section 610 indicate that they are very likely to terminate the service. Therefore, when the measurement result of the subscriber who executes the QoE measurement and compensation claim is located in the first section 610, the VoIP service provider must perform follow-up actions to improve the quality again with immediate compensation.

The next second section 620 is a section in which the R-value is 70 or more and 75 or less, and the quality value of the subscribers whose subjective quality measurement is 4 or 5 is displayed. The subscribers who exhibit the quality value in the second interval 620 feel the subjective quality felt by the subscribers to be dissatisfied or very dissatisfied even though the objective quality value is the normal level of 70 or more. These subscribers can be considered to be primarily subscribers who are more sensitive to call quality than ordinary subscribers.

If these types of subscribers frequently click on the QoE measurement and claim button 110 described in FIG. 1, i.e. after performing a quality measurement a few more times and feel that the subjective quality measurement feeling is still below normal, this subscriber is terminated in the future. It is a subscriber with a high probability of doing so. Therefore, if the subscribers indicating the quality value in the second interval 620 requires the quality measurement more than a certain number of times even though the objective quality measurement value is the normal level, the VoIP service provider may perform appropriate follow-up management for the subscriber.

The next third section 630 is a section in which the quality value of subscribers who feel that the R-Value is less than 70 and the subjective quality is normal or satisfactory. Subscribers in this interval can be considered primarily insensitive to call quality compared to regular subscribers.

However, if the subscriber who represents the quality value of the third interval 630 continuously clicks the QoE measurement and claim button, it requires a certain number of times to measure the quality until the user recognizes that the quality is not as good as he or she felt. It can be said that the subscriber can go. Therefore, if the subscribers indicating the quality value in the third section 630 require the quality measurement more than a certain number of times similarly to the subscribers in the second section 620, the VoIP service provider may perform appropriate follow-up management for the subscriber. Will have to give.

The fourth section 640 is a section in which the R-value is 70 or more and less than 75, and the quality value of the subscribers whose subjective quality measurement is 2 or 3 is displayed. The subscribers representing the quality value in the fourth section 640 frequently click on the QoE measurement and compensation claim button 110 even though the objective quality measurement value and the subjective quality value are more than normal, thereby indicating the quality of the service to which the subscriber subscribes. It is the subscribers who measure and confirm.

From the point of view of the VoIP service provider, if the subscribers showing the quality value in the fourth section 640 feels that the quality is a little lower, they should be regarded as those who are likely to terminate with many complaints. Therefore, if the subscribers indicating the quality value in the fourth interval 640 also require the quality measurement more than a certain number of times, similarly to the subscribers in the second interval 620 and the third interval 630, the VoIP service provider is the subscriber. Appropriate follow-up will be required.

Such an analysis can be made by dividing each month or quarter by considering the characteristics and policies of each VoIP service provider. For example, in the case of VoIP service providers, in most cases, compensation for call quality is generated by using a call quality measurement site to measure a communication quality of a corresponding section.

Then, the measured communication quality value is used to calculate the R-value of the E-Model, an objective measurement method, and post-processing related to compensation according to the value. Even in the compensation related post-processing method using the conventional objective measurement method, the upper limit subject to the compensation related post-processing is post-processed only when the R-value value is 70 or less as recommended by the standards body.

Next, a method of measuring the actual quality of customer experience using the module for measuring the quality of customer experience mounted inside the terminal 100 will be described with reference to FIGS. 3A and 3B.

3A and 3B are flowcharts illustrating a method of measuring customer haptic quality according to an embodiment of the present invention.

As shown in FIGS. 3A and 3B, when the service user determines that the call quality is low while using the service, the module is operated when the QoE measurement and compensation claim button 110 is clicked. When the module is operated, the first message is displayed on the terminal 100 (S100). After displaying the first message, the module opens a Real-time Transport Protocol / Real-time Transport Control Protocol (RTP) session to measure call quality (S110).

The module opens a session and waits for receiving a packet (S120). Then, when one of the RTP packet (also referred to as the second packet) or the RTCP packet (also referred to as the first packet) is obtained, it is determined whether the obtained packet is an RTCP packet or not (S130).

If it is determined that the packet is not an RTCP packet, a partial packet loss value is calculated (S190). The calculation period in calculation is based on 5 seconds, which is the transmission period of the RTCP packet, but is not necessarily limited to this. In other words, the module determines whether the preset timer is 5 seconds or more (S200), and stores the measured value when 5 seconds is exceeded (S210).

After accumulating and storing partial packet loss values, the number of reception of RR (Receiver Report) packets is increased by one to calculate the final loss value when the session is terminated. Here, the method for calculating the partial packet loss value is already known, and detailed description thereof will be omitted in the exemplary embodiment of the present invention.

On the other hand, if the received packet is an RTCP packet, it is determined whether the received RTCP packet is an SR (Sender Report) packet (S140). The SR packet will be described later. If the RTCP packet is an SR packet, a delay time is calculated using a time stamp of the packet (S150). That is, the calculation formula for calculating the delay time is calculated as Equation 1 when assuming that the receiving side receives the SR packet as A and the unidirectional delay is D.

[Equation 1]

D = A-(NTP time stamp of SR)

In other words, the value obtained by subtracting the NTP time stamp of the SR packet from the time at which the SR packet is received at the receiver is the one-way transmission delay time.

Next, it is determined whether or not the preset measurement period is exceeded (S160). If the measurement period is exceeded, the transmission delay for all received RTCP packets (SR) is measured, and when the session ends, the average one-way delay value is obtained and the measurement result value is stored (S170). The measurement period is based on 5 seconds, which is a transmission period of the RTCP (RR) packet, but is not necessarily limited thereto.

Next, it is determined whether the session opened in step S110 is terminated (S220). When the session ends, the final packet loss rate is calculated and stored (S230), and the one-way delay value is calculated and stored (S240). Using the final packet loss rate and the average one-way delay value, the result value of the objective measurement method calculates and stores the R-value (S250). In addition, the second message is displayed on the screen and simultaneously transmitted in voice for the subjective quality evaluation of the subscriber (S260).

It is determined whether the subjective quality evaluation value has been input during the preset time (S270), and if the subjective quality evaluation value is input, the subjective quality evaluation value is stored (S280). In operation S290, the third message indicating that the QoE measurement and compensation claim is completed is displayed or transmitted. Then, after transmitting the measurement result to the QoE result analysis unit 200 (S300), the operation of the module is terminated.

Next, an operation procedure of the QoE result analyzer of FIG. 1 will be described with reference to FIG. 4.

4 is an operation flowchart of a result analysis system according to an exemplary embodiment of the present invention.

As shown in FIG. 4, when a measurement result (R-value, SMS) value measured from the terminal 100 mentioned in FIG. 1 or FIGS. 3A and 3B is input, the number of QoE measurement and compensation claims of the corresponding subscriber is determined. Inquiry (S400). The inquired value is stored in a local variable, and the number of QoE measurements and compensation claims is increased by one and stored again (S410).

Then, it is determined whether there is an SMS value in the input measurement result (S420), and if there is an SMS value, a section is determined according to the decision table described in Table 1 (S440). According to the determined details, the post-action details are transmitted to the subscriber management unit 300 (S450), and the process returns to the standby state so as to process the next measurement result.

On the other hand, if it is determined in step S420 that there is no SMS in the measurement result, the R-value is determined as a preset value, and accordingly the section is determined (S430).

Next, the header structure of the RTP and the header of the RTCP protocol in the VoIP stream packet will be described with reference to FIGS. 5 and 6.

5 is an exemplary diagram illustrating a header structure of an RTP of a VoIP stream packet according to an embodiment of the present invention, and FIG. 6 is an exemplary diagram illustrating a header structure of an RTCP protocol of a VoIP stream packet according to an embodiment of the present invention.

First, as shown in FIG. 5, the upper 12 bytes of all RTP packets are in a fixed form, and then the CSRC field is added by a mixer. However, the mixer is not inserted in the point-to-point structure.

Among the various items of the RTP packet header, the items used for measuring the quality of the packet are a sequence number and a time stamp. The sequence number is incremented by one each time an RTP packet is transmitted from the transmitter to the receiver. The time stamp field indicates the moment when the first octet of the RTP packet was sampled. The sampling point is generated from a constantly increasing clock, which is used by the receiver to synchronize real-time data and to calculate jitter.

As shown in FIG. 6, the RTPC delivers feedback information on the RTP data flow to the terminal. The general content of the feedback is statistical data on the amount of data transmitted so far and its loss rate. Also included are jitter and Round Trip Rime (RTT) values.

There are five types of RTCP packets, as shown in Table 2 below.

TABLE 2

Packet type Packet name function 200 Sender Report (SR) Sender Report 201 Receiver Report (RR) Recipient Report 202 Source Descriptions (SEDS) Source Description 203 Bye (BYE) Entry End Notice 204 Application Specific (APP) Used for application function

Among the packet types shown in Table 2, the RTCP packet used for quality measurement on the RTP packet is an SR packet. The header structure of the SR packet protocol of RTCP is as shown in FIG. 6, and the items used for packet quality analysis are NTP time stamp, RTP time stamp, and packet count items of the sender information block. Subsequently, fractional loss of a report block, cumulative number of packets lost, inter arrival jitter, last sender report (LSR), delay since last SR (DLSR) Is a field used by the sender to report reception.

The NTP time stamp is a 64-bit field that indicates the time this report was sent and is used to calculate the RTT delay. The RTP time stamp is calculated from the corresponding NTP time stamp using the relationship between the RTP time stamp coefficient and the actual time. The sender's packet count represents the total number of RTP data packets transmitted by the sender from the start of the transmission until this packet is generated.

The partial loss field indicates the percentage of RTP data packets lost since the previous SR or RR packet was transmitted. This value gives a partial loss value that averages the partial loss value of the RR packet received during a call.

The accumulated value field of lost packets is defined as the total number of RTP data packets lost since the start of reception from the source SSRC_n minus the expected number of packets. The actual number of packets received includes delayed arrivals and duplicate arrivals.

The Extended highest sequence number received field is a 32-bit field, where the lower 16 bits contain the highest sequence number of the RTP data packet received from the source SSRC_n, and the higher 16 bits are a predefined algorithm. Expands to the corresponding factor of the sequence number that is managed according to

The jitter field is a 32-bit field that represents a measure of statistical variability between RTP data packet arrival times, measured in time stamps, and represented by unsigned integers. Assuming Si is the RTP time stamp from packet i and Ri is the arrival time measured in RTP time stamp units of packet i, jitter D of packets i and j is expressed as Equation 2, and jitter J between arrivals is It is defined as in Equation 3.

[Equation 2]

D (i, j) = (Rj-Ri)-(Sj-Si) = (Rj-Sj)-(Ri-Si)

&Quot; (3) &quot;

J = J + (| D (i-1, I) |-J) / 16

Here 1/16 is a gain parameter that ensures a good convergence rate while ensuring a good noise reduction rate.

The LSR field is a 32-bit field and indicates the middle 32 bits of the 64-bit NTP time stamp which is a part of the RTCP SR recently received from the source SSRC_n. If the SR has not yet been received, this field has a value of zero.

The DLSR field is a 32-bit field indicating the delay between receiving the last SR packet from the source sSRC_n and transmitting this reception report block, which is expressed in 1/65536 seconds. If the SR packet has not been received from SSRC_n, the value of this field is set to zero.

The embodiments of the present invention described above are not implemented only through the apparatus and the method, but may be implemented through a program for realizing a function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded. Implementation may be easily implemented by those skilled in the art from the description of the above-described embodiments.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

1 is a system structural diagram according to an embodiment of the present invention.

2 is an exemplary diagram of a policy of an internal function module for performing a quality violation determination and evaluation in a QoE result analysis unit according to an embodiment of the present invention.

3A and 3B are flowcharts illustrating a method of measuring customer haptic quality according to an embodiment of the present invention.

4 is an operation flowchart of a result analysis system according to an exemplary embodiment of the present invention.

5 is an exemplary diagram illustrating a header structure of an RTP of a VoIP stream packet according to an embodiment of the present invention.

6 is an exemplary diagram illustrating a header structure of an RTCP protocol of a VoIP stream packet according to an embodiment of the present invention.

Claims (13)

In the system for measuring the user experience quality of the Internet telephony service, A user haptic quality analysis unit configured to receive and analyze first quality measurement information collected through a preset measurement method for voice quality and second quality measurement information collected through a terminal; A subscriber management unit that performs subscriber management for post-processing based on the analysis of the user experience quality analysis unit; And Opening / cancellation management unit for collecting data to be used for the analysis of the second quality measurement information in the user experience quality analysis unit User experience quality measurement system comprising a. The method of claim 1, The terminal, Customer experience quality measurement module for measuring customer experience quality for the voice quality based on a measurement request signal input from the outside User experience quality measurement system comprising a. The method of claim 1, The second quality measurement information includes a call quality value and a user feel quality measurement value, The user experience quality analysis unit, And a user experience quality measurement system that sets a quality section of the voice quality based on the first quality measurement information and the second quality measurement information. In the method of measuring the user experience quality of the Internet telephony service, When the voice quality measurement request signal is input, checking a packet input through a session for voice quality measurement; If the input packet is a first packet, measuring a unidirectional delay value for the packet; Calculating a first measured value based on the measured delay value; And Determining whether a quality evaluation value has been input, and if the second measurement value is input, providing the measured user haptic quality information based on the first measurement value and the quality evaluation value User experience quality measurement method comprising a. The method of claim 4, wherein Measuring the one-way delay value, Determining whether the first packet is a sender report packet or a receiver report packet; Calculating a one-way transmission delay time based on a time stamp of the first packet if the sender report packet; And Determining whether or not the preset delay time measurement period has been exceeded, and if so, calculates an average one-way transmission delay value according to the transmission delay for all received first packets and stores it as a one-way delay value. User experience quality measurement method comprising a. The method of claim 5, If the first packet is a receiver report packet, waiting to receive a packet User experience quality measurement method comprising a. The method of claim 4, wherein If the input packet is a second packet, Calculating and storing a partial packet loss value from the second packet; Determining whether or not the preset delay time measurement period has been exceeded, and if so, storing the stored partial packet loss value as a one-way delay value. User experience quality measurement method comprising a. The method of claim 4, wherein Calculating the first measurement value, Determining whether a session opened to receive the packet including a first packet and a second packet has ended; If yes, calculating a final packet loss rate and one-way delay value; And Calculating a first measurement based on the calculated final packet loss rate and one-way delay value User experience quality measurement method comprising a. The method of claim 8, The first packet is a Real-time Transport Control Protocol (RTCP), and the second packet is a Real-time Transport Protocol (RTP). The method of claim 4, wherein Providing user experience quality information, Determining whether a quality evaluation value has been input for a preset time; Storing the quality evaluation value if it is input and displaying a message for the quality evaluation value; And Delivering the quality evaluation value and the first measurement value to a server and providing the user haptic quality information User experience quality measurement method comprising a. In the method for performing post-processing using the user experience quality of the Internet telephone service, Receiving a measurement result value including a first measurement value and a quality evaluation value which are user haptic quality measurement results from the terminal; Checking a number of claims for compensation for the terminal and determining a quality section based on the quality evaluation value; And Generating a follow-up detail according to the determined quality section Post-processing method comprising a. The method of claim 11, The quality section is a post processing method generated to determine the degree of service termination possibility and the quality measurement request based on the first measurement value and the quality evaluation value. The method of claim 11, Determining the quality section, Checking the number of compensation claims for the current month requested by the terminal; Storing the number of compensation claims by the number of times the compensation claim is increased by one; Determining whether the result value includes a subjective quality measurement value; And If the subjective quality measurement value is included, checking a section corresponding to the subjective quality measurement value among one or more preset intervals as the quality section; Post-processing method comprising a.

Images