CN111427801B - Service performance evaluation method based on load test tool - Google Patents
Service performance evaluation method based on load test tool Download PDFInfo
- Publication number
- CN111427801B CN111427801B CN202010333418.XA CN202010333418A CN111427801B CN 111427801 B CN111427801 B CN 111427801B CN 202010333418 A CN202010333418 A CN 202010333418A CN 111427801 B CN111427801 B CN 111427801B
- Authority
- CN
- China
- Prior art keywords
- service
- score
- version
- test
- baseline
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a business performance evaluation method based on a load test tool, which comprises the following steps: s1: performing performance test on the service system through a load test tool to obtain a test report; s2: obtaining test result data from the test report; s3: calculating the baseline percentage, the independent score and the weight of each business in the business system; s4: calculating a service system version score; s5: outputting the calculated baseline percentage, the individual score and the business system version score of each business according to a set template; s6: and obtaining the score of each version of the service system, and obtaining the overall performance change trend of each version of the service system. The invention obtains the independent score of each service and the version score of the service system through the load test tool result, calculates the test result of each version to obtain the score of each version of the service system, and intuitively obtains the overall performance change of the system.
Description
Technical Field
The invention relates to a performance evaluation method, in particular to a performance evaluation method based on a load test tool.
Background
Load test tools are used to predict system behavior and performance, such as open source test tool JMeter. The load testing tool confirms and searches the problems by simulating the mode that millions of users implement concurrent load and real-time performance monitoring, and the load testing tool can test the whole framework. The load testing tool can shorten the testing time to the greatest extent, optimize the performance and accelerate the release period of the application system. The load test tool is applicable to automatic load tests of various architectures, and can predict system behaviors and evaluate system performances. Currently, network application environments must support a large number of users, and network architecture contains various application environments and provides software and hardware products by different suppliers. Problems such as slow user response speed, system breakdown and the like are feared in the case of unpredictable user loads and increasingly complex application environments. In addition, load testing tools are generally capable of supporting a wide range of protocols and technologies.
The analysis of the load test tool results is a complex process, and can be generally analyzed from the aspects of result abstracts, concurrency numbers, average transaction response time, number of clicks per second, service success rate, system resources, web server resources, database server resources and the like, so that analysis data are relatively large and complex, and the overall performance change of the system cannot be directly and rapidly analyzed.
Disclosure of Invention
The invention aims to solve the technical problem of providing a business performance evaluation method based on a load test tool, which can quickly obtain the overall performance change of a system, avoids a complicated analysis process and is quick and efficient.
The technical scheme adopted by the invention for solving the technical problems is to provide a service performance evaluation method based on a load test tool, which comprises the following steps: s1: performing performance test on the service system through a load test tool to obtain a test report; the service system comprises a plurality of services; s2: obtaining test result data related to service performance from a test report; s3: calculating the baseline percentage, the independent score and the weight of each service in the service system through the test result data; s4: calculating a service system version score through the independent score and the weight of each service; s5: outputting the calculated baseline percentage, the individual score and the business system version score of each business according to a set template; s6: and obtaining the score of each version of the service system through the steps S1-S5, and further obtaining the overall performance change trend of each version of the service system.
Further, the baseline value and the version response time of each service in the test result data obtained in the step S2 are the historical shortest response time of the service.
Further, the step S3 specifically includes: s31: calculating the baseline percentage of each service according to the baseline value and version response time of each service, wherein the calculation formula is as follows: baseline percentage= (version response time-baseline value)/baseline value x 100; s32: calculating the independent score of each service according to the percentage of each service, wherein the calculation formula is as follows: business alone score = 100-baseline percentage, if baseline percentage > = 90%, baseline percentage is set to 90% when business system version score calculation is performed; s33: setting the weight of each service through the baseline percentage of each service: the baseline percentage < = 20% sets the traffic weight to 1, 20% < baseline percentage < = 40% sets the traffic weight to 2, and baseline percentage >40% sets the traffic weight to 3.
Further, when the service weight is calculated in step S33, if the difference between the version response time and the baseline value is less than or equal to 2S, the service weight is set to be 1.
Further, in the step S4, the service system version score is calculated according to the percentage and the weight of each service, and the calculation formula is as follows: version score = (individual score for each service weight) sum/number of services.
Further, the step S2 further includes converting the test result of the load testing tool into a text format, storing the text format in a data table under a set directory, and taking out the baseline value and version response time data of each service and storing the baseline value and version response time data in a data evaluation page of the data table.
Further, in the step S5, the baseline percentage, the individual score, and the version score of the service system of each service are stored in the data evaluation page of the data table corresponding to the baseline value and the version response time of each service.
Further, the load testing tool in step S1 performs performance testing on the service system, and specifically includes the following steps: s11: making a test plan according to scene requirements; s12: creating a virtual user script: creating a script, parameterizing the script according to a test plan, and associating the parameters; s13: creating an operation scene: setting a virtual user number according to a test plan, creating a scheme and selecting a script; s14: running a test script: scheduling a virtual user through a controller, adding a script and a loading machine, configuring, and carrying out connection test after the loading machine adds different IP; s15: and after the test is finished, summarizing the test result and submitting a test report.
Compared with the prior art, the invention has the following beneficial effects: according to the service performance evaluation method based on the load test tool, the independent score of each service and the version score of the service system are automatically obtained through the result of the load test tool, the operation is simple, and the result is visual and reliable; meanwhile, the score of each version of the service system is obtained through analysis and calculation of the test result of each version, the rising and falling trend of the system performance is obtained intuitively, the overall performance change of the system is obtained rapidly, the complicated analysis process is avoided, and the system is rapid and efficient.
Drawings
Fig. 1 is a flowchart of a method for evaluating service performance based on a load test tool in an embodiment of the present invention.
Fig. 2 is a result diagram of a service performance evaluation method based on a load test tool in an embodiment of the present invention.
Detailed Description
The invention is further described below with reference to the drawings and examples.
Fig. 1 is a flowchart of a method for evaluating service performance based on a load test tool in an embodiment of the present invention.
Referring to fig. 1, the method for evaluating service performance based on a load test tool according to the embodiment of the invention includes the following steps:
s1: performing performance test on the service system through a load test tool to obtain a test report; the service system comprises a plurality of services;
s2: obtaining test result data of performance related to the service from a test report;
s3: calculating the baseline percentage, the independent score and the weight of each service in the service system through the test result data;
s4: calculating a service system version score through the independent score and the weight of each service;
s5: outputting the calculated baseline percentage, the individual score and the business system version score of each business according to a set template;
s6: and obtaining the score of each version of the service system through the steps S1-S5, and further obtaining the overall performance change trend of each version of the service system.
Specifically, in the performance evaluation method based on the load test tool according to the embodiment of the present invention, in step S2, the test result of the load test tool is converted into a text format and stored in a data table under a set directory, a baseline value and a version response time of each service in test result data related to service performance are obtained, the baseline value is a historical shortest response time of the service, and the baseline value and the version response time data of each service are taken out and stored separately in a data evaluation page of the data table
Specifically, the service performance evaluation method based on the load test tool in the embodiment of the invention includes the specific calculation process:
the invention calculates the baseline percentage of each service by the baseline value and version response time of each service, and the calculation formula is as follows: baseline percentage= (version response time-baseline value)/baseline value x 100;
calculating the independent score of each service according to the baseline percentage of each service, wherein the calculation formula is as follows: business alone score = 100-baseline percentage, if baseline percentage > = 90%, baseline percentage is set to 90% when business system version score calculation is performed;
setting the weight of each service through the baseline percentage of each service: the baseline percentage < = 20% sets the traffic weight to 1, 20% < baseline percentage < = 40% sets the traffic weight to 2, and baseline percentage >40% sets the traffic weight to 3. When the service weight is calculated, if the difference value between the version response time and the base line value is less than or equal to 2s, the service weight is set to be 1.
Calculating the version score of the service system according to the baseline percentage and the weight of each service, wherein the calculation formula is as follows: version score = (individual score for each service weight) sum/number of services.
Referring to fig. 2, in the method for evaluating service performance based on the load test tool according to the embodiment of the present invention, the baseline percentage, the individual score and the service system version score of each service are stored in the data evaluation page of the data table corresponding to the baseline value and the version response time of each service.
The invention carries out performance test on a service system based on a load test tool, and specifically comprises the following steps:
s11: making a test plan according to scene requirements;
s12: creating a virtual user script: creating a script, parameterizing the script according to a test plan, and associating the parameters;
s13: creating an operation scene: setting a virtual user number according to a test plan, creating a scheme and selecting a script;
s14: running a test script: scheduling a virtual user through a controller, adding a script and a loading machine, configuring, and carrying out connection test after the loading machine adds different IP;
s15: and after the test is finished, summarizing the test result and submitting a test report.
In summary, the method for evaluating the service performance based on the load testing tool automatically obtains the independent score of each service and the version score of the service system through the result of the load testing tool, and has simple operation and visual and reliable result; meanwhile, the score of each version of the service system is obtained through analysis and calculation of the test result of each version, the rising and falling trend of the system performance is obtained intuitively, the overall performance change of the system is obtained rapidly, the complicated analysis process is avoided, and the system is rapid and efficient.
While the invention has been described with reference to the preferred embodiments, it is not intended to limit the invention thereto, and it is to be understood that other modifications and improvements may be made by those skilled in the art without departing from the spirit and scope of the invention, which is therefore defined by the appended claims.
Claims (5)
1. The service performance evaluation method based on the load test tool is characterized by comprising the following steps:
s1: performing performance test on the service system through a load test tool to obtain a test report; the service system comprises a plurality of services;
s2: obtaining test result data related to service performance from a test report;
s3: calculating the baseline percentage, the independent score and the weight of each service in the service system through the test result data;
s4: calculating a service system version score through the independent score and the weight of each service;
s5: outputting the calculated baseline percentage, the individual score and the business system version score of each business according to a set template;
s6: the score of each version of the service system is obtained through the steps S1-S5, and then the overall performance change trend of each version of the service system is obtained;
the load testing tool in the step S1 tests the performance of the service system, and specifically comprises the following steps:
s11: making a test plan according to scene requirements;
s12: creating a virtual user script: creating a script, parameterizing the script according to a test plan, and associating the parameters;
s13: creating an operation scene: setting a virtual user number according to a test plan, creating a scheme and selecting a script;
s14: running a test script: scheduling a virtual user through a controller, adding a script and a loading machine, configuring, and carrying out connection test after the loading machine adds different IP;
s15: after the test is finished, summarizing the test result and submitting a test report;
the baseline value and version response time of each service in the test result data obtained in the step S2 are the historical shortest response time of the service;
the step S3 specifically includes:
s31: calculating the baseline percentage of each service according to the baseline value and version response time of each service, wherein the calculation formula is as follows: baseline percentage= (version response time-baseline value)/baseline value x 100, which value represents the percentage of traffic response time above baseline;
s32: calculating the independent score of each service according to the baseline percentage of each service, wherein the calculation formula is as follows: business alone score = 100-baseline percentage, if baseline percentage > = 90%, the baseline percentage is set to 90% when business alone score calculation is performed;
s33: setting the weight of each service through the baseline percentage of each service: the baseline percentage < = 20% sets the traffic weight to 1, 20% < baseline percentage < = 40% sets the traffic weight to 2, and baseline percentage >40% sets the traffic weight to 3.
2. The method for evaluating the performance of a service based on a load testing tool according to claim 1, wherein when the service weight is calculated in the step S33, if the difference between the version response time and the baseline value is less than or equal to 2S, the service weight is set to be 1.
3. The method for evaluating the performance of a service based on a load test tool according to claim 1, wherein the step S4 calculates a service system version score by using the individual score and the weight of each service, and the calculation formula is as follows: version score = (individual score for each service weight) sum/number of services.
4. The method for evaluating the performance of a service based on a load testing tool according to claim 1, wherein the step S2 further comprises converting the test result of the load testing tool into a text format, storing the text format in a data table under a set directory, and taking out the baseline value and version response time data of each service and storing the baseline value and version response time data in a data evaluation page of the data table.
5. The load test tool-based traffic performance evaluation method according to claim 4, wherein the baseline percentage, the individual score, and the traffic system version score of each traffic are stored in the data evaluation page of the data table corresponding to the baseline value and the version response time of each traffic in step S5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010333418.XA CN111427801B (en) | 2020-04-24 | 2020-04-24 | Service performance evaluation method based on load test tool |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010333418.XA CN111427801B (en) | 2020-04-24 | 2020-04-24 | Service performance evaluation method based on load test tool |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111427801A CN111427801A (en) | 2020-07-17 |
| CN111427801B true CN111427801B (en) | 2024-03-19 |
Family
ID=71556728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010333418.XA Active CN111427801B (en) | 2020-04-24 | 2020-04-24 | Service performance evaluation method based on load test tool |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111427801B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211311A (en) * | 2006-12-25 | 2008-07-02 | 中国电信股份有限公司 | Performance prediction method for application software in manufacturing environment |
| CN102158373A (en) * | 2011-05-12 | 2011-08-17 | 哈尔滨工业大学 | Performance evaluation system of high-end server for intermediary business of bank |
| US9122789B1 (en) * | 2008-11-24 | 2015-09-01 | Jpmorgan Chase Bank, N.A. | System and method for testing applications with a load tester and testing translator |
| CN104901823A (en) * | 2014-03-04 | 2015-09-09 | 中国移动通信集团北京有限公司 | Method and device for generating alarm threshold value, and method and device for monitoring service performance index |
| US9459980B1 (en) * | 2013-04-17 | 2016-10-04 | Amazon Technologies, Inc. | Varying cluster sizes in a predictive test load while testing a productive system |
| CN110096429A (en) * | 2019-03-18 | 2019-08-06 | 深圳壹账通智能科技有限公司 | Test report generation method, device, equipment and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9225621B2 (en) * | 2013-06-25 | 2015-12-29 | Netflix, Inc. | Progressive deployment and termination of canary instances for software analysis |
-
2020
- 2020-04-24 CN CN202010333418.XA patent/CN111427801B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211311A (en) * | 2006-12-25 | 2008-07-02 | 中国电信股份有限公司 | Performance prediction method for application software in manufacturing environment |
| US9122789B1 (en) * | 2008-11-24 | 2015-09-01 | Jpmorgan Chase Bank, N.A. | System and method for testing applications with a load tester and testing translator |
| CN102158373A (en) * | 2011-05-12 | 2011-08-17 | 哈尔滨工业大学 | Performance evaluation system of high-end server for intermediary business of bank |
| US9459980B1 (en) * | 2013-04-17 | 2016-10-04 | Amazon Technologies, Inc. | Varying cluster sizes in a predictive test load while testing a productive system |
| CN104901823A (en) * | 2014-03-04 | 2015-09-09 | 中国移动通信集团北京有限公司 | Method and device for generating alarm threshold value, and method and device for monitoring service performance index |
| CN110096429A (en) * | 2019-03-18 | 2019-08-06 | 深圳壹账通智能科技有限公司 | Test report generation method, device, equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| Haque, A.B. ; Sultana, R. ; Fahad, M.S. ; Latif, M.N. ; Bari, M.A.."XDoser, A Benchmarking Tool for System Load Measurement Using Denial of Service Features".《arXiv》.2019,全文. * |
| 尹高嵩,范辉.Web负载测试的研究与应用.《微机发展》.2004,第94-96+130页. * |
| 张金娟 ; 陈娜 ; 胡虹 ; 徐歆壹 ; .在线计费系统综合性能评估体系研究.《电信科学》.2013,第123-129页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111427801A (en) | 2020-07-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109309596B (en) | Pressure testing method and device and server | |
| CN107643981A (en) | A kind of automatic test platform and operation method of polynary operation flow | |
| CN106776280B (en) | Configurable performance test device | |
| US10521322B2 (en) | Modeling and testing of interactions between components of a software system | |
| CN106933709A (en) | A kind of method of testing and device | |
| CN109633351B (en) | Intelligent IT operation and maintenance fault positioning method, device, equipment and readable storage medium | |
| CN104834602B (en) | A kind of program dissemination method, device and program delivery system | |
| CN111522728A (en) | Method for generating automatic test case, electronic device and readable storage medium | |
| CN110781089B (en) | Method and device for automatically testing UI of equipment, electronic equipment and medium | |
| CN111090666A (en) | Data processing method, device and system and computer readable storage medium | |
| CN107391373B (en) | AutoIT-based automatic performance testing method | |
| CN103139006A (en) | Web service based automated testing device and method | |
| CN106850330B (en) | Intelligent cloud desktop performance test system and method | |
| CN103902446A (en) | Network server automated testing method and device | |
| US6691259B1 (en) | Terminal server data file extraction and analysis application | |
| CN111737143B (en) | Method and system for troubleshooting AB test of webpage | |
| CN118656283B (en) | User operation time-consuming analysis method and device based on SAAS customer relationship management | |
| CN111104324A (en) | Test case generation method, generation device, and computer-readable storage medium | |
| CN110750453B (en) | HTML 5-based intelligent mobile terminal testing method, system, server and storage medium | |
| CN101322113B (en) | Grid computing control method and service method for testing server application performance | |
| CN103139004A (en) | Method and system for simulating network bandwidth by using network rate-limiting tool | |
| CN105868058A (en) | Cross-machine room test method and apparatus | |
| CN111427801B (en) | Service performance evaluation method based on load test tool | |
| CN105573905A (en) | Software compatibility testing method and system | |
| CN107229569A (en) | Method and system are performed towards the automatic test centralized dispatching for performing technology more |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |