CN109240930A - Collaborative testing method for Web application program - Google Patents
Collaborative testing method for Web application program Download PDFInfo
- Publication number
- CN109240930A CN109240930A CN201811095704.6A CN201811095704A CN109240930A CN 109240930 A CN109240930 A CN 109240930A CN 201811095704 A CN201811095704 A CN 201811095704A CN 109240930 A CN109240930 A CN 109240930A
- Authority
- CN
- China
- Prior art keywords
- test
- task
- tester
- pm2ct
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a collaborative testing method of Web application programs, which comprises the following steps: submitting a Web application program test task needing to be tested to the PM2CT middleware by a requester and proposing a test requirement; the task management component receives and manages the test tasks submitted by the requesters, and marks identification information on the test tasks; the information management component stores the personal information of the testers and counts the working record of each tester; the PM2CT component completes the splitting and matching of the test task and the merging and outputting of the test result; and finally feeding back the test result to the test task requester by the PM2CT middleware. The invention improves the completion quality of the test task, shortens the time for testing and maximally utilizes the human resources on the Internet by splitting the complex test task, analyzing the capability and interest of the tester, distributing and pushing the subtasks and combining the test results of the subtasks.
Description
Technical field
The present invention relates to a kind of test method of computer applied algorithm, especially a kind of application program based on Web
Test method.
Background technique
Application program based on Web just more and more provides feature-rich, economic convenience for whole world great amount of terminals user
Service.The prevalence of Internet technology and network-centric life style creates unprecedented commercial opportunity and valence
Value.Thereby, it is ensured that web application is reliable in varied situations, correctly operation has become most important.
Since there are many performances and user experience that factor can influence web application, lead to complete test Web application journey
Sequence is extremely difficult.For example, web application is usually by many there is the people of different technologies background and ability to use, these Web
Application deployment uses path in different, and Local or Remote network connection environment, different types of browser and network are set
It is standby.Therefore a large amount of test plan and Test Sample Design is needed to check the risk of various scenes, which results in traditional Web to answer
It is needed with the labor-intensive of program test and the expensive of resource-intensive, and this problem comes the company of restrictive budget
It says just more prominent.
Have benefited from technological progress bring web application test new method: swarm intelligence just becoming one it is attractive
Solution, it is labour-intensive to solve the problems, such as by integrating a large amount of human resources on internet.Swarm intelligence software is surveyed
Examination is different with traditional software test to be, the tester of swarm intelligence test is from all over the world, and test assignment is can
With what is concurrently executed, this can make test period short and testing cost is lower relative to traditional software test.In addition, network is online
Test worker possesses different network environments, hardware device, and technical background etc. can make tested software in different real platforms
It is tested in environment, so that swarm intelligence software test is more reliable, more cost-effective, also more rapidly.
Swarm intelligence test at present has been applied to usability testing, performance test, GUI test etc..In order to facilitate test
Personnel selection task, prior art proposes a kind of method for allocating tasks for being based on " pushing away " mode, test assignment specification at whole
Number linear programming problems, and propose that 4 heuristic strategies carry out test assignment assignments, i.e., with greedy comprising four heuristic strategies
Task is distributed to test worker by greedy algorithm within the testing time as short as possible in a manner of " push ".But it is greedy in this method
Greedy algorithm especially in the case where there is new tester addition, is very easy to fall into the uncertain situation of tester
Local optimum.This may cause the mismatch between the degree of difficulty of test assignment and the power of test of tester, and can
Tester, which can be further resulted in, can not effectively find defect, even result in the submission defect report of mistake or malice.
Summary of the invention
In view of the defects existing in the prior art, the technical problem to be solved in the present invention is to provide one kind is assigned based on multitask
PM2CT component model, using PM2CT component model by the collaboration test problem specification under swarm intelligence environment at ILP problem,
To solve the test of web application complexity test assignment.Assigned first according to last test assignment as a result, dynamically from
Test assignment, which is concentrated to choose, needs task subset to be tested;Then it proposes that test assignment is dispatched to phase using matching strategy
Answer the tester of power of test.In swarm intelligence collaboration test process, tester is brought to execute test assignment,
Which ensure that more complicated Web page can receive more to test, to increase test coverage and reliable test knot
Fruit.Finally according to the test result of feedback, result polymerization is carried out using most ballot modes.The technical solution adopted by the present invention packet
It includes:
A kind of collaboration test method of web application, comprising the following steps:
Web application test assignment in need of test is submitted to PM2CT middleware by requestor, and mentioned by S1
Testing requirement out, the PM2CT middleware are made of information management component, task management component and PM2CT component, wherein
PM2CT component splits module, task matching module and test result merging module by task and constitutes;
S2 is received by the task management component and is managed the test assignment of requestor's submission, and marks to test assignment
Identification information, the identification information include: unique ID of test assignment, and task category, threshold value, coverage area and task definition are retouched
State information;
S3 is saved the personal information of tester by the information management component, and remembered to the work of each tester
Record is counted, acceptance test task after tester is registered by information management component;
S3 is exported by the fractionation and matching and the merging of test result of PM2CT component completion test assignment;
Test result is fed back to test assignment requestor by PM2CT middleware by S4.
Further, the registration information of the tester includes at least: unique id information and current believable shape
State information;The logging of tester includes at least: all history for distributing to each test assignment of tester are completed
Data and its task category often handled.
Further, the specific work steps of PM2CT component described in above-mentioned steps S3 are as follows:
S3-1, being split the test assignment that module submits requestor by task and split becomes a series of subtasks, composition one
A task groups;
S3-2, task matching module match the subtask in task groups with its most suitable tester;
S3-3, test result merging module receive the test result of each tester's feedback, and carry out to test result
Selection merges and exports.
Further, the fractionation of test assignment and matching problem can be modeled as being determined by PM2CT component model in step S3
The ILP problem of the resource constraint of justice, objective function are to select a test accuracy most for each test assignment after splitting
High tester, constraint condition therein are respectively as follows:
Constraint 1 is to guarantee that all Web pages in web application can be arrived by least one tester test, often
The length of testing speech of a test case must not be lower than one minute;
It constrains 2 each test cases and at least covers a Web page;
Constraint 3 has enough testers to provide under conditions of considering tester's confidence level and test case threshold value
Test is supported;
Constraining 4 one test cases can only be tested once by the same tester.
Technical term PM2CT used in technical solution of the present invention, full name in English are Partition-based Multi-
Tasks Matching for Collaborative Testiong can be translated into and be cooperateed with based on complex task fractionation with matched
Test;Technology predicate ILP used, full name in English are Integer Linear Programming, can be translated into integral linear programming.
Beneficial effects of the present invention essentially consist in that passing through the ability of fractionation, tester to complicated test assignment and emerging
Interest analysis, the distribution of subtask and push, the merging of subtask test result, improve the completion quality of test assignment, shorten
It the test time used, working efficiency can be improved, has maximally utilized the human resources on internet.
Detailed description of the invention
Fig. 1 is that PM2CT of the present invention cooperates with test method flow chart;
Fig. 2 is that PM2CT of the present invention cooperates with test model block diagram;
Fig. 3 is PM2CT component operation flow diagram of the present invention.
Specific embodiment
The present invention is further described with reference to the accompanying drawings and detailed description:
As shown in Figure 1, a kind of collaboration test method of web application, comprising the following steps:
Web application test assignment in need of test is submitted to PM2CT middleware by requestor, and mentioned by S1
Testing requirement out, the PM2CT middleware are made of information management component, task management component and PM2CT component, wherein
PM2CT component splits module, task matching module and test result merging module by task and constitutes;
S2 is received by the task management component and is managed the test assignment of requestor's submission, and marks to test assignment
Identification information, the identification information include: unique ID of test assignment, and task category, threshold value, coverage area and task definition are retouched
State information;
S3 is saved the personal information of tester by the information management component, and remembered to the work of each tester
Record is counted, acceptance test task after tester is registered by information management component;
S4 is exported by the fractionation and matching and the merging of test result of PM2CT component completion test assignment;
Test result is fed back to test assignment requestor by PM2CT middleware by S5.
Further, the registration information of the tester includes at least: unique id information and current believable shape
State information;The logging of tester includes at least: all history for distributing to each test assignment of tester are completed
Data and its task category often handled.
Further, the specific work steps of PM2CT component described in step S3 are as follows:
S3-1, being split the test assignment that module submits requestor by task and split becomes a series of subtasks, composition one
A task groups;
S3-2, task matching module match the subtask in task groups with its most suitable tester;
S3-3, test result merging module receive the test result of each tester's feedback, and carry out to test result
Selection merges and exports.
Further, the fractionation of test assignment and matching problem can be modeled as being determined by PM2CT component model in step S3
The ILP problem of the resource constraint of justice, objective function are to select a test accuracy most for each test assignment after splitting
High tester, constraint condition therein are respectively as follows:
Constraint 1 is to guarantee that all Web pages in web application can be arrived by least one tester test, often
The length of testing speech of a test case must not be lower than one minute;
It constrains 2 each test cases and at least covers a Web page;
Constraint 3 has enough testers to provide under conditions of considering tester's confidence level and test case threshold value
Test is supported;
Constraining 4 one test cases can only be tested once by the same tester.
As shown in Fig. 2, PM2CT collaboration test model mainly by requestor, the test worker from internet and
PM2CT middleware three parts composition.Firstly, test assignment information is submitted in PM2CT middleware by requestor.Then, PM2CT
Middleware is that each test assignment finds out most suitable tester, and the task is distributed to them.Finally, being directed to tester
Member's feedback as a result, being prevented using the method for quality control of majority ballot or being detected low-quality as a result, and by final survey
Test result returns to requestor.PM2CT middleware includes three chief components: information management component, task management component,
And PM2CT component.Information management component is responsible for managing the information and all historical statistical datas of tester.It is by one group
In platform registration tester's composition.Information management component maintains all history numbers for each task for distributing to tester
According to, for example, feed back accuracy (sum of the positive and negative feedback provided by tester in the task of completion defines), with
And task category.Calculating of the can be convenient in this way reliability that each tester completes different types of test assignment and
Calculating to test assignment type preference.
Task management component is responsible for counting all test assignment information.Each test assignment, we are defined as < idj,
categoryj,thresholdj,coveragej,descriptionj>.In we test, these information all be used to count
The classification and threshold value of test assignment.Therefore, each test assignment is assigned with an only id, thus can be convenient with
Track test assignment information, such as the coverage area of the classification of test assignment, the threshold value of test assignment and test assignment being related to.
PM2CT component splits module, test assignment matching module and test assignment merging module three parts by test assignment
Composition.As shown in figure 3, splitting the stage in test assignment, result is assigned according to last test assignment, all tests are appointed
Business is all divided into a series of task groups (TGs), assigns the task groups for needing most test, each time to ensure to obtain better test
Covering and more reliable test result.As shown in figure 3, all test assignments are split into n group, it is defined as TG1, TG2 ...,
TGj,…,TGn.In matching stage, the several test workers with corresponding power of test are assigned for any one group of TGj to survey
Examination.In addition, each selection TGj is to be assigned according to the test assignment of last time as a result, therefore, tester is brought to execute
Test assignment, which ensure that more complicated Web page can receive more to test, to increase test coverage and reliable
Test result.In merging phase, for each test assignment, the result of tester's feedback is used into the side of most ballots
Method determines final test result.
The fractionation of test assignment and matching problem are modeled as the resource defined by PM2CT component model in above-described embodiment
The ILP problem of constraint is to cooperate with test problem by specification by test assignment set covering theory (A), and page threshold matrix (TH) is surveyed
Examination personnel are credible matrix (W), test assignment threshold matrix (CTC), test assignment executes time matrix (T) and tester holds
Capable test assignment matrix (X).Test assignment set covering theory indicates that ajk is equal to based on test assignment page covering (ajk)
1 i-th of test assignment of expression covers k-th of Web page, and otherwise ajk is equal to 0.Page threshold matrix is calculated by defining 1
The complexity (Ck) of each page is out come what is indicated.Ck is by being calculated according to the comentropy of page code, and Ck value is got over
The information element and link script that k-th of web page of big expression includes are more, that is, indicate that the Web page more needs more
Test.Test assignment threshold matrix is calculated by defining 2 statistics A and TH, and more complicated test assignment indicates more
The test worker that needs to have high power of test completes.The reliability matrix of tester is by statistical test personnel's history
What the state computation of the test assignment of completion obtained, come power of test, the participation etc. for reflecting tester.It is similar, I
Assume for the same test assignment, the time that the higher tester of confidence level executes test is shorter.
The symbol for writing test is listed in following table:
It defines 1 to enable using digraph one web application of expression, interior joint is Web page, while being Web page
Link between face.The complexity threshold of k-th of node is by the code complexity of k-th of Web page of Web page in digraph
(thk) calculated, as follows.
It enablesLOCkIndicate the lines of code of k-th of web page.α is weight ginseng
Number, for adjusting the intensity of collaboration test.The quantity of z expression Web page.
Defining 2 enables any test assignment i be expressed as TCi=< (P1,th1),(P2,th2),(P3,th3),...,(Pz,thz)
>, the complexity threshold of test assignment is defined as the sum of the complexity for all test pages that test assignment includes, following institute
Show.
The confidence level for defining 3 testers is to be correctly completed the quantity of a certain classification test assignment and complete by calculating
It is calculated at the ratio of the total amount of a certain classification test assignment, as follows.
According to notation defined above, we indicate swarm intelligence collaboration test model by using mathematical formization.
According to above matrix and information is defined, we are by test assignment assignment problem specification at ILP problem.Because of task assignment problem
It is to calculate an optimal representative subset, is a np complete problem, we are defined as follows:
[OF: objective function]
Meet following constraint condition:
(1)For each Web page.[CC1: covering constraint 1]
(2)For each test assignment.[CC2: covering constraint 2]
(3)For each tester.[CC3: tester can use constraint]
(4)For each test page [CC4: the page supports constraint]
(5)xijIt is 0 or 1. [CC5: binary constraint]
OF is objective function, is the minimum for calculating the sum of execution time of all test cases.CC1 and CC2 is test
Covering constraint, CC1 are to constrain each Web page at least to be tested once by a tester, and CC2 constrains each
Web page all at least includes by a test case.CC3 ensures that each tester has enough testing times to go to complete
The test of test case.CC4 is that each test page of constraint requires to reach certain test validity.Guarantee the more complicated page
More tests can be obtained.CC5 is a dualization constraint, it is ensured that for the same test case, the same tester is only
It can at most test primary.
By task management component and information management component, specification is indicated at five matrixes of TH, CTC, A, T, W respectively.It is based on
This 5 matrixes, swarm intelligence cooperation test specification at ILP problem, PM2CT model uses a greedy algorithm (TPA) first,
Test assignment subset dynamically is selected according to last assignment test assignment result, then uses an ability matching algorithm
(MMA) carry out dynamically to assign test assignment to corresponding tester, finally polymerize using the method for a most ballots anti-
The test result of feedback.
The stage is split in test assignment, algorithm (TPA) is split using task and selects a system from all test assignments
The test assignment subset (TG) of column.TPA is each time according to last assignment as a result, dynamically select to need most tested next time
The test assignment subset of examination.Tester is brought to execute test assignment, which ensure that more complicated Web page can receive
More tests, to increase test coverage and the such TPA algorithm of reliable test result, specific step is as follows.
Step 1, step 2 and step 3 are initiation parameter and constraint condition.Page supported value (u is calculated in step 4k)
To monitor the test case of all Web nodes.Page supported value is by test assignment set covering theory, test assignment complexity threshold
Matrix and tester's reliability matrix are calculated, as shown in formula 4
In steps of 5, by formula 5, the page yield value (eval for calculating each Web node is updatedk).Then again
The page yield value for counting all Web nodes selects the Web node (P for possessing maximum page yield valuek *)。
In step 6, it selects all comprising Pk *The test assignment (TG) of node, and using multitask dispatching algorithm TG
It is dispatched to the tester with corresponding power of test.Until all page yield values are all 0, then algorithm terminates.
In the test assignment matched stage, we aim to solve the problem that the problem of test assignment matches in cooperation test.In order to
Realize this point, we have proposed a multitask dispatching algorithms (MMA), and the purpose is to each test assignments in TG to be dispatched to
Most suitable tester.The step of MMA algorithm is described in detail in algorithm 2.
Initiation parameter in step 1.In step 2, in order to improve the utilization rate of tester, from available tester
Chi Zhong selects the tester (tester with highest power of testi).Then, in step 3, counted by formula 6 and 7
Calculate test assignment and the tester in all TGiMatching variance (vij).And select suitable test assignment to the tester.
Formula 7 be calculate tester and test assignment matching variance, matching variance yields it is lower illustrate tester and
Test assignment matching.Until the matching test personnel's number for meeting test assignment requires (NT), algorithm terminates.
Test result merge feedback stage due to each test assignment it is multiple be assigned to different testers
It executes, and the ability of tester is all not quite similar, therefore deletes invalid feedback test using the mode of majority ballot herein
Report.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
Anyone skilled in the art in the technical scope disclosed by the present invention, according to the technique and scheme of the present invention and its
Inventive concept is subject to equivalent substitution or change, should be covered by the protection scope of the present invention.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811095704.6A CN109240930A (en) | 2018-09-19 | 2018-09-19 | Collaborative testing method for Web application program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811095704.6A CN109240930A (en) | 2018-09-19 | 2018-09-19 | Collaborative testing method for Web application program |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109240930A true CN109240930A (en) | 2019-01-18 |
Family
ID=65059252
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811095704.6A Pending CN109240930A (en) | 2018-09-19 | 2018-09-19 | Collaborative testing method for Web application program |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109240930A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110851363A (en) * | 2019-11-12 | 2020-02-28 | 广东电网有限责任公司 | Cloud testing system and method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6993747B1 (en) * | 1999-08-30 | 2006-01-31 | Empirix Inc. | Method and system for web based software object testing |
CN104184728A (en) * | 2014-08-14 | 2014-12-03 | 电子科技大学 | Safety detection method and device for Web application system |
CN106021079A (en) * | 2016-05-06 | 2016-10-12 | 华南理工大学 | A Web application performance testing method based on a user frequent access sequence model |
CN108241582A (en) * | 2018-01-12 | 2018-07-03 | 东华大学 | A software automation testing platform based on RabbitMQ message middleware |
-
2018
- 2018-09-19 CN CN201811095704.6A patent/CN109240930A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6993747B1 (en) * | 1999-08-30 | 2006-01-31 | Empirix Inc. | Method and system for web based software object testing |
CN104184728A (en) * | 2014-08-14 | 2014-12-03 | 电子科技大学 | Safety detection method and device for Web application system |
CN106021079A (en) * | 2016-05-06 | 2016-10-12 | 华南理工大学 | A Web application performance testing method based on a user frequent access sequence model |
CN108241582A (en) * | 2018-01-12 | 2018-07-03 | 东华大学 | A software automation testing platform based on RabbitMQ message middleware |
Non-Patent Citations (1)
Title |
---|
郭世凯等: "A Real-Time Collaborative Testing", 《2016 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C)》 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110851363A (en) * | 2019-11-12 | 2020-02-28 | 广东电网有限责任公司 | Cloud testing system and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Perera et al. | Improve software quality through practicing DevOps | |
Li et al. | Architectural technical debt identification based on architecture decisions and change scenarios | |
Rozinat et al. | Discovering simulation models | |
Dobrica et al. | A survey on software architecture analysis methods | |
US9158663B2 (en) | Evaluating performance maturity level of an application | |
Bass et al. | Architecture-Based Development. | |
Perera et al. | Evaluating the impact of DevOps practice in Sri Lankan software development organizations | |
CN111966665A (en) | Data migration test method and device | |
Adewumi et al. | FOSSES: Framework for open‐source software evaluation and selection | |
GB2498023A (en) | Assessing maturity of business processes | |
US20200321084A1 (en) | Device, system, and method for optimizing pathology workflows | |
Šperka et al. | The performance assessment framework (PPAFR) for RPA implementation in a loan application process using process mining | |
US9064038B2 (en) | Method and system for combining multiple benchmarks | |
Hamzah et al. | An exploratory study for investigating the issues and current practices of service-oriented architecture adoption | |
Dias-Neto et al. | Supporting the combined selection of model-based testing techniques | |
CN109240930A (en) | Collaborative testing method for Web application program | |
Malhotra et al. | A defect tracking tool for open source software | |
Prikladnicki et al. | Patterns of evolution in the practice of distributed software development: quantitative results from a systematic review | |
CN114638042B (en) | System engineering design and verification method and system based on fishbone model | |
Wang et al. | Modification impact analysis based test case prioritization for regression testing of service-oriented workflow applications | |
Zhao et al. | Software project measurement based on the 5P model | |
Gupta et al. | A proposal of using conceptual models for user story development and maintenance | |
Roychoudhuri et al. | More equal than others? parity in developer interaction and its relation to bug resolution time | |
Røhne | Architectural anti-pattern identification and mitigation in microservice applications based on telemetry | |
Sai et al. | Driving component selection through actor-oriented models and use cases |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190118 |
|
RJ01 | Rejection of invention patent application after publication |