[go: up one dir, main page]

CN106908258A - The method and device of performance test - Google Patents

The method and device of performance test Download PDF

Info

Publication number
CN106908258A
CN106908258A CN201510982401.6A CN201510982401A CN106908258A CN 106908258 A CN106908258 A CN 106908258A CN 201510982401 A CN201510982401 A CN 201510982401A CN 106908258 A CN106908258 A CN 106908258A
Authority
CN
China
Prior art keywords
performance test
parameter
statistic
test parameter
test
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510982401.6A
Other languages
Chinese (zh)
Inventor
王楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201510982401.6A priority Critical patent/CN106908258A/en
Publication of CN106908258A publication Critical patent/CN106908258A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M99/00Subject matter not provided for in other groups of this subclass
    • G01M99/005Testing of complete machines, e.g. washing-machines or mobile phones

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Storage Device Security (AREA)

Abstract

This application discloses the method and apparatus of performance test, the method comprising the steps of:Statistic to performance test parameter carries out parameter Estimation, and obtains estimate;Judge whether the estimate for obtaining meets pre-conditioned, and determined whether to be tested next time according to judged result, it is described pre-conditioned according to the setting of the default fluctuating range of performance test parameter.The application can improve testing efficiency.

Description

The method and device of performance test
Technical field
The application is related to the Performance Testing Technology of equipment, more particularly to the method and apparatus that equipment performance is tested.
Background technology
The current test being mainly for the performance test of equipment to response time, but the survey of response time Test result is easily fluctuated by operating system itself, testing tool sampling and the reason such as test execution mode Influence, cause the fluctuation of test data.
In the prior art, in order to avoid the fluctuation of test data, it usually needs carry out substantial amounts of test time Count to exclude impacted test data, to obtain desired test result.Some test scenes may be needed The testing time wanted probably needs just obtain desired test result 500 times, therefore testing efficiency is very low.
The content of the invention
The method and apparatus that the application provides equipment performance test, it is possible to increase testing efficiency.
According to the first aspect of the embodiment of the present application, there is provided a kind of method of performance test, the method includes Step:
Statistic to performance test parameter carries out parameter Estimation, and obtains estimate;
Judge whether the estimate for obtaining meets pre-conditioned, and determined whether to carry out down according to judged result Once test, it is described pre-conditioned according to the setting of the default fluctuating range of performance test parameter.
According to the second aspect of the embodiment of the present application, there is provided a kind of device of performance test, including:
Computing module, carries out parameter Estimation, and obtain estimate for the statistic to performance test parameter;
Whether judge module, the estimate for judging to obtain meets pre-conditioned;And according to judged result Determine whether to be tested next time, the pre-conditioned default fluctuating range according to performance test parameter Setting.
Applicant has found the regularity of distribution of performance test parameter by substantial amounts of experiment, therewith using statistics Principle carries out parameter Estimation to performance test parameter, by the stopping test of estimate and user's setting Conditions correlation, can decide whether to need to carry out next round test after test every time, reach user's phase Test can be stopped after the test request of prestige, that is, the optimal testing time for stopping test being found, Therefore can both ensure to exclude impacted test data, testing cost can be reduced again, improve test effect Rate.
Brief description of the drawings
Fig. 1 is the flow chart of the method for performance test in the embodiment of the present application;
Fig. 2 is the flow chart of the application application example;
Fig. 3 a, Fig. 3 b show for the test result of the application application example;
Fig. 4 is the hardware structure figure of the device of the application performance test;
Fig. 5 is the logic diagram of the device of the application performance test.
Specific embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following When description is related to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous Key element.Implementation method described in following exemplary embodiment does not represent the institute consistent with the application There is implementation method.Conversely, they are only with described in detail in such as appended claims, the application The example of the consistent apparatus and method of a little aspects.
It is the purpose only merely for description specific embodiment in term used in this application, and is not intended to be limiting The application." one kind ", " institute of the singulative used in the application and appended claims State " and " being somebody's turn to do " be also intended to include most forms, unless context clearly shows that other implications.Should also Work as understanding, term "and/or" used herein refers to and associated lists item comprising one or more Purpose any or all may combine.
It will be appreciated that though may describe various using term first, second, third, etc. in the application Information, but these information should not necessarily be limited by these terms.These terms only be used for by same type of information that This is distinguished.For example, in the case where the application scope is not departed from, the first information can also be referred to as Two information, similarly, the second information can also be referred to as the first information.Depending on linguistic context, as in this institute Use word " if " can be construed to " and ... when " or " when ... when " or " response In it is determined that ".
The application can accomplish to be monitored the accumulation of the performance test results of test data, evade The influence of screening result test fluctuation;And whether can be reached according to the requirement of the precision of user's setting, monitor in real time Required precision, allows users to determine the opportunity for terminating test in time.
The equipment of the application bearing test data can be plurality of devices, for example handheld device, mobile unit, Wearable device, television equipment, computing device or other there is equipment of disposal ability etc..
Fig. 1, S101 please be participate in, the statistic to performance test parameter carries out parameter Estimation, and is estimated Evaluation;
S102, judges whether the estimate for obtaining meets pre-conditioned, and is determined whether according to judged result Tested next time, it is pre-conditioned to be set according to the default fluctuating range of performance test parameter.
According to statistical definition, statistic refers to the sample function constructed by each sample.Application People by substantial amounts of experimental studies have found that, the statistic of performance test parameter can meet certain statistical distribution Rule, the situation of change of the fluctuation of performance test parameter can be analyzed using this statistical law, For example, the response time for the test scene tested in test every time, can be separate Sample one by one, the average of the response time tested each time tends to normal distribution;Again for example, right In evaluated error, (i.e. test performance parameter is influenceed by enchancement factor during certain measurement, deviates normal condition The difference of lower test performance parameter), when sample reaches certain amount, normal distribution can be met.Cause The performance that repeatedly test is obtained can be surveyed performance test parameter as sample as an example for this The totality for trying parameter constitutes certain function as statistic to carry out parameter Estimation.
As a example by using response time as performance test parameter, performance test parameter can be obtained by following processes:
For the test scene with dynamic visual picture, for example to start certain application performance test, The performance test of facility switching machine, the performance test of closing of the circuit etc., can capture many of test scene Pictures, analyze the change procedure of picture to obtain the response time of test scene.
The mode for capturing the picture of test scene can utilize to image first-class shooting instrument with certain frequency Equipment is taken pictures, and the data that shooting instrument is gathered are preserved into picture, and record the collection per pictures Time.Filming frequency is higher than the frequency of the change per frame picture, for example, the refreshing frequency of mobile phone if 60fps (frame/second), can be shot with the frame rate of 120fps (frame/second).
The change procedure of preserved picture can be analyzed, to determine response time, for example, it may be determined that Picture starts the time of change and terminates the time of change, and the time interval that will be calculated is used as the checkout area The response time that scape is once tested.
As an example, it is also possible to capture the keyword in test script, specific survey is determined by keyword The response time that examination hall scape is tested next time.For example, work as test script upon execution, can be with print execution The daily record of script, brought into operation using " LOG " as keyword search test script and terminated operation when Between, so as to obtain the response time once tested.
Be readily appreciated that, it is cited go out example be intended to more intuitively understand the technical scheme of the application, and The implementation of cited example is not limited to, in addition to response time can be as performance test parameter, not Other performance test parameters are excluded, for example, represents occupancy data of each process of cpu performance data etc. Parameter.
As an example, because the overall average of the performance test parameter of multiple test is accorded with some occasions Normal distribution is closed, therefore, after the completion of certain can be tested in S101, each test of current accumulation The average of performance test parameter and is carried out as the statistic of performance test parameter using Estimating Confidence Interval Parameter Estimation, the confidential interval that Estimating Confidence Interval is obtained as estimate, alternatively, it is also possible to will The confidential interval of acquisition obtains other values (such as stability bandwidth) as estimate as median.
Confidential interval (Confidence interval) refers to the population parameter constructed by the statistic of sample Estimation interval.In statistics, the confidential interval of a probability sample be to this sample certain is total The interval estimation of body parameter.What confidential interval represented be this parameter actual value have certain probability fall survey Degree around amount result.What confidential interval was given is the credibility of the measured value of measured parameter, This credibility is confidence level.
In the application, the confidence level of confidential interval can be set by the user, user by set confidence level come The testing cost for needing to spend is determined, if the precision prescribed of the test scene is higher, then can be It is higher that confidence level is set, and makes the width of confidential interval larger;If precision is low, confidence level Value can lower, confidential interval can just reduce scope, can so help user to obtain as needed Obtain required data.For example, in an example, confidence level can be set into 95%, it is also possible to will Confidence level is set to 90%.
For example, the statistic for obtaining the performance test parameter of each test of current accumulation can pass through In the following manner.
If being directed to certain test scene, the response time when testing first time is t1, is tested for the second time When response time be t2, third time test when response time be t3, the 4th time test when response when A length of t4;Then after the completion of first time tests, the statistic of the performance test parameter of current accumulation is t1; After the completion of being tested when second, the statistic of the performance test parameter of current accumulation is the flat of the sum of t1, t2 Average.By that analogy, after the completion of being tested when the 4th time, the statistic of the performance test parameter of current accumulation It is this four times average values of the summation of the response time of test.
In step S101, during the confidential interval of Counting statistics amount, can be according to the difference of sample size And the regularity of distribution difference for presenting, using different method of interval estimation.As an example, can be by T Distribution or standardized normal distribution obtain the confidential interval of statistic.Can be by the testing time of current accumulation Contrasted with preset times, it is determined whether be distributed by the T of the statistic or standardized normal distribution calculates institute State the confidential interval of statistic.The statistic that pre-determined number is used to distinguish performance test parameter belongs to small sample Or large sample.It is noted that be not to be distinguished with sample size size between large sample, small sample, The conventional empirical value of statistics is may be referred to, pre-determined number is set to 30 times, testing time is less than 30 times When each performance test parameter belong to small sample;Testing time performance test acquired when being not less than 30 times Parameter is large sample.User can be adjusted according to the actual conditions of test scene to pre-determined number, this Shen Do not limit 30 times as the sole criterion for weighing large sample and small sample please.
As an example, in small sample parameter Estimation, the confidence area of statistic can be obtained according to T distributions Between;It is enough in sample, when can be considered as big-sample data, can be united according to standardized normal distribution The confidential interval of metering.T is distributed the unique spy for not realizing obtaining confidential interval with standardized normal distribution Distribution is levied, the attribute of the performance test parameter that specific test scene is obtained can be judged by experimental data Feature come determine select which kind of distribution characteristics.
In the S102 stages, the confidential interval for calculating needs to judge whether to meet to impose a condition, pre-conditioned Can be set according to the default fluctuating range of performance test parameter, fluctuating range may be referred to test institute in the past The empirical value of acquisition.Inhomogeneity can be set according to the different demands of tester as the parameter of fluctuating range Type, such as, in some occasions, default fluctuating range can be acceptable stability bandwidth;In other occasions, Default fluctuating range can be the scope of acceptable confidential interval.As needed, can be by one of which The parameter of default fluctuating range stops imposing a condition for test to set, it is also possible to by the pre- of two or more If the parameter of fluctuating range is used as imposing a condition.
As an example, if it is desired to reduce testing cost, only carry out a small amount of test, then can be in sample User is desirably less than into certain stability bandwidth in this test to be set to impose a condition;Or, in large sample test In, user is wished that confidential interval is set to impose a condition less than certain scope.
Stability bandwidth can be obtained by delt/ sample means.
Wherein, delt=S*t (n-1)/sqrt (n)
N represents testing time in formula, and t (n-1) can be distributed critical table acquisition by inquiring about t, and S is sample Standard deviation, sqrt (n) represents the square root of n.
The computational methods of confidential interval can refer to prior art.
For example, can be using the stability bandwidth less than 3% as imposing a condition, by taking 95% confidence level as an example, such as The stability bandwidth that fruit calculates is not in the range of the stability bandwidth of setting, then it is assumed that does not meet and imposes a condition, under continuation One wheel test, until stability bandwidth is fallen into the range of the stability bandwidth of this setting.If again for example, by confidence area Between scope less than 20ms as imposing a condition, by taking 95% confidence level as an example, if the confidential interval for calculating Not in the fiducial interval range of setting, then it is assumed that do not meet and impose a condition, continue next round test, directly To in the fiducial interval range for falling into this setting for calculating.
Below by taking 7 performance test parameters of the acquisition of test as an example, confidential interval and stability bandwidth are illustrated Acquisition process:
The performance test parameter of 7 test collections is as shown in table 2 below:
Table 2
According to above test result, due to belonging to small sample, therefore fluctuated come statistical computation using T distributions Rate, it is assumed that the stability bandwidth that the condition of user's setting is less than 3% stops test.Table 3 can be gone out with statistical computation Result:
Table 3
Average 1167.571
t(n-1) 2.446912
sqrt(n) 2.645751
t(n-1)/sqrt(n) 0.92485
S 44.05246
Average is the average value of the performance parameter of each test currently accumulated in table 3;t(n-1) The free degree is represented, n represents testing time, and the value of confidential interval can be that t is distributed critical table in confidence level 95%th, corresponding value when the free degree is 6, the stability bandwidth that data according to table 3 obtain 7 tests is 3.4853%, it is seen that current stability bandwidth will carry out the test of the 8th time more than pre-conditioned.
Fig. 2 is an application example of the application, and this application example is that the test scene that dialing is exited is entered The result of row performance test, performance test parameter is the response time that dialing is exited.
S201, user sets confidence level and stops the default bar of test before test assignment is initiated, first Part, in this example, 95% is set to by confidence level, stops the pre-conditioned for testing time is less than 30 of test Stability bandwidth is less than 3% when secondary;Confidential interval is less than 16.5ms when testing time is more than or equal to 30 times.When The test script that dialing is exited is triggered after execution, and the test script is performed (S202).Using at a high speed Camera preserves into many pieces of picture (S203) with the frame rate collecting test data of 120fps.
After stopping collection, the picture to being preserved is analyzed, and the analysis on change according to image goes out to work as Before acquire 7 times test response times (S204), in this example in view of test result referring to property, Test result only to testing time more than 5 times is analyzed, therefore will test setting be first circulation 7 Secondary execution test script.
After having tested every time, the confidential interval of confidence level 95% is calculated for the statistical value currently accumulated, When testing time is less than 30 times, critical table is distributed by t and draws confidential interval (S205, S206), S208, stability bandwidth is calculated according to confidential interval, judges whether stability bandwidth meets predetermined condition, if ripple Dynamic rate does not simultaneously fall within the stability bandwidth scope of setting, then return to S202 and proceed next round test.
After testing time reaches 30 times if confidential interval still not up to setting waving interval, then from Start for 30th time to calculate confidential interval (S207) according to standardized normal distribution.Fig. 3 a are that testing time is small The confidential interval obtained according to T distributions after being tested every time when 30 times and corresponding stability bandwidth;Can see The stability bandwidth that the testing time gone out within 30 times is obtained is all higher than 3%.Fig. 3 b be testing time be more than or The confidential interval obtained according to standardized normal distribution during equal to 30 times.As can be seen that when testing time reaches At 50 times, confidential interval falls into default width of confidence interval, that is, can meet user to precision It is required that, therefore can now stop test.
Embodiment with the method that aforementioned properties are tested is corresponding, present invention also provides the dress of performance test The embodiment put.
The embodiment of the device of the application performance test can be applied in test equipment.Device embodiment can Realized with by software, it is also possible to realized by way of hardware or software and hardware combining.It is implemented in software As a example by, used as the device on a logical meaning, being will be non-volatile by the processor of test where it Corresponding computer program instructions run what is formed in reading internal memory in memory.From for hardware view, As shown in figure 4, a kind of hardware structure diagram of the device place test equipment for the application performance test, removes Outside processor, internal memory, network interface and nonvolatile memory shown in Fig. 4, embodiment Test equipment where middle device can also include that other are hard generally according to the actual functional capability of the test equipment Part, such as high-speed camera are first-class, and this is repeated no more.
Refer to Fig. 5, the device 500 of performance test, including:
Computing module 501, carries out parameter Estimation, and estimated for the statistic to performance test parameter Evaluation;
Whether judge module 502, the estimate for judging to obtain meets pre-conditioned;And according to judgement Result determines whether to be tested next time, the pre-conditioned default fluctuation according to performance test parameter Amplitude set.
As an example, the statistic of performance test parameter can be the performance survey of each test of current accumulation The average of parameter is tried, the parameter Estimation can be Estimating Confidence Interval, and estimate can be confidential interval.
Computing module 501 can obtain the confidential interval of statistic according to predetermined confidence level.
Computing module 501 can contrast testing time and preset times, it is determined whether by the statistics The T distributions of amount or standardized normal distribution calculate the confidential interval of the statistic, and pre-determined number is used to distinguish The performance test parameter belongs to small sample or large sample.
When computing module 501 can work as testing time less than preset times, T points of the statistic is calculated The confidential interval of cloth;Or
When testing time is not less than preset times, the confidential interval of the standardized normal distribution of Counting statistics amount, Pre-determined number belongs to small sample or large sample for distinguishing the performance test parameter.
Performance test parameter can include response time of the test scene in once testing.
As an example, memory module (not shown) can also be included, for preserving picture format The gathered data of the test scene;
Computing module 501 can determine the test scene one according to the Changing Pattern of the picture for being preserved Response time in secondary test.
Computing module 501 can also search the predetermined keyword of the gathered data of test scene;According to predetermined Keyword determines response time of the test scene in once testing.
In addition, computing module 501 can be also used for obtaining the performance test ginseng according to the confidential interval Several stability bandwidths.
The default fluctuating range of performance test parameter can be the default stability bandwidth of performance test parameter, and/ Or the default width of confidence interval of the performance test parameter;Estimate can be confidential interval or stability bandwidth.
The function of unit and the implementation process of effect specifically refer to right in the above method in said apparatus The implementation process of step is answered, be will not be repeated here.
For device embodiment, because it corresponds essentially to embodiment of the method, so related part ginseng See the part explanation of embodiment of the method.Device embodiment described above be only it is schematical, It is wherein described as separating component illustrate unit can be or may not be it is physically separate, make For the part that unit shows can be or may not be physical location, you can with positioned at a place, Or can also be distributed on multiple NEs.Can select according to the actual needs part therein or Person whole modules realize the purpose of application scheme.Those of ordinary skill in the art are not paying creativeness In the case of work, you can to understand and implement.
The preferred embodiment of the application is the foregoing is only, is not used to limit the application, it is all at this Within the spirit and principle of application, any modification, equivalent substitution and improvements done etc. should be included in Within the scope of the application protection.

Claims (20)

1. a kind of method of performance test, it is characterised in that the method comprising the steps of:
Statistic to performance test parameter carries out parameter Estimation, and obtains estimate;
Judge whether the estimate for obtaining meets pre-conditioned, and determined whether to carry out down according to judged result Once test, it is described pre-conditioned according to the setting of the default fluctuating range of performance test parameter.
2. method according to claim 1, it is characterised in that
The statistic of the performance test parameter is the performance test parameter of each test of current accumulation Average, the parameter Estimation is Estimating Confidence Interval.
3. method according to claim 2, it is characterised in that obtaining estimate includes:
The confidential interval of the statistic is obtained according to predetermined confidence level.
4. method according to claim 3, it is characterised in that methods described also includes:
Testing time and preset times are contrasted, it is determined whether be distributed or standard by the T of the statistic Normal distribution calculates the confidential interval of the statistic, and the pre-determined number is used to distinguish the performance test Parameter belongs to small sample or large sample.
5. method according to claim 3, it is characterised in that:Methods described also includes:
When testing time is less than preset times, the confidential interval of the T distributions of the statistic is calculated;Or
When testing time is not less than preset times, the confidence of the standardized normal distribution of the statistic is calculated Interval, the pre-determined number belongs to small sample or large sample for distinguishing the performance test parameter.
6. method according to claim 1, it is characterised in that the performance test parameter includes Response time of the test scene in once testing.
7. method according to claim 6, it is characterised in that obtain the mistake of the response time Journey includes:
The gathered data of the test scene is preserved into picture;
Changing Pattern according to the picture for being preserved determines response of the test scene in once testing Duration.
8. method according to claim 6, it is characterised in that obtain the mistake of the response time Journey includes:
Search the predetermined keyword of the gathered data of the test scene;
Response time of the test scene in once testing is determined according to the predetermined keyword.
9. method according to claim 2, it is characterised in that methods described also includes:
The stability bandwidth of the performance test parameter is obtained according to the confidential interval.
10. the method according to claim 1, it is characterised in that the performance test parameter it is pre- If fluctuating range is the default stability bandwidth of the performance test parameter, and/or the performance test parameter is pre- If width of confidence interval;The estimate is confidential interval or stability bandwidth.
A kind of 11. devices of performance test, it is characterised in that including:
Computing module, carries out parameter Estimation, and obtain estimate for the statistic to performance test parameter;
Whether judge module, the estimate for judging to obtain meets pre-conditioned;And according to judged result Determine whether to be tested next time, the pre-conditioned default fluctuating range according to performance test parameter Setting.
12. devices according to claim 11, it is characterised in that
The statistic of the performance test parameter is the performance test parameter of each test of current accumulation Average, the parameter Estimation is Estimating Confidence Interval.
13. devices according to claim 12, it is characterised in that obtaining estimate includes:
The confidential interval of the statistic is obtained according to predetermined confidence level.
14. devices according to claim 13, it is characterised in that the computing module will be tested Number of times is contrasted with preset times, it is determined whether be distributed or standardized normal distribution meter by the T of the statistic The confidential interval of the statistic is calculated, the pre-determined number belongs to small for distinguishing the performance test parameter Sample or large sample.
15. devices according to claim 13, it is characterised in that:The computing module is when test When number of times is less than preset times, the confidential interval of the T distributions of the statistic is calculated;Or
When testing time is not less than preset times, the confidence of the standardized normal distribution of the statistic is calculated Interval, the pre-determined number belongs to small sample or large sample for distinguishing the performance test parameter.
16. devices according to claim 11, it is characterised in that the performance test parameter bag Include response time of the test scene in once testing.
17. devices according to claim 16, it is characterised in that also including memory module, use In the gathered data of the test scene for preserving picture format;
The computing module determines the test scene once according to the Changing Pattern of the picture for being preserved Response time in test.
18. devices according to claim 16, it is characterised in that the computing module searches institute State the predetermined keyword of the gathered data of test scene;The checkout area is determined according to the predetermined keyword Response time of the scape in once testing.
19. devices according to claim 12, it is characterised in that the computing module is additionally operable to The stability bandwidth of the performance test parameter is obtained according to the confidential interval.
20. devices according to claim 11, it is characterised in that the performance test parameter Default fluctuating range is the default stability bandwidth of the performance test parameter, and/or the performance test parameter Default width of confidence interval;The estimate is confidential interval or stability bandwidth.
CN201510982401.6A 2015-12-23 2015-12-23 The method and device of performance test Pending CN106908258A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510982401.6A CN106908258A (en) 2015-12-23 2015-12-23 The method and device of performance test

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510982401.6A CN106908258A (en) 2015-12-23 2015-12-23 The method and device of performance test

Publications (1)

Publication Number Publication Date
CN106908258A true CN106908258A (en) 2017-06-30

Family

ID=59206051

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510982401.6A Pending CN106908258A (en) 2015-12-23 2015-12-23 The method and device of performance test

Country Status (1)

Country Link
CN (1) CN106908258A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109473121A (en) * 2018-12-05 2019-03-15 苏州思必驰信息科技有限公司 Speech synthesis quality testing method and device
CN109783334A (en) * 2018-12-14 2019-05-21 平安普惠企业管理有限公司 Pressure test report-generating method, device, computer equipment and storage medium
CN110765414A (en) * 2019-09-11 2020-02-07 深信服科技股份有限公司 Performance index data evaluation method, device, equipment and storage medium
CN110765182A (en) * 2019-10-29 2020-02-07 北京达佳互联信息技术有限公司 Data statistical method and device, electronic equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005338049A (en) * 2004-04-26 2005-12-08 Mitsubishi Heavy Ind Ltd Plant instrumentation control unit and method
CN101267362A (en) * 2008-05-16 2008-09-17 亿阳信通股份有限公司 A dynamic determination method and device for normal fluctuation range of performance index value
CN102194134A (en) * 2010-03-01 2011-09-21 中国科学院自动化研究所 Biological feature recognition performance index prediction method based on statistical learning
CN102518206A (en) * 2011-11-15 2012-06-27 东南大学 Probabilistic forecasting method for performance of shock isolation rubber support
CN103838945A (en) * 2012-11-23 2014-06-04 北京圣涛平试验工程技术研究院有限责任公司 Method for determining radiation resisting performance index of radiation-sensitive device
CN103853743A (en) * 2012-11-29 2014-06-11 百度在线网络技术(北京)有限公司 Distributed system and log query method thereof
CN104123221A (en) * 2013-04-28 2014-10-29 腾讯科技(深圳)有限公司 Response time test method and device
CN104331477A (en) * 2014-11-04 2015-02-04 哈尔滨工业大学 Method for testing concurrency property of cloud platform based on federated research

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005338049A (en) * 2004-04-26 2005-12-08 Mitsubishi Heavy Ind Ltd Plant instrumentation control unit and method
CN101267362A (en) * 2008-05-16 2008-09-17 亿阳信通股份有限公司 A dynamic determination method and device for normal fluctuation range of performance index value
CN102194134A (en) * 2010-03-01 2011-09-21 中国科学院自动化研究所 Biological feature recognition performance index prediction method based on statistical learning
CN102518206A (en) * 2011-11-15 2012-06-27 东南大学 Probabilistic forecasting method for performance of shock isolation rubber support
CN103838945A (en) * 2012-11-23 2014-06-04 北京圣涛平试验工程技术研究院有限责任公司 Method for determining radiation resisting performance index of radiation-sensitive device
CN103853743A (en) * 2012-11-29 2014-06-11 百度在线网络技术(北京)有限公司 Distributed system and log query method thereof
CN104123221A (en) * 2013-04-28 2014-10-29 腾讯科技(深圳)有限公司 Response time test method and device
CN104331477A (en) * 2014-11-04 2015-02-04 哈尔滨工业大学 Method for testing concurrency property of cloud platform based on federated research

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109473121A (en) * 2018-12-05 2019-03-15 苏州思必驰信息科技有限公司 Speech synthesis quality testing method and device
CN109473121B (en) * 2018-12-05 2021-06-01 思必驰科技股份有限公司 Speech synthesis quality testing method and device
CN109783334A (en) * 2018-12-14 2019-05-21 平安普惠企业管理有限公司 Pressure test report-generating method, device, computer equipment and storage medium
CN110765414A (en) * 2019-09-11 2020-02-07 深信服科技股份有限公司 Performance index data evaluation method, device, equipment and storage medium
CN110765414B (en) * 2019-09-11 2023-12-29 深信服科技股份有限公司 Performance index data evaluation methods, devices, equipment and storage media
CN110765182A (en) * 2019-10-29 2020-02-07 北京达佳互联信息技术有限公司 Data statistical method and device, electronic equipment and storage medium
CN110765182B (en) * 2019-10-29 2022-07-01 北京达佳互联信息技术有限公司 Data statistical method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US10243967B2 (en) Method, apparatus and system for detecting fraudulant software promotion
CN110288599B (en) Dead pixel detection method and device, electronic equipment and storage medium
CN109447186A (en) Clustering method and Related product
CN109726364A (en) Electricity consumption method for detecting abnormality, device, terminal and computer readable storage medium
CN106908258A (en) The method and device of performance test
CN104202220B (en) Method for testing pressure and device
US20200012849A1 (en) Pedestrian Retrieval Method and Apparatus
CN110601900A (en) Network fault early warning method and device
CN105702595B (en) Wafer yield judgment method and multivariate inspection method for wafer qualification test
CN114064445B (en) Test method, test device, test equipment and computer-readable storage medium
CN110555349B (en) Working time length statistics method and device
CN109684302A (en) Data predication method, device, equipment and computer readable storage medium
US10104428B2 (en) Video playing detection method and apparatus
CN105990170A (en) Wafer yield analysis method and device
CN107808100B (en) Steganalysis method for specific test sample
CN109495291B (en) Calling abnormity positioning method and device and server
CN110415044A (en) Cheat detection method, device, equipment and storage medium
CN105354721B (en) Method and device for identifying machine operation behavior
CN112581444A (en) Anomaly detection method, device and equipment
CN118503889A (en) Financial risk prevention and control large model data processing method and electronic equipment
US7064826B2 (en) Digital optical measurement of particle populations using reduced magnification
CN109800146B (en) Application program start time testing method and device, computer equipment and storage medium
CN113194474B (en) Method, device, electronic device and readable storage medium for positioning pseudo base station
CN109145987A (en) model generating method and device
Yan et al. Video quality assessment via gradient magnitude similarity deviation of spatial and spatiotemporal slices

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170630