CN109818778A - A kind of automatic regression test method, system, equipment and medium - Google Patents
A kind of automatic regression test method, system, equipment and medium Download PDFInfo
- Publication number
- CN109818778A CN109818778A CN201811569145.8A CN201811569145A CN109818778A CN 109818778 A CN109818778 A CN 109818778A CN 201811569145 A CN201811569145 A CN 201811569145A CN 109818778 A CN109818778 A CN 109818778A
- Authority
- CN
- China
- Prior art keywords
- operation data
- information
- data record
- regression test
- version module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010998 test method Methods 0.000 title claims abstract description 24
- 238000012360 testing method Methods 0.000 claims abstract description 61
- 238000000034 method Methods 0.000 claims abstract description 16
- 230000005540 biological transmission Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 7
- 230000006399 behavior Effects 0.000 claims description 2
- 238000004422 calculation algorithm Methods 0.000 claims description 2
- 230000002123 temporal effect Effects 0.000 claims description 2
- 241001269238 Data Species 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000005291 magnetic effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005611 electricity Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000011017 operating method Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000000275 quality assurance Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention provides a kind of automatic regression test method, for carrying out regression test to the new version module in the network equipment, method includes: S1, for the network equipment with early version module with the network equipments configuration of new version module identical operation information；S2 acquires the second operation data record of the network equipment of the first operation data record and new version module with the network equipment of early version module；S3 compares the second operation data record and records with the first operation data, obtains comparison result, the new version module is not over regression test if comparison result is not in preset threshold, if comparison result new version module in preset threshold passes through regression test.On the other hand a kind of automatic regression test system, equipment and medium are provided.By comparing the operation data of new version module and the operation data of early version module, judge automatically to obtain test result, whole process is not necessarily to human intervention high degree of automation.
Description
Technical field
The present invention relates to testing field more particularly to a kind of automatic regression test method, system, equipment and media.
Background technique
With science and technology high speed development, various network equipment functions and complexity are continuously increased, and are carried out in the network equipment
In the activity of " quality assurance ", the workload that tester faces regression test execution is huge.In general, tester will do it certainly
Dynamicization test script is write, and regression test is carried out, to solve problems.But as the various configurations of the network equipment are combined
Diversity and expected results judgement complexity, the writing difficulty of answer is all increased to automatic test script.To each
The anticipated output of automatic test script needs to carry out manual confirmation one by one, needs through test modeling, by expected results and list
Every only operating procedure is bound one by one, and low efficiency either confirms one by one, or primary in test modeling with operating procedure
Property binding, all need manual intervention.Fitness is low, when operative combination complexity, can not be judged by independent certain step final whole
The expected results of body output, in addition, authenticity is low, the true simple mould fitted results conjecture for real business." expected results
The judgement of correctness ", with greater need for carefully confirming one by one, this is the key that automatic test script confidence level.It is promoted " it is expected that knot
The efficiency of the judgement of fruit correctness " is capable of writing and the testing efficiency of significant increase automatic test script.
Summary of the invention
(1) technical problems to be solved
The present invention provides a kind of automatic regression test method, system, equipment and media, at least solution problem above.
(2) technical solution
On the one hand, the present invention provides a kind of automatic regression test methods, for the new version module in the network equipment
Regression test is carried out, method includes: S1, for the network equipments configuration of the network equipment and new version module with early version module
Identical operation information；S2 acquires the first operation data record and new version module with the network equipment of early version module
Second operation data of the network equipment records；S3 compares the second operation data record and records with the first operation data, compared
As a result, the new version module is preset not over regression test if comparison result is less than if comparison result is greater than preset threshold
Then the new version module passes through regression test to threshold value.
Optionally, the first operation data record and the second operation data record include: log information, system status information
And packet information, log information, system status information and packet information are arranged different threshold ranges, it is right respectively
Answer first threshold, second threshold and third threshold value.
Optionally, step S3 is specifically included: being compared the second operation data record and is recorded with the first operation data, is compared
As a result；If log information, system status information and packet information and the first operation data in the second operation data record
In record log information, system status information and packet information comparison result first threshold, second threshold and
In three threshold ranges, then otherwise the new version module is not passed through by regression test.
Optionally, believe in the log compared in log information and the first operation data record in the second operation data record
The time in the log information in log information and the first operation data record before breath in the second operation data of removal record
Information.
Optionally, can by the MBT, stochastic model or ant group algorithm of Behavior-based control traverse realize step S1 in be with
The network equipment of early version module and the identical operation information of the network equipments configuration of new version module.
Optionally, identical operation information includes: to start simultaneously at flow transmission, transmission positioned at consolidated network in step S2
Flow is identical, simultaneously closes off flow transmission.
Optionally, compare the second operation data record with the first operation data record in packet information before include by
The packet information in packet information and the first operation data record in the second operation data record is converted to pcap
Format, if the data packet in the second operation data record is greater than with the identical quantity in the data packet in the first operation data record
The third threshold value packet information passes through test.
On the other hand, the present invention provides a kind of electronic equipment, the equipment includes: processor；Memory is stored with
Computer executable program, the program is when being executed by processor, so that processor executes above-mentioned automatic regression test method.
Another aspect, the present invention provides a kind of automatic regression test systems, comprising: configuration module, for for old
The network equipment of Version module and the identical operation information of the network equipments configuration of new version module；Acquisition module, for acquiring tool
There is the second operation data of the first operation data record of the network equipment of early version module and the network equipment of new version module
Record；Judgment module records with the first operation data for comparing the second operation data record, obtains comparison result, if
The comparison result of second operation data record not in preset threshold then the new version module not over regression test, if second
Operation data record then the new version module passes through regression test in preset threshold.
Another aspect, the present invention provides a kind of computer readable storage mediums, are stored thereon with computer program, the journey
Sequence is executed by processor above-mentioned automatic regression test method.
(3) beneficial effect
A kind of automatic regression test method, system, equipment and medium are provided through the invention, by being automated as having
The network equipment of new version module operation information identical with the network equipments configuration with early version module, with early version
The network equipment of module is reference, different threshold ranges is arranged for different operation result information, when with new version mould
The operation data of the network equipment of block is compared with threshold range automatically after generating, and is judged automatically to obtain test result, whole
A process is not necessarily to human intervention high degree of automation.
Detailed description of the invention
Fig. 1 diagrammatically illustrates the automatic regression test method and step figure of the embodiment of the present disclosure；
The network that Fig. 2 diagrammatically illustrates in the automatic regression test method of the embodiment of the present disclosure with new version module is set
Standby and the network equipment with early version module the network arrangement figure；
Fig. 3 diagrammatically illustrates the automatic regression test method flow diagram of the embodiment of the present disclosure；
The net of the network equipment when automatic regression test method threshold value that Fig. 4 diagrammatically illustrates the embodiment of the present disclosure determines
Network layout drawing；
Method flow diagram when the automatic regression test method threshold value that Fig. 5 diagrammatically illustrates the embodiment of the present disclosure determines；
Fig. 6 diagrammatically illustrates the electronic device block diagram of the embodiment of the present disclosure；
Fig. 7 diagrammatically illustrates the automatic regression test system block diagram of the embodiment of the present disclosure.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with specific embodiment, and reference
Attached drawing, the present invention is described in more detail.
The present invention provides a kind of automatic regression test methods, referring to Fig. 1, for the new version module in the network equipment
Regression test is carried out, method includes: S1, for the network equipments configuration of the network equipment and new version module with early version module
Identical operation information；S2 acquires the first operation data record and new version module with the network equipment of early version module
Second operation data of the network equipment records；S3 compares the second operation data record and records with the first operation data, compared
As a result, the new version module is not over regression test if comparison result is greater than preset threshold, if comparison result is less than in advance
If then the new version module passes through regression test to threshold value.The embodiment of the present invention is illustrated with a test case, which uses
Example can be run in early version module and new version module.Early version module herein is the module with correct executive capability.
Specifically, S1, for the network equipment with early version module with the network equipments configuration of new version module identical fortune
Row information；
Early version module and new version module are respectively configured on the identical network equipment, as shown in Figure 2, wherein test
Execution machine 1 will configure the network equipment and new version for being equipped with early version module for issuing test case simultaneously in a network
The network equipment of module.The network equipment 3 of the network equipment 2 and new version module with early version module is configured at identical
True network is to obtain true flow, and two network equipments in the present embodiment are transparent mode transmission, and two strands completely
Identical flow is respectively connected to the network equipment of the network equipment with early version module and new version module simultaneously, in order not to shadow
Response is used, and flow reproducing unit 4 can be used, will really net Lip river flow and be introduced into two network equipments.
In addition to the network equipment 3 of the above-mentioned network equipment 2 by with early version module and new version module be configured at it is identical
Network and flow outside, above-mentioned operation information further include configure identical turn-on flow rate channel, close traffic channel, turn-on flow rate
The time in channel, time, discharge record and the state recording of closing traffic channel etc..S2 acquires the net with early version module
The second operation data record of the network equipment of the first operation data record and new version module of network equipment；
By step S2, the network equipment with early version module and the network equipment with new version module are transported
Operation data, respectively the first operation data record and the second operation data record are generated after row, terminal 5 acquires in internal network
Above-mentioned operation data record, wherein the first operation data record and the second operation data record are including log information, system shape
State information and packet information can arrange when analyzing operation data record since above-mentioned configuration information is all the same
Influence except configuration parameter to operation result.
S3 compares the second operation data record and records with the first operation data, comparison result obtained, if comparison result is greater than
Then the new version module is not over regression test for preset threshold, and the new version module is logical if comparison result is less than preset threshold
Cross regression test.
By above-mentioned steps S2 it is found that second operation data record includes log information, is with the first operation data record
Status information of uniting and packet information.Different threshold ranges is arranged to different operation data record types, the disclosure is real
Apply in example, for log information be equipped with first threshold, for system status information be equipped with second threshold, packet information is set
Have third threshold value, by compare the second operation data record with the first operation data record, by comparison result respectively with the first threshold
Value, second threshold and third threshold value are compared, if comparison result is in first threshold, second threshold and third threshold range
Interior, then the new version module is by test, and the new version module is not over test if having at least one to be unsatisfactory for.
For the test case in the embodiment of the present disclosure, specifically, the comparison of log information is directed to, before log information compares
Temporal information should be removed, to remove time difference bring error, to log information be compared specially to log information just
Exactness is compared, and the definition of log correctness is successful log item number RN (right numver) and total log item number TLN
The ratio of (total log number), i.e. log correctness=RN/TLN, when the day of the network equipment with new version module
When the correctness of will record is greater than first threshold, then the log information is met the requirements.
For the comparison of system status information, system generally comprises the information such as CPU, memory, therefore for system mode
Comparison includes the ratio equity of the comparison of CPU information, memory information, specifically, CPU correctness=ABS (new version CPU usage-
Early version CPU usage)/new version CPU usage, memory correctness=ABS (new version memory usage-early version memory
Utilization rate)/new version memory usage.CPU and internal storage state include system-level overall condition and each functional module situation, specifically
Demand is according to the specific setting of respective product.Such as can it is fine-grained carry out some subfunction CPU and memory comparison.Cause
This should compare the information such as CPU, the memory in the first operation data record and the second operation data record respectively, if CPU, memory etc.
The correctness of information is all larger than default correctness, then the system mode of the new version module is within the scope of second threshold, otherwise not
In threshold range.
For the comparison of packet information, the data packet of output, the first operation data record and the second fortune are mainly compared
Data packet can be converted into pcap format in row data record, then the correctness of packet information be compared, data packet
The definition of correctness is the number RN (right number) and data packet sum TPN (total packet of identical packet
Number ratio), i.e. data packet correctness=RN/TPN, the second operation data record in data packet correctness with first operation
When the ratio between data packet correctness in data record is greater than third threshold value, then packet information passes through verifying.
According to aforesaid way can compare the first operation data record and the second operation data record in much information it is correct
Degree, when the correctness of all kinds information in the second operation data record, which is all satisfied, to be required, then new version module passes through test,
Otherwise test is not passed through.
The test of a variety of test cases is carried out, according to aforesaid way to carry out objective judgement to new version module.
In summary, the flow chart in the embodiment of the present invention for the network with new version module as shown in figure 3, by setting
The standby and network equipment with early version module matches identical test case, while open and close flow, it is taken to allow to count
According to record, operation data record is compared, tests and passes through if in threshold range, can directly exit test or carries out next survey
The test of example on probation, the test crash if not in threshold range are needed at this time by flow bag data, configuration information and operation
The filings such as data storage is recorded in case with reference to using.
It is referred to history reasonable value and determines first threshold, second threshold or third threshold value, specific method such as Fig. 4 and Fig. 5
It is shown, using the network equipment online test simultaneously of two early version modules, judge based on experience value, general common automation is used
0.1%, therefore first, the first step turns down 0.1% reference input as threshold value higher than 0.1% to example correctness rate of false alarm
Threshold value increases threshold value lower than 0.1%, in this way available first threshold, second threshold or third threshold value.It is testing
Other threshold values can be tuned into 0 when a certain threshold value, default does not report an error, and successively solves the threshold value of each correctness.Such as it solves
When CPU correctness threshold value, memory, log information, packet information correctness parameter can be set to 0, it is correct first to seek CPU
The threshold baseline of degree.
In conclusion being set by the network equipment for being automated as that there is new version module and the network with early version module
It is standby to configure identical operation information, to be reference with the network equipment of early version module, for different operation result information
Different threshold ranges is set, when the network equipment with new version module operation data generate after automatically and threshold range into
Row compares, and judges automatically to obtain test result, whole process is not necessarily to human intervention high degree of automation, greatly promotes automation
Script writing and debugging efficiency.；System mode compares more comprehensive, and from configuration, log, state, network packet variation done
It compares in all directions；Has stronger authenticity, based on really existing online test.
On the other hand, the present invention also provides a kind of electronic equipment, are the electronic equipment frame of the embodiment of the present invention referring to Fig. 6
Figure, electronic equipment 600 includes: processor 601 and memory 602, which can execute according to embodiments of the present invention
Method.
Specifically, processor 601 for example may include general purpose microprocessor, instruction set processor and/or related chip group
And/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..Processor 601 can also include using for caching
The onboard storage device on way.Processor 601 can be for executing the different movements of process according to the method for the embodiment of the present invention
Single treatment unit either multiple processing units.
Memory 602, such as can be the arbitrary medium can include, store, transmitting, propagating or transmitting instruction.For example,
Readable storage medium storing program for executing can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device or propagate Jie
Matter.The specific example of readable storage medium storing program for executing includes: magnetic memory apparatus, such as tape or hard disk (HDD)；Light storage device, such as CD
(CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication link.
Memory 602 may include computer program 6021, which may include code/computer can
It executes instruction, processor 601 is made to execute the method flow of the embodiment of the present invention above for example when being executed by processor 601
And its any deformation.
Computer program 6021 can be configured to have the computer program code for example including computer program module.Example
Such as, in the exemplary embodiment, the code in computer program 6021 may include one or more program modules, for example including
6021A, module 6021B ....It should be noted that the division mode and number of module are not fixed, those skilled in the art
It can be combined according to the actual situation using suitable program module or program module, when these program modules are combined by processor
When 601 execution, processor 601 is executed for example above in conjunction with the method flow of the embodiment of the present invention and its any change
Shape.
Another aspect, the embodiment of the invention provides a kind of automatic regression test systems, and referring to Fig. 7, system 700 includes:
Configuration module 701, acquisition module 702 and judgment module 703.
Specifically, configuration module 701, for being set for the network of the network equipment and new version module with early version module
It is standby to configure identical operation information；Acquisition module 702, for acquiring the first operation data of the network equipment with early version module
Second operation data of record and the network equipment of new version module record；Judgment module 703, for comparing the second operation data
Record is recorded with the first operation data, obtains comparison result, this is new if the second operation data record is not in preset threshold
Version module is not over regression test, and the new version module passes through back if the second operation data record is in preset threshold
Return test.
It is module according to an embodiment of the present application, submodule, unit, any number of or in which any more in subelement
A at least partly function can be realized in a module.It is single according to the module of the embodiment of the present application, submodule, unit, son
Any one or more in member can be split into multiple modules to realize.
Present invention also provides a kind of computer-readable medium, which, which can be in above-described embodiment, is retouched
Included in the equipment/device/system stated；It is also possible to individualism, and without in the supplying equipment/device/system.On
It states computer-readable medium and carries one or more program, when said one or multiple programs are performed, realize root
According to the method for the embodiment of the present application.
According to an embodiment of the present application, computer-readable medium can be computer-readable signal media or computer can
Read storage medium either the two any combination.Computer readable storage medium for example can be --- but it is unlimited
In system, device or the device of --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or any above combination.It calculates
The more specific example of machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, portable of one or more conducting wires
Formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable programmable read only memory
(EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device or
The above-mentioned any appropriate combination of person.In this application, computer readable storage medium can be it is any include or storage program
Tangible medium, which can be commanded execution system, device or device use or in connection.And in this Shen
Please in, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
In carry computer-readable program code.The data-signal of this propagation can take various forms, including but not limited to
Electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable
Any computer-readable medium other than storage medium, the computer-readable medium can send, propagate or transmit for by
Instruction execution system, device or device use or program in connection.The journey for including on computer-readable medium
Sequence code can transmit with any suitable medium, including but not limited to: wireless, wired, optical cable, radiofrequency signal etc., or
Above-mentioned any appropriate combination.
It will be understood by those skilled in the art that the feature recorded in each embodiment and/or claim of the application can
To carry out multiple combinations or/or combination, even if such combination or combination are not expressly recited in the application.Particularly, exist
In the case where not departing from the application spirit or teaching, the feature recorded in each embodiment and/or claim of the application can
To carry out multiple combinations and/or combination.All these combinations and/or combination each fall within scope of the present application.
Although the application, art technology has shown and described referring to the certain exemplary embodiments of the application
Personnel it should be understood that in the case where the spirit and scope limited without departing substantially from the following claims and their equivalents,
A variety of changes in form and details can be carried out to the application.Therefore, scope of the present application should not necessarily be limited by above-described embodiment,
But should be not only determined by appended claims, also it is defined by the equivalent of appended claims.
Claims (10)
1. a kind of automatic regression test method, for carrying out regression test to the new version module in the network equipment, method includes:
S1, for the network equipment with early version module with the network equipments configuration of new version module identical operation information；
S2, the first operation data record of the acquisition network equipment with early version module and the network of new version module are set
Standby the second operation data record；
S3 compares the second operation data record and records with the first operation data, comparison result obtained, if the comparison result
Not in preset threshold, then the new version module is not over regression test, this is new if the comparison result is in preset threshold
Version module passes through regression test.
2. automatic regression test method according to claim 1, which is characterized in that first operation data record and the
Two operation datas record includes: log information, system status information and packet information, to the log information, system
Different threshold ranges is arranged in status information and packet information, respectively corresponds first threshold, second threshold and third threshold value.
3. automatic regression test method according to claim 2, which is characterized in that step S3 is specifically included:
It compares the second operation data record to record with the first operation data, obtains comparison result；
If log information, system status information and packet information and first fortune in the second operation data record
In row data record log information, system status information and packet information comparison result first threshold, the second threshold
In value and third threshold range, then otherwise the new version module is not passed through by regression test.
4. automatic regression test method according to claim 3, which is characterized in that comparing the second operation data note
It is removed in the second operation data record before the log information in log information and the first operation data record in record
The temporal information in log information in log information and the first operation data record.
5. automatic regression test method according to claim 1, which is characterized in that can be by the MBT of Behavior-based control, random
Model or ant group algorithm traversal realize in step S1 to be the network equipment and new version module with early version module
The identical operation information of network equipments configuration.
6. automatic regression test method according to claim 1, which is characterized in that identical operation information packet in step S2
It includes: being located at consolidated network, start simultaneously at flow transmission, transmission flow is identical, simultaneously closes off flow transmission.
7. automatic regression test method according to claim 3, which is characterized in that compare the second operation data record
It before include by the data packet in second operation data record with the packet information in the first operation data record
Packet information in information and first operation data record is converted to pcap format, if second operation data records
In data packet and the first operation data record in data packet in identical quantity be greater than the third threshold value packet information lead to
Cross test.
8. a kind of electronic equipment, which is characterized in that the equipment includes:
Processor；
Memory is stored with computer executable program, and the program by the processor when being executed, so that the processor
Execute the automatic regression test method as described in any one of claim 1-7.
9. a kind of automatic regression test system characterized by comprising
Configuration module, for for the identical operation with the network equipments configuration of new version module of the network equipment with early version module
Information；
Acquisition module, for acquiring the first operation data record and new version mould of the network equipment with early version module
Second operation data of the network equipment of block records；
Judgment module records with the first operation data for comparing the second operation data record, comparison result is obtained, if institute
Stating the comparison result that the second operation data records, then the new version module is not over regression test not in preset threshold, if institute
It states the second operation data and is recorded in preset threshold the then new version module and pass through regression test.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The automatic regression test method as described in any one of claim 1-7 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811569145.8A CN109818778A (en) | 2018-12-21 | 2018-12-21 | A kind of automatic regression test method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811569145.8A CN109818778A (en) | 2018-12-21 | 2018-12-21 | A kind of automatic regression test method, system, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109818778A true CN109818778A (en) | 2019-05-28 |
Family
ID=66601857
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811569145.8A Pending CN109818778A (en) | 2018-12-21 | 2018-12-21 | A kind of automatic regression test method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109818778A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110928786A (en) * | 2019-11-20 | 2020-03-27 | 中国工商银行股份有限公司 | Testing method and device for financial program |
| CN111475405A (en) * | 2020-03-27 | 2020-07-31 | 深圳壹账通智能科技有限公司 | Method, apparatus, computer equipment and storage medium for regression testing |
| CN112965910A (en) * | 2021-03-19 | 2021-06-15 | 携程旅游信息技术（上海）有限公司 | Automatic regression testing method and device, electronic equipment and storage medium |
| CN115098122A (en) * | 2022-06-30 | 2022-09-23 | 际络科技(上海)有限公司 | Algorithm version iteration auxiliary method and device |
| US20230222050A1 (en) * | 2020-07-03 | 2023-07-13 | Hitachi Astemo, Ltd. | Vehicle control device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140325498A1 (en) * | 2013-04-24 | 2014-10-30 | Nintendo Co, Ltd. | Selective operating system patching/updating |
| CN106326108A (en) * | 2016-08-09 | 2017-01-11 | 北京金山安全软件有限公司 | New application testing method and device |
| CN106557414A (en) * | 2015-09-28 | 2017-04-05 | 富士通株式会社 | Application testing system and method |
| CN108829581A (en) * | 2018-05-22 | 2018-11-16 | 平安科技（深圳）有限公司 | Applied program testing method, device, computer equipment and storage medium |
-
2018
- 2018-12-21 CN CN201811569145.8A patent/CN109818778A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140325498A1 (en) * | 2013-04-24 | 2014-10-30 | Nintendo Co, Ltd. | Selective operating system patching/updating |
| CN106557414A (en) * | 2015-09-28 | 2017-04-05 | 富士通株式会社 | Application testing system and method |
| CN106326108A (en) * | 2016-08-09 | 2017-01-11 | 北京金山安全软件有限公司 | New application testing method and device |
| CN108829581A (en) * | 2018-05-22 | 2018-11-16 | 平安科技（深圳）有限公司 | Applied program testing method, device, computer equipment and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110928786A (en) * | 2019-11-20 | 2020-03-27 | 中国工商银行股份有限公司 | Testing method and device for financial program |
| CN110928786B (en) * | 2019-11-20 | 2024-04-02 | 中国工商银行股份有限公司 | Testing method and device for financial program |
| CN111475405A (en) * | 2020-03-27 | 2020-07-31 | 深圳壹账通智能科技有限公司 | Method, apparatus, computer equipment and storage medium for regression testing |
| US20230222050A1 (en) * | 2020-07-03 | 2023-07-13 | Hitachi Astemo, Ltd. | Vehicle control device |
| US12536094B2 (en) * | 2020-07-03 | 2026-01-27 | Hitachi Astemo, Ltd. | Vehicle control device |
| CN112965910A (en) * | 2021-03-19 | 2021-06-15 | 携程旅游信息技术（上海）有限公司 | Automatic regression testing method and device, electronic equipment and storage medium |
| CN115098122A (en) * | 2022-06-30 | 2022-09-23 | 际络科技(上海)有限公司 | Algorithm version iteration auxiliary method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109818778A (en) | A kind of automatic regression test method, system, equipment and medium | |
| CN112596972A (en) | Vehicle-mounted equipment testing method, device and system and computer equipment | |
| CN107516510A (en) | A kind of smart machine automated voice method of testing and device | |
| KR102016812B1 (en) | Method of Deriving and Visualizing the Causes of Process Malfunctions Through Machine Learning Model In Data Imbalance Environment | |
| CN106844217A (en) | Control to applying bury method and device, readable storage medium storing program for executing a little | |
| CN109491860A (en) | Method for detecting abnormality, terminal device and the medium of application program | |
| US20230086626A1 (en) | System and method for detection of anomalies in test and measurement results of a device under test (dut) | |
| WO2014085793A1 (en) | Advanced and automatic analysis of recurrent test failures | |
| CN109324959A (en) | A kind of method, server and the computer readable storage medium of automatic transfer data | |
| CN119271558A (en) | A DCS controller application program access control automated testing method and system | |
| US11520620B2 (en) | Electronic device and non-transitory storage medium implementing test path coordination method | |
| CN117858126A (en) | Router Wi-Fi aging test method and device, computer equipment and storage medium | |
| CN115766469B (en) | Network anomaly simulation test method, device, electronic device and storage medium | |
| CN116915583A (en) | Diagnostic method for communication abnormality, device and electronic equipment thereof | |
| CN110490132A (en) | Data processing method and device | |
| CN112799967B (en) | GIT-based test script write-back test case method, system, device and medium | |
| CN116346220B (en) | Optical fiber fault positioning method, system, equipment and medium | |
| CN106874201A (en) | Method of testing and device | |
| CN117856940A (en) | Interference test method, device, computer equipment and storage medium | |
| CN111190777A (en) | Disk I/O performance test method and device | |
| CN113886780B (en) | Client information verification method, device, medium and electronic equipment | |
| CN117931647A (en) | Automatic test method, device, electronic equipment and storage medium | |
| CN109241743A (en) | Method, apparatus, system and the medium of recording processor operation information | |
| CN109002475A (en) | Content outputting method and system, computer system and computer readable storage medium | |
| CN114936121A (en) | Fault simulation method, device, system and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100088 Building 3 332, 102, 28 Xinjiekouwai Street, Xicheng District, Beijing Applicant after: QAX Technology Group Inc. Address before: Beijing Chaoyang District Jiuxianqiao Road 10, building 15, floor 17, layer 1701-26, 3 Applicant before: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190528 |