JP2007011497A - Performance test method and test server - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a highly reliable test result for the entire system.
An operation recording module that controls a client so that an operation procedure inputted while synchronizing between the clients is stored in a time series for each client and an operation data file is created. 32, the playback module 34 that controls the client 4 to play back the operation procedure of the operation data file 36 created by the operation recording module 32, and the performance of the device under test in the period during which the playback module 34 plays back the operation procedure. A performance recording module 22 for controlling the device under test 1A so as to record the data and create the test result data file 38.
[Selection] Figure 2

Description

  The present invention relates to a performance test method and a test server.

  In the conventional large-scale test system test, a limited number of personnel are dispatched to the branch where the test system client is installed and manually tested. In the performance test, a simple key-pressing procedure provided in advance from the viewpoint of the system developer is performed by a method in which the dispatched tester repeats all at once. There, the number of testers was limited, so when testing branches located in various parts of the country, each branch was tested in multiple steps. For this reason, this test method could only implement tests with a uniform operating procedure that ignores the characteristics of production work by branches limited by geographical and time constraints.

  When the performance test was completed using this test method and the system was in production, there were problems that the response time deteriorated and the system went down due to the high load of client and server resources. Because this problem was tested only from clients installed in limited branches when performing performance tests, only partial test results were obtained for the system, Tests that repeat the uniform operation procedure determined by the system developer were conducted, so the characteristics of the production work, such as regional characteristics such as trends in processing contents and processing amount of each branch, and the entire system and each branch This occurred because the test results reflecting the load imbalance on the system due to time characteristics such as the trend of the processing contents and the processing amount transitioning with the time could not be obtained.

As methods for solving such problems, methods using systems as shown in Patent Document 1 and Patent Document 2 have been proposed. In the system of Patent Document 1, geographical and human restrictions are eliminated by operating and monitoring a client from a remote location. In the system of Patent Document 2, an online input message is created from journal files and parameters collected in the past and input from a virtual client, thereby realizing a performance test that reproduces the characteristics of the actual work.
Japanese Patent Laid-Open No. 5-108519 JP-A-5-216706

  The performance test method using the conventional system has the following two problems and cannot provide a highly reliable test result for the entire system.

  The first problem is that even when a performance test is performed by operating the clients all at once using the system and method of Patent Document 1, since uniform test data is used, the trend and processing of processing contents for each branch The locality such as the amount differs is ignored, and in production work, the load on each machine under test varies depending on the region, and the trend of the processing contents and the processing amount of the entire system and each branch transition according to the time If there is a tendency for the time to maximize the amount of processing at the branch to overlap, the performance test does not reflect the increase in the load on the machine under test that communicates with the branch and performs processing. Accidents may occur.

  In order to solve the first problem, when a performance test that is executed simultaneously on all clients using test data that achieves the maximum processing amount on the client is performed, a test in which an excessive load is applied to the system. The result is obtained, and as a result, there is a risk of excessive resource augmentation ignoring the amount and characteristics of the load on the system in the actual business.

  The second problem is that the system and method of Patent Document 2 is a test using a virtual client, and therefore, it is not possible to place a load on a real server under test or a relay server that relays a client and a business server. As a result, it is not possible to detect performance problems caused by clients or relay servers.

  In view of the above, the main object of the present invention is to solve the above-described problems and provide a highly reliable test result for the entire system.

  In order to solve the above-mentioned problems, the present invention provides a test for testing the performance of a test target machine using a test target server and a plurality of clients installed remotely from the test target server. A performance test method using a server, wherein the test server controls the client to create an operation data file in which operation procedures input while synchronizing between the clients are stored in time series for each client. An operation recording step; a reproduction step for controlling the client to reproduce the operation procedure of the operation data file created in the operation recording step; and a period during which the operation procedure is reproduced in the reproduction step. Before recording test machine performance data and creating test result data file And performance recording step of controlling the testing machine, and executes and a test result output step of receiving and outputting the test result data file recorded from the object tester in the performance recording step.

  Thereby, for example, it is possible to realize a test in consideration of regional characteristics and time characteristics in production work, and to detect a performance problem caused by a client or a relay server as a machine under test.

  In the present invention, a highly reliable test result can be provided for the entire system.

  Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a configuration diagram showing an outline of a test system.

  The test server 1 instructs the device under test 1A to execute a performance test by remotely executing a series of online processes in the client 4. The machine under test 1A is a generic term for the client 4 and the server under test 1B. The server under test 1B is a generic term for the business server 2 and the relay server 3. The business server 2 receives a request from the client 4 and performs business processing. The relay server 3 relays communication between the business server 2 and the client 4. The client 4 collects user operations as operation data.

  Each apparatus (the test server 1 and the device under test 1A) in FIG. 1 is configured as a computer including at least a memory serving as a storage unit used when performing arithmetic processing and an arithmetic processing device that performs the arithmetic processing. The memory is composed of a RAM (Random Access Memory) or the like, and stores tables and modules described later. Arithmetic processing is realized by an arithmetic processing unit constituted by a CPU (Central Processing Unit) executing a program (including modules described later) on a memory. In the case of the client 4, an input device such as a mouse and an output device such as a computer display are connected to the client 4.

  FIG. 2 is a block diagram showing the hardware of the test system and the configuration of modules in each hardware. The test system of FIG. 2 is realized by a plurality of modules.

  The test server 1 includes a distribution / collection module 11, a remote control module 12, a time synchronization module 13, a collection result storage module 14, a test result output module 15, a performance test management table 16, and a threshold setting table 17.

  The business server 2 includes a remote control module 21, a performance recording module 22, and a test result data file 23 in addition to a module (not shown) that executes business processing. The relay server 3 includes a remote control module 21, a performance recording module 22, and a test result data file 23 in addition to a module (not shown) that executes communication relay processing.

  The client 4 includes a remote control module 31, an operation recording module 32, an editing module 33, a playback module 34, a performance recording module 35, an operation data file 36, a test data file 37, and a test result data file 38. In FIG. 2, the configuration of one client 4 is described in detail, but the configuration of the other clients 4 is the same. Each module of the machine under test 1A described above is installed online from the test server 1, for example. Hereinafter, each module and each file will be described in detail.

  The distribution / collection module 11 distributes and collects arbitrary files to all the servers under test 1B and all the clients 4. The file to be distributed is, for example, a test data file 37 that realizes a function of remotely controlling the machine under test 1 </ b> A that is distributed before the user's actual work starts. The files to be collected are, for example, test result data and various logs created by the machine under test 1A after the test is completed.

  The remote control module 12 remotely controls all the servers under test 1B and all the clients 4. The time synchronization module 13 synchronizes the time between the test server 1 and the device under test 1A. The collection result storage module 14 stores data from the test result data collected from the machine under test 1 </ b> A in the performance test management table 16.

  The test result output module 15 organizes and outputs the performance test results from the collected results. Arrangement refers to, for example, arranging the performance test results for the entire system and each branch in time series using the data stored in the performance test management table 16, the values stored in the threshold setting table 17, and various logs.

  Further, the test result output module 15 outputs from the performance test management table 16 an output of a matrix representing the correlation between the response time of the arbitrary device under test 1A, the internal processing time, and the resource usage rate, and the arbitrary device under test 1A. Output the resource utilization graph, time-series output of the machine under test 1A in which an error occurred, and output that performs shading on the output result when the performance data threshold (see Fig. 4) is exceeded It may be easy for the user to grasp the test result. As a result, the tester can intuitively grasp the relationship between the load statuses of each of the test machines 1A and the geographical and temporal load trends of the test machine 1A.

  The remote control module 21 remotely controls each module of its own device from the test server 1. The performance recording module 22 monitors and stores the internal processing time and the resource usage rate in its own device, using the file distributed from the test server 1. The test result data file 23 is the usage rate and internal processing time of each resource of the server under test 1B while the test data file 37 is being reproduced.

  The remote control module 31 remotely controls each module of its own device from the test server 1. The operation recording module 32 records an operation data file 36 which will be described later in accordance with a user operation (an input operation using a mouse or the like).

  The editing module 33 edits the operation procedure stored by the operation recording module 32 and creates a test data file 37 from the operation data file 36.

  The reproduction module 34 reproduces and executes the operation procedure edited by the editing module 33. More specifically, the test data file 37 created for each client 4 can be tested on all or a plurality of clients to be arbitrarily controlled by remotely operating the file distributed from the test server 1 during the test. Play all the target clients simultaneously.

  The performance recording module 35 monitors and stores the response time of the test system and the resource usage rate in the client 4 by using a file distributed from the test server 1. For example, the playback module 34 monitors and stores the test data file 37 during playback.

  The operation data file 36 is a file in which the operation procedure of the test system in the user client 4 is recorded as operation data. That is, the operation procedure input by one or more clients 4 to be arbitrarily selected during the actual work is stored in time series while synchronizing with other clients 4. The operation procedure is, for example, mouse movement / click information on a window implemented in the client 4, keyboard keystroke information, and information input by copying and pasting (see FIG. 5).

  The test data file 37 is a file created by editing or copying the operation data file 36. For example, the test data file 37 is obtained by arbitrarily shortening the operation procedure stored in the operation data file 36 while maintaining the overall ratio with respect to the time axis. As a result, it is possible to realize a test in which normal production operations are executed at a fast forward speed and the number of processing cases per unit time is increased, so that an accident due to an increase in the number of processing cases occurs in the machine under test 1A. Can be suppressed. For example, by verifying the resources required to cover the increase in throughput per unit time expected by the next system upgrade due to the increase in the number of users and throughput per year, When the number of processing increases in the system, it is possible to detect in advance the occurrence of an accident due to performance.

  The test result data file 38 stores performance data of the device under test 1A such as the usage rate and online response time of each resource of the client 4 while the test data file 37 is being reproduced.

  FIG. 3 is a configuration diagram showing the performance test management table 16. The performance test management table 16 stores the resource usage rate, internal processing time, and online response time of the device under test 1A. The name of the machine under test 1A is set in advance to identify the machine under test 1A on the test system of FIG. After performing the performance test, the resource usage rate, internal processing time, and online response time recorded in the machine under test 1A are stored using the name of the machine under test 1A as a key.

  FIG. 4 is a configuration diagram showing the threshold setting table 17. The threshold setting table 17 stores thresholds for resource usage rate, internal processing time, and online response time for each machine under test 1A. The name of the machine under test 1A is set in advance to identify the machine under test 1A on the test system of FIG. The internal processing time in the server under test 1B and the name of the online processing in the client 4 are set in advance to identify the processing name. The threshold of the resource usage rate for each online device under test 1A is stored using the name of the device under test 1A as a key. The internal processing time and online response time are stored with the name of the machine under test 1A as a main key and the processing name as a subkey.

  FIG. 5 is a configuration diagram showing the operation data file 36. When the client 4 has a focus on the test system window and the user performs a mouse or keyboard operation, the time when the operation occurs, the name of the window to be focused, and the cursor position are stored, and the mouse to be operated The cursor position, left-click / right-click pressing (on) and releasing (off) operations, the keystroke content of the keyboard, and input information by pasting are recorded.

  FIG. 6 is a configuration diagram showing a performance test result data file in the entire test system. FIG. 6 is a performance test output result for the test operator to confirm the load distribution in the entire system based on the locality and timeliness of the system in the actual work after the performance test is completed. The performance test results in the machine under test 1A for each time as an output unit from the start time to the end time of the performance test are output separately.

  Next, each item of the performance test result (the entire system) will be described. The maximum resource usage rate and average usage rate, maximum internal processing time and average processing time, maximum online response time and average online response time for each machine under test 1A installed at each headquarter and branch are output. If threshold values are set in advance in the threshold setting table 17 for each resource and processing time in the machine under test 1A, the result exceeding the threshold is shaded and output.

  FIG. 7 is a configuration diagram showing a performance test result data file in the branch B. FIG. 7 shows an output result when the test operator selects the branch B as the branch performance test result in the actual work after the performance test. Performance test results in the machine under test 1A are output to the list for each time set as an output unit from the start time to the end time of the performance test.

  Next, each item of the performance test result (branch B) will be described. The maximum resource usage rate, the maximum internal processing time, and the maximum online response time for each output unit time of the performance test in the machine under test 1A are output. If threshold values are set in advance in the threshold management table for each resource and processing time in the machine under test 1A, the result exceeding the threshold value is shaded and output.

  Hereinafter, a series of operations from the preparation of the performance test to the output of the performance test result after completion will be described with reference to a flowchart. In addition, each parameter (time, threshold value, etc.) when explaining a flowchart is an example to the last, and it can implement without being limited to this example. First, as preparation work for this online performance test, the distribution / collection module 11 distributes modules 21, 22 and 31 to 35 to the server under test 1 </ b> B and the client 4. After distribution, the time synchronization module 13 synchronizes the time between the test server 1 and the device under test 1A.

  FIG. 8 is a flowchart showing an operation of creating operation data of the user's client 4 in the actual business.

  During the actual operation, the test operator from the test server 1 designates a specified time for recording operation from the remote control module 12 to the remote control module 31 of the client 4 to be tested (start time: March 28, 2005 9: 00, end time: March 28, 2005 17:00) and an execution command are input from the input / output device (S101).

  The designated time information and the execution command (operation recording start command) are transmitted to the client 4 via the communication network interface provided in the test server 1 and the communication network interface provided in each branch (S102, S103).

  The remote control module 31 of the client 4 that has received the execution time and the designated time (start time: March 28, 2005, 9:00, end time: March 28, 2005, 17:00) for performing operation storage is designated. At the start time (March 28, 2005, 9:00) (S104, YES), the operation recording module 32 is instructed to start operation recording.

  The operation recording module 32 determines, as an operation procedure on the test system in the client 4 of the user, the time when the operation has occurred with the mouse or keyboard operation by the user on the condition that the window of the test system has focus. The main key includes the name of the window to be focused, the cursor position, the position coordinates of the mouse cursor to be operated, the left click / right click press (on) and release (off) actions, the keyboard input code, and the paste input. Information or the like is stored on the memory as operation data (S105).

  When the designated operation recording end time (March 28, 2005, 17:00) comes (S106, YES), the remote control module 31 instructs the operation recording module 32 to stop the recording operation.

  The operation recording module 32 creates an operation data file 36 arranged in chronological order using the operation occurrence time as a key from the operation procedure recorded in the memory until the stop is instructed (S107).

  At the same time, the remote control module 31 transmits an operation record end message to the test server 1 via the communication network interface provided in the branch where the client 4 is installed and the communication network interface provided in the test server 1 (S108).

  The remote control module 12 of the test server 1 receives an operation record end message from all the clients 4 to be tested (S109), and then outputs an operation record end message to the test operator from an input / output device such as a computer ( S110, S111).

  FIG. 9 is a flowchart showing the operation of creating the test data file 37 by editing the user operation data created by the operation of FIG.

  After confirming the operation record end message, the test worker inputs a scale ratio (0.5) and an execution command for editing the operation data file 36 from the input / output device to the test server 1 (S121).

  The scale ratio and execution command (operation recording start command) for editing the operation data file 36 are transmitted to the client 4 via the communication network interface provided in each branch to the communication network interface provided in the test server 1. (S122, S123).

  The remote control module 31 that has received the execution command for performing the editing work instructs the editing module 33 to reduce the scale (0.5) and start editing. The editing module 33 is a main key of the operation data file 36 in order to shorten the operation time based on the scale ratio (0.5) while maintaining the overall ratio of the operation data file 36 with respect to the time axis. The difference (first operation 00:05:00, first operation 9:05:00, second operation 9:06:00) and the time of storage start (9: 00: 00: 00) The value (first operation 00:02:50, second operation 00:03:00) obtained by multiplying the second operation 00:06:00) by the scale factor (0.5) is the operation time (first operation 00:02). : 50, second operation 00:03:00), the editing operation is performed for the time when the operation of all operation recording occurs (S124), and the test data file 37 is created (S125).

  After creating the test data file 37, the editing module 33 sends a reply to the remote control module 31 that the editing operation has been completed, and the remote control module 31 that has received the reply sends a communication network interface provided in the branch where the client 4 is installed, An editing work end message is transmitted to the test server 1 via the communication network interface provided in the server 1 (S126).

  The remote control module 12 of the test server 1 receives the editing work end message from all the clients 4 to be tested (S127), and then outputs the editing work end message from the input / output device to the test worker (S128, S129). ).

  FIG. 10 is a flowchart showing the operation of reproducing the test data file 37 of each client 4 created by the operation of FIG. 9 and recording the resource, internal processing time, and online response time to perform the performance test.

  When the production operation is finished and the performance test is started, the test operator starts the performance test from the test server 1 to the remote control module 21 of the server under test 1B to be tested from the remote control module 12 (April 2005). 8:00) on the 2nd, and an execution command for creating test result data, and a performance test start time (April 2, 2005, 8:00) and a performance test execution command to the remote control module 31 of the client 4 (S131).

  The performance test start time information and test result data creation execution command are transmitted to the server under test 1B via the server under test 1B provided in the test server 1 of the headquarters and the communication network interface, and the communication network interface provided in each branch. (S132 to S135).

  The performance test start time information and the performance test execution command information are transmitted to the client 4 via the communication network interface provided in the test server 1 and the communication network interface provided in each branch (S136).

  The remote control module 21 that has received the performance test start time (April 2, 2005, 8:00) and the test result data creation execution command, at the performance test start time (April 2, 2005, 8:00) (S137 to S139), the performance recording module 22 is instructed to start recording the resource usage rate and the internal processing time.

  Upon receiving the instruction, the performance recording module 22 issues a command for outputting the resource usage rate (CPU, memory, network, RD area) at regular intervals (5 seconds), and stores the output result in the memory as a key. And the operation of recording in the memory using the processing time of the online message in the server under test 1B as the internal processing time and the start time of the internal processing as a key (S141 to S143).

  Further, the remote control module 31 that has received the performance test start time (April 2, 2005 8:00) and the performance test execution command at the performance test start time (April 2, 2005 8:00) (S140, YES), the playback module 34 is instructed to start playback, and the performance recording module 32 is instructed to start recording the resource usage rate and online response time.

  Upon receipt of the instruction, the playback module 34 operates the mouse cursor position on the operation target window and the cursor position at the operation time interval recorded in the test data file 37 at the start time of the performance test. The performance recording module 35 uses the resource usage rate (CPU, memory, network) for right click pressing (on) and releasing (off), input code input by keyboard, and playback by inputting input information by pasting. Is issued at regular intervals (5 seconds), the time when the output result is stored is stored in the memory as a key, and the online response time and online processing start time are recorded in the memory as a key. The work is started (S144).

  FIG. 11 is a flowchart showing an operation of creating test result data related to the test performed by the operation of FIG.

  From the test server 1, the test operator sends a test result data creation end command to the remote control module 21 of the server under test 1 B to be tested from the remote control module 12, and a performance test end command to the remote control module 31 of the client 4. Is input from the input / output device (S145). The test result data creation end command is transmitted to the test server 1B via the test server 1B provided in the test server 1 of the headquarters and the communication network interface, and the communication network interface provided in each branch (S146 to S149). The performance test end command information is transmitted to the client 4 via the communication network interface provided in the test server 1 and the communication network interface provided in each branch (S150).

  Receiving the test result data creation end command (S151 to S153), the remote control module 21 instructs the performance recording module 22 to stop the recording work. Upon receiving the instruction, the performance recording module 22 stops the recording work, and the memory From the resource usage rate and internal processing time data recorded above, a test result data file 23 arranged in time series using the stored time as a key is created (S155 to S157).

  After creating the test result data file 23, the performance recording module 22 transmits to the remote control module 21 that the work of creating test result data has been completed (S160 to S162). The remote control module 21 that has received the transmission is set to the test server 1 when the server under test 1B is set in the same headquarters as the test server 1, and when the server under test 1B is set as a branch, A test result data creation work completion message is transmitted to the test server 1 via the communication network interface provided in the branch where the server 1B is installed and the communication network interface provided in the test server 1 (S164 to S166).

  Also, the remote control module 31 that has received the performance test end command (S154, YES) instructs the reproduction module 34 to stop the reproduction work, instructs the performance recording module 35 to stop the recording work, and issues an instruction to stop the reproduction work. The received reproduction module 34 stops the reproduction of the test data file 37, and the performance recording module 35 that has received the instruction to stop the recording operation stops the recording operation, and the resource usage rate and online response time data recorded in the memory. Then, a test result data file 38 arranged in time series using the stored time as a key is created (S158).

  After creating the test result data, the performance recording module 35 transmits to the remote control module 31 that the work for creating the test result data has been completed (S163). Upon receiving the transmission, the remote control module 31 transmits a test result data creation completion message to the test server 1 via the communication network interface provided in the branch where the client 4 is installed and the communication network interface provided in the test server 1. (S167).

  The remote control module 12 receives a test result data creation completion message from the server under test 1B and the client 4 installed in the headquarters and branches to be tested, and then inputs a message indicating the completion of the performance test to the test worker. Output from the output device (S168, S169).

  Next, a process for outputting the test result data created by the operation of FIG. 11 after the test is completed will be described.

  After the test is completed, the test operator uses the distribution / collection module 11 of the test server 1 to create the test result data file 23, the test result data file 38, and the test system created on the server under test 1B and the client 4 to be tested. Collect the log output by.

  The distribution / collection module 11 that has completed the collection work from all the servers under test 1B and the clients 4 receives the name information of the machine under test 1A collected in the collection result storage module 14, the collected test result data, the log, and the performance test management. An instruction to store data in the table 16 is issued. The collection result storage module 15 that has received an instruction to store data in the performance test management table 16 uses the name of the device under test 1A as a key and the recording time and resource usage rate of each resource usage rate from the test result data. Stores recording time and internal processing time or online response time. After the storage of all test result data in the performance test management table 16 is completed, the collection result storage module 15 outputs a message to the test worker from the input / output device indicating that the collection of test result data has been completed.

  After the test result data collection work is completed, the test operator sends the test result output module 15 the performance test result start time (April 2, 2005, 8:00) and end time ( (April 2, 2005, 17:00), an output unit time (1 hour) and an output command of the performance test result of the entire system are input from the input / output device.

  The test result output module 15 receiving the performance test result output command refers to the data stored in the performance test management table 16 and starts the performance test to be output (April 2, 2005, 8:00) To the end time (April 2, 2005, 17:00) per unit time (1 hour) The maximum resource usage, average usage, and maximum internal processing for each unit under test 1A installed in the headquarters and all branches The time and average processing time, maximum online response time and average online response time are output by the input / output device.

  If threshold values are set in advance in the threshold setting table 17 for each resource and processing time in the machine under test 1A, if there is a result exceeding the threshold in the output result, the test result output module 15 The result exceeding the threshold is shaded and output from the input / output device.

  For example, the test operator selects a branch where a large number of test machines 1A having a high resource usage rate or a long processing time exist, and starts the performance test result to be output to the test result output module 15 (as of April 2005). 12:00), the end time (April 2, 2005 12:00), the output unit time (5 minutes), and the output command of the target branch are input from the input / output device.

  The test result output module 15 receiving the performance test result output command refers to the data stored in the performance test management table 16 and starts the performance test to be output (April 2, 2005, 11:00) To the end time (April 2, 2005, 12:00) per unit time (5 minutes), maximum resource usage, maximum internal processing time and maximum online for each unit under test installed in the target branch 1A The response time is output by the input / output device.

  The test operator checks the system load bias in each branch every time by outputting the performance test results of all the systems, and outputs the performance test results in the branch in the heavily loaded branch, internal processing time and online response time The resource usage rate of the machine under test 1 </ b> A when becomes large is confirmed. As a result, it is possible to grasp the regional and temporal load status of the system, and to perform redesign for resource enhancement in the required machine under test 1A of the required branch.

  In the present embodiment described above, one or more business servers 2 are installed in the headquarters, and one or more relay servers 3 that relay communication between the business server 2 and the client 4 are installed in the headquarters and each branch. The above system is applied to a large-scale online system in which the client 4 is installed in each branch, and a performance test of the entire system is realized. This test system is characterized in that the client 4 is operated remotely.

It is a block diagram which shows the outline | summary of the test system regarding one Embodiment of this invention. It is a block diagram which shows the structure of the module in the hardware of each test system, and each hardware. It is a block diagram which shows a performance test management table. It is a block diagram which shows a threshold value setting table. It is a block diagram which shows the operation data file. It is a block diagram which shows the performance test result data file in the whole test system. It is a block diagram which shows the performance test result data file in the branch B. It is a flowchart which shows the operation | movement which produces the operation data of the user's client in a production business. It is a flowchart which shows the operation | movement which edits the stored user's operation data and produces a test data file. It is a flowchart which shows the operation | movement which reproduces | regenerates the test data file of each to-be-client, and records a resource, internal processing time, and online response time in order to implement a performance test. It is a flowchart which shows the operation | movement which produces test result data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Test server 1A Test machine 1B Test server 2 Business server 3 Relay server 4 Client 11 Distribution / collection module 12 Remote control module 13 Time synchronization module 14 Collection result storage module 15 Test result output module 16 Performance test management table 17 Threshold setting Table 21 Remote control module 22 Performance recording module 23 Test result data file 31 Remote control module 32 Operation recording module 33 Editing module 34 Playback module 35 Performance recording module 36 Operation data file 37 Test data file 38 Test result data file

Claims (5)

A performance test method by a test server that tests a performance of the server under test, and a plurality of clients installed at remote locations from the server under test as test machines,
The test server is
An operation recording step of controlling the client so as to create an operation data file in which operation procedures input while synchronizing between the clients are stored in time series for each client;
A reproduction step of controlling the client to reproduce the operation procedure of the operation data file created in the operation recording step;
A performance recording step for controlling the device under test so as to record performance data of the device under test and create a test result data file in a period during which the operation procedure is reproduced in the reproduction step;
A test result output step for receiving and outputting the test result data file recorded in the performance recording step from the device under test;
A performance test method characterized by executing   2. The performance test method according to claim 1, wherein in the reproduction step, the operation data file is arbitrarily shortened and reproduced while maintaining an overall ratio with respect to a time axis.   In the test result output step, based on the test result data file, the output of a matrix representing the correlation between the response time of the device under test, the internal processing time, and the resource usage rate, the resource usage rate of the device under test At least one of the output of the graph, the time-series output of the machine under test in which an error occurred, and the output that shades the output result when the threshold of performance data is exceeded, The performance test method according to claim 1 or 2. A server under test, and a plurality of clients installed remotely from the server under test as a test machine, and a test server for testing the performance of the machine under test,
An operation recording module for controlling the client so as to create an operation data file in which operation procedures input in synchronization between the clients are stored in time series for each client;
A reproduction module for controlling the client to reproduce the operation procedure of the operation data file created by the operation recording module;
A performance recording module for controlling the device under test so as to record performance data of the device under test and create a test result data file during a period of replaying the operation procedure with the playback module;
A test result output module for receiving and outputting the test result data file recorded by the performance recording module from the device under test;
A test server comprising:   The test server according to claim 1, wherein the reproduction module reproduces the operation data file by arbitrarily shortening the operation data file while maintaining an overall ratio with respect to a time axis.

Images