[go: up one dir, main page]

CN114579442A - Capacity estimation parameter control method and system - Google Patents

Capacity estimation parameter control method and system Download PDF

Info

Publication number
CN114579442A
CN114579442A CN202210199376.4A CN202210199376A CN114579442A CN 114579442 A CN114579442 A CN 114579442A CN 202210199376 A CN202210199376 A CN 202210199376A CN 114579442 A CN114579442 A CN 114579442A
Authority
CN
China
Prior art keywords
parameter
evaluation
capacity
under test
device under
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210199376.4A
Other languages
Chinese (zh)
Other versions
CN114579442B (en
Inventor
胡玉溪
王润哲
王庆龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Alibaba China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba China Co Ltd filed Critical Alibaba China Co Ltd
Priority to CN202210199376.4A priority Critical patent/CN114579442B/en
Publication of CN114579442A publication Critical patent/CN114579442A/en
Application granted granted Critical
Publication of CN114579442B publication Critical patent/CN114579442B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668Testing of software
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3433Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment for load management
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668Testing of software
    • G06F11/3696Methods or tools to render software testable

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

The application provides a method and a system for controlling capacity evaluation parameters. The method comprises the following steps: the capacity evaluation parameter control device may acquire at least one system parameter of each device under test and a parameter value of each system parameter by interacting with the device under test. The capacity estimation parameter control device may input a parameter value of at least one system parameter of one device under test into a preset tuning algorithm. The capacity evaluation parameter control device can obtain a parameter value of at least one evaluation parameter of the tested device through the preset tuning algorithm. The capacity evaluation parameter control equipment can generate a capacity evaluation case of the tested equipment according to a parameter value combination predicted by a preset tuning algorithm. The method improves the generation efficiency of the evaluation parameter and improves the evaluation accuracy and the evaluation efficiency of the tested equipment.

Description

容量评估参数控制方法和系统Capacity evaluation parameter control method and system

技术领域technical field

本申请涉及计算机领域,尤其涉及一种容量评估参数控制方法和系统。The present application relates to the field of computers, and in particular, to a method and system for controlling capacity evaluation parameters.

背景技术Background technique

容量评估是性能测试的一个分支方向。容量评估通常通过Benchmark对被测软硬件系统进行最高负载能力的评估。Benchmark的参数组合将决定该次容量评估的评估效果。不合适的参数组合可能导致Benchmark无法产生足够的压力数据来评估出软硬件系统的真实容量能力。Capacity evaluation is a branch of performance testing. Capacity evaluation usually evaluates the highest load capacity of the software and hardware systems under test through Benchmark. The parameter combination of Benchmark will determine the evaluation effect of this capacity evaluation. Inappropriate parameter combinations may cause Benchmark to fail to generate enough pressure data to evaluate the true capacity capability of the hardware and software systems.

为了提高容量评估的效率,现有技术中,通常需要技术人员根据人工经验确定Benchmark的参数组合,从而实现被测软硬件系统的容量评估。并且,针对不同机型的被测软硬件系统,其CPU、内存、IO、网络等的参数通常并不相同。技术人员需要根据不同机型的被测软硬件系统,确定不同的参数组合,以实现最优的容量评估效果。In order to improve the efficiency of capacity evaluation, in the prior art, technicians are usually required to determine the parameter combination of the benchmark according to manual experience, so as to realize the capacity evaluation of the software and hardware systems under test. Moreover, for different models of tested software and hardware systems, the parameters of its CPU, memory, IO, network, etc. are usually different. Technicians need to determine different parameter combinations according to the tested software and hardware systems of different models to achieve the optimal capacity evaluation effect.

然而,使用人工经验制定的容量评估的参数组合,存在参数制定效率低的问题。However, using the parameter combination for capacity evaluation formulated by human experience, there is a problem of low parameter formulation efficiency.

发明内容SUMMARY OF THE INVENTION

本申请提供一种容量评估参数控制方法和系统,用以解决现有技术存在的参数制定效率低的问题。The present application provides a capacity evaluation parameter control method and system to solve the problem of low parameter formulation efficiency existing in the prior art.

第一方面,本申请提供一种容量评估参数控制方法,包括:In a first aspect, the present application provides a capacity evaluation parameter control method, including:

获取被测设备的至少一个系统参数的参数值;Obtain the parameter value of at least one system parameter of the device under test;

根据所述被测设备的至少一个系统参数的参数值和预设调优算法,确定所述被测设备的至少一个评估参数的参数值;determining a parameter value of at least one evaluation parameter of the device under test according to the parameter value of the at least one system parameter of the device under test and a preset tuning algorithm;

根据所述至少一个评估参数的参数值,生成所述被测设备的容量评估用例,所述容量评估用例用于评估所述被测设备的容量。According to the parameter value of the at least one evaluation parameter, a capacity evaluation case of the device under test is generated, and the capacity evaluation case is used to evaluate the capacity of the device under test.

可选地,根据所述被测设备的至少一个系统参数的参数值和预设调优算法,确定所述被测设备的至少一个评估参数的参数值,具体包括:Optionally, determining the parameter value of at least one evaluation parameter of the device under test according to the parameter value of at least one system parameter of the device under test and a preset tuning algorithm, specifically including:

根据所述被测设备的至少一个系统参数的参数值,确定所述被测设备的每一评估参数的参数调整范围;Determine the parameter adjustment range of each evaluation parameter of the device under test according to the parameter value of at least one system parameter of the device under test;

根据所述每一评估参数的参数调整范围和预设调优算法,确定所述被测设备的每一评估参数的参数值。A parameter value of each evaluation parameter of the device under test is determined according to the parameter adjustment range of each evaluation parameter and a preset optimization algorithm.

可选地,根据所述被测设备的至少一个系统参数的参数值,确定所述被测设备的每一评估参数的参数调整范围,具体包括:Optionally, according to the parameter value of at least one system parameter of the device under test, the parameter adjustment range of each evaluation parameter of the device under test is determined, specifically including:

针对每个评估参数,获取所述评估参数对应的计算模型,并将所述系统参数的参数值输入所述评估参数对应的计算模型,计算获得所述评估参数的参数调整范围。For each evaluation parameter, a calculation model corresponding to the evaluation parameter is obtained, the parameter value of the system parameter is input into the calculation model corresponding to the evaluation parameter, and the parameter adjustment range of the evaluation parameter is obtained by calculation.

可选地,根据所述每一评估参数的参数调整范围和预设调优算法,确定所述被测设备的每一评估参数的参数值,具体包括:Optionally, according to the parameter adjustment range of each evaluation parameter and a preset optimization algorithm, determine the parameter value of each evaluation parameter of the device under test, specifically including:

根据各个所述评估参数的所述参数调整范围,生成参数矩阵;Generate a parameter matrix according to the parameter adjustment range of each of the evaluation parameters;

将所述参数矩阵输入所述预设调优算法,得到所述评估参数中的每一所述评估参数的参数值。The parameter matrix is input into the preset tuning algorithm to obtain a parameter value of each of the evaluation parameters.

可选地,所述方法,还包括:Optionally, the method further includes:

使用所述被测设备对应的所述容量评估用例对所述被测设备进行评估,得到评估结果;Evaluate the device under test using the capacity evaluation use case corresponding to the device under test to obtain an evaluation result;

根据所述评估结果,确定所述被测设备的评估指标,所述评估指标用于指示所述被测设备的真实容量。According to the evaluation result, an evaluation index of the device under test is determined, and the evaluation index is used to indicate the real capacity of the device under test.

可选地,所述至少一个系统参数包括CPU参数、内存参数、IO参数以及网络参数中的至少一项。Optionally, the at least one system parameter includes at least one of a CPU parameter, a memory parameter, an IO parameter, and a network parameter.

第二方面,本申请提供一种容量评估参数控制系统,包括:In a second aspect, the present application provides a capacity evaluation parameter control system, including:

获取模块,用于获取被测设备的至少一个系统参数的参数值;an acquisition module for acquiring the parameter value of at least one system parameter of the device under test;

控制模块,用于根据所述被测设备的至少一个系统参数的参数值和预设调优算法,确定所述被测设备的至少一个评估参数的参数值;根据所述至少一个评估参数的参数值,生成所述被测设备的容量评估用例,所述容量评估用例用于评估所述被测设备的容量。a control module, configured to determine a parameter value of at least one evaluation parameter of the device under test according to a parameter value of at least one system parameter of the device under test and a preset tuning algorithm; according to the parameter value of the at least one evaluation parameter value to generate a capacity evaluation use case of the device under test, where the capacity evaluation use case is used to evaluate the capacity of the device under test.

可选地,所述控制模块,具体用于:Optionally, the control module is specifically used for:

根据所述被测设备的至少一个系统参数的参数值,确定所述被测设备的每一评估参数的参数调整范围;Determine the parameter adjustment range of each evaluation parameter of the device under test according to the parameter value of at least one system parameter of the device under test;

根据所述每一评估参数的参数调整范围和预设调优算法,确定所述被测设备的每一评估参数的参数值。A parameter value of each evaluation parameter of the device under test is determined according to the parameter adjustment range of each evaluation parameter and a preset optimization algorithm.

可选地,所述控制模块,具体用于:Optionally, the control module is specifically used for:

针对每个评估参数,获取所述评估参数对应的计算模型,并将所述系统参数的参数值输入所述评估参数对应的计算模型,计算获得所述评估参数的参数调整范围。For each evaluation parameter, a calculation model corresponding to the evaluation parameter is obtained, the parameter value of the system parameter is input into the calculation model corresponding to the evaluation parameter, and the parameter adjustment range of the evaluation parameter is obtained by calculation.

可选地,所述控制模块,具体用于:Optionally, the control module is specifically used for:

根据各个所述评估参数的所述参数调整范围,生成参数矩阵;Generate a parameter matrix according to the parameter adjustment range of each of the evaluation parameters;

将所述参数矩阵输入所述预设调优算法,得到所述评估参数中的每一所述评估参数的参数值。The parameter matrix is input into the preset tuning algorithm to obtain a parameter value of each of the evaluation parameters.

可选地,所述系统,还包括:Optionally, the system further includes:

评估模块,用于使用所述被测设备对应的所述容量评估用例对所述被测设备进行评估,得到评估结果;根据所述评估结果,确定所述被测设备的评估指标,所述评估指标用于指示所述被测设备的真实容量。an evaluation module, configured to evaluate the device under test by using the capacity evaluation case corresponding to the device under test to obtain an evaluation result; according to the evaluation result, determine the evaluation index of the device under test, the evaluation Metrics are used to indicate the true capacity of the device under test.

可选地,所述至少一个系统参数包括CPU参数、内存参数、IO参数以及网络参数中的至少一项。Optionally, the at least one system parameter includes at least one of a CPU parameter, a memory parameter, an IO parameter, and a network parameter.

第三方面,本申请提供一种容量评估参数控制设备,包括:存储器和处理器等;In a third aspect, the present application provides a capacity evaluation parameter control device, including: a memory, a processor, and the like;

所述存储器用于存储计算机程序;所述处理器用于根据所述存储器存储的计算机程序执行第一方面及第一方面任一种可能的设计中的容量评估参数控制方法。The memory is used for storing a computer program; the processor is used for executing the first aspect and the capacity evaluation parameter control method in any possible design of the first aspect according to the computer program stored in the memory.

第四方面,本申请提供一种可读存储介质,可读存储介质中存储有计算机程序,当容量评估参数控制设备的至少一个处理器执行该计算机程序时,容量评估参数控制设备执行第一方面及第一方面任一种可能的设计中的容量评估参数控制方法。In a fourth aspect, the present application provides a readable storage medium in which a computer program is stored, and when at least one processor of the capacity evaluation parameter control device executes the computer program, the capacity evaluation parameter control device executes the first aspect and a capacity evaluation parameter control method in any possible design of the first aspect.

第五方面,本申请提供一种计算机程序产品,所述计算机程序产品包括计算机程序,当容量评估参数控制设备的至少一个处理器执行该计算机程序时,容量评估参数控制设备执行第一方面及第一方面任一种可能的设计中的容量评估参数控制方法。In a fifth aspect, the present application provides a computer program product, the computer program product comprising a computer program, when at least one processor of the capacity evaluation parameter control device executes the computer program, the capacity evaluation parameter control device executes the first aspect and the first aspect. On the one hand the capacity evaluation parameter control method in any possible design.

本申请提供的容量评估参数控制方法,通过与被测设备交互,获取每一被测设备的至少一个系统参数以及每一系统参数的参数值;将一个被测设备的至少一个系统参数的参数值输入预设调优算法;通过该预设调优算法,得到该被测设备的至少一个评估参数的参数值;根据预设调优算法预测得到的参数值组合,生成被测设备的容量评估用例的手段,实现被测设备的个性化评估参数的生成,提高了该评估参数的生成效率,避免了多组评估参数导致的容量评估用例的冗余,提高了该被测设备的评估准确性和评估效率的效果。In the capacity evaluation parameter control method provided by the present application, at least one system parameter of each device under test and the parameter value of each system parameter are obtained by interacting with the device under test; the parameter value of at least one system parameter of one device under test is Input a preset tuning algorithm; obtain a parameter value of at least one evaluation parameter of the device under test through the preset tuning algorithm; generate a capacity evaluation case for the device under test according to the combination of parameter values predicted by the preset tuning algorithm It realizes the generation of personalized evaluation parameters of the device under test, improves the generation efficiency of the evaluation parameters, avoids the redundancy of capacity evaluation use cases caused by multiple sets of evaluation parameters, and improves the evaluation accuracy of the device under test. Evaluate the effect of efficiency.

附图说明Description of drawings

为了更清楚地说明本申请或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the present application or the prior art more clearly, the following briefly introduces the accompanying drawings required in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are the For some embodiments of the application, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

图1为现有技术提供的一种人工制定容量评估用例的场景示意图;FIG. 1 is a schematic diagram of a scenario of manually formulating a capacity evaluation use case provided by the prior art;

图2为本申请一实施例提供的一种容量评估参数控制的场景示意图;FIG. 2 is a schematic diagram of a scenario of capacity evaluation parameter control provided by an embodiment of the present application;

图3为本申请一实施例提供的一种容量评估参数控制方法的流程图;3 is a flowchart of a method for controlling a capacity evaluation parameter provided by an embodiment of the present application;

图4为本申请一实施例提供的一种容量评估参数控制方法的流程图;4 is a flowchart of a method for controlling a capacity evaluation parameter provided by an embodiment of the present application;

图5为本申请一实施例提供的一种容量评估参数控制系统的结构示意图;FIG. 5 is a schematic structural diagram of a capacity evaluation parameter control system provided by an embodiment of the present application;

图6为本申请一实施例提供的一种容量评估参数控制设备的硬件结构示意图。FIG. 6 is a schematic diagram of a hardware structure of a capacity evaluation parameter control device according to an embodiment of the present application.

具体实施方式Detailed ways

为使本申请的目的、技术方案和优点更加清楚,下面将结合本申请中的附图,对本申请中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be described clearly and completely below with reference to the accompanying drawings in the present application. Obviously, the described embodiments are part of the embodiments of the present application. , not all examples. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换。例如,在不脱离本文范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。The terms "first", "second", "third", "fourth", etc. in the description and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that data so used may be interchanged under appropriate circumstances. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of this document.

取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining."

再者,如同在本文中所使用的,单数形式“一”、“一个”和“该”旨在也包括复数形式,除非上下文中有相反的指示。Also, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context dictates otherwise.

应当进一步理解,术语“包含”、“包括”表明存在的特征、步骤、操作、元件、组件、项目、种类、和/或组,但不排除一个或多个其他特征、步骤、操作、元件、组件、项目、种类、和/或组的存在、出现或添加。It should be further understood that the terms "comprising" and "comprising" indicate the presence of features, steps, operations, elements, components, items, kinds, and/or groups, but do not exclude one or more other features, steps, operations, elements, The existence, appearance or addition of components, items, categories, and/or groups.

此处使用的术语“或”和“和/或”被解释为包括性的,或意味着任一个或任何组合。因此,“A、B或C”或者“A、B和/或C”意味着“以下任一个:A;B;C;A和B;A和C;B和C;A、B和C”。仅当元件、功能、步骤或操作的组合在某些方式下内在地互相排斥时,才会出现该定义的例外。The terms "or" and "and/or" as used herein are to be construed to be inclusive or to mean any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C" . Exceptions to this definition arise only when combinations of elements, functions, steps, or operations are inherently mutually exclusive in some way.

容量评估是性能测试的一个分支方向。容量评估通常通过Benchmark对被测软硬件系统进行最高负载能力的评估。具体地,容量评估是通过Benchmark对系统处于最大负载状态或某项指标达到所能接受的最大阈值下对请求的最大处理能力进行测试和评价的方法。其中,Benchmark即为基准程序。该基准程序为用于对调优应用性能进行估计并给出性能得分的评估程序。在完成评估后,用户可以使用评估得到的评估结果进行辅助,完成新机型验证对比、机器采购、解决方案等工作。例如,可以使用该评估结果,判断当前集群/数据中心等的业务承载能力是否满足需求。又如,可以根据该评估结果确定采购的机器类型、数量等信息。Capacity evaluation is a branch of performance testing. Capacity evaluation usually evaluates the highest load capacity of the software and hardware systems under test through Benchmark. Specifically, capacity evaluation is a method of testing and evaluating the maximum processing capacity of requests when the system is in a maximum load state or when a certain indicator reaches an acceptable maximum threshold through Benchmark. Among them, Benchmark is the benchmark program. The benchmark is an evaluation program used to estimate the performance of a tuned application and give a performance score. After completing the evaluation, users can use the evaluation results obtained from the evaluation to assist in completing the verification and comparison of new models, machine procurement, and solutions. For example, the evaluation result can be used to determine whether the service carrying capacity of the current cluster/data center meets the requirements. For another example, information such as the type and quantity of purchased machines may be determined according to the evaluation result.

现有技术中,不同的被测设备通常具有不同的系统参数。该系统参数可以为操作系统中可以进行动态设置并对应用性能产生影响的配置项,例如内核配置参数和应用配置参数等。当用户在该被测设备中设置不同的系统参数时,该被测设备的在某基准程序上得分将会发生变化。例如,该系统参数可以包括CPU、内存、IO、网络等。技术人员可以根据被测设备的系统参数和人工经验,指定几组Benchmark的参数组合。容量评估参数控制设备可以根据这些Benchmark的参数组合,实现被测软硬件系统的容量评估。在容量评估过程中,Benchmark的参数组合将决定该次容量评估的评估效果。不合适的参数组合可能导致Benchmark无法产生足够的压力数据来评估出软硬件系统的真实容量能力。例如,在不同机型上面,固定的参数组合并不一定能够使Benchmark产生足够的压力数据,进而将导致无法评估出软硬件的真实容量能力。因此,技术人员需要根据不同机型的被测软硬件系统,确定不同的参数组合,以实现最优的容量评估效果。In the prior art, different devices under test usually have different system parameters. The system parameter may be a configuration item that can be dynamically set in the operating system and affects application performance, such as kernel configuration parameters and application configuration parameters. When the user sets different system parameters in the device under test, the score of the device under test on a certain benchmark program will change. For example, the system parameters may include CPU, memory, IO, network, and the like. Technicians can specify several sets of Benchmark parameter combinations based on the system parameters of the device under test and human experience. The capacity evaluation parameter control device can realize the capacity evaluation of the tested software and hardware system according to the parameter combination of these benchmarks. In the process of capacity evaluation, the parameter combination of Benchmark will determine the evaluation effect of this capacity evaluation. Inappropriate parameter combinations may cause Benchmark to fail to generate enough pressure data to evaluate the true capacity capability of the hardware and software systems. For example, on different models, a fixed parameter combination may not allow Benchmark to generate enough pressure data, which will make it impossible to evaluate the real capacity capability of software and hardware. Therefore, technicians need to determine different parameter combinations according to the tested software and hardware systems of different models to achieve the optimal capacity evaluation effect.

然而,技术人员在根据经验制定的容量评估的参数组合时,如图1所示,为了尽可能正确的评估不同环境的容量,往往会设置多组参数组合。而该多组参数组合的设置,则容易导致测试用例的冗余,以及测试耗时的增加,存在评估效率低问题。并且,该多组参数组合仍然无法适应所有设备的问题。例如,在小规格被测设备上使用时,该多组参数组合容易存在压力太大,导致机器挂死的问题。以及,在大规格被测设备上使用时,该多组参数组合则容易因为压力不足,导致无法有效评估被测设备的真实容量。此外,一旦有新的机型或者新的软件成为被测设备,往往需要技术人员人工进行用例的适配,或者新的用例的编写,存在维护成本高的问题。However, when technicians formulate the parameter combinations for capacity evaluation based on experience, as shown in Figure 1, in order to evaluate the capacity of different environments as accurately as possible, multiple sets of parameter combinations are often set. However, the setting of the multiple sets of parameter combinations may easily lead to redundancy of test cases and increase the time-consuming of tests, resulting in the problem of low evaluation efficiency. Moreover, the multiple sets of parameter combinations still cannot adapt to the problems of all devices. For example, when used on a device under test with a small size, the combination of multiple sets of parameters is likely to have too much pressure, causing the machine to hang up. Moreover, when used on a large-scale device under test, the multiple sets of parameter combinations are prone to insufficient pressure, resulting in an inability to effectively evaluate the true capacity of the device under test. In addition, once a new model or new software becomes the device under test, technicians are often required to manually adapt the use case or write a new use case, which has the problem of high maintenance costs.

针对上述问题,本申请提出了一种容量评估参数控制方法。本申请提出了一种基于超参调优算法的Benchmark评估参数控制方法。该基于超参调优的参数调优算法可以通过某种算法策略,不断给出更优的评估参数的组合,从而找到评估效果更好的参数配置。并且,本申请还通过探测被测设备的系统参数,实现了针对不同被测设备的评估参数智能化控制方法。本申请通过对被测设备的探测,可以得到CPU参数、内存参数、IO参数、网络参数等硬件资源的系统参数。这些系统参数可以为Benchmark的评估参数提供参数调整范围。本申请可以通过超参调优算法,从Benchmark的评估参数的参数调整范围中选择合适的参数值组成不同的评估参数组合。本申请可以根据该评估参数组合生成被测设备的容量评估用例。该容量评估用例为容量评估参数控制设备针对不同的软硬件环境定制化生成的测试用例,可以有效探测出不同被测设备的真实容量。In view of the above problems, the present application proposes a capacity evaluation parameter control method. This application proposes a benchmark evaluation parameter control method based on a hyperparameter tuning algorithm. The parameter tuning algorithm based on hyperparameter tuning can continuously provide a better combination of evaluation parameters through a certain algorithm strategy, so as to find a parameter configuration with better evaluation effect. In addition, the present application also realizes an intelligent control method of evaluation parameters for different devices under test by detecting the system parameters of the device under test. The present application can obtain system parameters of hardware resources such as CPU parameters, memory parameters, IO parameters, and network parameters by detecting the device under test. These system parameters can provide parameter adjustment ranges for Benchmark's evaluation parameters. In the present application, different evaluation parameter combinations can be formed by selecting appropriate parameter values from the parameter adjustment range of the evaluation parameters of Benchmark through the hyperparameter tuning algorithm. The application can generate a capacity evaluation case of the device under test according to the combination of evaluation parameters. The capacity evaluation case is a customized test case generated by the capacity evaluation parameter control device for different software and hardware environments, which can effectively detect the real capacity of different devices under test.

本申请通过上述方案实现了不同的软硬件环境中定制化的参数组合的生成,以及定制化容量评估用例的生成。该容量评估用例的能够产生足够的压力,评估出环境的真实容量,极大提高了参数制定效率。并且,本申请通过定制化生成容量评估用例,减少了在不同环境上使用相同一套评估用例导致的冗余问题,有效减少了人工维护的成本,极大地提高了评估效率。The present application realizes the generation of customized parameter combinations in different software and hardware environments and the generation of customized capacity evaluation use cases through the above solutions. The capacity evaluation use case can generate enough pressure to evaluate the real capacity of the environment, which greatly improves the efficiency of parameter formulation. In addition, the present application generates capacity evaluation use cases through customization, which reduces the redundancy problem caused by using the same set of evaluation use cases in different environments, effectively reduces the cost of manual maintenance, and greatly improves the evaluation efficiency.

下面以具体地实施例对本申请的技术方案进行详细说明。下面这几个具体的实施例可以相互结合,对于相同或相似的概念或过程可能在某些实施例不再赘述。The technical solutions of the present application will be described in detail below with specific examples. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

图2示出了本申请一实施例提供的一种容量评估参数控制的场景示意图。如图2所示,一个容量评估参数控制设备可以对应于多个被测设备。该容量评估参数控制设备可以从每一被测设备中获取该被测设备的软硬件系统参数。容量评估参数控制设备中可以预设有多个评估参数的计算模型。容量评估参数控制设备可以根据每一被测设备的系统参数,确定每一被测设备的评估参数的参数调整范围。容量评估参数控制设备还可以将每一被测设备的系统参数和该容量评估参数控制设备中预设的多个评估参数输入预设调优算法。容量评估参数控制设备可以通过该预设调优算法确定每一被测设备的至少一个评估参数的参数值。容量评估参数控制设备可以根据每一被测设备的至少一个评估参数的参数值,生成该被测设备的容量评估用例。容量评估参数控制设备可以使用该容量评估用例评估该被测设备的容量。例如,如图2所示,当容量评估参数控制设备获取被测设备1的系统参数后,可以将对应生成的容量评估用例用于评估被测设备1的容量。FIG. 2 shows a schematic diagram of a scenario of capacity evaluation parameter control provided by an embodiment of the present application. As shown in Fig. 2, one capacity evaluation parameter control device may correspond to a plurality of devices under test. The capacity evaluation parameter control device can acquire the software and hardware system parameters of the device under test from each device under test. The capacity evaluation parameter control device may be preset with calculation models for multiple evaluation parameters. The capacity evaluation parameter control device may determine the parameter adjustment range of the evaluation parameters of each device under test according to the system parameters of each device under test. The capacity evaluation parameter control device may also input the system parameters of each device under test and a plurality of evaluation parameters preset in the capacity evaluation parameter control device into the preset tuning algorithm. The capacity evaluation parameter control device may determine the parameter value of at least one evaluation parameter of each device under test through the preset tuning algorithm. The capacity evaluation parameter control device may generate a capacity evaluation case for the device under test according to the parameter value of at least one evaluation parameter of each device under test. The capacity assessment parameter control device can use the capacity assessment use case to assess the capacity of the device under test. For example, as shown in FIG. 2 , after the capacity evaluation parameter control device acquires the system parameters of the device under test 1 , the corresponding generated capacity evaluation case can be used to evaluate the capacity of the device under test 1 .

本申请中,以容量评估参数控制设备为执行主体,执行如下实施例的容量评估参数控制方法。具体地,该执行主体可以为容量评估参数控制设备的硬件装置,或者为容量评估参数控制设备中实现下述实施例的软件应用,或者为安装有实现下述实施例的软件应用的计算机可读存储介质,或者为实现下述实施例的软件应用的代码。In the present application, the capacity assessment parameter control device is used as the execution body to execute the capacity assessment parameter control method of the following embodiments. Specifically, the executive body may be a hardware device of a capacity evaluation parameter control device, or a software application implementing the following embodiments in the capacity evaluation parameter control device, or a computer-readable computer readable with a software application implementing the following embodiments installed. A storage medium, or a code for implementing the software application of the following embodiments.

图3示出了本申请一实施例提供的一种容量评估参数控制方法的流程图,在图2所示实施例的基础上,如图3所示,以容量评估参数控制设备为执行主体,本实施例的方法可以包括如下步骤:Fig. 3 shows a flow chart of a capacity evaluation parameter control method provided by an embodiment of the present application. On the basis of the embodiment shown in Fig. 2, as shown in Fig. 3, a capacity evaluation parameter control device is used as the execution subject, The method of this embodiment may include the following steps:

S101、获取被测设备的至少一个系统参数的参数值。S101. Acquire a parameter value of at least one system parameter of the device under test.

本实施例中,一个容量评估参数控制设备可以与多个被测设备通信。该容量评估参数控制设备可以通过与被测设备交互,获取每一被测设备的至少一个系统参数以及每一系统参数的参数值。其中,这些系统参数可以为CPU参数、内存参数、IO参数、网络参数等。In this embodiment, one capacity evaluation parameter control device may communicate with multiple devices under test. The capacity evaluation parameter control device can acquire at least one system parameter of each device under test and a parameter value of each system parameter by interacting with the device under test. The system parameters may be CPU parameters, memory parameters, IO parameters, network parameters, and the like.

S102、根据被测设备的至少一个系统参数的参数值和预设调优算法,确定被测设备的至少一个评估参数的参数值。S102: Determine a parameter value of at least one evaluation parameter of the device under test according to a parameter value of at least one system parameter of the device under test and a preset tuning algorithm.

本实施例中,容量评估参数控制设备可以将一个被测设备的至少一个系统参数的参数值输入预设调优算法。该容量评估参数控制设备可以通过该预设调优算法,得到该被测设备的至少一个评估参数的参数值。当该容量评估参数控制设备对应于多个被测设备时,该容量评估参数控制设备可以逐一将每一被测设备的至少一个系统参数的参数值输入该预设调优算法,从而计算得到每一被测设备的至少一个评估参数的参数值。其中预设调优算法可以为超参数调优算法。In this embodiment, the capacity evaluation parameter control device may input a parameter value of at least one system parameter of a device under test into a preset tuning algorithm. The capacity evaluation parameter control device may obtain a parameter value of at least one evaluation parameter of the device under test through the preset tuning algorithm. When the capacity evaluation parameter control device corresponds to a plurality of devices under test, the capacity evaluation parameter control device may input the parameter value of at least one system parameter of each device under test into the preset tuning algorithm one by one, so as to calculate each device under test. A parameter value of at least one evaluation parameter of a device under test. The preset tuning algorithm may be a hyperparameter tuning algorithm.

一种示例中,容量评估参数控制设备计算得到至少一个评估参数的参数值的具体过程可以包括如下步骤:In an example, the specific process of calculating the parameter value of at least one evaluation parameter by the capacity evaluation parameter control device may include the following steps:

步骤1、根据被测设备的至少一个系统参数的参数值,确定被测设备的每一评估参数的参数调整范围。Step 1. Determine the parameter adjustment range of each evaluation parameter of the device under test according to the parameter value of at least one system parameter of the device under test.

本步骤中,容量评估参数控制设备可以存储有评估参数集合。该评估参数集合中可以包括至少一个评估参数和每一评估的计算模型。容量评估参数控制设备可以在获取一个被测设备的至少一个系统参数的参数值后,根据该被测设备的至少一个系统参数的参数值和预设的评估参数的计算模型,计算得到该被测设备的评估参数的参数调整范围。例如,系统参数为CPU参数,该CPU参数的参数值用于指示该被测设备中CPU/处理器的个数。评估参数中进程参数可以根据该CPU参数计算得到。容量评估参数控制设备可以根据预设的计算模型,确定进程参数的下限为0.5*cpu个数,上限为10*cpu个数。例如,该被测设备中CPU参数为4个时,该进程参数的下限为2,上限为40。即,该被测设备的进程参数的参数调整范围为[2,40]。In this step, the capacity evaluation parameter control device may store an evaluation parameter set. The evaluation parameter set may include at least one evaluation parameter and a calculation model for each evaluation. The capacity evaluation parameter control device may, after acquiring the parameter value of at least one system parameter of a device under test, calculate the value of the device under test according to the parameter value of at least one system parameter of the device under test and a preset calculation model of evaluation parameters. The parameter adjustment range of the evaluation parameters of the device. For example, the system parameter is a CPU parameter, and the parameter value of the CPU parameter is used to indicate the number of CPUs/processors in the device under test. The process parameter in the evaluation parameter can be calculated according to the CPU parameter. The capacity evaluation parameter control device can determine, according to a preset calculation model, that the lower limit of the process parameter is 0.5*the number of cpus, and the upper limit is 10*the number of cpus. For example, when there are 4 CPU parameters in the device under test, the lower limit of the process parameter is 2, and the upper limit is 40. That is, the parameter adjustment range of the process parameter of the device under test is [2, 40].

步骤2、根据每一评估参数的参数调整范围和预设调优算法,确定被测设备的每一评估参数的参数值。Step 2: Determine the parameter value of each evaluation parameter of the device under test according to the parameter adjustment range of each evaluation parameter and the preset optimization algorithm.

本步骤中,容量评估参数控制设备可以在确定至少一个评估参数的参数调整范围后,将这些评估参数的参数调整范围输入到预设调优算法中。容量评估参数控制设备可以通过该预设调优算法,确定其中最优的评估参数的参数值组合。当容量评估参数控制设备使用这些参数值的组合生成容量评估用例时,测试效率将达到最优。In this step, after determining the parameter adjustment range of at least one evaluation parameter, the capacity evaluation parameter control device may input the parameter adjustment range of these evaluation parameters into the preset tuning algorithm. The capacity evaluation parameter control device may determine the optimal parameter value combination of the evaluation parameter through the preset tuning algorithm. The test efficiency will be optimal when the capacity assessment parameter control device uses the combination of these parameter values to generate capacity assessment cases.

一种实现方式中,容量评估参数控制设备可以根据这些评估参数的参数调整范围,生成参数矩阵。其中,每一个评估参数可以用该参数矩阵中的一行表示。例如,在进程参数对应的行的向量可以表示为[2,40]。容量评估参数控制设备可以将该参数矩阵输入预设调优算法中,预设得到评估参数中的每一评估参数的参数值。这些评估参数的参数值组成的参数值组合。In an implementation manner, the capacity evaluation parameter control device may generate a parameter matrix according to the parameter adjustment range of these evaluation parameters. where each evaluation parameter can be represented by a row in the parameter matrix. For example, the vector at the row corresponding to the process parameter can be represented as [2, 40]. The capacity evaluation parameter control device may input the parameter matrix into a preset tuning algorithm, and obtain a parameter value of each evaluation parameter in the evaluation parameters by default. A combination of parameter values consisting of the parameter values of these evaluation parameters.

S103、根据至少一个评估参数的参数值,生成被测设备的容量评估用例,容量评估用例用于评估被测设备的容量。S103. Generate a capacity evaluation case of the device under test according to the parameter value of at least one evaluation parameter, where the capacity evaluation case is used to evaluate the capacity of the device under test.

本实施例中,容量评估参数控制设备可以根据预设调优算法预测得到的参数值组合,生成被测设备的容量评估用例。例如,当进程参数为的参数值为10时,对应生成的容量评估测试用例的并发进程数量可以为10。容量评估参数控制设备可以使用该容量评估用例对被测设备的容量进行评估,从而确定该被测设备的真实容量。In this embodiment, the capacity evaluation parameter control device may generate a capacity evaluation use case of the device under test according to a combination of parameter values predicted by a preset tuning algorithm. For example, when the parameter value of the process parameter is 10, the number of concurrent processes corresponding to the generated capacity evaluation test case may be 10. The capacity evaluation parameter control device can use the capacity evaluation use case to evaluate the capacity of the device under test, thereby determining the real capacity of the device under test.

本申请提供的容量评估参数控制方法,容量评估参数控制设备可以通过与被测设备交互,获取每一被测设备的至少一个系统参数以及每一系统参数的参数值。容量评估参数控制设备可以将一个被测设备的至少一个系统参数的参数值输入预设调优算法。该容量评估参数控制设备可以通过该预设调优算法,得到该被测设备的至少一个评估参数的参数值。容量评估参数控制设备可以根据预设调优算法预测得到的参数值组合,生成被测设备的容量评估用例。本申请中,通过获取被测设备的系统参数,实现该被测设备的个性化评估参数的生成,提高了该评估参数的生成效率,避免了多组评估参数导致的容量评估用例的冗余,提高了该被测设备的评估准确性和评估效率。In the capacity evaluation parameter control method provided by the present application, the capacity evaluation parameter control device can acquire at least one system parameter of each device under test and the parameter value of each system parameter by interacting with the device under test. The capacity evaluation parameter control device may input the parameter value of at least one system parameter of a device under test into a preset tuning algorithm. The capacity evaluation parameter control device may obtain a parameter value of at least one evaluation parameter of the device under test through the preset tuning algorithm. The capacity evaluation parameter control device can generate the capacity evaluation use case of the device under test according to the combination of parameter values predicted by the preset tuning algorithm. In the present application, by obtaining the system parameters of the device under test, the generation of the personalized evaluation parameters of the device under test is realized, the generation efficiency of the evaluation parameters is improved, and the redundancy of the capacity evaluation case caused by multiple sets of evaluation parameters is avoided, The evaluation accuracy and evaluation efficiency of the device under test are improved.

图4示出了本申请一实施例提供的一种容量评估参数控制方法的流程图。在图2和图3所示实施例的基础上,如图4所示,以容量评估参数控制设备为执行主体,本实施例的方法可以包括如下步骤:FIG. 4 shows a flowchart of a method for controlling a capacity evaluation parameter provided by an embodiment of the present application. On the basis of the embodiments shown in FIG. 2 and FIG. 3 , as shown in FIG. 4 , with the capacity evaluation parameter control device as the execution subject, the method of this embodiment may include the following steps:

S201、获取被测设备的至少一个系统参数的参数值。S201. Obtain a parameter value of at least one system parameter of the device under test.

S202、根据被测设备的至少一个系统参数的参数值和预设调优算法,确定被测设备的至少一个评估参数的参数值。S202. Determine a parameter value of at least one evaluation parameter of the device under test according to a parameter value of at least one system parameter of the device under test and a preset tuning algorithm.

S203、根据至少一个评估参数的参数值,生成被测设备的容量评估用例,容量评估用例用于评估被测设备的容量。S203. Generate a capacity evaluation case of the device under test according to the parameter value of at least one evaluation parameter, where the capacity evaluation case is used to evaluate the capacity of the device under test.

其中,步骤S201至S203与图2实施例中的步骤S101至S103实现方式类似,本实施例此处不再赘述。The implementation manner of steps S201 to S203 is similar to that of steps S101 to S103 in the embodiment of FIG. 2 , and details are not described herein again in this embodiment.

S204、使用被测设备对应的容量评估用例对被测设备进行评估,得到评估结果。S204 , evaluating the device under test by using a capacity evaluation case corresponding to the device under test to obtain an evaluation result.

本实施例中,容量评估参数控制设备可以在完成容量评估用例的生成后,根据该容量评估用例生成测试请求。容量评估参数控制设备可以将这些测试请求发送到被测设备,以实现该被测设备的在处于最大负载状态或某项指标达到所能接受的最大阈值下对请求的处理能力。容量评估参数控制设备可以获取被测反馈的处理结果。容量评估参数控制设备可以根据该处理结果,统计得到评估结果。例如,该评估结果中可以包括完成处理的请求数量、平均等待时长等信息。In this embodiment, the capacity evaluation parameter control device may generate a test request according to the capacity evaluation case after completing the generation of the capacity evaluation case. The capacity evaluation parameter control device can send these test requests to the device under test, so as to realize the processing capability of the device under test when it is in a state of maximum load or when a certain indicator reaches an acceptable maximum threshold. The capacity evaluation parameter control device can obtain the processing result of the measured feedback. The capacity evaluation parameter control device can obtain the evaluation result by statistics according to the processing result. For example, the evaluation result may include information such as the number of completed requests, the average waiting time, and the like.

S205、根据评估结果,确定被测设备的评估指标,评估指标用于指示被测设备的真实容量。S205. Determine an evaluation index of the device under test according to the evaluation result, where the evaluation index is used to indicate the real capacity of the device under test.

本实施例中,容量评估参数控制设备可以根据统计得到的评估结果,计算得到该被测设备真实容量。该真实容量为该被测设备预估可以在最大负载状态或某项指标达到所能接受的最大阈值下处理的请求数量。容量评估参数控制设备可以将该被测设备的真实容量生成评估指标。容量评估参数控制设备还可以显示该评估指标,以便于技术人员根据该评估指标完后后续判断。In this embodiment, the capacity evaluation parameter control device may calculate and obtain the real capacity of the device under test according to the evaluation result obtained by statistics. The real capacity is the estimated number of requests that the device under test can handle when the maximum load state or a certain indicator reaches the acceptable maximum threshold. The capacity evaluation parameter control device can generate an evaluation index for the real capacity of the device under test. The capacity evaluation parameter control device can also display the evaluation index, so that the technician can make subsequent judgments based on the evaluation index.

本申请提供的容量评估参数控制方法,容量评估参数控制设备可以获取被测设备的至少一个系统参数的参数值。容量评估参数控制设备可以根据被测设备的至少一个系统参数的参数值和预设调优算法,确定被测设备的至少一个评估参数的参数值。容量评估参数控制设备可以根据至少一个评估参数的参数值,生成被测设备的容量评估用例,容量评估用例用于评估被测设备的容量。容量评估参数控制设备可以根据该容量评估用例生成测试请求。容量评估参数控制设备可以将这些测试请求发送到被测设备,得到评估结果。容量评估参数控制设备可以根据统计得到的评估结果,计算得到该被测设备真实容量。本申请中,通过获取被测设备的系统参数,实现该被测设备的个性化评估参数的生成,提高了该评估参数的生成效率。此外,本申请还可以通过根据该评估参数生成容量评估用例,避免了多组评估参数导致的容量评估用例的冗余,提高了该被测设备的评估准确性和评估效率。In the capacity evaluation parameter control method provided by the present application, the capacity evaluation parameter control device can acquire the parameter value of at least one system parameter of the device under test. The capacity evaluation parameter control device may determine the parameter value of the at least one evaluation parameter of the device under test according to the parameter value of the at least one system parameter of the device under test and the preset tuning algorithm. The capacity evaluation parameter control device may generate a capacity evaluation case of the device under test according to the parameter value of at least one evaluation parameter, and the capacity evaluation case is used to evaluate the capacity of the device under test. The capacity evaluation parameter control device can generate a test request according to the capacity evaluation case. The capacity evaluation parameter control device can send these test requests to the device under test to obtain evaluation results. The capacity evaluation parameter control device can calculate the real capacity of the device under test according to the evaluation result obtained by statistics. In the present application, by acquiring the system parameters of the device under test, the generation of the personalized evaluation parameters of the device under test is realized, and the generation efficiency of the evaluation parameters is improved. In addition, the present application can also generate capacity evaluation use cases according to the evaluation parameters, which avoids redundancy of capacity evaluation use cases caused by multiple sets of evaluation parameters, and improves the evaluation accuracy and evaluation efficiency of the device under test.

图5示出了本申请一实施例提供的一种容量评估参数控制系统的结构示意图,如图5所示,本实施例的容量评估参数控制系统10用于实现上述任一方法实施例中对应于容量评估参数控制设备的操作,本实施例的容量评估参数控制系统10包括:FIG. 5 shows a schematic structural diagram of a capacity evaluation parameter control system provided by an embodiment of the present application. As shown in FIG. 5 , the capacity evaluation parameter control system 10 of this embodiment is used to implement the corresponding method in any of the above method embodiments. For the operation of the capacity evaluation parameter control device, the capacity evaluation parameter control system 10 of this embodiment includes:

获取模块11,用于获取被测设备的至少一个系统参数的参数值。The obtaining module 11 is configured to obtain a parameter value of at least one system parameter of the device under test.

控制模块12,用于根据被测设备的至少一个系统参数的参数值和预设调优算法,确定被测设备的至少一个评估参数的参数值。根据至少一个评估参数的参数值,生成被测设备的容量评估用例,容量评估用例用于评估被测设备的容量。The control module 12 is configured to determine a parameter value of at least one evaluation parameter of the device under test according to a parameter value of at least one system parameter of the device under test and a preset tuning algorithm. According to the parameter value of at least one evaluation parameter, a capacity evaluation case of the device under test is generated, and the capacity evaluation case is used to evaluate the capacity of the device under test.

一种示例中,控制模块12,具体用于:In an example, the control module 12 is specifically used for:

根据被测设备的至少一个系统参数的参数值,确定被测设备的每一评估参数的参数调整范围。The parameter adjustment range of each evaluation parameter of the device under test is determined according to the parameter value of at least one system parameter of the device under test.

根据每一评估参数的参数调整范围和预设调优算法,确定被测设备的每一评估参数的参数值。According to the parameter adjustment range of each evaluation parameter and the preset optimization algorithm, the parameter value of each evaluation parameter of the device under test is determined.

一种示例中,控制模块12,具体用于:In an example, the control module 12 is specifically used for:

针对每个评估参数,获取评估参数对应的计算模型,并将系统参数的参数值输入评估参数对应的计算模型,计算获得评估参数的参数调整范围。For each evaluation parameter, a calculation model corresponding to the evaluation parameter is obtained, and the parameter value of the system parameter is input into the calculation model corresponding to the evaluation parameter, and the parameter adjustment range of the evaluation parameter is obtained by calculation.

一种示例中,控制模块12,具体用于:In an example, the control module 12 is specifically used for:

根据各个评估参数的参数调整范围,生成参数矩阵。According to the parameter adjustment range of each evaluation parameter, a parameter matrix is generated.

将参数矩阵输入预设调优算法,得到评估参数中的每一评估参数的参数值。The parameter matrix is input into the preset tuning algorithm, and the parameter value of each evaluation parameter in the evaluation parameters is obtained.

一种示例中,容量评估参数控制系统10,还包括:In one example, the capacity evaluation parameter control system 10 further includes:

评估模块13,用于使用被测设备对应的容量评估用例对被测设备进行评估,得到评估结果。根据评估结果,确定被测设备的评估指标,评估指标用于指示被测设备的真实容量。The evaluation module 13 is used for evaluating the device under test by using a capacity evaluation case corresponding to the device under test to obtain an evaluation result. According to the evaluation result, the evaluation index of the device under test is determined, and the evaluation index is used to indicate the real capacity of the device under test.

一种示例中,至少一个系统参数包括CPU参数、内存参数、IO参数以及网络参数中的至少一项。In an example, the at least one system parameter includes at least one of a CPU parameter, a memory parameter, an IO parameter, and a network parameter.

本申请实施例提供的容量评估参数控制系统10,可执行上述方法实施例,其具体实现原理和技术效果,可参见上述方法实施例,本实施例此处不再赘述。The capacity evaluation parameter control system 10 provided in this embodiment of the present application can execute the foregoing method embodiments, and the specific implementation principles and technical effects thereof may refer to the foregoing method embodiments, which will not be repeated here.

图6示出了本申请实施例提供的一种容量评估参数控制设备的硬件结构示意图。如图6所示,该容量评估参数控制设备20,用于实现上述任一方法实施例中对应于容量评估参数控制设备的操作,本实施例的容量评估参数控制设备20可以包括:存储器21,处理器22和通信接口24。FIG. 6 shows a schematic diagram of the hardware structure of a capacity evaluation parameter control device provided by an embodiment of the present application. As shown in FIG. 6 , the capacity evaluation parameter control device 20 is used to implement operations corresponding to the capacity evaluation parameter control device in any of the above method embodiments. The capacity evaluation parameter control device 20 in this embodiment may include: a memory 21, Processor 22 and communication interface 24 .

存储器21,用于存储计算机程序。该存储器21可能包含高速随机存取存储器(Random Access Memory,RAM),也可能还包括非易失性存储(Non-Volatile Memory,NVM),例如至少一个磁盘存储器,还可以为U盘、移动硬盘、只读存储器、磁盘或光盘等。The memory 21 is used to store computer programs. The memory 21 may include a high-speed random access memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory, and may also be a U disk, a removable hard disk , read-only memory, magnetic disk or optical disk, etc.

处理器22,用于执行存储器存储的计算机程序,以实现上述实施例中的容量评估参数控制方法。具体可以参见前述方法实施例中的相关描述。该处理器22可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific IntegratedCircuit,ASIC)等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合发明所公开的方法的步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。The processor 22 is configured to execute the computer program stored in the memory, so as to realize the capacity evaluation parameter control method in the above embodiment. For details, refer to the relevant descriptions in the foregoing method embodiments. The processor 22 may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in conjunction with the invention can be directly embodied as executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

可选地,存储器21既可以是独立的,也可以跟处理器22集成在一起。Optionally, the memory 21 may be independent or integrated with the processor 22 .

当存储器21是独立于处理器22之外的器件时,容量评估参数控制设备20还可以包括总线23。该总线23用于连接存储器21和处理器22。该总线23可以是工业标准体系结构(Industry Standard Architecture,ISA)总线、外部设备互连(Peripheral ComponentInterconnect,PCI)总线或扩展工业标准体系结构(Extended Industry StandardArchitecture,EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,本申请附图中的总线并不限定仅有一根总线或一种类型的总线。When the memory 21 is a separate device from the processor 22 , the capacity evaluation parameter control device 20 may also include a bus 23 . The bus 23 is used to connect the memory 21 and the processor 22 . The bus 23 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus can be divided into address bus, data bus, control bus and so on. For convenience of representation, the buses in the drawings of the present application are not limited to only one bus or one type of bus.

通信接口24,可以通过总线23与处理器21连接。该通信接口24可以与被测设备通信,并从被测设备获取被测设备的至少一个系统参数的参数值。该通信接口还可以根据容量评估用例向被测设备发送评估信号,实现对该被测设备的评估。The communication interface 24 can be connected to the processor 21 through the bus 23 . The communication interface 24 can communicate with the device under test, and obtain a parameter value of at least one system parameter of the device under test from the device under test. The communication interface can also send an evaluation signal to the device under test according to the capacity evaluation use case, so as to realize the evaluation of the device under test.

本实施例提供的容量评估参数控制设备可用于执行上述的容量评估参数控制方法,其实现方式和技术效果类似,本实施例此处不再赘述。The capacity evaluation parameter control device provided in this embodiment can be used to execute the above-mentioned capacity evaluation parameter control method, and its implementation manner and technical effects are similar, and details are not described herein again in this embodiment.

本申请还提供一种计算机可读存储介质,计算机可读存储介质中存储有计算机程序,计算机程序被处理器执行时用于实现上述的各种实施方式提供的方法。The present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, is used to implement the methods provided by the above-mentioned various embodiments.

其中,计算机可读存储介质可以是计算机存储介质,也可以是通信介质。通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。计算机存储介质可以是通用或专用计算机能够存取的任何可用介质。例如,计算机可读存储介质耦合至处理器,从而使处理器能够从该计算机可读存储介质读取信息,且可向该计算机可读存储介质写入信息。当然,计算机可读存储介质也可以是处理器的组成部分。处理器和计算机可读存储介质可以位于专用集成电路(Application Specific Integrated Circuits,ASIC)中。另外,该ASIC可以位于用户设备中。当然,处理器和计算机可读存储介质也可以作为分立组件存在于通信设备中。The computer-readable storage medium may be a computer storage medium or a communication medium. Communication media includes any medium that facilitates transfer of a computer program from one place to another. Computer storage media can be any available media that can be accessed by a general purpose or special purpose computer. For example, a computer-readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the computer-readable storage medium. Of course, the computer-readable storage medium can also be an integral part of the processor. The processor and the computer-readable storage medium may reside in Application Specific Integrated Circuits (ASIC). Alternatively, the ASIC may be located in the user equipment. Of course, the processor and computer-readable storage medium may also exist in the communication device as discrete components.

具体地,该计算机可读存储介质可以是由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(Static Random-Access Memory,SRAM),电可擦除可编程只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM),可擦除可编程只读存储器(Erasable Programmable Read Only Memory,EPROM),可编程只读存储器(Programmable read-only memory,PROM),只读存储器(Read-OnlyMemory,ROM),磁存储器,快闪存储器,磁盘或光盘。存储介质可以是通用或专用计算机能够存取的任何可用介质。Specifically, the computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random-Access Memory (SRAM), electrically erasable Except Programmable Read-Only Memory (Electrically-Erasable Programmable Read-Only Memory, EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM) ), read-only memory (Read-Only Memory, ROM), magnetic memory, flash memory, magnetic disk or optical disk. A storage medium can be any available medium that can be accessed by a general purpose or special purpose computer.

本申请还提供一种计算机程序产品,该计算机程序产品包括计算机程序,该计算机程序存储在计算机可读存储介质中。设备的至少一个处理器可以从计算机可读存储介质中读取该计算机程序,至少一个处理器执行该计算机程序使得设备实施上述的各种实施方式提供的方法。The present application also provides a computer program product comprising a computer program stored in a computer-readable storage medium. At least one processor of the device can read the computer program from a computer-readable storage medium, and the at least one processor executes the computer program to cause the device to implement the methods provided by the various embodiments described above.

本申请实施例还提供一种芯片,该芯片包括存储器和处理器,存储器用于存储计算机程序,处理器用于从存储器中调用并运行计算机程序,使得安装有芯片的设备执行如上各种可能的实施方式中的方法。An embodiment of the present application further provides a chip, the chip includes a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device installed with the chip can perform various possible implementations as above method in method.

在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅是示意性的,例如,模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或模块的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another A system, or some feature, can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or modules, and may be in electrical, mechanical or other forms.

其中,各个模块可以是物理上分开的,例如安装于一个的设备的不同位置,或者安装于不同的设备上,或者分布到多个网络单元上,或者分布到多个处理器上。各个模块也可以是集成在一起的,例如,安装于同一个设备中,或者,集成在一套代码中。各个模块可以以硬件的形式存在,或者也可以以软件的形式存在,或者也可以采用软件加硬件的形式实现。本申请可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。Wherein, each module may be physically separated, for example, installed in different positions of one device, or installed on different devices, or distributed to multiple network units, or distributed to multiple processors. The individual modules can also be integrated, eg, installed in the same device, or integrated in a set of codes. Each module can exist in the form of hardware, or can also exist in the form of software, or can also be implemented in the form of software plus hardware. The present application may select some or all of the modules according to actual needs to achieve the purpose of the solution of this embodiment.

当各个模块以软件功能模块的形式实现的集成的模块,可以存储在一个计算机可读取存储介质中。上述软件功能模块存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例方法的部分步骤。When each module is implemented as an integrated module in the form of a software function module, it can be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium, and include several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute some steps of the methods of various embodiments of the present application.

应该理解的是,虽然上述实施例中的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,其可以以其他的顺序执行。而且,图中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,其执行顺序也不必然是依次进行,而是可以与其他步骤或者其他步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that, although the steps in the flow charts in the above embodiments are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order and may be performed in other orders. Moreover, at least a part of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential. Instead, it may be performed in turn or alternately with other steps or at least a portion of sub-steps or stages of other steps.

最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制。尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换。而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that the technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced. . However, these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims (11)

1. A capacity estimation parameter control method, characterized in that the method comprises:
acquiring a parameter value of at least one system parameter of the tested equipment;
determining a parameter value of at least one evaluation parameter of the tested equipment according to the parameter value of at least one system parameter of the tested equipment and a preset tuning algorithm;
and generating a capacity evaluation use case of the tested device according to the parameter value of the at least one evaluation parameter, wherein the capacity evaluation use case is used for evaluating the capacity of the tested device.
2. The method according to claim 1, wherein the determining a parameter value of at least one evaluation parameter of the device under test according to the parameter value of the at least one system parameter of the device under test and a preset tuning algorithm specifically comprises:
determining a parameter adjustment range of each evaluation parameter of the tested device according to a parameter value of at least one system parameter of the tested device;
and determining the parameter value of each evaluation parameter of the tested equipment according to the parameter adjustment range of each evaluation parameter and a preset tuning algorithm.
3. The method according to claim 2, wherein the determining a parameter adjustment range for each evaluation parameter of the device under test according to the parameter value of the at least one system parameter of the device under test specifically comprises:
and aiming at each evaluation parameter, obtaining a calculation model corresponding to the evaluation parameter, inputting the parameter value of the system parameter into the calculation model corresponding to the evaluation parameter, and calculating to obtain the parameter adjustment range of the evaluation parameter.
4. The method according to claim 2, wherein the determining the parameter value of each evaluation parameter of the device under test according to the parameter adjustment range of each evaluation parameter and a preset tuning algorithm specifically comprises:
generating a parameter matrix according to the parameter adjustment range of each evaluation parameter;
and inputting the parameter matrix into the preset tuning algorithm to obtain the parameter value of each evaluation parameter in the evaluation parameters.
5. The method according to any one of claims 1-4, further comprising:
evaluating the tested equipment by using the capacity evaluation use case corresponding to the tested equipment to obtain an evaluation result;
and determining an evaluation index of the tested device according to the evaluation result, wherein the evaluation index is used for indicating the real capacity of the tested device.
6. The method according to any of claims 1-4, wherein the at least one system parameter comprises at least one of a CPU parameter, a memory parameter, an IO parameter, and a network parameter.
7. A capacity estimation parameter control system, the system comprising:
the acquisition module is used for acquiring a parameter value of at least one system parameter of the tested equipment;
the control module is used for determining the parameter value of at least one evaluation parameter of the tested equipment according to the parameter value of at least one system parameter of the tested equipment and a preset tuning algorithm; and generating a capacity evaluation use case of the tested device according to the parameter value of the at least one evaluation parameter, wherein the capacity evaluation use case is used for evaluating the capacity of the tested device.
8. The system of claim 7, further comprising:
the evaluation module is used for evaluating the tested equipment by using the capacity evaluation use case corresponding to the tested equipment to obtain an evaluation result; and determining an evaluation index of the tested device according to the evaluation result, wherein the evaluation index is used for indicating the real capacity of the tested device.
9. A capacity estimation parameter control apparatus, characterized in that the apparatus comprises: a memory, a processor;
the memory is used for storing a computer program; the processor is configured to implement the capacity estimation parameter control method according to the computer program stored in the memory, according to any one of claims 1 to 6.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, is configured to implement the capacity estimation parameter control method according to any one of claims 1 to 6.
11. A computer program product, characterized in that the computer program product comprises a computer program which, when being executed by a processor, implements the capacity estimation parameter control method of any one of claims 1 to 6.
CN202210199376.4A 2022-03-02 2022-03-02 Capacity evaluation parameter control method and system Active CN114579442B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210199376.4A CN114579442B (en) 2022-03-02 2022-03-02 Capacity evaluation parameter control method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210199376.4A CN114579442B (en) 2022-03-02 2022-03-02 Capacity evaluation parameter control method and system

Publications (2)

Publication Number Publication Date
CN114579442A true CN114579442A (en) 2022-06-03
CN114579442B CN114579442B (en) 2025-08-01

Family

ID=81771171

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210199376.4A Active CN114579442B (en) 2022-03-02 2022-03-02 Capacity evaluation parameter control method and system

Country Status (1)

Country Link
CN (1) CN114579442B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6522995B1 (en) * 1999-12-28 2003-02-18 International Business Machines Corporation Method and apparatus for web-based control of a web-based workload simulation
CN107273296A (en) * 2017-06-26 2017-10-20 上海传英信息技术有限公司 The method of testing and test device of a kind of software
CN110798373A (en) * 2019-09-20 2020-02-14 苏州浪潮智能科技有限公司 A method for realizing performance test, test server and computer storage medium
US20200167269A1 (en) * 2018-11-26 2020-05-28 Red Hat, Inc. Optimal selection of relevant testing parameters
CN111488271A (en) * 2020-03-10 2020-08-04 中移(杭州)信息技术有限公司 Message middleware tuning method, system, electronic equipment and storage medium
CN111552631A (en) * 2020-03-27 2020-08-18 中国平安人寿保险股份有限公司 System testing method, device and computer readable storage medium
US20210165729A1 (en) * 2019-12-02 2021-06-03 Bank Of America Corporation System for intelligent unit performance testing of computer applications
CN113407426A (en) * 2021-06-17 2021-09-17 北京字跳网络技术有限公司 Server cluster capacity evaluation method and device, electronic equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6522995B1 (en) * 1999-12-28 2003-02-18 International Business Machines Corporation Method and apparatus for web-based control of a web-based workload simulation
CN107273296A (en) * 2017-06-26 2017-10-20 上海传英信息技术有限公司 The method of testing and test device of a kind of software
US20200167269A1 (en) * 2018-11-26 2020-05-28 Red Hat, Inc. Optimal selection of relevant testing parameters
CN110798373A (en) * 2019-09-20 2020-02-14 苏州浪潮智能科技有限公司 A method for realizing performance test, test server and computer storage medium
US20210165729A1 (en) * 2019-12-02 2021-06-03 Bank Of America Corporation System for intelligent unit performance testing of computer applications
CN111488271A (en) * 2020-03-10 2020-08-04 中移(杭州)信息技术有限公司 Message middleware tuning method, system, electronic equipment and storage medium
CN111552631A (en) * 2020-03-27 2020-08-18 中国平安人寿保险股份有限公司 System testing method, device and computer readable storage medium
CN113407426A (en) * 2021-06-17 2021-09-17 北京字跳网络技术有限公司 Server cluster capacity evaluation method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114579442B (en) 2025-08-01

Similar Documents

Publication Publication Date Title
WO2019153487A1 (en) System performance measurement method and device, storage medium and server
CN110347582A (en) Buried point testing method and device
CN111881023A (en) A software aging prediction method and device based on multi-model comparison
WO2023169274A1 (en) Data processing method and device, and storage medium and processor
CN110728306A (en) Target parameter selection method in reverse proxy evaluation model and related device
CN113946983A (en) Method and device for evaluating weak links of product reliability and computer equipment
CN108376369A (en) Finance and money management Products Show method, equipment, system and storage medium
CN110602207A (en) Method, device, server and storage medium for predicting push information based on off-network
CN120353677A (en) System performance test method, device, computer equipment and readable storage medium
CN115526498A (en) Method, device and medium for service evaluation
CN114579442A (en) Capacity estimation parameter control method and system
CN113205230A (en) Data prediction method, device and equipment based on model set and storage medium
CN109344025A (en) CPU performance self-monitoring method and server
CN111352825A (en) Test method, device and server for data interface
CN116204396A (en) Test method and device for performance of analytical database
CN118093332A (en) Processor task analysis method and related device
CN111340349B (en) Product reliability evaluation method, device, computer equipment and storage medium
CN112699140B (en) Data processing method, device, equipment and storage medium
CN114860608A (en) Scene construction based system automation testing method, device, equipment and medium
CN113590448A (en) CPU utilization rate simulation method and device and electronic equipment
CN114564375B (en) Working pressure determining method and device, electronic equipment and storage medium
CN113434215B (en) Information loading method and device, storage medium and processor
CN119227020B (en) Product information determining method, device, electronic equipment and medium
CN114963630B (en) System Debugging Method of Semiconductor Refrigeration Equipment
CN114003373B (en) Service testing method, device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant