[go: up one dir, main page]

CN114819095A - Method, device and electronic device for generating business data processing model - Google Patents

Method, device and electronic device for generating business data processing model Download PDF

Info

Publication number
CN114819095A
CN114819095A CN202210507967.3A CN202210507967A CN114819095A CN 114819095 A CN114819095 A CN 114819095A CN 202210507967 A CN202210507967 A CN 202210507967A CN 114819095 A CN114819095 A CN 114819095A
Authority
CN
China
Prior art keywords
target
operator
information
candidate
evaluation information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210507967.3A
Other languages
Chinese (zh)
Other versions
CN114819095B (en
Inventor
叶方捷
李晓晨
乔爽爽
施恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202210507967.3A priority Critical patent/CN114819095B/en
Publication of CN114819095A publication Critical patent/CN114819095A/en
Application granted granted Critical
Publication of CN114819095B publication Critical patent/CN114819095B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/211Selection of the most significant subset of features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Medical Informatics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The utility model provides a method and a device for generating a business data processing model and an electronic device, which relate to the technical field of artificial intelligence, in particular to the technical fields of deep learning, computer vision and the like, and comprise the following steps: the method comprises the steps of determining model evaluation information of an initial business data processing model, determining a target operator according to the model evaluation information, determining target description information of the target operator according to the model evaluation information, and generating a target business data processing model according to the target description information and the target operator.

Description

业务数据处理模型的生成方法、装置及电子设备Method, device and electronic device for generating business data processing model

技术领域technical field

本公开涉及人工智能技术领域,具体涉及深度学习、计算机视觉等技术领域,尤其涉及一种业务数据处理模型的生成方法、装置及电子设备。The present disclosure relates to the technical field of artificial intelligence, in particular to the technical fields of deep learning and computer vision, and in particular, to a method, device and electronic device for generating a business data processing model.

背景技术Background technique

人工智能是研究使计算机来模拟人的某些思维过程和智能行为(如学习、推理、思考、规划等)的学科,既有硬件层面的技术也有软件层面的技术。人工智能硬件技术一般包括如传感器、专用人工智能芯片、云计算、分布式存储、大数据处理等技术;人工智能软件技术主要包括计算机视觉技术、语音识别技术、自然语言处理技术以及机器学习/深度学习、大数据处理技术、知识图谱技术等几大方向。Artificial intelligence is the study of making computers to simulate certain thinking processes and intelligent behaviors of people (such as learning, reasoning, thinking, planning, etc.), both hardware-level technology and software-level technology. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, and machine learning/depth Learning, big data processing technology, knowledge graph technology and other major directions.

相关技术中,在生成业务数据处理模型时,模型所需算子以及算子描述信息(算子描述信息例如算子的超参数)的确定效率不高,导致目标业务数据处理模型的生成过程不够灵活,影响目标业务数据处理模型的生成效率。In the related art, when generating a business data processing model, the determination efficiency of the operators required by the model and the operator description information (the operator description information such as the hyperparameters of the operator) is not high, resulting in insufficient generation process of the target business data processing model. It is flexible and affects the generation efficiency of the target business data processing model.

发明内容SUMMARY OF THE INVENTION

本公开提供了一种业务数据处理模型的生成方法、装置、电子设备、存储介质及计算机程序产品。The present disclosure provides a method, apparatus, electronic device, storage medium and computer program product for generating a business data processing model.

根据本公开的第一方面,提供了一种业务数据处理模型的生成方法,包括:确定初始业务数据处理模型的模型评估信息;根据所述模型评估信息,确定目标算子;根据所述模型评估信息,确定所述目标算子的目标描述信息;以及根据所述目标描述信息和所述目标算子,生成目标业务数据处理模型。According to a first aspect of the present disclosure, a method for generating a business data processing model is provided, including: determining model evaluation information of an initial business data processing model; determining a target operator according to the model evaluation information; evaluating according to the model information, determine the target description information of the target operator; and generate a target service data processing model according to the target description information and the target operator.

根据本公开的第二方面,提供了一种业务数据处理模型的生成装置,包括:第一确定模块,用于确定初始业务数据处理模型的模型评估信息;第二确定模块,用于根据所述模型评估信息,确定目标算子;第三确定模块,用于根据所述模型评估信息,确定所述目标算子的目标描述信息;以及生成模块,用于根据所述目标描述信息和所述目标算子,生成目标业务数据处理模型。According to a second aspect of the present disclosure, there is provided an apparatus for generating a business data processing model, comprising: a first determination module for determining model evaluation information of an initial business data processing model; a second determination module for model evaluation information to determine a target operator; a third determination module for determining target description information of the target operator according to the model evaluation information; and a generation module for determining the target description information and the target according to the target description information The operator generates the target business data processing model.

根据本公开的第三方面,提供了一种电子设备,包括:至少一个处理器;以及与至少一个处理器通信连接的存储器;其中,存储器存储有可被至少一个处理器执行的指令,指令被至少一个处理器执行,以使至少一个处理器能够执行如本公开第一方面的业务数据处理模型的生成方法。According to a third aspect of the present disclosure, there is provided an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor. The at least one processor executes to enable the at least one processor to execute the method for generating a business data processing model according to the first aspect of the present disclosure.

根据本公开的第四方面,提供了一种存储有计算机指令的非瞬时计算机可读存储介质,计算机指令用于使计算机执行如本公开第一方面的业务数据处理模型的生成方法。According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method for generating a business data processing model according to the first aspect of the present disclosure.

根据本公开的第五方面,提供了一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现如本公开第一方面的业务数据处理模型的生成方法的步骤。According to a fifth aspect of the present disclosure, there is provided a computer program product, comprising a computer program that, when executed by a processor, implements the steps of the method for generating a business data processing model according to the first aspect of the present disclosure.

应当理解,本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征,也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that what is described in this section is not intended to identify key or critical features of embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the present disclosure will become readily understood from the following description.

附图说明Description of drawings

附图用于更好地理解本方案,不构成对本公开的限定。其中:The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present disclosure. in:

图1是根据本公开第一实施例的示意图;1 is a schematic diagram according to a first embodiment of the present disclosure;

图2是根据本公开第二实施例的示意图;2 is a schematic diagram according to a second embodiment of the present disclosure;

图3是根据本公开第三实施例的示意图;3 is a schematic diagram according to a third embodiment of the present disclosure;

图4是根据本公开第四实施例的示意图;4 is a schematic diagram according to a fourth embodiment of the present disclosure;

图5是根据本公开第五实施例的示意图;5 is a schematic diagram according to a fifth embodiment of the present disclosure;

图6是根据本公开第六实施例的示意图;6 is a schematic diagram according to a sixth embodiment of the present disclosure;

图7是根据本公开第七实施例的示意图;FIG. 7 is a schematic diagram according to a seventh embodiment of the present disclosure;

图8是本公开实施例中的示例性业务数据处理模型的生成装置的框图;8 is a block diagram of an apparatus for generating an exemplary business data processing model in an embodiment of the present disclosure;

图9示出了可以用来实施本公开的业务数据处理模型的生成方法的示例电子设备的示意性框图。FIG. 9 shows a schematic block diagram of an example electronic device that can be used to implement the business data processing model generation method of the present disclosure.

具体实施方式Detailed ways

以下结合附图对本公开的示范性实施例做出说明,其中包括本公开实施例的各种细节以助于理解,应当将它们认为仅仅是示范性的。因此,本领域普通技术人员应当认识到,可以对这里描述的实施例做出各种改变和修改,而不会背离本公开的范围和精神。同样,为了清楚和简明,以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

图1是根据本公开第一实施例的示意图。FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure.

其中,需要说明的是,本实施例的业务数据处理模型的生成方法的执行主体为业务数据处理模型的生成装置,该装置可以由软件和/或硬件的方式实现,该装置可以配置在电子设备中,电子设备可以包括但不限于终端、服务器端等。It should be noted that the execution body of the method for generating a business data processing model in this embodiment is a device for generating a business data processing model, the device may be implemented by software and/or hardware, and the device may be configured in an electronic device , the electronic device may include, but is not limited to, a terminal, a server, and the like.

本公开实施例涉及人工智能技术领域,具体涉及深度学习、计算机视觉等技术领域。The embodiments of the present disclosure relate to the technical field of artificial intelligence, and specifically to the technical fields of deep learning, computer vision, and the like.

其中,人工智能(Artificial Intelligence),英文缩写为AI。它是研究、开发用于模拟、延伸和扩展人的智能的理论、方法、技术及应用系统的一门新的技术科学。Among them, artificial intelligence (Artificial Intelligence), the English abbreviation is AI. It is a new technical science that studies and develops theories, methods, techniques and application systems for simulating, extending and expanding human intelligence.

深度学习,是学习样本数据的内在规律和表示层次,这些学习过程中获得的信息对诸如文字,图像和声音等数据的解释有很大的帮助。深度学习的最终目标是让机器能够像人一样具有分析学习能力,能够识别文字、图像和声音等数据。Deep learning is to learn the inherent laws and representation levels of sample data, and the information obtained during these learning processes is of great help to the interpretation of data such as text, images and sounds. The ultimate goal of deep learning is to enable machines to have the ability to analyze and learn like humans, and to recognize data such as words, images, and sounds.

计算机视觉,是指用摄影机和电脑代替人眼对目标进行识别、跟踪和测量等机器视觉,并进一步做图形处理,使电脑处理成为更适合人眼观察或传送至仪器检测的图像。Computer vision refers to the use of cameras and computers instead of human eyes to identify, track and measure targets, and further perform graphics processing to make computer processing images more suitable for human eyes to observe or transmit to instruments for detection.

本公开的技术方案中,所涉及的用户个人信息的收集、存储、使用、加工、传输、提供和公开等处理,均符合相关法律法规的规定,且不违背公序良俗。In the technical solutions of the present disclosure, the collection, storage, use, processing, transmission, provision, and disclosure of the user's personal information involved are all in compliance with relevant laws and regulations, and do not violate public order and good customs.

如图1所示,该业务数据处理模型的生成方法,包括:As shown in Figure 1, the generation method of the business data processing model includes:

S101:确定初始业务数据处理模型的模型评估信息。S101: Determine model evaluation information of an initial business data processing model.

其中,模型,可以例如为人工智能模型,例如神经网络模型、机器学习模型等。The model may be, for example, an artificial intelligence model, such as a neural network model, a machine learning model, or the like.

其中,业务数据处理模型,可以是指被用于处理各种业务数据的模型。The business data processing model may refer to a model used to process various business data.

其中,初始业务数据处理模型,可以是对人工智能模型进行训练的训练初始阶段所得到的业务数据处理模型,或者,当对人工智能模型执行多个轮次的迭代训练时,也可以将上一轮迭代训练所得业务数据处理模型作为初始业务数据处理模型,或者,该初始业务数据处理模型,还可以是预先配置的初始业务数据处理模型。The initial business data processing model may be the business data processing model obtained in the initial stage of training the artificial intelligence model, or, when multiple rounds of iterative training are performed on the artificial intelligence model, the previous The business data processing model obtained by the rounds of iterative training is used as the initial business data processing model, or the initial business data processing model may also be a preconfigured initial business data processing model.

本公开实施例中,可以分析并评估初始业务数据处理模型的模型性能,得到模型评估信息,而后,基于该模型评估信息指导下一轮迭代训练过程中算子的选取和超参数的设置,对此不做限制。In the embodiment of the present disclosure, the model performance of the initial business data processing model can be analyzed and evaluated to obtain model evaluation information, and then, based on the model evaluation information, the selection of operators and the setting of hyperparameters in the next round of iterative training process are guided. This does not limit.

本公开实施例中,初始业务数据处理模型可以由多个算子构建,并对多个算子所构建业务数据处理模型训练得到,在基于多个算子构建业务数据处理模型时,还可以确定各个算子的描述信息(描述信息例如为超参数),而后,基于描述信息配置各个算子,以得到业务数据处理模型,并展开后续业务数据处理模型的训练过程,得到初始业务数据处理模型。In this embodiment of the present disclosure, the initial business data processing model may be constructed by multiple operators, and obtained by training the business data processing models constructed by the multiple operators. When constructing the business data processing model based on multiple operators, it is also possible to determine The description information of each operator (the description information is, for example, hyperparameters), and then configure each operator based on the description information to obtain a business data processing model, and start the training process of the subsequent business data processing model to obtain the initial business data processing model.

本公开实施例中,在训练得到初始业务数据处理模型的过程中,还可以动态分析初始业务数据处理模型的表现性能,以得到其模型评估信息,用于下一轮迭代过程中算子的选取和超参数的设置,对此不做限制。In the embodiment of the present disclosure, in the process of obtaining the initial business data processing model through training, the performance of the initial business data processing model can also be dynamically analyzed to obtain its model evaluation information, which is used for operator selection in the next round of iterations. and hyperparameter settings, there are no restrictions on this.

本公开实施例中,可以预先配置一个算子搜索空间,该算子搜索空间中可以包括多种类型算子,并设置一个参数搜索空间,该参数搜索空间可以包括与各种类型算子所对应的超参数,则在每轮迭代过程中,可以从算子搜索空间中选取当轮迭代所需的目标算子,以及从参数搜索空间中选取当轮迭代所需的超参数(可以被作为目标描述信息),对此不做限制。In this embodiment of the present disclosure, an operator search space may be pre-configured, and the operator search space may include multiple types of operators, and a parameter search space may be set, and the parameter search space may include operators corresponding to various types of operators. , in each iteration process, the target operator required for the current iteration can be selected from the operator search space, and the hyperparameters required for the current iteration can be selected from the parameter search space (which can be used as the target). description), there is no restriction on this.

本公开实施例中,上述初始业务数据处理模型的数量可以是一个或者多个,而业务数据模型可以处理的业务数据可以例如是金融风控数据、视频数据、图像数据、文本数据、音频数据等,对此不做限制。In the embodiment of the present disclosure, the number of the above-mentioned initial business data processing models may be one or more, and the business data that the business data model can process may be, for example, financial risk control data, video data, image data, text data, audio data, etc. , there is no restriction on this.

其中,模型评估信息,可以是指针对上述业务数据处理模型的一个或多个维度的属性特征进行评估,所得到的相关信息,例如,可以是初始业务数据处理模型的工作效率评估信息、稳定性评估信息、输出准确率评估信息等,对此不做限制。Wherein, the model evaluation information may refer to evaluating the attribute features of one or more dimensions of the above-mentioned business data processing model, and the obtained relevant information, for example, may be the work efficiency evaluation information, stability and stability of the initial business data processing model. Evaluation information, output accuracy evaluation information, etc., are not limited.

本公开实施例中,在确定初始业务数据处理模型的模型评估信息时,可以是预先建立本公开实施例的执行主体与大数据服务器的通信链接,而后从大数据服务器处获取初始业务数据处理模型对应的模型评估信息,或者,也可以是预先获取多个参考业务数据,而后使用该初始业务数据处理模型对多个参考业务数据进行处理,而后根据处理结果分析得到对应的模型评估信息,对此不做限制。In the embodiment of the present disclosure, when determining the model evaluation information of the initial business data processing model, the communication link between the executive body and the big data server in the embodiment of the present disclosure may be established in advance, and then the initial business data processing model is obtained from the big data server. Corresponding model evaluation information, alternatively, it is possible to obtain multiple reference business data in advance, and then use the initial business data processing model to process the multiple reference business data, and then analyze and obtain the corresponding model evaluation information according to the processing result. No restrictions.

S102:根据模型评估信息,确定目标算子。S102: Determine a target operator according to the model evaluation information.

其中,算子,即指机器学习算法,可以是指在业务数据上运行以创建业务数据处理模型的过程,该算子可以例如是K-邻近算法、线性回归算法等,对此不作限制。The operator refers to a machine learning algorithm, which may refer to the process of running on business data to create a business data processing model. The operator may be, for example, a K-proximity algorithm, a linear regression algorithm, etc., which is not limited.

而目标算子,可以是指基于模型评估信息所选取的算子,由于可以参考初始业务数据处理模型的模型评估信息来选取目标算子,则所得目标算子可以适用于当轮待构建的目标业务数据处理模型。The target operator can refer to the operator selected based on the model evaluation information. Since the target operator can be selected with reference to the model evaluation information of the initial business data processing model, the obtained target operator can be applied to the target to be constructed in the current round. Business data processing model.

一些实施例中,根据模型评估信息,确定目标算子,可以是预先配置评估阈值,而后随机挑选候选算子,并基于模型评估信息确定候选算子对应的候选算子评估信息,将候选算子评估信息与评估阈值进行分析对比,在候选算子评估信息大于或等于评估阈值时,将对应候选算子作为目标算子,对此不做限制。In some embodiments, the target operator is determined according to the model evaluation information, which may be a pre-configured evaluation threshold, and then a candidate operator is randomly selected, and the candidate operator evaluation information corresponding to the candidate operator is determined based on the model evaluation information, and the candidate operator is determined. The evaluation information is analyzed and compared with the evaluation threshold. When the evaluation information of the candidate operator is greater than or equal to the evaluation threshold, the corresponding candidate operator is used as the target operator, which is not limited.

另一些实施例中,根据模型评估信息,确定目标算子,还可以是获取各个可选算子的算子特征,而后,分析模型评估信息与各个算子特征之间的匹配程度,根据各个匹配程度从多个可选算子中确定目标算子,对此不做限制。In other embodiments, the target operator is determined according to the model evaluation information, and the operator characteristics of each optional operator may also be obtained, and then the matching degree between the model evaluation information and the characteristics of each operator is analyzed, according to the matching degree of each operator. The degree determines the target operator from multiple optional operators, which is not limited.

当然,还可以是采用其他任意可能的方法实现根据模型评估信息确定目标算子,如工程学方法、数形结合等方式,对此不做限制。Of course, any other possible methods can also be used to realize the determination of the target operator according to the model evaluation information, such as engineering methods, combination of numbers and shapes, etc., which are not limited.

本公开实施例中,由于在生成目标业务数据处理模型的过程中可供选择的算子数量可能是多个,且不同算子对应的性能信息可能存在差异,当根据模型评估信息,确定目标算子,可以保证目标算子的性能,为后续目标业务数据处理模型的生成过程提供可靠的参考信息。In the embodiment of the present disclosure, since the number of operators that can be selected in the process of generating the target service data processing model may be multiple, and the performance information corresponding to different operators may be different, when the target operator is determined according to the model evaluation information It can guarantee the performance of the target operator and provide reliable reference information for the subsequent generation process of the target business data processing model.

S103:根据模型评估信息,确定目标算子的目标描述信息。S103: Determine target description information of the target operator according to the model evaluation information.

其中,描述信息,可以是指算子对应的超参数,即被用于确定模型的一些参数,超参数不同,模型是不同的(举例而言,不同层数的卷积神经网络模型是不同的模型),超参数可以是根据经验确定的变量,也可以根据应用场景进行配置,对此不做限制。Among them, the description information can refer to the hyperparameters corresponding to the operator, that is, some parameters used to determine the model, different hyperparameters, different models (for example, different layers of convolutional neural network models are different model), the hyperparameters can be variables determined according to experience, or can be configured according to the application scenario, which is not limited.

举例而言,在深度学习中,超参数包括:学习速率,迭代次数,层数,每层神经元的个数等。For example, in deep learning, hyperparameters include: learning rate, number of iterations, number of layers, number of neurons in each layer, etc.

其中,目标描述信息,是指目标算子的多个描述信息中基于模型评估信息确定的,可以被用于生成目标业务数据处理模型的描述信息,目标描述信息例如为指定的学习速率、迭代次数、模型层数等。The target description information refers to the description information of the target operator, which is determined based on the model evaluation information and can be used to generate the target business data processing model. The target description information is, for example, the specified learning rate and the number of iterations. , model layers, etc.

一些实施例中,根据模型评估信息,确定目标算子的目标描述信息,可以是确定目标算子的初始描述信息,基于该初始描述信息生成对应的初始向量,并对初始向量进行赋值并改变初始向量的值,基于模型评估信息对各种取值的初始向量对应的目标算子性能进行评估,并形成对应的评估值,选择值最大评估值对应的初始向量的取值作为初始向量的最终优化值,而后基于该最终优化值优化初始描述信息,以获取目标描述信息。In some embodiments, determining the target description information of the target operator according to the model evaluation information may be determining the initial description information of the target operator, generating a corresponding initial vector based on the initial description information, and assigning a value to the initial vector and changing the initial value. The value of the vector, based on the model evaluation information, evaluate the performance of the target operator corresponding to the initial vector of various values, and form the corresponding evaluation value, and select the value of the initial vector corresponding to the maximum evaluation value as the final optimization of the initial vector value, and then optimize the initial description information based on the final optimized value to obtain the target description information.

另一些实施例中,根据模型评估信息,确定目标算子的目标描述信息,还可以是采用其他任意可能的方法根据模型评估信息,确定目标算子的目标描述信息,如确定目标算子对应的初始描述信息,而后采用贝叶斯优化的方法对其进行优化,以生成目标描述信息,对此不做限制。In other embodiments, the target description information of the target operator is determined according to the model evaluation information, or any other possible method may be used to determine the target description information of the target operator according to the model evaluation information, such as determining the corresponding information of the target operator. The initial description information is then optimized by the Bayesian optimization method to generate the target description information, which is not limited.

可以理解的是,同一算子可以分别采用不同的描述信息,且不同描述信息结合算子所生成的模型性能可能存在差异,而基于模型评估信息确定目标算子的目标描述信息,可以保证所得目标描述信息的描述效果,能够提升该目标描述信息在目标业务数据处理模型生成过程中的可靠性。It can be understood that the same operator can use different description information, and the performance of models generated by combining different description information with operators may be different. Determining the target description information of the target operator based on the model evaluation information can guarantee the obtained target. The description effect of the description information can improve the reliability of the target description information in the process of generating the target business data processing model.

本公开实施例在确定初始业务数据处理模型的模型评估信息之后,可以基于模型评估信息分别确定适配的目标算子和目标描述信息,以此实现目标算子和目标描述信息的确定过程的有效解耦,在保障目标算子和目标描述信息对模型性能贡献程度的同时,有效提升目标业务数据处理模型生成过程的灵活性,提升目标业务数据处理模型生成效率。In this embodiment of the present disclosure, after the model evaluation information of the initial business data processing model is determined, the adapted target operator and the target description information can be respectively determined based on the model evaluation information, so as to realize the effective process of determining the target operator and the target description information. Decoupling, while ensuring the contribution of target operators and target description information to model performance, effectively improves the flexibility of the target business data processing model generation process, and improves the generation efficiency of the target business data processing model.

本公开实施例中,目标算子的数量还可以是多个,相应的,各个目标算子分别具有对应的目标描述信息,则在根据模型评估信息确定目标算子的过程中,还可以是基于模型评估信息同时确定出多个目标算子,以及与各个目标算子所对应目标描述信息,从而较大程度上提升目标算子和目标描述信息的搜索选取效率。In this embodiment of the present disclosure, the number of target operators may also be multiple. Correspondingly, each target operator has corresponding target description information. In the process of determining the target operator according to the model evaluation information, the target operator may also be determined based on the model evaluation information. The model evaluation information simultaneously determines multiple target operators and target description information corresponding to each target operator, thereby greatly improving the search and selection efficiency of target operators and target description information.

S104:根据目标描述信息和目标算子,生成目标业务数据处理模型。S104: Generate a target business data processing model according to the target description information and the target operator.

其中,目标业务数据处理模型,可以是指基于目标描述信息和目标算子所生成的业务数据处理模型。The target business data processing model may refer to a business data processing model generated based on target description information and target operators.

也即是说,本公开实施例在根据模型评估信息确定目标描述信息和目标算子之后,可以基于目标描述信息对目标算子进行描述处理,并基于描述后的目标算子生成目标业务数据处理模型。That is to say, after determining the target description information and the target operator according to the model evaluation information, the embodiment of the present disclosure can perform description processing on the target operator based on the target description information, and generate target service data processing based on the described target operator. Model.

一些实施例中,目标算子的数量可以是多个,根据目标描述信息和目标算子,生成目标业务数据处理模型,可以是确定多个目标算子的优先级信息,而后根据该优先级信息分别采用目标描述信息对对应目标算子进行描述处理,以得到多个描述后目标算子,并基于多个描述后目标算子生成目标业务数据处理模型。In some embodiments, the number of target operators may be multiple, and the target business data processing model is generated according to the target description information and the target operators, which may be to determine the priority information of multiple target operators, and then according to the priority information. The corresponding target operators are described and processed by using the target description information respectively, so as to obtain a plurality of post-description target operators, and a target business data processing model is generated based on the plurality of post-description target operators.

另一些实施例中,根据目标描述信息和目标算子,生成目标业务数据处理模型,还可以是随机从多个目标算子中挑选一个或多个目标算子作为待描述目标算子,并根据待描述目标算子对应的目标描述信息对待描述目标算子进行描述处理,以得到多个描述后目标算子,并基于多个描述后目标算子生成目标业务数据处理模型,对此不做限制。In other embodiments, the target business data processing model is generated according to the target description information and the target operator, and one or more target operators may be randomly selected from multiple target operators as the target operator to be described, and according to The target description information corresponding to the target operator to be described performs description processing on the target operator to be described to obtain a plurality of post-description target operators, and generates a target business data processing model based on the plurality of post-description target operators, which is not limited. .

本实施例中,通过确定初始业务数据处理模型的模型评估信息,根据模型评估信息,确定目标算子,根据模型评估信息,确定目标算子的目标描述信息,以及根据目标描述信息和目标算子,生成目标业务数据处理模型,由此,可以基于模型评估信息分别确定目标算子和目标描述信息,实现对目标算子和目标描述信息的确定过程进行解耦,有效提升目标业务数据处理模型生成过程的灵活性,提升目标业务数据处理模型生成效率。In this embodiment, the model evaluation information of the initial business data processing model is determined, the target operator is determined according to the model evaluation information, the target description information of the target operator is determined according to the model evaluation information, and the target description information and the target operator are determined according to the target description information and the target operator. , to generate the target business data processing model, thus, the target operator and target description information can be determined respectively based on the model evaluation information, so as to realize the decoupling of the determination process of the target operator and the target description information, and effectively improve the generation of target business data processing model. The flexibility of the process improves the generation efficiency of the target business data processing model.

图2是根据本公开第二实施例的示意图。FIG. 2 is a schematic diagram of a second embodiment according to the present disclosure.

如图2所示,该业务数据处理模型的生成方法,包括:As shown in Figure 2, the generation method of the business data processing model includes:

S201:确定初始业务数据处理模型的模型评估信息。S201: Determine model evaluation information of an initial business data processing model.

S201的描述说明可以具体参见上述实施例,在此不再赘述。The description of S201 may refer to the above-mentioned embodiments for details, and details are not repeated here.

S202:确定多个候选算子。S202: Determine multiple candidate operators.

其中,候选算子,是指可能被用于作为目标算子的多个算子。The candidate operator refers to multiple operators that may be used as target operators.

本公开实施例中,确定多个候选算子,可以是预先确定应用场景和上述初始业务数据处理模型的特征信息,并基于该特征信息确定可能适用于该业务数据处理模型的多个算子作为候选算子,由此,可以为后续确定目标算子提供可靠的分析对象。In the embodiment of the present disclosure, to determine multiple candidate operators, it may be to predetermine the feature information of the application scenario and the above-mentioned initial business data processing model, and to determine, based on the feature information, multiple operators that may be applicable to the business data processing model as The candidate operator, thus, can provide a reliable analysis object for the subsequent determination of the target operator.

S203:根据模型评估信息,确定与各个候选算子对应的候选算子评估信息。S203: Determine candidate operator evaluation information corresponding to each candidate operator according to the model evaluation information.

其中,候选算子评估信息,是指基于模型评估信息所确定的候选算子的评估信息,该候选算子评估信息,可以被用于对候选算子的性能进行评估,以确定不同候选算子之间的性能差异。该候选算子评估信息可以包括候选算子对应的迭代参与次数、算子性能信息等,对此不做限制。The candidate operator evaluation information refers to the evaluation information of the candidate operator determined based on the model evaluation information. The candidate operator evaluation information can be used to evaluate the performance of the candidate operator to determine different candidate operators. performance differences. The candidate operator evaluation information may include the iteration participation times corresponding to the candidate operator, operator performance information, etc., which is not limited.

一些实施例中,根据模型评估信息,确定与各个候选算子对应的候选算子评估信息,可以是基于模型评估信息确定各个候选算子在执行过程中所消耗的时间资源和系统内存资源,并将该时间资源和系统内存资源作为对应的候选算子评估信息。In some embodiments, determining the candidate operator evaluation information corresponding to each candidate operator according to the model evaluation information may be to determine the time resources and system memory resources consumed by each candidate operator in the execution process based on the model evaluation information, and The time resource and system memory resource are used as the corresponding candidate operator evaluation information.

另一些实施例中,根据模型评估信息,确定与各个候选算子对应的候选算子评估信息,还可以是基于模型评估信息确定其他任意可能的信息作为候选算子评估信息,例如各个候选算子分别对于异常输入的鲁棒性、各个候选算子自身的易读性等,对此不做限制。In other embodiments, the candidate operator evaluation information corresponding to each candidate operator is determined according to the model evaluation information, and any other possible information may be determined based on the model evaluation information as the candidate operator evaluation information, for example, each candidate operator There are no restrictions on the robustness of abnormal input and the legibility of each candidate operator.

本公开实施例中,通过根据模型评估信息,确定与各个候选算子对应的候选算子评估信息,所得候选算子评估信息可以有效表征对应候选算子一个或多个维度的评估信息,可以为后续从多个候选算子中确定目标算子提供清晰、准确的参考依据。In the embodiment of the present disclosure, by determining the candidate operator evaluation information corresponding to each candidate operator according to the model evaluation information, the obtained candidate operator evaluation information can effectively represent the evaluation information corresponding to one or more dimensions of the candidate operator, which can be Subsequent determination of the target operator from multiple candidate operators provides a clear and accurate reference.

S204:从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子。S204: Determine target operator evaluation information from multiple candidate operator evaluation information, and use the candidate operator corresponding to the target operator evaluation information as the target operator.

其中,目标算子评估信息,可以是指基于预设条件从多个候选算子评估信息中选取的一个或多个候选算子评估信息。例如,可以是确定多个候选算子评估信息的优先级信息,而后根据优先级信息从多个候选算子评估信息选取一个或多个候选算子评估信息作为目标算子评估信息。The target operator evaluation information may refer to one or more candidate operator evaluation information selected from multiple candidate operator evaluation information based on preset conditions. For example, priority information of multiple candidate operator evaluation information may be determined, and then one or more candidate operator evaluation information may be selected from the multiple candidate operator evaluation information as target operator evaluation information according to the priority information.

一些实施例中,候选算子评估信息所包含的评估信息数量可能是多个,多个评估信息对应于候选算子的多个维度特征,则从多个候选算子评估信息中确定目标算子评估信息,可以是分别对单个候选算子评估信息中的多个评估信息进行加权处理,以得到多个维度特征的综合评估信息,而后对多个候选算子评估信息对应的综合评估信息进行分析对比,并将最优综合评估信息对应的候选算子评估信息作为目标算子评估信息。In some embodiments, the number of evaluation information contained in the candidate operator evaluation information may be multiple, and the multiple evaluation information corresponds to multiple dimension features of the candidate operator, and the target operator is determined from the multiple candidate operator evaluation information. Evaluation information, which can be weighted processing of multiple evaluation information in the evaluation information of a single candidate operator to obtain comprehensive evaluation information of multiple dimension features, and then analyze the comprehensive evaluation information corresponding to the evaluation information of multiple candidate operators Compare, and take the candidate operator evaluation information corresponding to the optimal comprehensive evaluation information as the target operator evaluation information.

另一些实施例中,从多个候选算子评估信息中确定目标算子评估信息,还可以是从候选算子评估信息中选取与应用场景适配的一个或多个维度特征对应的维度评估信息,并对多个候选算子对应的维度评估信息进行分析对比,以确定适用于该应用场景的目标算子评估信息。In other embodiments, the target operator evaluation information is determined from multiple candidate operator evaluation information, and dimension evaluation information corresponding to one or more dimension features adapted to the application scenario may also be selected from the candidate operator evaluation information. , and analyze and compare the dimension evaluation information corresponding to the multiple candidate operators to determine the target operator evaluation information suitable for the application scenario.

本公开实施例中,优选的,可以确定多个候选算子,并根据模型评估信息,确定与各个候选算子对应的候选算子评估信息,而后从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子,由此,所得候选算子评估信息可以有效表征对应候选算子的性能信息,基于该候选算子评估信息可以准确、快速地从多个候选算子中确定性能较优的候选算子作为目标算子,保证该目标算子确定过程的可靠性。In the embodiment of the present disclosure, preferably, multiple candidate operators can be determined, and according to the model evaluation information, the candidate operator evaluation information corresponding to each candidate operator can be determined, and then the target operator can be determined from the multiple candidate operator evaluation information. The candidate operator evaluation information corresponding to the target operator evaluation information is used as the target operator. Therefore, the obtained candidate operator evaluation information can effectively represent the performance information of the corresponding candidate operator. Based on the candidate operator evaluation information, it can be accurately , Quickly determine a candidate operator with better performance from a plurality of candidate operators as a target operator to ensure the reliability of the determination process of the target operator.

S205:确定目标算子的初始描述信息。S205: Determine initial description information of the target operator.

其中,初始描述信息,是指目标算子在初始状态下未经处理的描述信息,初始描述信息,可以例如对目标算子所初始配置的超参数值,或者超参数的预设值,对此不做限制。The initial description information refers to the unprocessed description information of the target operator in the initial state. The initial description information can be, for example, the hyperparameter value initially configured for the target operator, or the preset value of the hyperparameter. No restrictions.

本公开实施例中,确定目标算子的初始描述信息,可以是预先建立本公开实施例的执行主体与大数据服务器的通信链接,并从大数据服务器处获取目标算子较优的描述信息作为初始描述信息,由此,该初始描述信息可以为确定目标描述信息提供可靠的参考对象。In the embodiment of the present disclosure, to determine the initial description information of the target operator, the communication link between the executive body and the big data server in the embodiment of the present disclosure may be established in advance, and the better description information of the target operator is obtained from the big data server as The initial description information, thus, the initial description information can provide a reliable reference object for determining the target description information.

S206:根据模型评估信息,确定初始描述信息的信息调整值。S206: Determine the information adjustment value of the initial description information according to the model evaluation information.

其中,信息调整值,是指初始描述信息基于模型评估信息所确定的调整信息,该信息调整值可以被用于作为后续调整初始描述信息的参考依据。The information adjustment value refers to the adjustment information determined by the initial description information based on the model evaluation information, and the information adjustment value can be used as a reference for subsequent adjustment of the initial description information.

信息调整值例如,待对目标算子所初始配置的超参数值,或者超参数的预设值所进行调整的值,对此不做限制。The information adjustment value is, for example, the value of the hyperparameter initially configured for the target operator, or the value adjusted by the preset value of the hyperparameter, which is not limited.

本公开实施例中,根据模型评估信息,确定初始描述信息的信息调整值,可以是根据模型评估信息确定初始描述信息在不同取值下的性能表现趋势,而后根据该性能表现趋势确定初始描述信息的信息调整值,由此,可以为后续初始描述信息的调整过程提供准确的执行依据。In the embodiment of the present disclosure, determining the information adjustment value of the initial description information according to the model evaluation information may be to determine the performance trend of the initial description information under different values according to the model evaluation information, and then determine the initial description information according to the performance trend. Therefore, an accurate execution basis can be provided for the subsequent adjustment process of the initial description information.

S207:根据信息调整值调整初始描述信息,以得到目标描述信息。S207: Adjust the initial description information according to the information adjustment value to obtain the target description information.

也即是说,本公开实施例中可以基于信息调整值实现对初始描述信息的灵活调整,从而保证所得目标描述信息与目标业务数据处理模型构建过程的适配性。That is to say, in the embodiments of the present disclosure, the initial description information can be flexibly adjusted based on the information adjustment value, thereby ensuring the adaptability of the obtained target description information and the construction process of the target service data processing model.

本公开实施例中,优选的,可以确定目标算子的初始描述信息,并根据模型评估信息,确定初始描述信息的信息调整值,而后根据信息调整值调整初始描述信息,以得到目标描述信息,由于信息调整值是基于模型评估信息得到的,而模型评估信息能够有效表征目标算子的性能信息,从而所得信息调整值可以为初始描述信息的调整过程提供清晰、可靠的参考依据,能够有效提升所得目标描述信息对于目标算子的描述效果。In the embodiment of the present disclosure, preferably, the initial description information of the target operator can be determined, and the information adjustment value of the initial description information can be determined according to the model evaluation information, and then the initial description information can be adjusted according to the information adjustment value to obtain the target description information, Since the information adjustment value is obtained based on the model evaluation information, and the model evaluation information can effectively represent the performance information of the target operator, the obtained information adjustment value can provide a clear and reliable reference for the adjustment process of the initial description information, which can effectively improve the The description effect of the obtained target description information on the target operator.

S208:根据多个目标描述信息描述相应目标算子,以得到多个所描述目标算子。S208: Describe the corresponding target operator according to the plurality of target description information, so as to obtain a plurality of described target operators.

其中,所描述目标算子,是指目标算子经由对应目标描述信息的描述过程所得到的算子。The described target operator refers to an operator obtained by the target operator through the description process of the corresponding target description information.

本公开实施例中,通过根据多个目标描述信息描述相应目标算子,可以快速、准确地实现对多个目标算子的同步描述处理,从而有效提升构建目标业务数据处理模型的工作效率。In the embodiment of the present disclosure, by describing the corresponding target operators according to the multiple target description information, the synchronous description processing of the multiple target operators can be quickly and accurately realized, thereby effectively improving the work efficiency of constructing the target business data processing model.

S209:根据多个所描述目标算子,构建目标业务数据处理模型。S209: Build a target business data processing model according to the multiple described target operators.

本公开实施例中,通过根据多个所描述目标算子,构建目标业务数据处理模型,可以有效提升目标业务数据处理模型的性能,使其适用于不同的应用环境。In the embodiment of the present disclosure, by constructing a target business data processing model according to a plurality of described target operators, the performance of the target business data processing model can be effectively improved, so that it is suitable for different application environments.

本公开实施例中,优选的,可以根据多个目标描述信息并行描述相应目标算子,以得到多个所描述目标算子,根据多个所描述目标算子,构建目标业务数据处理模型,可以实现多个目标算子对应描述过程的并行处理,较大程度地减少总体描述过程的时间成本,基于多个所描述目标算子可以有效提升目标业务数据处理模型的构建效果,保证所得目标业务数据处理模型在不同应用环境中的工作性能。In the embodiment of the present disclosure, preferably, corresponding target operators can be described in parallel according to multiple target description information, so as to obtain multiple described target operators, and a target business data processing model can be constructed according to the multiple described target operators. It realizes the parallel processing of the description process corresponding to multiple target operators, and reduces the time cost of the overall description process to a large extent. Based on multiple described target operators, the construction effect of the target business data processing model can be effectively improved, and the target business data obtained can be guaranteed. The working performance of the processing model in different application environments.

本实施例中,通过确定初始业务数据处理模型的模型评估信息,确定多个候选算子,根据模型评估信息,确定与各个候选算子对应的候选算子评估信息,并从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子,由此,所得候选算子评估信息可以有效表征对应候选算子的性能信息,基于该候选算子评估信息可以准确、快速地从多个候选算子中确定性能较优的候选算子作为目标算子,保证该目标算子确定过程的可靠性,而后确定目标算子的初始描述信息,根据模型评估信息,确定初始描述信息的信息调整值,根据信息调整值调整初始描述信息,以得到目标描述信息,由于信息调整值是基于模型评估信息得到的,而模型评估信息能够有效表征目标算子的性能信息,从而所得信息调整值可以为初始描述信息的调整过程提供清晰、可靠的参考依据,能够有效提升所得目标描述信息对于目标算子的描述效果,通过根据多个目标描述信息描述相应目标算子,以得到多个所描述目标算子,根据多个所描述目标算子,构建目标业务数据处理模型,可以实现多个目标算子对应描述过程的并行处理,较大程度地减少总体描述过程的时间成本,基于多个所描述目标算子可以有效提升目标业务数据处理模型的构建效果,保证所得目标业务数据处理模型在不同应用环境中的工作性能。In this embodiment, by determining the model evaluation information of the initial business data processing model, multiple candidate operators are determined, and according to the model evaluation information, the candidate operator evaluation information corresponding to each candidate operator is determined, and the multiple candidate operators are selected from the multiple candidate operators. The target operator evaluation information is determined in the evaluation information, and the candidate operator corresponding to the target operator evaluation information is used as the target operator. Therefore, the obtained candidate operator evaluation information can effectively represent the performance information of the corresponding candidate operator. The operator evaluation information can accurately and quickly determine the candidate operator with better performance from multiple candidate operators as the target operator, to ensure the reliability of the target operator determination process, and then determine the initial description information of the target operator, According to the model evaluation information, the information adjustment value of the initial description information is determined, and the initial description information is adjusted according to the information adjustment value to obtain the target description information. Since the information adjustment value is obtained based on the model evaluation information, the model evaluation information can effectively represent the target calculation information. Therefore, the obtained information adjustment value can provide a clear and reliable reference for the adjustment process of the initial description information, which can effectively improve the description effect of the obtained target description information on the target operator. target operator to obtain multiple described target operators, and build a target business data processing model according to the multiple described target operators, which can realize parallel processing of the description process corresponding to multiple target operators, and greatly reduce the overall The time cost of the description process, based on multiple described target operators, can effectively improve the construction effect of the target business data processing model, and ensure the performance of the obtained target business data processing model in different application environments.

图3是根据本公开第三实施例的示意图。FIG. 3 is a schematic diagram of a third embodiment according to the present disclosure.

如图3所示,该业务数据处理模型的生成方法,包括:As shown in Figure 3, the generation method of the business data processing model includes:

S301:确定初始业务数据处理模型的模型评估信息。S301: Determine model evaluation information of an initial business data processing model.

S302:确定多个候选算子。S302: Determine multiple candidate operators.

S301-S302的描述说明可以具体参见上述实施例,在此不再赘述。For the description of S301-S302, reference may be made to the foregoing embodiments, and details are not repeated here.

S303:根据模型评估信息,确定各个候选算子的迭代参与次数。S303: Determine the iteration participation times of each candidate operator according to the model evaluation information.

可以理解的是,本公开实施例在确定目标算子之前,上述多个候选算子可能会参与多轮模型评估,以提升各个候选算子的性能,在各轮模型评估过程中可以基于多个候选算子的模型评估参与轮数和性能表现信息,确定下一轮参与模型评估的候选算子。It can be understood that, before the target operator is determined in the embodiment of the present disclosure, the above-mentioned multiple candidate operators may participate in multiple rounds of model evaluation to improve the performance of each candidate operator. The model evaluation participation rounds and performance information of the candidate operators are used to determine the candidate operators participating in the model evaluation in the next round.

其中,迭代参与次数,是指候选算子在上述多轮模型评估过程中的参与次数。The number of iterative participations refers to the number of participations of candidate operators in the above-mentioned multi-round model evaluation process.

本公开实施例中,候选算子在进行迭代时,会消耗时间成本和算力成本,且时间成本和算力成本的消耗数量可能会随着迭代参与次数的增加而提高,由此,当根据模型评估信息确定各个候选算子的迭代参与次数,该迭代参与次数可以有效表征各个候选算子的成本信息,从而为后续确定候选算子评估信息提供可靠的参考依据,保证所得候选算子评估信息的全面性。In the embodiment of the present disclosure, when a candidate operator is iterating, it will consume time cost and computing power cost, and the consumption amount of time cost and computing power cost may increase with the increase of the number of iteration participations. The model evaluation information determines the iterative participation times of each candidate operator, which can effectively represent the cost information of each candidate operator, thereby providing a reliable reference for subsequent determination of candidate operator evaluation information and ensuring the obtained candidate operator evaluation information comprehensiveness.

S304:根据模型评估信息,确定各个候选算子的算子性能信息。S304: Determine operator performance information of each candidate operator according to the model evaluation information.

其中,算子性能信息,可以是指被用于描述各个候选算子性能表现的相关信息。The operator performance information may refer to related information used to describe the performance of each candidate operator.

举例而言,可以对预先制定一套算子性能评估标准,而后基于各个候选算子对应的模型评估信息和算子性能评估标准进行对比分析,以确定各个候选算子的算子性能信息。For example, a set of operator performance evaluation criteria may be formulated in advance, and then a comparative analysis is performed based on the model evaluation information corresponding to each candidate operator and the operator performance evaluation criteria to determine the operator performance information of each candidate operator.

本公开实施例中,通过根据模型评估信息,确定各个候选算子的算子性能信息,可以为后续确定候选算子评估信息提供适用的参考依据,使候选算子评估信息可以有效表征各个候选算子的性能表现信息。In the embodiment of the present disclosure, by determining the operator performance information of each candidate operator according to the model evaluation information, a suitable reference basis can be provided for the subsequent determination of the candidate operator evaluation information, so that the candidate operator evaluation information can effectively characterize each candidate operator child performance information.

S305:将迭代参与次数和算子性能信息作为相应候选算子对应的候选算子评估信息。S305: Use the iteration participation times and operator performance information as candidate operator evaluation information corresponding to the corresponding candidate operator.

也即是说,本公开实施例在得到迭代参与次数和算子性能信息之后,可以将迭代参与次数和算子性能信息作为相应候选算子对应的候选算子评估信息,以实现候选算子评估信息对对应候选算子全面、准确地考量,能够有效提升候选算子评估信息对候选算子相关信息的表征能力。That is to say, after obtaining the iteration participation times and operator performance information in the embodiments of the present disclosure, the iteration participation times and operator performance information may be used as candidate operator evaluation information corresponding to the corresponding candidate operators, so as to realize candidate operator evaluation. The information is comprehensively and accurately considered for the corresponding candidate operator, which can effectively improve the ability of the candidate operator evaluation information to represent the relevant information of the candidate operator.

举例而言,存在3个候选算子(候选算子1、候选算子2、候选算子3),在当前时间点,候选算子1已迭代10次(评估分数为0.1),候选算子2已迭代5次(评估分数为0.3),候选算子3已迭代2次(评估分数为0.4),而此时候选算子1的性能表现较好(评估分数为1),候选算子2的性能表现次之(评估分数为0.9),候选算子3的性能表现较差(评估分数为0.6),则在当前时间点综合评估分数最高的是候选算子2(得分=0.9+0.3=1.2),故可以选择候选算子2作为目标算子。For example, there are 3 candidate operators (candidate operator 1, candidate operator 2, candidate operator 3). At the current point in time, candidate operator 1 has iterated 10 times (the evaluation score is 0.1), and the candidate operator 2 has been iterated 5 times (evaluation score is 0.3), candidate operator 3 has been iterated 2 times (evaluation score is 0.4), and at this time candidate operator 1 performs better (evaluation score is 1), candidate operator 2 The performance of the candidate operator 3 is second (the evaluation score is 0.9), and the performance of the candidate operator 3 is poor (the evaluation score is 0.6), then the candidate operator 2 has the highest comprehensive evaluation score at the current time point (score=0.9+0.3= 1.2), so the candidate operator 2 can be selected as the target operator.

本公开实施例中,优选的,可以根据模型评估信息,确定各个候选算子的迭代参与次数,根据模型评估信息,确定各个候选算子的算子性能信息,并将迭代参与次数和算子性能信息作为相应候选算子对应的候选算子评估信息,可以从迭代参与次数和算子性能信息两个维度较大程度地丰富所得候选算子评估信息,实现对各个候选算子全面、准确地考量,提升候选算子评估信息对候选算子相关信息的表征能力。In the embodiment of the present disclosure, preferably, the iteration participation times of each candidate operator may be determined according to the model evaluation information, the operator performance information of each candidate operator may be determined according to the model evaluation information, and the iteration participation times and the operator performance may be calculated. The information is used as the candidate operator evaluation information corresponding to the corresponding candidate operator, which can greatly enrich the obtained candidate operator evaluation information from the two dimensions of iteration participation times and operator performance information, and realize comprehensive and accurate consideration of each candidate operator. , to improve the ability of the candidate operator evaluation information to represent the candidate operator related information.

S306:从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子。S306: Determine target operator evaluation information from multiple candidate operator evaluation information, and use the candidate operator corresponding to the target operator evaluation information as the target operator.

S306的描述说明可以具体参见上述实施例,在此不再赘述。The description of S306 may refer to the above-mentioned embodiment for details, and details are not repeated here.

S307:确定目标算子的多个候选描述信息。S307: Determine multiple candidate description information of the target operator.

其中,候选描述信息,是指适用于目标算子的多个描述信息。The candidate description information refers to a plurality of description information applicable to the target operator.

可以理解的是,目标算子可以对应于多个候选描述信息,且多个候选描述信息对目标算子的描述效果可能存在差异。It can be understood that the target operator may correspond to multiple candidate description information, and the description effects of the multiple candidate description information on the target operator may be different.

本公开实施例中,通过确定目标算子的多个候选描述信息,可以为后续确定目标描述信息提供可靠的分析对象。In the embodiment of the present disclosure, by determining multiple candidate description information of the target operator, a reliable analysis object can be provided for the subsequent determination of the target description information.

S308:确定模型评估信息与各个候选描述信息之间的匹配程度值。S308: Determine a matching degree value between the model evaluation information and each candidate description information.

其中,匹配程度值,可以是指各个候选描述信息与模型评估信息进行匹配处理,所得到的用于表征各个候选描述信息与模型评估信息之间匹配程度的数值。The matching degree value may refer to a value obtained by performing matching processing between each candidate description information and model evaluation information and used to represent the matching degree between each candidate description information and model evaluation information.

本公开实施例中,由于模型评估信息可以有效表征目标算子在模型评估过程中的最佳描述信息,当定模型评估信息与各个候选描述信息之间的匹配程度值,该匹配程度值为后续确定目标描述信息提供准确的判断依据。In the embodiment of the present disclosure, since the model evaluation information can effectively represent the best description information of the target operator in the model evaluation process, when the matching degree value between the model evaluation information and each candidate description information is determined, the matching degree value is the following value. Determining the target description information provides accurate judgment basis.

S309:从多个匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所对应的候选描述信息作为目标描述信息。S309: Select the candidate description information corresponding to the largest matching degree value from the plurality of matching degree values, and use the corresponding candidate description information as the target description information.

也即是说,本公开实施例在确定模型评估信息与各个候选描述信息之间的匹配程度值之后,可以从多个匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所对应候选描述信息作为目标描述信息,以提升所得目标描述信息在生成目标业务数据处理模型过程中的适用性。That is to say, after determining the matching degree value between the model evaluation information and each candidate description information in this embodiment of the present disclosure, the candidate description information corresponding to the largest matching degree value may be selected from multiple matching degree values, and The corresponding candidate description information is used as the target description information, so as to improve the applicability of the obtained target description information in the process of generating the target business data processing model.

本公开实施例中,优选的,可以确定目标算子的多个候选描述信息,确定模型评估信息与各个候选描述信息之间的匹配程度值,而后从多个匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所对应候选描述信息作为目标描述信息,由于所得匹配程度值可以有效表征目标算子在模型训练过程中所得到的最佳描述信息与各个候选描述信息之间的匹配程度,当基于最大的匹配程度值确定目标描述信息时,可以有效提升所得目标描述信息在目标业务数据处理模型生成过程中的适配性,最大化所得目标描述信息的描述效果。In the embodiment of the present disclosure, preferably, multiple candidate description information of the target operator may be determined, the matching degree value between the model evaluation information and each candidate description information may be determined, and then the largest matching degree may be selected from the multiple matching degree values. The candidate description information corresponding to the value, and the corresponding candidate description information is used as the target description information, because the obtained matching degree value can effectively represent the best description information obtained by the target operator in the model training process. When the target description information is determined based on the maximum matching degree value, the adaptability of the obtained target description information in the process of generating the target business data processing model can be effectively improved, and the description effect of the obtained target description information can be maximized.

S310:根据目标描述信息和目标算子,生成目标业务数据处理模型。S310: Generate a target business data processing model according to the target description information and the target operator.

S310的描述说明可以具体参见上述实施例,在此不再赘述。For the description of S310, reference may be made to the foregoing embodiments, and details are not repeated here.

本实施例中,通过确定初始业务数据处理模型的模型评估信息,确定多个候选算子,根据模型评估信息,确定各个候选算子的迭代参与次数,根据模型评估信息,确定各个候选算子的算子性能信息,并将迭代参与次数和算子性能信息作为相应候选算子对应的候选算子评估信息,可以从迭代参与次数和算子性能信息两个维度较大程度地丰富所得候选算子评估信息,实现对各个候选算子全面、准确地考量,提升候选算子评估信息对候选算子相关信息的表征能力,而后从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子,确定目标算子的多个候选描述信息,确定模型评估信息与各个候选描述信息之间的匹配程度值,从多个匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所对应候选描述信息作为目标描述信息,由于所得匹配程度值可以有效表征目标算子在模型训练过程中所得到的最佳描述信息与各个候选描述信息之间的匹配程度,当基于最大的匹配程度值确定目标描述信息时,可以有效提升所得目标描述信息在目标业务数据处理模型生成过程中的适配性,最大化所得目标描述信息的描述效果。In this embodiment, multiple candidate operators are determined by determining the model evaluation information of the initial business data processing model, the iteration participation times of each candidate operator are determined according to the model evaluation information, and the number of iterations of each candidate operator is determined according to the model evaluation information. The operator performance information, and the iteration participation times and operator performance information are used as the candidate operator evaluation information corresponding to the corresponding candidate operators, which can greatly enrich the obtained candidate operators from the two dimensions of iteration participation times and operator performance information. Evaluation information, to achieve comprehensive and accurate consideration of each candidate operator, improve the ability of candidate operator evaluation information to represent candidate operator-related information, and then determine target operator evaluation information from multiple candidate operator evaluation information, and use it. The candidate operator corresponding to the target operator evaluation information is used as the target operator to determine multiple candidate description information of the target operator, determine the matching degree value between the model evaluation information and each candidate description information, and select from the multiple matching degree values. The candidate description information corresponding to the maximum matching degree value, and the corresponding candidate description information is used as the target description information, because the obtained matching degree value can effectively represent the best description information obtained by the target operator in the model training process and each candidate. The matching degree between the description information. When the target description information is determined based on the maximum matching degree value, the adaptability of the obtained target description information in the process of generating the target business data processing model can be effectively improved, and the description of the obtained target description information can be maximized. Effect.

图4是根据本公开第四实施例的示意图。FIG. 4 is a schematic diagram of a fourth embodiment according to the present disclosure.

如图4所示,该业务数据处理模型的生成装置40,包括:As shown in Figure 4, the generating device 40 of the business data processing model includes:

第一确定模块401,用于确定初始业务数据处理模型的模型评估信息;The first determination module 401 is used to determine the model evaluation information of the initial business data processing model;

第二确定模块402,用于根据模型评估信息,确定目标算子;The second determination module 402 is configured to determine the target operator according to the model evaluation information;

第三确定模块403,用于根据模型评估信息,确定目标算子的目标描述信息;以及The third determining module 403 is configured to determine the target description information of the target operator according to the model evaluation information; and

生成模块404,用于根据目标描述信息和目标算子,生成目标业务数据处理模型。The generating module 404 is configured to generate a target business data processing model according to the target description information and the target operator.

在本公开的一些实施例中,如图5所示,图5是根据本公开第五实施例的示意图,该业务数据处理模型的生成装置50,包括:第一确定模块501、第二确定模块502、第三确定模块503、生成模块504,其中,第二确定模块502,包括:In some embodiments of the present disclosure, as shown in FIG. 5 , which is a schematic diagram according to a fifth embodiment of the present disclosure, the apparatus 50 for generating a business data processing model includes: a first determination module 501 and a second determination module 502, a third determination module 503, a generation module 504, wherein the second determination module 502 includes:

第一确定子模块5021,用于确定多个候选算子;The first determination submodule 5021 is used to determine a plurality of candidate operators;

第二确定子模块5022,用于根据模型评估信息,确定与各个候选算子对应的候选算子评估信息;The second determination submodule 5022 is configured to determine candidate operator evaluation information corresponding to each candidate operator according to the model evaluation information;

第三确定子模块5023,用于从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子。The third determination sub-module 5023 is configured to determine target operator evaluation information from multiple candidate operator evaluation information, and use the candidate operator corresponding to the target operator evaluation information as the target operator.

在本公开的一些实施例中,其中,第三确定模块503,具体用于:In some embodiments of the present disclosure, the third determining module 503 is specifically configured to:

确定目标算子的初始描述信息;Determine the initial description information of the target operator;

根据模型评估信息,确定初始描述信息的信息调整值;以及Based on the model evaluation information, determine the information adjustment value of the initial description information; and

根据信息调整值调整初始描述信息,以得到目标描述信息。Adjust the initial description information according to the information adjustment value to obtain the target description information.

在本公开的一些实施例中,其中,第三确定模块503,还用于:In some embodiments of the present disclosure, the third determining module 503 is further configured to:

确定目标算子的多个候选描述信息;Determine multiple candidate description information of the target operator;

确定模型评估信息与各个候选描述信息之间的匹配程度值;以及determining a value for the degree of match between the model evaluation information and each candidate description; and

从多个匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所对应的候选描述信息作为目标描述信息。The candidate description information corresponding to the largest matching degree value is selected from the plurality of matching degree values, and the corresponding candidate description information is used as the target description information.

在本公开的一些实施例中,其中,第二确定子模块5022,具体用于:In some embodiments of the present disclosure, the second determination sub-module 5022 is specifically configured to:

根据模型评估信息,确定各个候选算子的迭代参与次数;Determine the iteration participation times of each candidate operator according to the model evaluation information;

根据模型评估信息,确定各个候选算子的算子性能信息;以及Determine the operator performance information of each candidate operator according to the model evaluation information; and

将迭代参与次数和算子性能信息作为相应候选算子对应的候选算子评估信息。The iteration participation times and operator performance information are used as candidate operator evaluation information corresponding to the corresponding candidate operator.

在本公开的一些实施例中,目标算子的数量是多个;In some embodiments of the present disclosure, the number of target operators is multiple;

其中,生成模块504,具体用于:Wherein, the generating module 504 is specifically used for:

根据多个目标描述信息描述相应目标算子,以得到多个所描述目标算子;Describe the corresponding target operator according to the plurality of target description information, so as to obtain a plurality of described target operators;

根据多个所描述目标算子,构建目标业务数据处理模型。According to a plurality of described target operators, a target business data processing model is constructed.

可以理解的是,本实施例附图5中的业务数据处理模型的生成装置50与上述实施例中的业务数据处理模型的生成装置40,第一确定模块501与上述实施例中的第一确定模块401,第二确定模块502与上述实施例中的第二确定模块402,第三确定模块503与上述实施例中的第三确定模块403,生成模块504与上述实施例中的生成模块404,可以具有相同的功能和结构。It can be understood that, the generating apparatus 50 of the business data processing model in FIG. 5 of this embodiment and the generating apparatus 40 of the business data processing model in the above-mentioned embodiment, the first determining module 501 is the same as the first determining module 501 in the above-mentioned embodiment. module 401, the second determination module 502 and the second determination module 402 in the above embodiment, the third determination module 503 and the third determination module 403 in the above embodiment, the generation module 504 and the generation module 404 in the above embodiment, can have the same function and structure.

需要说明的是,前述对业务数据处理模型的生成方法的解释说明也适用于本实施例业务数据处理模型的生成装置。It should be noted that, the foregoing explanations on the method for generating a business data processing model are also applicable to the apparatus for generating a business data processing model in this embodiment.

本实施例中,通过确定初始业务数据处理模型的模型评估信息,根据模型评估信息,确定目标算子,根据模型评估信息,确定目标算子的目标描述信息,以及根据目标描述信息和目标算子,生成目标业务数据处理模型,由此,可以基于模型评估信息分别确定目标算子和目标描述信息,实现对目标算子和目标描述信息的确定过程进行解耦,有效提升目标业务数据处理模型生成过程的灵活性,提升目标业务数据处理模型生成效率。In this embodiment, the model evaluation information of the initial business data processing model is determined, the target operator is determined according to the model evaluation information, the target description information of the target operator is determined according to the model evaluation information, and the target description information and the target operator are determined according to the target description information and the target operator. , to generate the target business data processing model, thus, the target operator and target description information can be determined respectively based on the model evaluation information, so as to realize the decoupling of the determination process of the target operator and the target description information, and effectively improve the generation of target business data processing model. The flexibility of the process improves the generation efficiency of the target business data processing model.

本公开实施例中的业务数据处理模型的生成方法可以应用于以下业务数据处理模型的生成装置中,该业务数据处理模型的生成装置的框架结构还可以如下所示:The method for generating a business data processing model in the embodiment of the present disclosure may be applied to the following apparatus for generating a business data processing model, and the framework structure of the apparatus for generating a business data processing model may also be as follows:

图6是根据本公开第六实施例的示意图。FIG. 6 is a schematic diagram of a sixth embodiment according to the present disclosure.

如图6所示,该业务数据处理模型的生成装置60,还可以包括:算子选择模块601和算子描述模块602;其中,As shown in FIG. 6, the generating apparatus 60 of the business data processing model may further include: an operator selection module 601 and an operator description module 602; wherein,

算子选择模块601,用于确定初始业务数据处理模型的模型评估信息,并根据模型评估信息确定目标算子,以及将模型评估信息传输至算子描述模块;The operator selection module 601 is used to determine the model evaluation information of the initial business data processing model, and determine the target operator according to the model evaluation information, and transmit the model evaluation information to the operator description module;

算子描述模块602,用于根据模型评估信息,确定目标算子的目标描述信息,其中,目标算子和目标描述信息,用于生成目标业务数据处理模型。The operator description module 602 is configured to determine target description information of the target operator according to the model evaluation information, wherein the target operator and the target description information are used to generate a target service data processing model.

在本公开的一些实施例中,如图7所示,图7是根据本公开第七实施例的示意图,该业务数据处理模型的生成装置70,还可以包括:算子选择模块701、算子描述模块702,其中,算子选择模块701,具体用于:In some embodiments of the present disclosure, as shown in FIG. 7 , which is a schematic diagram according to a seventh embodiment of the present disclosure, the apparatus 70 for generating a business data processing model may further include: an operator selection module 701 , an operator Describe the module 702, wherein the operator selection module 701 is specifically used for:

确定多个候选算子;Determine multiple candidate operators;

根据模型评估信息,确定与各个候选算子对应的候选算子评估信息;以及Determine candidate operator evaluation information corresponding to each candidate operator according to the model evaluation information; and

从多个候选算子评估信息中确定目标算子评估信息,并将目标算子评估信息所对应候选算子作为目标算子。The target operator evaluation information is determined from the plurality of candidate operator evaluation information, and the candidate operator corresponding to the target operator evaluation information is used as the target operator.

在本公开实施例中,算子选择模块701,可以用于对模型生成过程进行调度主管,由此,也可以被称为调度主管模块(Dispatcher Supervisor),调度主管模块(DispatcherSupervisor)中可以启动进程,以基于该进程接收和发送消息、确定目标算子、根据所接收到的指令消息控制单一调度模块进行对应操作等。In this embodiment of the present disclosure, the operator selection module 701 may be used to perform a dispatch supervisor for the model generation process, and thus may also be referred to as a dispatch supervisor module (Dispatcher Supervisor), and a process can be started in the dispatch supervisor module (Dispatcher Supervisor). , to receive and send messages based on the process, determine the target operator, and control a single scheduling module to perform corresponding operations according to the received command message.

在本公开的一些实施例中,其中,算子描述模块702,具体用于:In some embodiments of the present disclosure, the operator description module 702 is specifically configured to:

确定目标算子的初始描述信息;Determine the initial description information of the target operator;

根据模型评估信息确定初始描述信息的信息调整值;以及Determine the information adjustment value of the initial description information based on the model evaluation information; and

根据信息调整值调整初始描述信息,以得到目标描述信息。Adjust the initial description information according to the information adjustment value to obtain the target description information.

在本公开的一些实施例中,其中,算子描述模块702,具体用于:In some embodiments of the present disclosure, the operator description module 702 is specifically configured to:

确定目标算子的多个候选描述信息;Determine multiple candidate description information of the target operator;

确定模型评估信息与各个候选描述信息之间的匹配程度值;以及determining a value for the degree of match between the model evaluation information and each candidate description; and

从多个匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所对应的候选描述信息作为目标描述信息。The candidate description information corresponding to the largest matching degree value is selected from the plurality of matching degree values, and the corresponding candidate description information is used as the target description information.

在本公开实施例中,算子描述模块702,可以用于对单个目标算子的描述信息进行调度优化,由此,也可以被称为单一调度模块(Single Dispatcher),单一调度模块(SingleDispatcher)中也可以启动进程,并基于该进程执行初始化目标算子、目标算子的描述信息调优、收集目标算子的评估指标等。In this embodiment of the present disclosure, the operator description module 702 may be used to perform scheduling optimization on the description information of a single target operator, and thus may also be referred to as a single dispatch module (Single Dispatcher), a single dispatch module (Single Dispatcher) You can also start a process, and based on the process, initialize the target operator, tune the description information of the target operator, and collect the evaluation indicators of the target operator.

可以理解的是,上述算子选择模块701和算子描述模块702可以同时被封装在调谐器模块(Tuner)中,以提升该业务数据处理模型的生成装置的集成程度,同时可以提升算子选择模块与算子描述模块之间的交互效率,以保证算子选择模块与算子描述模块的工作性能。It can be understood that the above-mentioned operator selection module 701 and operator description module 702 can be encapsulated in a tuner module (Tuner) at the same time, so as to improve the degree of integration of the generating device of the business data processing model, and at the same time, it can improve the operator selection. The interaction efficiency between the module and the operator description module ensures the working performance of the operator selection module and the operator description module.

在Tuner模块对应进程中,调度主管子模块是主线程,而单一调度子模块是子线程。调度主管子模块和单一调度子模块之间可以通过共享队列通信。In the corresponding process of the Tuner module, the scheduling supervisor sub-module is the main thread, and the single-scheduling sub-module is the sub-thread. A shared queue can be used to communicate between the scheduler sub-module and the single-scheduler sub-module.

在本公开的一些实施例中,其中,算子选择模块701,具体用于:In some embodiments of the present disclosure, the operator selection module 701 is specifically configured to:

根据模型评估信息,确定各个候选算子的迭代参与次数;Determine the iteration participation times of each candidate operator according to the model evaluation information;

根据模型评估信息,确定各个候选算子的算子性能信息;以及Determine the operator performance information of each candidate operator according to the model evaluation information; and

将迭代参与次数和算子性能信息作为相应候选算子对应的候选算子评估信息。The iteration participation times and operator performance information are used as candidate operator evaluation information corresponding to the corresponding candidate operator.

在本公开的一些实施例中,其中,该装置还包括:In some embodiments of the present disclosure, wherein the apparatus further comprises:

模型生成模块703,用于获取与目标算子对应的目标算子标识,并根据目标算子标识生成模型构建消息,以及将模型构建消息传输至算子描述模块702;The model generation module 703 is used to obtain the target operator identifier corresponding to the target operator, and generate a model construction message according to the target operator identifier, and transmit the model construction message to the operator description module 702;

在本公开实施例中,模型生成模块703可以用于驱动该业务数据处理模型生成过程的多个进程,由此,也可以被称为驱动模块(Driver),驱动模块(Driver)中也可以启动进程,并基于该进程执行接收消息、发送消息等。In this embodiment of the present disclosure, the model generation module 703 may be used to drive multiple processes of the business data processing model generation process, and thus may also be referred to as a driver module (Driver), and the driver module (Driver) can also be started process, and based on the process perform receiving messages, sending messages, etc.

可以理解的是,在该业务数据处理模型的生成装置中,上述Tuner模块和Driver模块之间通过进程间通信(interprocess communication,IPC),例如可以是管道(pipe)通信,通信内容可以由command和data构成,传输格式为(command,data),command表示命令的种类,data表示命令操作对应的数据对象。It can be understood that, in the device for generating the business data processing model, the above-mentioned Tuner module and the Driver module pass through interprocess communication (interprocess communication, IPC), such as pipe communication, and the communication content can be composed of command and It consists of data, the transmission format is (command, data), command represents the type of command, and data represents the data object corresponding to the command operation.

其中,command类型可以包括但不限于:Among them, the command type can include but is not limited to:

#in#in

Initialize=b'IN',表示初始化搜索空间。Initialize=b'IN', indicating that the search space is initialized.

RequestTrialJobs=b'GE',表示请求实验。RequestTrialJobs=b'GE', indicating that the experiment is requested.

ReportMetricData=b'ME',表示上报指标。ReportMetricData=b'ME', indicating reporting metrics.

UpdateSearchSpace=b'SS',表示更新搜索空间。UpdateSearchSpace=b'SS', which means to update the search space.

ImportData=b'FD',表示导入数据,用于断点恢复。ImportData=b'FD', which means import data, which is used for breakpoint recovery.

TrialEnd=b'EN',表示单个实验结束。TrialEnd=b'EN', indicating the end of a single experiment.

Terminate=b'TE',表示终止任务。Terminate=b'TE', which means to terminate the task.

#out#out

Initialized=b'ID',表示搜索空间已初始化。Initialized=b'ID', indicating that the search space has been initialized.

NewTrialJob=b'TR',表示实验配置已生成。NewTrialJob=b'TR', indicating that the experimental configuration has been generated.

NoMoreTrialJobs=b'NO',表示搜索空间中已没有更多的配置信息。NoMoreTrialJobs=b'NO', indicating that there is no more configuration information in the search space.

KillTrialJob=b'KI',表示终止实验。KillTrialJob=b'KI', indicating termination of the experiment.

其中,data格式可以包括但不限于:Among them, the data format can include but is not limited to:

#in#in

Initialize data(数据):用于初始化多种机器学习算法的搜索空间。Initialize data: Used to initialize the search space for various machine learning algorithms.

多个算法的超参数搜索空间可以例如为The hyperparameter search space for multiple algorithms can be, for example,

Figure BDA0003636796540000191
Figure BDA0003636796540000191

其中,id表示不同的算子(种类),parameters表示算子对应的描述信息(类型和取值范围)。Among them, id represents different operators (types), and parameters represents the description information (type and value range) corresponding to the operators.

RequestTrialJobs data:请求的Trial(实验)个数。RequestTrialJobs data: The number of Trials (experiments) requested.

ReportMetricData data:报告的Trial指标。ReportMetricData data: Trial metrics reported.

UpdateSearchSpace data:更新的搜索空间。UpdateSearchSpace data: The updated search space.

ImportData data:导入以前的数据列表,用于实验的恢复。ImportData data: Import the previous data list for experimental recovery.

TrialEnd data:报告的Trial状态。TrialEnd data: Trial status reported.

Terminate data:空。Terminate data: Empty.

#out#out

Initialized data:空。Initialized data: Empty.

NewTrialJob data:Trial配置参数。NewTrialJob data: Trial configuration parameters.

NoMoreTrialJobs data:空。NoMoreTrialJobs data: Empty.

KillTrialJob data:实验id。KillTrialJob data: Experiment id.

其中,算子描述模块702,还用于接收模型构建消息,并从模型构建消息中解析得到目标算子标识,以及根据目标算子标识所属目标算子的目标描述信息描述目标算子,得到所描述目标算子,其中,所描述目标算子,用于构建目标业务数据处理模型。The operator description module 702 is further configured to receive the model construction message, obtain the target operator identifier by parsing from the model construction message, and describe the target operator according to the target description information of the target operator to which the target operator identifier belongs, and obtain the Describe the target operator, wherein the described target operator is used to construct the target business data processing model.

在本公开的一些实施例中,其中,In some embodiments of the present disclosure, wherein,

算子描述模块702的数量是多个,各个算子描述模块702用于确定相应目标算子的目标描述信息;其中,多个算子描述模块702用于描述相应目标算子,得到多个所描述目标算子,多个所描述目标算子,共同用于构建目标业务数据处理模型。The number of operator description modules 702 is multiple, and each operator description module 702 is used to determine the target description information of the corresponding target operator; wherein, the multiple operator description modules 702 are used to describe the corresponding target operator, and obtain a plurality of all the target operators. Describe the target operator, and multiple described target operators are used together to construct the target business data processing model.

本公开实施例中,在构建目标业务数据处理模型过程中,多个算子描述模块702的任务进程相互独立,即多个目标算子的描述信息调优过程可以并行实现,以提升多个目标算子的描述信息调优效率。In the embodiment of the present disclosure, in the process of constructing the target business data processing model, the task processes of the multiple operator description modules 702 are independent of each other, that is, the description information tuning process of the multiple target operators can be implemented in parallel, so as to improve the multiple goals Optimization efficiency of operator description information.

举例而言,图8是本公开实施例中的示例性业务数据处理模型的生成装置的框图,如图8所示,该示例性业务数据处理模型的生成装置,包括:驱动模块(Driver)和调谐器模块(Tuner),Driver模块和Tuner模块可以分别生成对应的进程。其中,Tuner模块可以分为调度主管子模块(Dispatcher Supervisor)和多个单一调度子模块(Single Dispatcher),该单一调度子模块的数量可以是一个或多个,对此不做限制。For example, FIG. 8 is a block diagram of an apparatus for generating an exemplary business data processing model in an embodiment of the present disclosure. As shown in FIG. 8 , the apparatus for generating an exemplary business data processing model includes: a driver module (Driver) and a Tuner module (Tuner), Driver module and Tuner module can generate corresponding processes respectively. The Tuner module may be divided into a dispatch supervisor sub-module (Dispatcher Supervisor) and a plurality of single dispatch sub-modules (Single Dispatcher). The number of the single dispatch sub-module may be one or more, which is not limited.

基于该示例性业务数据处理模型的生成装置和通信协议,确定目标算子和目标算子对应目标描述信息的实验过程可以如下所示:Based on the generation device and communication protocol of the exemplary business data processing model, the experimental process of determining the target operator and the target description information corresponding to the target operator can be as follows:

①Driver模块接收并转发请求初始化的消息(Initialize);在Tuner模块的Dispatcher Supervisor接收Initialize请求之后,可以初始化多个Single Dispatcher(每个Single Dispatcher对应一种算子)。当所有的Single Dispatcher完成初始化后,Dispatcher Supervisor可以向Driver模块发送表征已完成初始化的消息(Initialized);在Driver模块接收到Initialized时,整个初始化任务结束。①The Driver module receives and forwards the initialize request message (Initialize); after the Dispatcher Supervisor of the Tuner module receives the Initialize request, multiple Single Dispatchers can be initialized (each Single Dispatcher corresponds to an operator). After all Single Dispatchers are initialized, the Dispatcher Supervisor can send a message (Initialized) to the Driver module indicating that the initialization has been completed; when the Driver module receives Initialized, the entire initialization task ends.

②Driver模块发送请求实验的消息(RequestTrialJobs);Tuner模块的Dispatcher Supervisor在接收RequestTrialJobs请求之后,对于各个实验请求,可以根据相应的多算子选择策略(灵活地支持各种策略)得到在下一次实验更有可能产生更好指标的目标算子,由此在对应的Single Dispatcher生成下一次实验配置(目标描述信息),并使Dispatcher Supervisor向Driver模块发送新的实验请求消息(NewTrialJob),该NewTrialJob信息中包含Dispatcher Supervisor所选择的目标算子及其目标描述信息,当Driver模块接受到完整的NewTrialJob信息时表示请求实验任务完成。②The Driver module sends a message requesting the experiment (RequestTrialJobs); after the Dispatcher Supervisor of the Tuner module receives the RequestTrialJobs request, for each experiment request, it can be obtained according to the corresponding multi-operator selection strategy (flexibly supporting various strategies) to obtain more information in the next experiment. A target operator that may generate better indicators, thereby generating the next experiment configuration (target description information) in the corresponding Single Dispatcher, and making the Dispatcher Supervisor send a new experiment request message (NewTrialJob) to the Driver module. The NewTrialJob information contains The target operator and its target description information selected by the Dispatcher Supervisor, when the Driver module receives the complete NewTrialJob information, it indicates that the experimental task is requested to be completed.

③Driver模块接收并转发请求报告度量数据的消息(ReportMetricData);Tuner模块的Dispatcher Supervisor在接收ReportMetricData请求时,根据ReportMetricData的数据信息(包含实验对应的算子种类和算子评估信息),对应的Single Dispatcher可以收集实验的算子评估信息(超参调优策略会根据收集到的算子评估信息,为下一次实验请求生成对应的算子描述信息)。③The Driver module receives and forwards the message (ReportMetricData) requesting the report metric data; when the Dispatcher Supervisor of the Tuner module receives the ReportMetricData request, according to the data information of the ReportMetricData (including the operator type and operator evaluation information corresponding to the experiment), the corresponding Single Dispatcher The operator evaluation information of the experiment can be collected (the hyperparameter tuning strategy will generate corresponding operator description information for the next experiment request based on the collected operator evaluation information).

④在满足停止条件(例如:实验次数达到预设次数,或者,所消耗时间已超过时间预算等)后,Driver模块接收并转发请求终止消息(Terminate);Tuner模块的DispatcherSupervisor在接收Terminate请求之后,可以向Tuner模块中的多个SingleDispatcher发送Terminate信号,在全部Single Dispatcher线程停止运行且Dispatcher Supervisor线程也停止运行时表示Tuner模块进程停止完成(即目标算子选择和目标算子对应目标描述信息优化任务完成)。④ After the stop conditions are met (for example: the number of experiments reaches the preset number, or the time consumed has exceeded the time budget, etc.), the Driver module receives and forwards the request termination message (Terminate); after the Dispatcher Supervisor of the Tuner module receives the Terminate request, The Terminate signal can be sent to multiple SingleDispatchers in the Tuner module. When all the Single Dispatcher threads stop running and the Dispatcher Supervisor thread also stops running, it means that the Tuner module process stops and completes (that is, the target operator selection and the target operator corresponding to the target description information optimization task Finish).

可以理解的是,本实施例附图7中的业务数据处理模型的生成装置70与上述实施例中的业务数据处理模型的生成装置60,算子选择模块701与上述实施例中的算子选择模块601,算子描述模块702与上述实施例中的算子描述模块602,可以具有相同的功能和结构。It can be understood that, the generating apparatus 70 of the business data processing model in FIG. 7 of this embodiment and the generating apparatus 60 of the business data processing model in the above embodiment, the operator selection module 701 and the operator selection in the above embodiment The module 601 and the operator description module 702 may have the same function and structure as the operator description module 602 in the above embodiment.

需要说明的是,前述对业务数据处理模型的生成方法的解释说明也适用于本实施例业务数据处理模型的生成装置。It should be noted that the foregoing explanations on the method for generating a business data processing model are also applicable to the apparatus for generating a business data processing model in this embodiment.

本实施例中,通过确定初始业务数据处理模型的模型评估信息,根据模型评估信息,确定目标算子,根据模型评估信息,确定目标算子的目标描述信息,以及根据目标描述信息和目标算子,生成目标业务数据处理模型,由此,可以基于模型评估信息分别确定目标算子和目标描述信息,实现对目标算子和目标描述信息的确定过程进行解耦,有效提升目标业务数据处理模型生成过程的灵活性,提升目标业务数据处理模型生成效率。In this embodiment, the model evaluation information of the initial business data processing model is determined, the target operator is determined according to the model evaluation information, the target description information of the target operator is determined according to the model evaluation information, and the target description information and the target operator are determined according to the target description information and the target operator. , to generate the target business data processing model, thus, the target operator and target description information can be determined respectively based on the model evaluation information, so as to realize the decoupling of the determination process of the target operator and the target description information, and effectively improve the generation of target business data processing model. The flexibility of the process improves the generation efficiency of the target business data processing model.

根据本公开的实施例,本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

图9示出了可以用来实施本公开的业务数据处理模型的生成方法的示例电子设备的示意性框图。电子设备旨在表示各种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 9 shows a schematic block diagram of an example electronic device that can be used to implement the business data processing model generation method of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

如图9所示,设备900包括计算单元901,其可以根据存储在只读存储器(ROM)902中的计算机程序或者从存储单元908加载到随机访问存储器(RAM)903中的计算机程序,来执行各种适当的动作和处理。在RAM 903中,还可存储设备900操作所需的各种程序和数据。计算单元901、ROM 902以及RAM 903通过总线904彼此相连。输入/输出(I/O)接口905也连接至总线904。As shown in FIG. 9 , the device 900 includes a computing unit 901 that can be executed according to a computer program stored in a read only memory (ROM) 902 or a computer program loaded from a storage unit 908 into a random access memory (RAM) 903 Various appropriate actions and handling. In the RAM 903, various programs and data necessary for the operation of the device 900 can also be stored. The computing unit 901 , the ROM 902 , and the RAM 903 are connected to each other through a bus 904 . An input/output (I/O) interface 905 is also connected to bus 904 .

设备900中的多个部件连接至I/O接口905,包括:输入单元906,例如键盘、鼠标等;输出单元907,例如各种类型的显示器、扬声器等;存储单元908,例如磁盘、光盘等;以及通信单元909,例如网卡、调制解调器、无线通信收发机等。通信单元909允许设备900通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。Various components in the device 900 are connected to the I/O interface 905, including: an input unit 906, such as a keyboard, mouse, etc.; an output unit 907, such as various types of displays, speakers, etc.; a storage unit 908, such as a magnetic disk, an optical disk, etc. ; and a communication unit 909, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 909 allows the device 900 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

计算单元901可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元901的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元901执行上文所描述的各个方法和处理,例如执行业务数据处理模型的生成方法。例如,在一些实施例中,执行业务数据处理模型的生成方法可被实现为计算机软件程序,其被有形地包含于机器可读介质,例如存储单元908。在一些实施例中,计算机程序的部分或者全部可以经由ROM 902和/或通信单元909而被载入和/或安装到设备900上。当计算机程序加载到RAM 903并由计算单元901执行时,可以执行上文描述的执行业务数据处理模型的生成方法的一个或多个步骤。备选地,在其他实施例中,计算单元901可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行业务数据处理模型的生成方法。Computing unit 901 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 901 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 901 executes the various methods and processes described above, for example, executes the generation method of the business data processing model. For example, in some embodiments, a method of generating a business data processing model may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 908 . In some embodiments, part or all of the computer program may be loaded and/or installed on device 900 via ROM 902 and/or communication unit 909 . When the computer program is loaded into the RAM 903 and executed by the computing unit 901, one or more steps of the above-described method for performing the generation of a business data processing model may be performed. Alternatively, in other embodiments, the computing unit 901 may be configured to perform the generation method of the business data processing model by any other suitable means (eg, by means of firmware).

本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described herein above may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips system (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器,使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented. The program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.

在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

为了提供与用户的交互,可以在计算机上实施此处描述的系统和技术,该计算机具有:用于向用户显示信息的显示装置(例如,CRT(阴极射线管)或者LCD(液晶显示器)监视器);以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(LAN)、广域网(WAN)、互联网及区块链网络。The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), the Internet, and blockchain networks.

计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,又称为云计算服务器或云主机,是云计算服务体系中的一项主机产品,以解决了传统物理主机与VPS服务("Virtual Private Server",或简称"VPS")中,存在的管理难度大,业务扩展性弱的缺陷。服务器也可以为分布式系统的服务器,或者是结合了区块链的服务器。A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or a cloud host. It is a host product in the cloud computing service system to solve the traditional physical host and VPS service ("Virtual Private Server", or "VPS" for short). , there are the defects of difficult management and weak business expansion. The server can also be a server of a distributed system, or a server combined with a blockchain.

应该理解,可以使用上面所示的各种形式的流程,重新排序、增加或删除步骤。例如,本发公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本公开公开的技术方案所期望的结果,本文在此不进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in different orders. As long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, there is no limitation herein.

上述具体实施方式,并不构成对本公开保护范围的限制。本领域技术人员应该明白的是,根据设计要求和其他因素,可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等,均应包含在本公开保护范围之内。The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present disclosure should be included within the protection scope of the present disclosure.

Claims (15)

1.一种业务数据处理模型的生成方法,包括:1. A method for generating a business data processing model, comprising: 确定初始业务数据处理模型的模型评估信息;Determine model evaluation information for the initial business data processing model; 根据所述模型评估信息,确定目标算子;Determine the target operator according to the model evaluation information; 根据所述模型评估信息,确定所述目标算子的目标描述信息;以及determining target description information of the target operator according to the model evaluation information; and 根据所述目标描述信息和所述目标算子,生成目标业务数据处理模型。According to the target description information and the target operator, a target business data processing model is generated. 2.根据权利要求1所述的方法,其中,所述根据所述模型评估信息,确定目标算子,包括:2. The method according to claim 1, wherein the determining a target operator according to the model evaluation information comprises: 确定多个候选算子;Determine multiple candidate operators; 根据所述模型评估信息,确定与各个所述候选算子对应的候选算子评估信息;以及According to the model evaluation information, determine candidate operator evaluation information corresponding to each of the candidate operators; and 从多个所述候选算子评估信息中确定目标算子评估信息,并将所述目标算子评估信息所对应候选算子作为所述目标算子。The target operator evaluation information is determined from the plurality of candidate operator evaluation information, and the candidate operator corresponding to the target operator evaluation information is used as the target operator. 3.根据权利要求1所述的方法,其中,所述根据所述模型评估信息,确定所述目标算子的目标描述信息,包括:3. The method according to claim 1, wherein the determining the target description information of the target operator according to the model evaluation information comprises: 确定所述目标算子的初始描述信息;determining the initial description information of the target operator; 根据所述模型评估信息,确定所述初始描述信息的信息调整值;以及determining an information adjustment value of the initial description information according to the model evaluation information; and 根据所述信息调整值调整所述初始描述信息,以得到所述目标描述信息。The initial description information is adjusted according to the information adjustment value to obtain the target description information. 4.根据权利要求1所述的方法,其中,所述根据所述模型评估信息,确定所述目标算子的目标描述信息,包括:4. The method according to claim 1, wherein the determining the target description information of the target operator according to the model evaluation information comprises: 确定所述目标算子的多个候选描述信息;determining multiple candidate descriptions of the target operator; 确定所述模型评估信息与各个所述候选描述信息之间的匹配程度值;以及determining a matching degree value between the model evaluation information and each of the candidate description information; and 从多个所述匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所述所对应的候选描述信息作为所述目标描述信息。The candidate description information corresponding to the largest matching degree value is selected from a plurality of the matching degree values, and the corresponding candidate description information is used as the target description information. 5.根据权利要求2所述的方法,其中,所述根据所述模型评估信息,确定与各个所述候选算子对应的候选算子评估信息,包括:5. The method according to claim 2, wherein the determining the candidate operator evaluation information corresponding to each of the candidate operators according to the model evaluation information comprises: 根据所述模型评估信息,确定各个所述候选算子的迭代参与次数;According to the model evaluation information, determine the iteration participation times of each of the candidate operators; 根据所述模型评估信息,确定各个所述候选算子的算子性能信息;以及determining operator performance information of each of the candidate operators according to the model evaluation information; and 将所述迭代参与次数和所述算子性能信息作为相应候选算子对应的候选算子评估信息。The iteration participation times and the operator performance information are used as candidate operator evaluation information corresponding to the corresponding candidate operator. 6.根据权利要求1-5任一项所述的方法,所述目标算子的数量是多个;6. The method according to any one of claims 1-5, the number of the target operator is multiple; 其中,所述根据所述目标描述信息和所述目标算子,生成目标业务数据处理模型,包括:Wherein, generating the target business data processing model according to the target description information and the target operator includes: 根据多个所述目标描述信息描述相应目标算子,以得到多个所描述目标算子;Describe corresponding target operators according to a plurality of the target description information, so as to obtain a plurality of described target operators; 根据所述多个所描述目标算子,构建所述目标业务数据处理模型。The target business data processing model is constructed according to the plurality of described target operators. 7.一种业务数据处理模型的生成装置,包括:7. A device for generating a business data processing model, comprising: 第一确定模块,用于确定初始业务数据处理模型的模型评估信息;a first determination module, used for determining model evaluation information of the initial business data processing model; 第二确定模块,用于根据所述模型评估信息,确定目标算子;a second determination module, configured to determine a target operator according to the model evaluation information; 第三确定模块,用于根据所述模型评估信息,确定所述目标算子的目标描述信息;以及a third determining module, configured to determine target description information of the target operator according to the model evaluation information; and 生成模块,用于根据所述目标描述信息和所述目标算子,生成目标业务数据处理模型。A generating module is configured to generate a target business data processing model according to the target description information and the target operator. 8.根据权利要求7所述的装置,其中,所述第二确定模块,包括:8. The apparatus according to claim 7, wherein the second determining module comprises: 第一确定子模块,用于确定多个候选算子;a first determination submodule for determining multiple candidate operators; 第二确定子模块,用于根据所述模型评估信息,确定与各个所述候选算子对应的候选算子评估信息;以及a second determination submodule, configured to determine candidate operator evaluation information corresponding to each of the candidate operators according to the model evaluation information; and 第三确定子模块,用于从多个所述候选算子评估信息中确定目标算子评估信息,并将所述目标算子评估信息所对应候选算子作为所述目标算子。The third determination submodule is configured to determine target operator evaluation information from a plurality of candidate operator evaluation information, and use the candidate operator corresponding to the target operator evaluation information as the target operator. 9.根据权利要求7所述的装置,其中,所述第三确定模块,具体用于:9. The apparatus according to claim 7, wherein the third determining module is specifically configured to: 确定所述目标算子的初始描述信息;determining the initial description information of the target operator; 根据所述模型评估信息,确定所述初始描述信息的信息调整值;以及determining an information adjustment value of the initial description information according to the model evaluation information; and 根据所述信息调整值调整所述初始描述信息,以得到所述目标描述信息。The initial description information is adjusted according to the information adjustment value to obtain the target description information. 10.根据权利要求7所述的装置,其中,所述第三确定模块,还用于:10. The apparatus according to claim 7, wherein the third determining module is further configured to: 确定所述目标算子的多个候选描述信息;determining multiple candidate descriptions of the target operator; 确定所述模型评估信息与各个所述候选描述信息之间的匹配程度值;以及determining a matching degree value between the model evaluation information and each of the candidate description information; and 从多个所述匹配程度值中选取最大的匹配程度值所对应的候选描述信息,并将所述所对应的候选描述信息作为所述目标描述信息。The candidate description information corresponding to the largest matching degree value is selected from a plurality of the matching degree values, and the corresponding candidate description information is used as the target description information. 11.根据权利要求8所述的装置,其中,所述第二确定子模块,具体用于:11. The apparatus according to claim 8, wherein the second determination sub-module is specifically configured to: 根据所述模型评估信息,确定各个所述候选算子的迭代参与次数;According to the model evaluation information, determine the iteration participation times of each of the candidate operators; 根据所述模型评估信息,确定各个所述候选算子的算子性能信息;以及determining operator performance information of each of the candidate operators according to the model evaluation information; and 将所述迭代参与次数和所述算子性能信息作为相应候选算子对应的候选算子评估信息。The iteration participation times and the operator performance information are used as candidate operator evaluation information corresponding to the corresponding candidate operator. 12.根据权利要求7-11任一项所述的装置,所述目标算子的数量是多个;12. The device according to any one of claims 7-11, wherein the number of the target operators is multiple; 其中,所述生成模块,具体用于:Wherein, the generating module is specifically used for: 根据多个所述目标描述信息描述相应目标算子,以得到多个所描述目标算子;Describe corresponding target operators according to a plurality of the target description information, so as to obtain a plurality of described target operators; 根据所述多个所描述目标算子,构建所述目标业务数据处理模型。The target business data processing model is constructed according to the plurality of described target operators. 13.一种电子设备,包括:13. An electronic device comprising: 至少一个处理器;以及at least one processor; and 与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein, 所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-6中任一项所述的方法。The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the execution of any of claims 1-6 Methods. 14.一种存储有计算机指令的非瞬时计算机可读存储介质,其中,所述计算机指令用于使所述计算机执行根据权利要求1-6中任一项所述的方法。14. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any of claims 1-6. 15.一种计算机程序产品,包括计算机程序,所述计算机程序在被处理器执行时实现根据权利要求1-6中任一项所述方法的步骤。15. A computer program product comprising a computer program which, when executed by a processor, implements the steps of the method according to any of claims 1-6.
CN202210507967.3A 2022-05-10 2022-05-10 Method, device and electronic device for generating business data processing model Active CN114819095B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210507967.3A CN114819095B (en) 2022-05-10 2022-05-10 Method, device and electronic device for generating business data processing model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210507967.3A CN114819095B (en) 2022-05-10 2022-05-10 Method, device and electronic device for generating business data processing model

Publications (2)

Publication Number Publication Date
CN114819095A true CN114819095A (en) 2022-07-29
CN114819095B CN114819095B (en) 2024-12-24

Family

ID=82512760

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210507967.3A Active CN114819095B (en) 2022-05-10 2022-05-10 Method, device and electronic device for generating business data processing model

Country Status (1)

Country Link
CN (1) CN114819095B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115169164A (en) * 2022-09-09 2022-10-11 昆仑智汇数据科技(北京)有限公司 Information processing method, device and equipment of industrial model
CN118689753A (en) * 2024-08-23 2024-09-24 北京壁仞科技开发有限公司 Data processing method, device, electronic device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190370684A1 (en) * 2018-06-01 2019-12-05 Sas Institute Inc. System for automatic, simultaneous feature selection and hyperparameter tuning for a machine learning model
CN111105040A (en) * 2019-11-14 2020-05-05 深圳追一科技有限公司 Hyper-parameter optimization method, device, computer equipment and storage medium
CN112396108A (en) * 2020-11-19 2021-02-23 腾讯科技(深圳)有限公司 Service data evaluation method, device, equipment and computer readable storage medium
CN112527383A (en) * 2020-12-15 2021-03-19 北京百度网讯科技有限公司 Method, apparatus, device, medium, and program for generating multitask model
CN114186633A (en) * 2021-12-10 2022-03-15 北京百度网讯科技有限公司 Distributed training method, device, device and storage medium of model

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190370684A1 (en) * 2018-06-01 2019-12-05 Sas Institute Inc. System for automatic, simultaneous feature selection and hyperparameter tuning for a machine learning model
CN111105040A (en) * 2019-11-14 2020-05-05 深圳追一科技有限公司 Hyper-parameter optimization method, device, computer equipment and storage medium
CN112396108A (en) * 2020-11-19 2021-02-23 腾讯科技(深圳)有限公司 Service data evaluation method, device, equipment and computer readable storage medium
CN112527383A (en) * 2020-12-15 2021-03-19 北京百度网讯科技有限公司 Method, apparatus, device, medium, and program for generating multitask model
CN114186633A (en) * 2021-12-10 2022-03-15 北京百度网讯科技有限公司 Distributed training method, device, device and storage medium of model

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115169164A (en) * 2022-09-09 2022-10-11 昆仑智汇数据科技(北京)有限公司 Information processing method, device and equipment of industrial model
CN115169164B (en) * 2022-09-09 2022-11-18 昆仑智汇数据科技(北京)有限公司 Information processing method, device and equipment of industrial model
CN118689753A (en) * 2024-08-23 2024-09-24 北京壁仞科技开发有限公司 Data processing method, device, electronic device and storage medium
CN118689753B (en) * 2024-08-23 2024-11-12 北京壁仞科技开发有限公司 Data processing method, device, electronic device and storage medium

Also Published As

Publication number Publication date
CN114819095B (en) 2024-12-24

Similar Documents

Publication Publication Date Title
CN113377520B (en) Resource scheduling method, device, equipment and storage medium
US20220374776A1 (en) Method and system for federated learning, electronic device, and computer readable medium
US20220391780A1 (en) Method of federated learning, electronic device, and storage medium
CN114157701B (en) Task testing method, device, equipment and storage medium
CN115390161B (en) Precipitation prediction method and device based on artificial intelligence
CN118672782A (en) Multi-agent-based problem processing method, device and product
CN114819095A (en) Method, device and electronic device for generating business data processing model
CN114818913B (en) Decision making method and device
EP4123516A1 (en) Method and apparatus for acquiring pre-trained model, electronic device and storage medium
JP2021193619A (en) Dialogue generation methods, devices, electronic devices and storage media
CN119829709B (en) Training of large question-answering models and methods and devices for question-answering tasks
CN113961289B (en) Data processing method, device, equipment and storage medium
CN113037489B (en) Data processing method, apparatus, device and storage medium
CN113012695B (en) Intelligent control method, device, electronic device and computer-readable storage medium
CN120218182A (en) Model distillation method, response information generation method and device
CN116567077B (en) Bare metal instruction transmission method, apparatus, equipment and storage medium
CN118433039A (en) Node communication method and device during model training
CN113361575B (en) Model training method and device and electronic equipment
CN114844889A (en) Video processing model updating method and device, electronic equipment and storage medium
KR20220046526A (en) Method and device for processing data, electronic device and storage medium
CN116091824A (en) Fine-tuning method of vehicle classification model, vehicle classification method, device and equipment
CN115757120A (en) Pressure testing method and device, electronic equipment and readable storage medium
CN119443277B (en) Question and answer processing method, large model training method, device, equipment and storage medium
CN114925816B (en) Method for generating text processing neural network model and text processing method
EP4152753A1 (en) Motion search method and apparatus, electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant