[go: up one dir, main page]

WO2018173481A1 - Dispositif et procédé de conception de configuration de service - Google Patents

Dispositif et procédé de conception de configuration de service Download PDF

Info

Publication number
WO2018173481A1
WO2018173481A1 PCT/JP2018/002699 JP2018002699W WO2018173481A1 WO 2018173481 A1 WO2018173481 A1 WO 2018173481A1 JP 2018002699 W JP2018002699 W JP 2018002699W WO 2018173481 A1 WO2018173481 A1 WO 2018173481A1
Authority
WO
WIPO (PCT)
Prior art keywords
business
service configuration
service
resource
relational expression
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/002699
Other languages
English (en)
Japanese (ja)
Inventor
清一 小泉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to JP2019507399A priority Critical patent/JPWO2018173481A1/ja
Publication of WO2018173481A1 publication Critical patent/WO2018173481A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Definitions

  • the present invention relates to a service configuration design apparatus and a service configuration design method for designing the configuration of a system that provides an ICT service.
  • a system that provides an ICT (Information and Communication Technology) service for example, Web site, video distribution, business system
  • a communication network such as the Internet
  • ICT Information and Communication Technology
  • a Web system is configured by a plurality of components such as a Web server, an application server, and a database server (see, for example, Patent Document 1).
  • Patent Document 1 describes a system configuration plan generation device that generates a system configuration plan that provides an ICT service in consideration of component requirements desired by a user.
  • Patent Document 2 introduces a service chain composed of a plurality of functions for realizing one service.
  • FIG. 14 is a system configuration diagram showing a general service providing system 500 that provides an ICT service via the Internet 600.
  • the service providing system 500 includes servers such as Web servers 510a and 510b, an application server 520, and a database (DB) server 530.
  • the service providing system 500 includes a firewall (FW) 540 that eliminates unnecessary traffic, and a load balancer (LB) 550 that converts an IP (Internet Protocol) address.
  • the service providing system 500 may incorporate a function of a proxy (Proxy) that stores a cache or a function of NAT (Network Address Translation) that performs address conversion.
  • modules that provide various server functions and network functions are collectively referred to as nodes.
  • resources such as CPU (Central Processing Unit), memory, and network I / O (Input / Output) may be added.
  • CPU Central Processing Unit
  • memory may be added to the node.
  • network I / O Input / Output
  • an accelerator that supports AES-NI Advanced Encryption Standard New Instructions
  • parallel processing by scale-out may be executed.
  • the optimal resource allocation pattern is also different. For example, in the case of FW, a CPU resource with high performance is required when performing a virus check on mail. When performing filtering of moving image distribution, network I / O resources with high performance are required. When both processes are performed simultaneously, the optimal resource allocation pattern is different, for example, more resources are required than the sum of the CPU resources and network I / O resources required by each single function.
  • the function of each node constituting the service chain corresponds to a service. Therefore, the “service configuration” is a concept representing how a plurality of nodes are combined. Further, the “service configuration” includes the concept of resource allocation in each node. “Service configuration design” is to determine a combination of a plurality of nodes in order to satisfy a required service level and to determine the amount of resources allocated to each node.
  • An object of the present invention is to reduce the time required for designing the configuration of a system that provides a service.
  • the service configuration design apparatus formulates a relationship between a business pattern defining means for analyzing a traffic of each node for providing an ICT service and defining a business, and a business and a resource consumption amount in each node.
  • Service configuration derivation means for generating a business / resource relational expression and service configuration derivation means for generating a service configuration based on a design derivation tree representing a combination of resources that can be included in a node.
  • the means generates a service configuration after narrowing down resources in the design derivation tree based on the business / resource relational expression.
  • the service configuration design method analyzes the traffic of each node for providing an ICT service, defines a business, formulates the relationship between the business and the resource consumption in each node, and creates a business / resource relationship.
  • An expression is generated, and after narrowing down resources in a design derivation tree that represents a combination of resources that can be included in a node based on a business / resource relational expression, a service configuration is generated based on the design derivation tree.
  • the recording medium is a computer-readable recording medium storing a service configuration design program, and the service configuration design program, when executed by a processor, traffic of each node for providing an ICT service. Included in the node based on the business / resource relational expression, the process that defines the business by analyzing the process, the process that formulates the relation between the business and the resource consumption at each node, and the business / resource relational expression After narrowing down resources in a design derivation tree that represents a possible resource combination, processing for generating a service configuration based on the design derivation tree is executed.
  • the time required for the configuration design of a system that provides a service is shortened.
  • FIG. 1 is a block diagram showing a service configuration design device (system configuration design device for selecting a service chain configuration for realizing an ICT service) for designing an optimal configuration of a service execution device together with related devices.
  • a service configuration design device system configuration design device for selecting a service chain configuration for realizing an ICT service
  • a service execution device 200 a measurement device 201, a configuration change device 202, a service configuration storage device 203, a measurement information storage device 204, and an input device 300 are shown.
  • the service execution device 200 provides an environment in which a plurality of services (Service1 and Service2 in the example illustrated in FIG. 1) that are realized by a plurality of nodes are operating.
  • the input device 300 is a device that supplies the service configuration design device 100 with requirements for a newly generated service (ICT service).
  • the measuring device 201 targets each node for providing the ICT service, traffic information (for example, traffic amount that is the amount of data passing through the network), service time (time required for data processing), resource consumption rate And the measured value is stored in the measurement information storage device 204.
  • traffic information for example, traffic amount that is the amount of data passing through the network
  • service time time required for data processing
  • resource consumption rate resource consumption rate
  • the configuration change device 202 reads the configuration information newly stored in the service configuration storage device 203 and constructs a service chain in the service execution device 200 based on the configuration information.
  • the service configuration storage device 203 stores configuration information selected by the service configuration design device 100.
  • the service configuration design device 100 includes a service configuration derivation unit (system configuration derivation unit) 101, a business / resource relational expression generation unit 102, a business pattern definition unit 103, a service requirement storage unit 110, a design derivation tree storage unit 111, a business / resource.
  • a relational expression storage unit 112 and a business pattern storage unit 113 are included.
  • the service configuration deriving unit 101 selects an appropriate service configuration (concatenation of a plurality of nodes for providing an ICT service) and the like.
  • the business / resource relational expression generation unit 102 generates a business / resource relational expression (a relational expression between a node business and a resource consumption rate) and stores the business / resource relational expression in the business / resource relational expression storage unit 112.
  • the business pattern definition unit 103 defines a business pattern (for example, ICT service) and stores business pattern information related to the business pattern in the business pattern storage unit 113.
  • the service requirement storage unit 110 stores service requirements supplied from the input device 300.
  • the design derivation tree storage unit 111 stores design derivation tree data.
  • the service configuration deriving unit 101, the business / resource relational expression generating unit 102, and the business pattern defining unit 103 are in accordance with programs stored in a non-temporary nonvolatile memory such as a ROM (Read Only Memory), a flash memory, or a hard disk. This can be realized by one or a plurality of processors (for example, CPUs) executing processing.
  • a non-temporary nonvolatile memory such as a ROM (Read Only Memory), a flash memory, or a hard disk.
  • the service requirement storage unit 110, the design derivation tree storage unit 111, the business / resource relational expression storage unit 112, and the business pattern storage unit 113 can be realized by a storage device such as a hard disk.
  • the measuring apparatus 201 includes, for each node in the service execution apparatus 200, information (traffic information) regarding traffic (data input to the node via the network and data output from the node), CPU, RAM (Random access) memory), network I / O, storage IOPS (Input / Output operation per second) information of resource utilization rate (resource consumption rate) is measured, and each measured value is stored in the measurement information storage device 204.
  • FIG. 2 is an explanatory diagram showing an example of a list of traffic information (traffic information table) stored in the measurement information storage device 204.
  • a communication log is set in the traffic information table together with a corresponding time stamp, service ID, node ID, and log type.
  • the service execution apparatus 200 provides a plurality of ICT services (Service1, Service 2, etc.).
  • FIG. 3 is an explanatory diagram showing an example of a list of resource consumption rates (resource consumption rate table) stored in the measurement information storage device 204.
  • the resource consumption rate table includes a CPU consumption rate, a RAM consumption rate, an IOPS consumption rate, and an NW (NetworkI) I / O consumption rate corresponding to the time stamp, service ID, and node. It is set together with the ID.
  • NW NetworkI
  • the service configuration design device 100 receives the requirements for the newly generated service from the input device 300 and stores them in the service requirement storage unit 110.
  • the service requirements include at least information indicating connection of nodes as service configuration requirements, information indicating a service level (for example, data transfer rate), and information indicating a node type (node type).
  • FIG. 4 is an explanatory diagram showing an example of service requirements stored in the service requirement storage unit 110.
  • the service requirement storage unit 110 stores service configuration requirements, service level requirements, and business pattern IDs (pattern IDs) as service requirements. Further, as shown in (B), the service requirement storage unit 110 also stores information indicating the node type included in the service configuration requirements.
  • the service specified by the service ID “service1” includes a plurality of ICT services (the moving image distribution service specified by patternA and the predetermined application service specified by patternB).
  • Juniper registered trademark
  • LVS Linux (registered trademark) Virtual Server) load balancer
  • Apache registered trademark
  • Tomcat server Tomcat server
  • MySQL registered trademark
  • fw indicates a firewall.
  • no indicates a NAT device.
  • lb indicates a load balancer.
  • px indicates a proxy.
  • dpi indicates a DPI (Deep Packet Inspection) device.
  • app indicates an application server.
  • ids indicates an intrusion detection system.
  • web indicates a Web server.
  • db indicates a database.
  • FIG. 5 is a flowchart showing the processing executed by the business pattern definition unit 103.
  • the business pattern definition unit 103 reads the traffic information corresponding to the node in the new service from the measurement information storage device 204 (step S11). Then, the business pattern definition unit 103 executes the process of step S13 for each node type stored in the service requirement storage unit 110 (steps S12 and S14).
  • step S13 the business pattern definition unit 103 defines a business pattern based on protocol information and content information in traffic information.
  • the business pattern definition unit 103 uses “HTTP” as protocol information and “Content-Type: video / flv” as content information. And define a business pattern of “video traffic”.
  • the business pattern definition unit 103 stores business pattern information related to the defined business pattern in the business pattern storage unit 113 (step S15).
  • FIG. 6 is an explanatory diagram showing an example of business pattern information stored in the business pattern storage unit 113.
  • name data representing a business pattern and data representing an identification pattern are registered corresponding to the pattern ID.
  • FIG. 7 is a flowchart showing processing executed by the business / resource relational expression generation unit 102.
  • the business / resource relational expression generation unit 102 reads the log and the resource consumption rate included in the traffic information from the measurement information storage device 204 (step S21).
  • the traffic volume can be known from the log.
  • the business / resource relational expression generating unit 102 reads business pattern information from the business pattern storage unit 113 (step S22).
  • the business / resource relational expression generation unit 102 classifies the traffic information for each business pattern (step S23). Further, the business / resource relational expression generating unit 102 executes the process of step S25 for each node type (steps S24 and S26).
  • step S25 the business / resource relational expression generation unit 102 generates a business / resource relational expression by performing mathematical analysis such as regression analysis using the traffic amount of the business pattern as an objective variable and the consumption rate for each resource as an explanatory variable. To do.
  • the business / resource relational expression generation unit 102 sets a threshold value of the precision of the relational expression, and deletes an explanatory variable having a low correlation with the objective variable. That is, the business / resource relational expression generation unit 102 generates a business / resource relational expression narrowed down to a resource type effective for the performance of the node type.
  • the business / resource relational expression generation unit 102 stores the generated business / resource relational expression in the business / resource relational expression storage unit 112 (step S27).
  • FIG. 8 is an explanatory diagram showing an example of a business / resource relational expression stored in the business / resource relational expression storage unit 112.
  • the resources are CPU, RAM, NWIO, and IOPS.
  • the business / resource relational expression generating unit 102 calculates the significance probability (p value) of the coefficient of the explanatory variable and stores it in the business / resource relational expression storage unit 112 together with “significant F” indicating the significance of the relation. .
  • the business / resource relational expression generation unit 102 sets “significant F ⁇ 0.05” as a threshold of accuracy of the relational expression, the correlation with the objective variable is low so as to satisfy this threshold Sharpen variables.
  • FIG. 9 is an explanatory diagram illustrating an example of a design derivation tree (hereinafter, also referred to as a derivation tree) stored in the design derivation tree storage unit 111.
  • a design derivation tree hereinafter, also referred to as a derivation tree
  • the design derivation tree storage unit 111 stores derivation trees in which all combinations of resources are set in a tree shape for each of a plurality of types of nodes for providing one or a plurality of ICT services. Yes.
  • a derivation tree indicated as ID: derivation tree 1 in FIG. 9 is stored in the design derivation tree storage unit 111 in advance.
  • the derivation tree shown as ID: derivation tree 2 is an example of a derivation tree in a state after the pruning process is performed by the service configuration derivation unit 101.
  • FIG. 10 exemplifies resource amounts of resources in each combination (resource type) of resources that can be included in each node.
  • the resource amount illustrated in FIG. 10 is stored in the design derivation tree storage unit 111.
  • CPU [Large] indicates that the amount of CPU resources in the combination of resources (CPU, RAM, NWIO, and IOPS) is large.
  • FIG. 11 is a flowchart showing processing executed by the service configuration deriving unit 101.
  • the service configuration deriving unit 101 reads out service requirements from the service requirement storage unit 110. That is, the service requirement shown in the first line in FIG. 4A stored in the service requirement storage unit 110 is read.
  • the service configuration deriving unit 101 sets a business pattern and traffic volume as an ICT service (step S31).
  • “video traffic” (pattern A) and “application service” (pattern B) are set as business patterns.
  • the service configuration deriving unit 101 reads data representing the derived tree from the design derived tree storage unit 111, and reads the node type business / resource relational expression included in the service from the business / resource relational expression storage unit 112 (step S32). ).
  • the service configuration deriving unit 101 summarizes business / resource relational expressions, business patterns, and traffic volume information for each node type. Then, the service configuration deriving unit 101 executes the processes of steps S34 to S37 for each node type (steps S33 and S38).
  • step S34 the service configuration deriving unit 101 determines whether or not the number of business patterns is 1 (step S34).
  • the service configuration deriving unit 101 determines the amount of resources based on the magnitude of significance (significance probability (p value)) of the explanatory variables in the business / resource relational expression of the business pattern. Is changed (step S36). That is, the service configuration deriving unit 101 performs pruning processing of the derived tree. Note that the service configuration deriving unit 101 allocates a minimum amount to a resource that does not have a corresponding variable. Further, the resource amount is defined as illustrated in FIG.
  • the service configuration deriving unit 101 changes the allocation amount of the resource amount based on the significance probability (p value) of the explanatory variable of the business / resource relational expression of the business pattern. Specifically, as an example, a derived tree according to a determination rule such as “the resource amount Large if p value ⁇ 0.01”, Medium if 0.01 ⁇ p value ⁇ 0.05, and Small if 0.05 ⁇ p value ”. Pruning. As a result, a derivation tree indicated as ID: derivation tree 2 is generated from the derivation tree indicated as ID: derivation tree 1 in FIG.
  • the node “fw1” ⁇ ⁇ ⁇ has three branches of CPU [Small], CPU [Medium], and CPU [Large]. It is narrowed down to CPU [Large].
  • the service configuration deriving unit 101 uses a plurality of business / resource relational expressions, but generates a pruning pattern from the plurality of business / resource relational expressions.
  • a pruning pattern an average value of significance probabilities (p values) of explanatory variables of a plurality of business / resource relational expressions is used.
  • the service configuration deriving unit 101 executes the process of step S36.
  • the service configuration deriving unit 101 generates instance candidates for the service configuration by combining the candidate components for each node (step S39).
  • the system when selecting system component candidates for providing a service based on log information collected during operation of an ICT service or the like, the system is configured by pruning a derived tree. Since the candidate elements are narrowed down, the candidate elements are derived in a short time.
  • the service configuration deriving unit 101 selects a best service configuration by performing a test on the candidate components. Then, the service configuration deriving unit 101 stores the selected service configuration in the service configuration storage device 203.
  • FIG. 12 is an explanatory diagram showing an example of a service configuration stored in the service configuration storage device 203.
  • the service configuration storage device 203 stores data that can specify how to link each service (each node) for realizing the ICT service and the amount of resources in each service.
  • FIG. 12 is an example that satisfies the service requirements illustrated in FIG.
  • the configuration change device 202 reads the service configuration newly stored in the service configuration storage device 203 and constructs a service chain on the service execution device 200 based on the service configuration.
  • a service configuration suitable for a new ICT service is designed, or the service configuration (service chain configuration) is automatically improved based on log information measured during the operation of the ICT service. It is used for applications that improve service quality.
  • FIG. 13 is a block diagram showing the main part of the service configuration design device.
  • the service configuration design device 10 analyzes the traffic of each node for providing the ICT service and defines a business pattern definition unit (business pattern definition unit) 11 (in the embodiment, realized by the business pattern definition unit 103) And a business / resource relational expression generating unit (business / resource relational expression generating means) 12 for formulating a relation between a business and resource consumption at each node to generate a business / resource relational expression (embodiment) And a service configuration deriving unit (service configuration deriving unit) 13 that generates a service configuration based on a design derivation tree that represents a combination of resources that can be included in the node. (In the embodiment, it is realized by the service configuration deriving unit 101). On the basis of the source relationship to generate a service configuration after narrowing down the resources in the design derivation tree.
  • the service configuration design program and the recording medium storing the service configuration design program may be configured as follows.
  • the service configuration design program formulates the relationship between the process of defining the business by analyzing the traffic of each node for providing the ICT service to the computer, and the business and the resource consumption at each node. After narrowing down the resources in the design derivation tree that represents the combination of resources that can be included in the node based on the process that generates the business / resource relational expression and the business / resource relational expression, the service configuration is configured based on the design derivation tree. The process to generate is executed.
  • the service configuration design program of (1) prunes the design derivation tree according to the degree of the relationship of the variables corresponding to the resources that can be included in the nodes in the business / resource relational expression to the business. To execute processing to narrow down resources.
  • the service configuration design program of (1) or (2) causes the computer to generate a business / resource relational expression by eliminating resources having low correlation with the performance of the node.
  • the service configuration design program of any one of (1) to (3) causes the computer to generate a service configuration for a plurality of tasks in a lump.
  • a non-transitory storage medium storing a service configuration design program, and when executed by a processor, the service configuration design program analyzes the traffic of each node for providing an ICT service.
  • a service configuration is generated based on the design derivation tree.
  • the service configuration design program stored in the storage medium of (5) or (6) generates a business / resource relational expression by excluding resources having low correlation with the performance of the node.
  • the service configuration design program stored in any one of the storage media of (5) to (7) generates service configurations for a plurality of business operations at once.

Landscapes

  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)

Abstract

La présente invention concerne un dispositif de conception de configuration de service (10) afin de raccourcir le temps requis pour la conception de configuration d'un système qui fournit un service, comprenant : une unité de définition de modèle de fonctionnement (11) qui analyse le trafic de chaque nœud pour fournir un service ICT et définit un fonctionnement ; une unité de génération d'expression relationnelle de ressource de fonctionnement (12) qui donne une relation entre le fonctionnement et les dépenses de ressource dans chacun des nœuds et génère une expression relationnelle de ressource de fonctionnement ; et une unité de dérivation de configuration de service (13) qui génère une configuration de service sur la base d'un arbre de dérivation de conception qui représente des combinaisons des ressources qui peuvent être contenues dans les nœuds. L'unité de dérivation de configuration de service (13) génère la configuration de service après avoir contraint les ressources dans l'arbre de dérivation de conception sur la base de l'expression relationnelle de ressource de fonctionnement.
PCT/JP2018/002699 2017-03-24 2018-01-29 Dispositif et procédé de conception de configuration de service Ceased WO2018173481A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019507399A JPWO2018173481A1 (ja) 2017-03-24 2018-01-29 サービス構成設計装置、およびサービス構成設計方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017058724 2017-03-24
JP2017-058724 2017-03-24

Publications (1)

Publication Number Publication Date
WO2018173481A1 true WO2018173481A1 (fr) 2018-09-27

Family

ID=63585326

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/002699 Ceased WO2018173481A1 (fr) 2017-03-24 2018-01-29 Dispositif et procédé de conception de configuration de service

Country Status (2)

Country Link
JP (1) JPWO2018173481A1 (fr)
WO (1) WO2018173481A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650505A (zh) * 2020-12-21 2021-04-13 四川长虹电器股份有限公司 一种web项目生成部署配置方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002202959A (ja) * 2000-12-28 2002-07-19 Hitachi Ltd 動的な資源分配をする仮想計算機システム
WO2016038857A1 (fr) * 2014-09-09 2016-03-17 日本電気株式会社 Appareil d'estimation de nombre d'échelles, système de gestion de nombre d'échelles, procédé d'estimation de nombre d'échelles, procédé de gestion de nombre d'échelles, et support de stockage

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002202959A (ja) * 2000-12-28 2002-07-19 Hitachi Ltd 動的な資源分配をする仮想計算機システム
WO2016038857A1 (fr) * 2014-09-09 2016-03-17 日本電気株式会社 Appareil d'estimation de nombre d'échelles, système de gestion de nombre d'échelles, procédé d'estimation de nombre d'échelles, procédé de gestion de nombre d'échelles, et support de stockage

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"FUJITSU Server PRIMERGY", FUJITSU FORUM, May 2015 (2015-05-01) *
HISADA NATSUMI ET AL: "Estimation methods of job characteristics in a job allocation agent in JAM/JC", IPSJ SIG NOTES, vol. 97, no. 57, 6 June 1997 (1997-06-06), pages 19 - 24 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650505A (zh) * 2020-12-21 2021-04-13 四川长虹电器股份有限公司 一种web项目生成部署配置方法

Also Published As

Publication number Publication date
JPWO2018173481A1 (ja) 2020-01-30

Similar Documents

Publication Publication Date Title
Ahmed et al. Cloud computing simulators: A detailed survey and future direction
CN104346433B (zh) 用于数据库查询操作的可缩放加速的方法和系统
CN107590075B (zh) 一种软件测试方法及装置
US9774654B2 (en) Service call graphs for website performance
JP6558374B2 (ja) スケール数推定装置、スケール数管理システム、スケール数推定方法、スケール数管理方法、および、コンピュータ・プログラム
CN111935223A (zh) 基于5g和云计算的物联网设备处理方法及云计算中心
CN110971478B (zh) 云平台服务性能的压测方法、装置及计算设备
US10341164B2 (en) Modifying computer configuration to improve performance
CN112650710A (zh) 数据迁移的发送方法及装置、存储介质、电子装置
EP2829972B1 (fr) Procédé et appareil pour attribuer une unité de traitement de flux
Yanggratoke et al. A service‐agnostic method for predicting service metrics in real time
US11374869B2 (en) Managing bandwidth based on user behavior
US9565060B2 (en) Managing a network connection for use by a plurality of application program processes
CN103152212B (zh) 一种告警相关性分析方法、装置及网络管理系统
WO2018173481A1 (fr) Dispositif et procédé de conception de configuration de service
CN104135525B (zh) 云平台elb组件的资源扩展方法和装置
CN114584627B (zh) 一种具有网络监控功能的中台调度系统及方法
CN110333994B (zh) 一种数据集匹配的模型确定方法、装置、设备及存储介质
CN112988560B (zh) 测试系统健壮性的方法和装置
CN117370127A (zh) 内容分发网络的调度测试方法、装置及计算机设备
Skračić et al. A Big Data solution for troubleshooting mobile network performance problems
CN116662144A (zh) 一种模拟数据的方法和装置
CN113392131A (zh) 数据处理方法、装置及计算机设备
JP6710716B2 (ja) 脅威情報評価装置、脅威情報評価方法およびプログラム
US20240031252A1 (en) Methods for measuring user experience and satisfaction and identifying bottlenecks on communications networks

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18770683

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019507399

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18770683

Country of ref document: EP

Kind code of ref document: A1