CN114138406A - Application container rapid deployment platform - Google Patents
Application container rapid deployment platform Download PDFInfo
- Publication number
- CN114138406A CN114138406A CN202111316847.7A CN202111316847A CN114138406A CN 114138406 A CN114138406 A CN 114138406A CN 202111316847 A CN202111316847 A CN 202111316847A CN 114138406 A CN114138406 A CN 114138406A
- Authority
- CN
- China
- Prior art keywords
- node
- deployment
- submodule
- resource
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45562—Creating, deleting, cloning virtual machine instances
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45575—Starting, stopping, suspending or resuming virtual machine instances
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a rapid deployment platform for an application container, which comprises: the request module is used for generating a corresponding operation request based on an operation instruction input by a user; a determining module, configured to determine, based on the operation request, a preparation resource corresponding to a deployment operation; the acquisition module is used for adjusting the node to be deployed determined based on the preparation resource and acquiring a corresponding final deployment strategy based on the adjusted node to be deployed; the deployment module is used for updating the deployment file based on the hot migration and the final deployment strategy to realize rapid deployment; to combine live migration with rapid deployment so that live migration can quickly resume running on other hosts or platforms.
Description
Technical Field
The invention relates to the technical field of application deployment methods, in particular to a rapid deployment platform for an application container.
Background
Container technology has attracted extensive attention in the industry, and there is ample evidence that container technology can greatly improve work efficiency. However, more and more users find that hypervisors offer such a widely supported feature to be really cumbersome to make themselves. For the hypervisor environment, each virtual machine instance needs to run a complete copy of the client operating system and the large number of applications contained therein. From the practical operation point of view, the resulting heavy load will affect the working efficiency and performance. First, each operating system and application stack requires the use of DRAM. For multiple small virtual machine instances running simple applications, this approach may generate significant overhead and degrade performance. Loading and unloading these stack images takes a long time and also increases the number of network connections for the container technology server.
Live Migration (also called Live Migration or Live Migration) refers to completely storing the run-time shape of a whole container and rapidly recovering the run-time shape on other hosts or platforms. Container thermomigration finds application in two major areas: firstly, a plurality of operation units execute tasks, and the container can be quickly copied and migrated by the hot migration, so that the operation without perception is realized; secondly, load balance of clusters in the data center can be processed, when a large amount of data burst and calculation cannot be operated, a plurality of container processing operation tasks can be created by using thermal migration, information data processing peaks and valleys are adjusted, a management load balance proportion is configured, and application delay is reduced.
In order to solve the problem of multiple operating systems or application program stacks, the invention provides a rapid application container deployment platform.
Disclosure of Invention
The invention provides a rapid deployment platform for an application container, which is used for combining the hot migration and the rapid deployment, so that the hot migration can be rapidly recovered to run on other hosts or platforms.
The invention provides a rapid deployment platform for an application container, which comprises:
the request module is used for generating a corresponding operation request based on an operation instruction input by a user;
a determining module, configured to determine, based on the operation request, a preparation resource corresponding to a deployment operation;
the acquisition module is used for adjusting the node to be deployed determined based on the preparation resource and acquiring a corresponding final deployment strategy based on the adjusted node to be deployed;
and the deployment module is used for updating the deployment file based on the hot migration and the final deployment strategy so as to realize rapid deployment.
Preferably, the application container rapid deployment platform, the request module, includes:
the receiving submodule is used for receiving an operation instruction input by a user;
and the request submodule is used for analyzing the applications to be operated and the corresponding application operation instructions contained in the operation instructions and generating the operation requests corresponding to the applications to be operated based on the application operation instructions.
Preferably, the operation request includes an application operation request and a resource access request, and the resource access request is used to request access to a corresponding prepared resource in a preset application configuration resource library.
Preferably, the determining module of the application container rapid deployment platform includes:
the analysis submodule is used for receiving the operation request, analyzing the emergency level of the application operation instruction in the operation request and establishing an operation instruction list based on all the received operation requests and the corresponding emergency levels;
the computing submodule is used for analyzing the resource access request corresponding to each application operation instruction and obtaining the reliability coefficient corresponding to the resource access request;
the replacing submodule is used for replacing the application operating instruction with the reliability coefficient not meeting the requirement in the operating instruction list based on a preset safety instruction library to generate a standard operating instruction list;
and the first calling submodule is used for calling the preparation resource corresponding to each standard operation instruction from a preset application configuration resource library in sequence based on the standard operation instruction list.
Preferably, the application container rapid deployment platform, the obtaining module, includes:
the first generation module is used for generating a preliminary deployment strategy based on a standard operation instruction list and determining a corresponding preliminary deployment network and a first node to be deployed in the preliminary deployment network;
the simulation submodule is used for carrying out simulation application deployment in the container corresponding to the first node based on the preliminary deployment strategy;
and the adjusting module is used for monitoring a simulated deployment process, adjusting the first node based on the simulated deployment process and generating a final deployment strategy.
Preferably, the application container rapid deployment platform, the first generating module, includes:
the reading submodule is used for reading node information of all available nodes, determining a target computer corresponding to each standard operation instruction in a standard operation instruction list, and reading position information of the target computer;
the first generation submodule is used for generating a preliminary deployment strategy based on the node information and the position information;
and the first determining submodule is used for determining a corresponding preliminary deployment network and a first node to be deployed in the preliminary deployment network based on the preliminary deployment strategy.
Preferably, the application container rapid deployment platform, the adjusting module, includes:
the statistical submodule is used for monitoring the simulated deployment process, counting the access times of a first node to be deployed in the preliminary deployment network, and determining the first resource bearing capacity in each access process based on the access times;
and the adjusting submodule is used for adjusting the first node based on the first resource bearing capacity of the first node in each access process to generate a final deployment strategy.
Preferably, the application container rapid deployment platform, the deployment module, includes:
the detection submodule is used for determining a target computer to be deployed based on the final deployment strategy and determining an available memory of the target computer and a bandwidth value of a corresponding deployment interface;
the judging module is used for acquiring an occupied space predicted value corresponding to each standard operation instruction, judging whether the available memory of the target computer is larger than the corresponding occupied space predicted value and whether the bandwidth value of the corresponding deployment interface is larger than a first threshold value, if so, sending a starting signal, and otherwise, controlling the corresponding target computer to perform capacity expansion processing;
and the hot migration sub-module is used for determining a second node in the final deployment strategy based on the final deployment strategy when the starting signal is received, updating the application container deployment file corresponding to the second node based on hot migration, and deploying the application container deployment file of the second node to a corresponding target computer based on hot migration, so that the rapid deployment of the application container takes effect.
Preferably, the application container rapid deployment platform, the adjusting submodule includes:
the acquisition submodule is used for determining the topological structure of the current available node and determining the topological information of the topological structure and the path information among all the available nodes;
the monitoring submodule is used for monitoring the available node, acquiring the current resource bearing capacity of the available node and acquiring the corresponding current available bearing capacity based on the current resource bearing capacity;
the first screening submodule is used for judging whether the first resource bearing capacity is larger than the current available bearing capacity of a corresponding first node or not, if so, screening a third node set of which the current available bearing capacity is larger than the first resource bearing capacity from the remaining second nodes except the first node in the available nodes, and replacing the corresponding first node with the third node set as a total node, otherwise, reserving the first node until all the first nodes are screened, and generating a second deployment network;
a second screening submodule, configured to determine all adjacent node combinations in the second deployment network, and if the adjacent node combinations include a single node and a total node, determine a first sub-path attribute between each first sub-node in the corresponding total node and the single node, determine a first transmission resource attribute between the total node and the single node, and screen out a fourth node set, of which the first sub-path attribute is matched with the first transmission resource attribute, from all the first sub-nodes;
a third screening submodule, configured to determine, if the adjacent node combination includes two total nodes, a second sub-path attribute between each second sub-node included in the total node and each third sub-node included in another total node, determine a second transmission resource attribute between the two total nodes, and screen, from all second sub-paths, a third sub-path set whose corresponding second sub-path attribute matches the second transmission resource attribute and an adjacent sub-node set corresponding to each third sub-path;
a fourth screening submodule, configured to determine a third path attribute between two single nodes and determine a third transmission resource attribute between the two single nodes if the adjacent node combination includes two single nodes, and determine whether the third path attribute and the third transmission resource attribute match, if yes, retain the single node, and otherwise, determine a corresponding fifth node set based on a path attribute matching principle;
the second generation submodule is used for screening out a final node from the reserved single node, all the fourth node sets and all the adjacent sub-node sets based on the shortest transmission distance principle and the initial deployment network, and generating a final deployment strategy based on the final node;
the second generation submodule is also used for taking the preliminary deployment strategy as a final deployment strategy when the first resource bearing capacity is larger than the current available bearing capacity of each first node;
wherein the combination of adjacent nodes is a combination of adjacent nodes in the second deployment network.
Preferably, the application container rapid deployment platform, the determining module includes:
the second calling submodule is used for calling corresponding standard operation information based on each standard operation instruction;
a second determining submodule, configured to determine, based on a jump relationship included in the standard operation information and a jump operation memory difference corresponding to each jump relationship, an iterative operation memory value and a jump operation memory value of a corresponding standard operation instruction in a corresponding target computer, determine the jump operation memory value as a first threshold value, obtain an occupied space value of a preparation resource corresponding to each standard operation instruction, and use a larger value of the occupied space value and the iterative operation memory value as an occupied space prediction value corresponding to each target computer;
the judgment submodule is used for judging whether the available memory of each target computer is larger than the corresponding occupied space predicted value and whether the bandwidth value of the corresponding deployment interface is larger than a first threshold value, and if so, sending a starting signal;
the first capacity expansion submodule is used for controlling the corresponding target computer to perform capacity expansion processing according to the corresponding occupied space predicted value when the available memory of the target computer is not larger than the corresponding occupied space predicted value and the bandwidth value of the corresponding deployment interface is larger than the corresponding first threshold value;
the second capacity expansion sub-module is used for controlling the corresponding deployment interface to carry out capacity expansion processing according to the corresponding first threshold when the available memory of the target computer is larger than the corresponding occupied space predicted value and the bandwidth value of the corresponding deployment interface is not larger than the corresponding first threshold;
and the third expansion submodule is used for controlling the corresponding target computer to perform expansion processing according to the corresponding occupation space predicted value and controlling the corresponding deployment interface to perform expansion processing according to the corresponding first threshold value when the available memory of the target computer is not greater than the corresponding occupation space predicted value and the bandwidth value of the corresponding deployment interface is not greater than the corresponding first threshold value.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a block diagram of a system for rapid deployment of application containers according to an embodiment of the present invention;
FIG. 2 is a block diagram of a request module in an embodiment of the invention;
FIG. 3 is a block diagram of a determination module in an embodiment of the present invention;
FIG. 4 is a block diagram of an acquisition module according to an embodiment of the present invention;
FIG. 5 is a diagram of a first generation submodule in an embodiment of the present invention;
FIG. 6 is a block diagram of an adjustment module according to an embodiment of the present invention;
FIG. 7 is a block diagram of a deployment module in an embodiment of the invention;
FIG. 8 is a block diagram of an adjustment submodule in an embodiment of the present invention;
FIG. 9 is a block diagram of a determining module according to an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Example 1:
the invention provides a rapid deployment platform for an application container, as shown in fig. 1, comprising:
the request module is used for generating a corresponding operation request based on an operation instruction input by a user;
a determining module, configured to determine, based on the operation request, a preparation resource corresponding to a deployment operation;
the acquisition module is used for adjusting the node to be deployed determined based on the preparation resource and acquiring a corresponding final deployment strategy based on the adjusted node to be deployed;
and the deployment module is used for updating the deployment file based on the hot migration and the final deployment strategy so as to realize rapid deployment.
In this embodiment, an application deployment operation instruction input by a user is received from a target computer side (user side), the application deployment operation instruction is transmitted to a cloud platform or other deployment control platforms, a preparation resource corresponding to a deployment operation is determined, a final deployment strategy is determined, and finally, a deployment file is updated to a node to be deployed in the cloud platform or other deployment control platforms based on a live migration phenomenon, and then the node to be deployed is deployed to the target computer side (user side).
In this embodiment, the operation instruction is an application deployment operation instruction input by a user from a target computer side (user side), for example: create an application box, and the like.
In this embodiment, the request module is disposed at a target computer end (user end), the determination module is disposed in a cloud platform or an application configuration resource library of another deployment control platform, and the acquisition module and the deployment module are disposed in the cloud platform or another deployment control platform.
In this embodiment, preparing the resource includes: an application configuration file, an application configuration mirror copy file, and the like.
In this embodiment, the node to be deployed is a node that will pass through in the deployment process determined in the preset distributed node network based on the operation instruction input by the user.
In this embodiment, the final deployment policy is a deployment policy finally determined based on the operation instructions input by the user, and includes a deployment sequence of each operation instruction, which nodes each operation executes in a deployment process.
In this embodiment, the deployment file is an application deployment file included in the container application in the node and an application deployment file included in the target computer.
The beneficial effects of the above technical scheme are: generating a corresponding operation request based on an operation instruction input by a user, further determining a corresponding preparation resource, determining a corresponding deployment strategy based on the determined preparation resource, determining the deployment strategy based on the operation instruction actually input by the user, realizing the adjustment of a deployment path and a deployment method according to the actual situation, avoiding the phenomenon of system crash caused by overlarge node load in the deployment process, and finally combining the thermal migration and the deployment strategy, the hot migration can be quickly recovered to run on other hosts or platforms, the deployment efficiency of the application container is further improved, the system overhead in the deployment process is reduced, the system performance in the deployment process is kept, the running time in the deployment process is reduced, the excessive network connection quantity of the container technology server is avoided, the containers can be rapidly copied and migrated based on the thermal migration, and the operation without perception is achieved; the load balancing of the clusters in the data center can be processed, a plurality of container processing operation tasks can be created, information data processing peaks and valleys can be adjusted, load balancing proportion can be configured and managed, application delay is reduced, and the problem of stacking of multiple operating systems or application programs is solved.
Example 2:
based on embodiment 1, the request module, as shown in fig. 2, includes:
the receiving submodule is used for receiving an operation instruction input by a user;
and the request submodule is used for analyzing the applications to be operated and the corresponding application operation instructions contained in the operation instructions and generating the operation requests corresponding to the applications to be operated based on the application operation instructions.
In this embodiment, the receiving module and the request submodule are disposed on the target computer side (user side).
The beneficial effects of the above technical scheme are: and receiving an operation instruction input by a user, determining the preparation resource correspondingly meeting the application deployment requirement of the user, and providing a basis for subsequently determining the final deployment strategy.
Example 3:
based on embodiment 2, the operation request includes an application operation request and a resource access request, where the resource access request is used to request access to a corresponding prepared resource in a preset application configuration resource library.
In this embodiment, the application configuration resource library is a container configuration file corresponding to an application, which is stored in the cloud platform or other deployment control platforms and can be used by a user for deployment selection.
In this embodiment, the application operation request is used to indicate the application to be deployed and the operation of the application to be deployed, which are selected by the user, to the cloud platform or other deployment control platforms.
The beneficial effects of the above technical scheme are: the method comprises the steps of receiving an operation instruction input by a user, on one hand, determining a preparation resource corresponding to the application deployment requirement of the user, and on the other hand, performing security check on the application operation request based on the resource access request, so that the security in the application deployment process is improved, and the application resource library in a cloud platform or other deployment control platforms is prevented from being damaged.
Example 4:
based on embodiment 1, the determining module, as shown in fig. 3, includes:
the analysis submodule is used for receiving the operation request, analyzing the emergency level of the application operation instruction in the operation request and establishing an operation instruction list based on all the received operation requests and the corresponding emergency levels;
the computing submodule is used for analyzing the resource access request corresponding to each application operation instruction and obtaining the reliability coefficient corresponding to the resource access request;
the replacing submodule is used for replacing the application operating instruction with the reliability coefficient not meeting the requirement in the operating instruction list based on a preset safety instruction library to generate a standard operating instruction list;
and the first calling submodule is used for calling the preparation resource corresponding to each standard operation instruction from a preset application configuration resource library in sequence based on the standard operation instruction list.
In this embodiment, analyzing the urgency level of the application operation instruction in the operation request includes: and matching the application operation instruction with a preset application operation instruction emergency level table to determine the emergency level of the application operation instruction in the operation request, wherein the application operation instruction emergency level table is specified in advance.
In this embodiment, the standard operation instruction list is an application operation instruction list corresponding to the operation instruction list whose reliability coefficient meets the requirement.
The beneficial effects of the above technical scheme are: and determining a corresponding operation instruction list based on the emergency level of the application operation instruction, providing a basis for subsequently determining a deployment strategy, calculating a reliability coefficient of the resource access request, and further confirming the security of the application operation instruction, further improving the security in the application deployment process, and avoiding the application resource library in the cloud platform or other deployment control platforms from being damaged.
Example 5:
based on embodiment 1, as shown in fig. 4, the obtaining module includes:
the first generation module is used for generating a preliminary deployment strategy based on a standard operation instruction list and determining a corresponding preliminary deployment network and a first node to be deployed in the preliminary deployment network;
the simulation submodule is used for carrying out simulation application deployment in the container corresponding to the first node based on the preliminary deployment strategy;
and the adjusting module is used for monitoring a simulated deployment process, adjusting the first node based on the simulated deployment process and generating a final deployment strategy.
In this embodiment, the preliminary deployment policy is a deployment policy preliminarily determined based on a standard operation instruction;
in this embodiment, the preliminary deployment network is a topology structure between deployment nodes determined by the preliminary deployment policy.
In this embodiment, the first node is a node included in the preliminary deployment network.
The beneficial effects of the above technical scheme are: the first node is adjusted through the simulated deployment process based on the preliminary deployment strategy, so that the implementability of the final deployment strategy is ensured.
Example 6:
based on embodiment 5, the first generating module, as shown in fig. 5, includes:
the reading submodule is used for reading node information of all available nodes, determining a target computer corresponding to each standard operation instruction in a standard operation instruction list, and reading position information of the target computer;
the first generation submodule is used for generating a preliminary deployment strategy based on the node information and the position information;
and the first determining submodule is used for determining a corresponding preliminary deployment network and a first node to be deployed in the preliminary deployment network based on the preliminary deployment strategy.
In this embodiment, all available nodes are all available nodes in the cloud platform or other deployment control platform.
In this embodiment, the node information includes the maximum resource carrying capacity and the current resource carrying capacity of the corresponding node, and the location information.
In this embodiment, a preliminary deployment strategy is generated based on the node information and the location information, that is, a preliminary deployment path is sequentially determined as the preliminary deployment strategy based on the location information of the node, the location information of the target computer, and the shortest transmission distance principle.
The beneficial effects of the above technical scheme are: and determining a preliminary deployment strategy according to the acquired position information of all available nodes, the position information of the target computer and the shortest transmission distance principle, and providing a basis for subsequently determining a final deployment strategy.
Example 7:
based on embodiment 5, the adjusting module, as shown in fig. 6, includes:
the statistical submodule is used for monitoring the simulated deployment process, counting the access times of a first node to be deployed in the preliminary deployment network, and determining the first resource bearing capacity in each access process based on the access times;
and the adjusting submodule is used for adjusting the first node based on the first resource bearing capacity of the first node in each access process to generate a final deployment strategy.
In this embodiment, the first resource bearing capacity corresponds to a maximum resource bearing capacity to be deployed in the access process.
The beneficial effects of the above technical scheme are: the first nodes are adjusted based on the determined maximum deployment resource bearing capacity of each first node in the access process, so that the situation that the determined deployment strategy is likely to cause overload and crash of part of the nodes in the deployment process can be avoided.
Example 8:
based on embodiment 1, as shown in fig. 7, the deployment module includes:
the detection submodule is used for determining a target computer to be deployed based on the final deployment strategy and determining an available memory of the target computer and a bandwidth value of a corresponding deployment interface;
the judging module is used for acquiring an occupied space predicted value corresponding to each standard operation instruction, judging whether the available memory of the target computer is larger than the corresponding occupied space predicted value and whether the bandwidth value of the corresponding deployment interface is larger than a first threshold value, if so, sending a starting signal, and otherwise, controlling the corresponding target computer to perform capacity expansion processing;
and the hot migration sub-module is used for determining a second node in the final deployment strategy based on the final deployment strategy when the starting signal is received, updating the application container deployment file corresponding to the second node based on hot migration, and deploying the application container deployment file of the second node to a corresponding target computer based on hot migration, so that the rapid deployment of the application container takes effect.
In this embodiment, the available memory is the maximum available space allocated by the corresponding target computer for this task at deployment.
In this embodiment, the bandwidth value of the deployment interface reflects the maximum amount of transmission that the deployment interface of the corresponding target computer can transmit simultaneously.
In this embodiment, the predicted occupied space value is a determination value for determining whether the available memory of the corresponding target computer meets the deployment condition.
In this embodiment, the first threshold is a determination value for determining whether or not the bandwidth value of the deployment interface of the win target computer satisfies the deployment condition.
In this embodiment, the second node is a node included in the final deployment network determined by the final deployment policy.
In this embodiment, the application container deployment file is a configuration file that needs to be deployed to the target computer determined based on the provisioning resources.
The beneficial effects of the above technical scheme are: the method and the device are used for comparing the bandwidth values of the available memory and the deployment interface corresponding to the target computer with the corresponding judgment values, so that the memory and the deployment interface of the target computer meet the corresponding deployment conditions, failure of deployment tasks is avoided, and the condition that the system is crashed due to overload is also avoided.
Example 9:
based on embodiment 7, the adjusting sub-module, as shown in fig. 8, includes:
the acquisition submodule is used for determining the topological structure of the current available node and determining the topological information of the topological structure and the path information among all the available nodes;
the monitoring submodule is used for monitoring the available node, acquiring the current resource bearing capacity of the available node and acquiring the corresponding current available bearing capacity based on the current resource bearing capacity;
the first screening submodule is used for judging whether the first resource bearing capacity is larger than the current available bearing capacity of a corresponding first node or not, if so, screening a third node set of which the current available bearing capacity is larger than the first resource bearing capacity from the remaining second nodes except the first node in the available nodes, and replacing the corresponding first node with the third node set as a total node, otherwise, reserving the first node until all the first nodes are screened, and generating a second deployment network;
a second screening submodule, configured to determine all adjacent node combinations in the second deployment network, and if the adjacent node combinations include a single node and a total node, determine a first sub-path attribute between each first sub-node in the corresponding total node and the single node, determine a first transmission resource attribute between the total node and the single node, and screen out a fourth node set, of which the first sub-path attribute is matched with the first transmission resource attribute, from all the first sub-nodes;
a third screening submodule, configured to determine, if the adjacent node combination includes two total nodes, a second sub-path attribute between each second sub-node included in the total node and each third sub-node included in another total node, determine a second transmission resource attribute between the two total nodes, and screen, from all second sub-paths, a third sub-path set whose corresponding second sub-path attribute matches the second transmission resource attribute and an adjacent sub-node set corresponding to each third sub-path;
a fourth screening submodule, configured to determine a third path attribute between two single nodes and determine a third transmission resource attribute between the two single nodes if the adjacent node combination includes two single nodes, and determine whether the third path attribute and the third transmission resource attribute match, if yes, retain the single node, and otherwise, determine a corresponding fifth node set based on a path attribute matching principle;
the second generation submodule is used for screening out a final node from the reserved single node, all the fourth node sets and all the adjacent sub-node sets based on the shortest transmission distance principle and the initial deployment network, and generating a final deployment strategy based on the final node;
the second generation submodule is also used for taking the preliminary deployment strategy as a final deployment strategy when the first resource bearing capacity is larger than the current available bearing capacity of each first node;
wherein the combination of adjacent nodes is a combination of adjacent nodes in the second deployment network.
In this embodiment, the currently available nodes are all nodes included in the deployment platform or other deployment control platform, and the first node is a node determined according to the preliminary deployment policy from among the currently available nodes.
In this embodiment, all the first nodes that do not satisfy the requirement are replaced by corresponding total nodes, and the total nodes are in one-to-one correspondence with the first nodes, so that one or more of the first nodes that do not satisfy the requirement may or may not be present.
In this embodiment, the first node is directly determined according to the preliminary deployment policy, and then the first node is screened, so as to perform judgment screening on the aspects of resource bearing capacity, path attributes and the like, and replace the unqualified first node.
In this embodiment, the topology information is a topology structure between currently available nodes.
In this embodiment, the path information includes path attributes between available nodes.
In this embodiment, the current resource carrying capacity is the transmission capacity currently carried by the available node.
In this embodiment, the current available bearer amount is a value obtained by subtracting the current resource bearer amount from the maximum bearable transmission capacity of the available node.
In this embodiment, the total node is a node that combines the third node set into one large node.
In this embodiment, the second deployment network is a deployment network formed by replacing the first node with the total node as required.
In this embodiment, a single node is an independent node, and is not a total node formed by a plurality of nodes, but may also be regarded as each first node reserved in the second-step network.
In this embodiment, the first sub-path attribute is a path attribute between each first sub-node in the corresponding total node and the single node, such as: the source attribute indicates the source of the path information; the next hop attribute indicates the next hop IP address to the destination; the AS path attribute is a list of AS numbers passed by the route to the target network, and the autonomous system advertising the router is located at the end of the list.
In this embodiment, the first transmission resource attribute is a transmission resource attribute between the first node and the single node before the total node is replaced, such as: the method comprises the steps of initially preparing resource attributes, node deployment file attributes and target computer deployment file attributes, wherein the initially preparing resource attributes are matched with source attributes in path attributes, the node deployment file attributes are matched with next hop attributes in the path attributes, and the target computer deployment file attributes are matched with AS path attributes in the path attributes.
In this embodiment, the second sub-path attribute is a path attribute between each second sub-node included in the total node and each third sub-node included in another total node.
In this embodiment, it is determined that the second transmission resource attribute between the two master nodes is: transmission resource attributes between the first nodes respectively corresponding to the two nodes before replacement are determined.
In this embodiment, the third path attribute is a path attribute between two single nodes.
In this embodiment, the third transmission resource attribute is a transmission resource attribute between two single nodes.
In this embodiment, based on the shortest transmission distance principle and the preliminary deployment network, screening out a final node from the reserved single node, all the fourth node sets, and all the adjacent child node sets, and generating a final deployment policy based on the final node includes: and taking a cloud platform or other deployment control platforms as a starting point, taking the preliminary deployment network as a framework, and based on a shortest transmission distance principle, sequentially determining transmission paths (deployment nodes) from the reserved single node, all fourth node sets and all adjacent child node sets to generate a final deployment strategy.
In this embodiment, the final node is a node included in the final deployment network corresponding to the final deployment policy.
The beneficial effects of the above technical scheme are: and adjusting and replacing the first node based on the resource bearing capacity of the node, the path attribute of the adjacent node and the transmission resource attribute, and ensuring the enforceability of the determined final deployment strategy.
Example 10:
based on embodiment 8, as shown in fig. 9, the determining module includes:
the second calling submodule is used for calling corresponding standard operation information based on each standard operation instruction;
a second determining submodule, configured to determine, based on a jump relationship included in the standard operation information and a jump operation memory difference corresponding to each jump relationship, an iterative operation memory value and a jump operation memory value of a corresponding standard operation instruction in a corresponding target computer, determine the jump operation memory value as a first threshold value, obtain an occupied space value of a preparation resource corresponding to each standard operation instruction, and use a larger value of the occupied space value and the iterative operation memory value as an occupied space prediction value corresponding to each target computer;
the judgment submodule is used for judging whether the available memory of each target computer is larger than the corresponding occupied space predicted value and whether the bandwidth value of the corresponding deployment interface is larger than a first threshold value, and if so, sending a starting signal;
the first capacity expansion submodule is used for controlling the corresponding target computer to perform capacity expansion processing according to the corresponding occupied space predicted value when the available memory of the target computer is not larger than the corresponding occupied space predicted value and the bandwidth value of the corresponding deployment interface is larger than the corresponding first threshold value;
the second capacity expansion sub-module is used for controlling the corresponding deployment interface to carry out capacity expansion processing according to the corresponding first threshold when the available memory of the target computer is larger than the corresponding occupied space predicted value and the bandwidth value of the corresponding deployment interface is not larger than the corresponding first threshold;
and the third expansion submodule is used for controlling the corresponding target computer to perform expansion processing according to the corresponding occupation space predicted value and controlling the corresponding deployment interface to perform expansion processing according to the corresponding first threshold value when the available memory of the target computer is not greater than the corresponding occupation space predicted value and the bandwidth value of the corresponding deployment interface is not greater than the corresponding first threshold value.
In this embodiment, the standard operation information is a jump relationship corresponding to each standard operation instruction and a jump operation memory difference corresponding to each jump relationship.
In this embodiment, the jump relationship is a jump relationship between standard operation instructions.
In this embodiment, the jump run memory difference is a run memory difference between adjacent standard operation instructions corresponding to the jump relationship.
In this embodiment, determining an iterative operation memory value and a jump operation memory value of a corresponding standard operation instruction in a corresponding target computer based on a jump relationship included in the standard operation information and a jump operation memory difference corresponding to each jump relationship includes:
based on the determined corresponding standard operation instruction, the corresponding prepared resource memory value and the jump operation memory difference, calculating an iteration operation memory value in the corresponding target computer:
wherein S is the memory value of the iteration operation in the corresponding target computer, N is the total iteration times, and S0Preparing the resource memory value corresponding to the corresponding standard operation instruction, I is the iteration number, SIThe memory difference is the skip operation memory difference between the I iteration and the (I-1) iteration;
for example, the total number of iterations N is 3, corresponding to the prepared resource memory value S corresponding to the standard operation instruction0100, jump run memory difference S between 2 nd iteration and 1 st210, jump run memory difference S between iteration 3 and 23If the value is 10, the iterative operation memory value S in the corresponding target computer is 32812100;
based on the total jumping times determined by the jumping relation, the prepared resource memory value corresponding to the determined corresponding standard operation instruction and the jumping operation memory difference, calculating the jumping operation memory value in the corresponding target computer:
in the formula, S' is a jump operation memory value in a corresponding target computer, and M is the total jump times determined based on the jump relation;
for example, the total number of jumping times M determined based on the jumping relation is 5, corresponding to the standard operationPreparing resource memory value S corresponding to instruction0100, jump run memory difference S between 2 nd iteration and 1 st210, jump run memory difference S between iteration 3 and 2310, jump run memory difference S between 4 th iteration and 3 rd25, jump operation memory difference S between 5 th iteration and 4 th iteration3If 20, the jump run memory value S' in the corresponding target computer is 545.
In this embodiment, the iterative operation memory value is an accumulated memory value required by the generator as the code body of the access resource during the operation of the generator in the iterative process.
In this embodiment, the jump run memory value is a memory required for instruction jump in the process of deploying each standard operation instruction.
The beneficial effects of the above technical scheme are: the iterative operation memory value and the corresponding preparation resource occupation space value are compared to determine a corresponding judgment value, the memory generated in the iterative operation process and the occupation memory of the preparation resource are considered, the memory and the deployment interface of the target computer are further ensured to meet the corresponding deployment condition, the failure of the deployment task is avoided, and the condition that the overload causes the system crash is also avoided.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. An application container rapid deployment platform comprising:
the request module is used for generating a corresponding operation request based on an operation instruction input by a user;
a determining module, configured to determine, based on the operation request, a preparation resource corresponding to a deployment operation;
the acquisition module is used for adjusting the node to be deployed determined based on the preparation resource and acquiring a corresponding final deployment strategy based on the adjusted node to be deployed;
and the deployment module is used for updating the deployment file based on the hot migration and the final deployment strategy so as to realize rapid deployment.
2. The application container rapid deployment platform of claim 1, wherein the request module comprises:
the receiving submodule is used for receiving an operation instruction input by a user;
and the request submodule is used for analyzing the applications to be operated and the corresponding application operation instructions contained in the operation instructions and generating the operation requests corresponding to the applications to be operated based on the application operation instructions.
3. The platform of claim 2, wherein the operation request includes an application operation request and a resource access request, and the resource access request is used to request access to a corresponding prepared resource in a preset application configuration resource library.
4. The application container rapid deployment platform of claim 1, wherein the determining module comprises:
the analysis submodule is used for receiving the operation request, analyzing the emergency level of the application operation instruction in the operation request and establishing an operation instruction list based on all the received operation requests and the corresponding emergency levels;
the computing submodule is used for analyzing the resource access request corresponding to each application operation instruction and obtaining the reliability coefficient corresponding to the resource access request;
the replacing submodule is used for replacing the application operating instruction with the reliability coefficient not meeting the requirement in the operating instruction list based on a preset safety instruction library to generate a standard operating instruction list;
and the first calling submodule is used for calling the preparation resource corresponding to each standard operation instruction from a preset application configuration resource library in sequence based on the standard operation instruction list.
5. The application container rapid deployment platform according to claim 1, wherein the acquisition module comprises:
the first generation module is used for generating a preliminary deployment strategy based on a standard operation instruction list and determining a corresponding preliminary deployment network and a first node to be deployed in the preliminary deployment network;
the simulation submodule is used for carrying out simulation application deployment in the container corresponding to the first node based on the preliminary deployment strategy;
and the adjusting module is used for monitoring a simulated deployment process, adjusting the first node based on the simulated deployment process and generating a final deployment strategy.
6. The application container rapid deployment platform according to claim 5, wherein the first generation module comprises:
the reading submodule is used for reading node information of all available nodes, determining a target computer corresponding to each standard operation instruction in a standard operation instruction list, and reading position information of the target computer;
the first generation submodule is used for generating a preliminary deployment strategy based on the node information and the position information;
and the first determining submodule is used for determining a corresponding preliminary deployment network and a first node to be deployed in the preliminary deployment network based on the preliminary deployment strategy.
7. The application container rapid deployment platform of claim 5, wherein the adjustment module comprises:
the statistical submodule is used for monitoring the simulated deployment process, counting the access times of a first node to be deployed in the preliminary deployment network, and determining the first resource bearing capacity in each access process based on the access times;
and the adjusting submodule is used for adjusting the first node based on the first resource bearing capacity of the first node in each access process to generate a final deployment strategy.
8. The application container rapid deployment platform according to claim 1, wherein the deployment module comprises:
the detection submodule is used for determining a target computer to be deployed based on the final deployment strategy and determining an available memory of the target computer and a bandwidth value of a corresponding deployment interface;
the judging module is used for acquiring an occupied space predicted value corresponding to each standard operation instruction, judging whether the available memory of the target computer is larger than the corresponding occupied space predicted value and whether the bandwidth value of the corresponding deployment interface is larger than a first threshold value, if so, sending a starting signal, and otherwise, controlling the corresponding target computer to perform capacity expansion processing;
and the hot migration sub-module is used for determining a second node in the final deployment strategy based on the final deployment strategy when the starting signal is received, updating the application container deployment file corresponding to the second node based on hot migration, and deploying the application container deployment file of the second node to a corresponding target computer based on hot migration, so that the rapid deployment of the application container takes effect.
9. The application container rapid deployment platform of claim 7, wherein the tuning submodule comprises:
the acquisition submodule is used for determining the topological structure of the current available node and determining the topological information of the topological structure and the path information among all the available nodes;
the monitoring submodule is used for monitoring the available node, acquiring the current resource bearing capacity of the available node and acquiring the corresponding current available bearing capacity based on the current resource bearing capacity;
the first screening submodule is used for judging whether the first resource bearing capacity is larger than the current available bearing capacity of a corresponding first node or not, if so, screening a third node set of which the current available bearing capacity is larger than the first resource bearing capacity from the remaining second nodes except the first node in the available nodes, and replacing the corresponding first node with the third node set as a total node, otherwise, reserving the first node until all the first nodes are screened, and generating a second deployment network;
a second screening submodule, configured to determine all adjacent node combinations in the second deployment network, and if the adjacent node combinations include a single node and a total node, determine a first sub-path attribute between each first sub-node in the corresponding total node and the single node, determine a first transmission resource attribute between the total node and the single node, and screen out a fourth node set, of which the first sub-path attribute is matched with the first transmission resource attribute, from all the first sub-nodes;
a third screening submodule, configured to determine, if the adjacent node combination includes two total nodes, a second sub-path attribute between each second sub-node included in the total node and each third sub-node included in another total node, determine a second transmission resource attribute between the two total nodes, and screen, from all second sub-paths, a third sub-path set whose corresponding second sub-path attribute matches the second transmission resource attribute and an adjacent sub-node set corresponding to each third sub-path;
a fourth screening submodule, configured to determine a third path attribute between two single nodes and determine a third transmission resource attribute between the two single nodes if the adjacent node combination includes two single nodes, and determine whether the third path attribute and the third transmission resource attribute match, if yes, retain the single node, and otherwise, determine a corresponding fifth node set based on a path attribute matching principle;
the second generation submodule is used for screening out a final node from the reserved single node, all the fourth node sets and all the adjacent sub-node sets based on the shortest transmission distance principle and the initial deployment network, and generating a final deployment strategy based on the final node;
the second generation submodule is also used for taking the preliminary deployment strategy as a final deployment strategy when the first resource bearing capacity is larger than the current available bearing capacity of each first node;
wherein the combination of adjacent nodes is a combination of adjacent nodes in the second deployment network.
10. The application container rapid deployment platform according to claim 8, wherein the determining module comprises:
the second calling submodule is used for calling corresponding standard operation information based on each standard operation instruction;
a second determining submodule, configured to determine, based on a jump relationship included in the standard operation information and a jump operation memory difference corresponding to each jump relationship, an iterative operation memory value and a jump operation memory value of a corresponding standard operation instruction in a corresponding target computer, determine the jump operation memory value as a first threshold value, obtain an occupied space value of a preparation resource corresponding to each standard operation instruction, and use a larger value of the occupied space value and the iterative operation memory value as an occupied space prediction value corresponding to each target computer;
the judgment submodule is used for judging whether the available memory of each target computer is larger than the corresponding occupied space predicted value and whether the bandwidth value of the corresponding deployment interface is larger than a first threshold value, and if so, sending a starting signal;
the first capacity expansion submodule is used for controlling the corresponding target computer to perform capacity expansion processing according to the corresponding occupied space predicted value when the available memory of the target computer is not larger than the corresponding occupied space predicted value and the bandwidth value of the corresponding deployment interface is larger than the corresponding first threshold value;
the second capacity expansion sub-module is used for controlling the corresponding deployment interface to carry out capacity expansion processing according to the corresponding first threshold when the available memory of the target computer is larger than the corresponding occupied space predicted value and the bandwidth value of the corresponding deployment interface is not larger than the corresponding first threshold;
and the third expansion submodule is used for controlling the corresponding target computer to perform expansion processing according to the corresponding occupation space predicted value and controlling the corresponding deployment interface to perform expansion processing according to the corresponding first threshold value when the available memory of the target computer is not greater than the corresponding occupation space predicted value and the bandwidth value of the corresponding deployment interface is not greater than the corresponding first threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111316847.7A CN114138406B (en) | 2021-11-09 | 2021-11-09 | A rapid deployment platform for application containers |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111316847.7A CN114138406B (en) | 2021-11-09 | 2021-11-09 | A rapid deployment platform for application containers |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114138406A true CN114138406A (en) | 2022-03-04 |
| CN114138406B CN114138406B (en) | 2025-04-29 |
Family
ID=80392727
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111316847.7A Active CN114138406B (en) | 2021-11-09 | 2021-11-09 | A rapid deployment platform for application containers |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114138406B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119603135A (en) * | 2024-11-26 | 2025-03-11 | 天翼云科技有限公司 | Cluster processing method, device, computer equipment, storage medium and product |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110265164A1 (en) * | 2010-04-26 | 2011-10-27 | Vmware, Inc. | Cloud platform architecture |
| CN104618164A (en) * | 2015-02-12 | 2015-05-13 | 北京航空航天大学 | Management method for rapid cloud computing platform application deployment |
| WO2018001004A1 (en) * | 2016-06-27 | 2018-01-04 | 中兴通讯股份有限公司 | Docker based cloud platform control method and apparatus |
| WO2020135228A1 (en) * | 2018-12-26 | 2020-07-02 | 中兴通讯股份有限公司 | Cloud platform deployment method and apparatus, server and storage medium |
| CN113283855A (en) * | 2021-04-29 | 2021-08-20 | 成都商高智能科技有限公司 | Recruitment system based on containerized resource programming |
-
2021
- 2021-11-09 CN CN202111316847.7A patent/CN114138406B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110265164A1 (en) * | 2010-04-26 | 2011-10-27 | Vmware, Inc. | Cloud platform architecture |
| CN104618164A (en) * | 2015-02-12 | 2015-05-13 | 北京航空航天大学 | Management method for rapid cloud computing platform application deployment |
| WO2018001004A1 (en) * | 2016-06-27 | 2018-01-04 | 中兴通讯股份有限公司 | Docker based cloud platform control method and apparatus |
| WO2020135228A1 (en) * | 2018-12-26 | 2020-07-02 | 中兴通讯股份有限公司 | Cloud platform deployment method and apparatus, server and storage medium |
| CN113283855A (en) * | 2021-04-29 | 2021-08-20 | 成都商高智能科技有限公司 | Recruitment system based on containerized resource programming |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119603135A (en) * | 2024-11-26 | 2025-03-11 | 天翼云科技有限公司 | Cluster processing method, device, computer equipment, storage medium and product |
| CN119603135B (en) * | 2024-11-26 | 2026-01-23 | 天翼云科技有限公司 | Cluster processing method, cluster processing device, computer equipment, storage medium and product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114138406B (en) | 2025-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220318071A1 (en) | Load balancing method and related device | |
| US8478878B2 (en) | Placement of virtual machines based on server cost and network cost | |
| CN117149445B (en) | Cross-cluster load balancing method and device, equipment and storage medium | |
| EP3745678B1 (en) | Storage system, and method and apparatus for allocating storage resources | |
| CN108512890B (en) | Container cloud platform resource scheduling method and system based on rack sensing | |
| CN109451540B (en) | A resource allocation method and device for network slicing | |
| JP2018516022A (en) | Message transfer processing method, apparatus and system | |
| US10884880B2 (en) | Method for transmitting request message and apparatus | |
| CN115277598A (en) | A computing power resource scheduling method, device and computer-readable storage medium | |
| CN113835823B (en) | Resource scheduling method and device, electronic equipment and computer readable storage medium | |
| US8104038B1 (en) | Matching descriptions of resources with workload requirements | |
| US20250086004A1 (en) | Resource use methods and apparatuses | |
| CN112532674A (en) | Method, device and medium for establishing network edge computing system | |
| CN110445884A (en) | A kind of container IP address management method and device | |
| CN114827079B (en) | Capacity expansion method, device and storage medium of network address translation gateway | |
| US10505840B2 (en) | Methods and systems for failure recovery in a virtual network environment | |
| WO2021013185A1 (en) | Virtual machine migration processing and strategy generation method, apparatus and device, and storage medium | |
| CN114138406A (en) | Application container rapid deployment platform | |
| US11695856B2 (en) | Scheduling solution configuration method and apparatus, computer readable storage medium thereof, and computer device | |
| CN112261125A (en) | Centralized unit cloud deployment method, device and system | |
| CN109005071B (en) | A decision-making deployment method and scheduling device | |
| US20240314030A1 (en) | Management of at least one orchestration entity in a computer network | |
| CN107872404A (en) | Business burst processing method, device and software defined network controller | |
| CN117880184A (en) | Multicast forwarding method, device, computer equipment and storage medium for cloud network | |
| CN118473912A (en) | Service resource deployment method, device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |