WO2024165016A1 - Edge node communication method based on cloud computing technology, and related device - Google Patents
Edge node communication method based on cloud computing technology, and related device Download PDFInfo
- Publication number
- WO2024165016A1 WO2024165016A1 PCT/CN2024/076306 CN2024076306W WO2024165016A1 WO 2024165016 A1 WO2024165016 A1 WO 2024165016A1 CN 2024076306 W CN2024076306 W CN 2024076306W WO 2024165016 A1 WO2024165016 A1 WO 2024165016A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- management platform
- node
- edge
- cloud management
- relay
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W40/00—Communication routing or communication path finding
- H04W40/02—Communication route or path selection, e.g. power-based or shortest path routing
- H04W40/22—Communication route or path selection, e.g. power-based or shortest path routing using selective relaying for reaching a BTS [Base Transceiver Station] or an access point
Definitions
- the present application relates to the field of cloud computing technology, and in particular to an edge node communication method and related equipment based on cloud computing technology.
- Edge computing technology based on cloud computing is an extended application of cloud computing on the edge side. Since computing resources are closer to the physical location of users or data sources, it can generate faster network service responses and meet users' various needs in real-time business, security and privacy protection.
- the management of edge nodes is usually done by deploying management components on the cloud management node, and managing the edge nodes and the applications running on the edge nodes through the management components.
- An agent can be deployed on each edge node, and the management component can establish a cloud-edge communication channel with the agent on each edge node, so that the cloud management node can transmit cloud-edge information with each edge node.
- a certain edge node will establish a cloud-edge communication channel with the cloud management node to avoid data leakage, or the current location of a certain edge node may be beyond the communication range with the cloud management node. Since these edge nodes cannot connect to the cloud management node, they cannot interact with the cloud management node.
- edge node communication method based on cloud computing technology, which can enable edge nodes that fail to establish a connection with a cloud management platform to also exchange information with the cloud management platform.
- an embodiment of the present application discloses an edge node communication method based on cloud computing technology, which is applied to a cloud management platform.
- the cloud management platform is used to manage M edge nodes, wherein H edge nodes among the M edge nodes are connected to the cloud management platform, and N edge nodes among the M edge nodes are disconnected from the cloud management platform.
- the edge node communication method includes: the cloud management platform confirms a first edge node among the H edge nodes as a relay node, wherein the relay node is connected to the N edge nodes; the cloud management platform sends first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded to the second edge node via the relay node.
- the cloud management platform selects an edge node from the edge nodes connected to it as a relay node.
- the selected relay node can maintain connection with the edge nodes that cannot be connected to the cloud management platform, and forward information through the relay node.
- the edge nodes that cannot establish a connection with the cloud management platform can interact with the cloud management platform through the relay node, so that the cloud management platform can manage each edge node. For example, for the edge nodes that cannot establish a connection with the cloud management platform, the cloud management platform can send the interaction information sent to the edge node to the relay node, and the relay node forwards it to the edge node.
- the edge node communication method based on cloud computing technology also includes: the cloud management platform receives second interaction information sent by the relay node, and the second interaction information is sent by the second edge node to the relay node.
- the interactive information that needs to be sent to the cloud management platform can be sent to the relay node, which will forward it to the cloud management platform to realize information interaction with the cloud management platform.
- the cloud management platform is also connected to the infrastructure that provides cloud computing resources.
- the edge node communication method of the technology also includes: the cloud management platform calls the cloud computing resources of the infrastructure to process the second interaction information.
- the cloud management platform can process the second interaction information by calling the cloud computing resources of the infrastructure connected to it.
- the second interaction information may be information collected by the edge node, or information executed by the edge node based on the task issued by the cloud management platform, etc.
- the infrastructure may include one or more cloud data centers.
- the cloud management platform confirms a first edge node among H edge nodes as a relay node, including: the cloud management platform confirms that the H edge nodes are connected to the cloud management platform based on the communication status of each edge node among the M edge nodes, and selects the first edge node from the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform.
- the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node, and select an edge node as a relay node from these edge nodes connected to the cloud management platform. Since the relay node can interact with the cloud management platform, the edge nodes that fail to establish a connection with the cloud management platform can forward information through the relay node, thereby realizing information interaction with the cloud management platform.
- the cloud management platform receives second interaction information sent by the relay node, including: the cloud management platform sends relay identification information to the relay node, the relay identification information includes the relay node identification, wherein the relay identification information is sent to N edge nodes via the relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the second interaction information reported to the cloud management platform to the relay node; the cloud management platform receives the second interaction information forwarded by the relay node.
- the cloud management platform can send relay identification information including the relay node identification to the relay node, which will be forwarded by the relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the relay node information based on the relay identification information, and then send the interactive information reported to the cloud management platform to the relay node, which will be forwarded to the cloud management platform by the relay node, thereby realizing information interaction with the cloud management platform.
- the edge node communication method based on cloud computing technology also includes: before the relay node is disconnected from the cloud management platform, the cloud management platform reselects an edge node from the M edge nodes as an updated relay node based on the communication status of each of the M edge nodes, wherein the updated relay node remains connected to the cloud management platform within a preset time period, and the updated relay node remains connected to N edge nodes.
- the cloud management platform can re-select an edge node from the edge nodes connected to it as an updated relay node before the relay node is disconnected from it.
- the updated relay node can save the connection with the edge node disconnected from the cloud management platform and maintain the connection with the cloud management platform within a preset time period, avoiding the need to frequently select updated relay nodes and forward information through the updated relay nodes.
- the edge nodes that fail to establish a connection with the cloud management platform can interact with the cloud management platform through the updated relay nodes, so that the cloud management platform can manage each edge node.
- the edge node communication method based on cloud computing technology also includes: the cloud management platform sends the updated relay identification information to the updated relay node, wherein the updated relay identification information is sent to N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the third interaction information reported to the cloud management platform to the updated relay node; the cloud management platform receives the third interaction information forwarded by the updated relay node.
- the cloud management platform can send relay identification information including the updated relay node identification to the updated relay node, which will be forwarded by the updated relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the updated relay node information based on the updated relay identification information, and then subsequently send the interactive information reported to the cloud management platform to the updated relay node, which will be forwarded by the updated relay node to the cloud management platform, thereby realizing information interaction with the cloud management platform.
- the cloud management platform confirms that the first edge node among the H edge nodes is used as a relay node, including: the cloud management platform confirms that the H edge nodes are connected to the cloud based on the communication status of each edge node among the M edge nodes. The management platform is connected, and the first edge node selected from the H edge nodes is confirmed as a relay node. The communication status includes whether a connection can be established with the cloud management platform.
- the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node.
- Relay nodes can be elected from these edge nodes connected to the cloud management platform, so that edge nodes that fail to establish a connection with the cloud management platform can forward information through relay nodes to achieve information interaction with the cloud management platform.
- an embodiment of the present application provides a cloud management platform, which is used to manage M edge nodes, wherein H edge nodes among the M edge nodes are connected to the cloud management platform, and N edge nodes among the M edge nodes are disconnected from the cloud management platform, and the cloud management platform includes: a confirmation module, used to confirm that a first edge node among the H edge nodes is used as a relay node, wherein the relay node is connected to the N edge nodes; a sending module, used to send first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded to the second edge node via the relay node.
- a confirmation module used to confirm that a first edge node among the H edge nodes is used as a relay node, wherein the relay node is connected to the N edge nodes
- a sending module used to send first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded
- the cloud management platform selects an edge node from the edge nodes connected to it as a relay node.
- the selected relay node can maintain connection with the edge nodes that cannot be connected to the cloud management platform, and forward information through the relay node.
- the edge nodes that cannot establish a connection with the cloud management platform can interact with the cloud management platform through the relay node, so that the cloud management platform can manage each edge node. For example, for the edge nodes that cannot establish a connection with the cloud management platform, the cloud management platform can send the interaction information sent to the edge node to the relay node, and the relay node forwards it to the edge node.
- the cloud management platform further includes: a receiving module, configured to receive second interaction information sent by the relay node, where the second interaction information is sent by the second edge node to the relay node.
- the interactive information that needs to be sent to the cloud management platform can be sent to the relay node, which will forward it to the cloud management platform, so that the cloud management platform can interact with each edge node that fails to establish a connection with it.
- the cloud management platform is also connected to an infrastructure that provides cloud computing resources.
- the cloud management platform also includes: a processing module for invoking the cloud computing resources of the infrastructure to process the second interaction information.
- the cloud management platform can process the second interaction information by calling the cloud computing resources of the infrastructure connected to it.
- the second interaction information may be information collected by the edge node, or information executed by the edge node based on the task issued by the cloud management platform, etc.
- the infrastructure may include one or more cloud data centers.
- the confirmation module is also used to confirm that H edge nodes are connected to the cloud management platform based on the communication status of each edge node among the M edge nodes, and select a first edge node from the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform.
- the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node, and select an edge node as a relay node from these edge nodes connected to the cloud management platform. Since the relay node can interact with the cloud management platform, the edge nodes that fail to establish a connection with the cloud management platform can forward information through the relay node, thereby realizing information interaction with the cloud management platform.
- the cloud management platform also includes a sending module, which is used to send relay identification information to the relay node, and the relay identification information includes a relay node identification, wherein the relay identification information is sent to N edge nodes via the relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the second interaction information reported to the cloud management platform to the relay node.
- a sending module which is used to send relay identification information to the relay node
- the relay identification information includes a relay node identification, wherein the relay identification information is sent to N edge nodes via the relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the second interaction information reported to the cloud management platform to the relay node.
- the cloud management platform can send relay identification information including the relay node identification to the relay node, which will be forwarded by the relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the relay node information based on the relay identification information, and then send the interactive information reported to the cloud management platform to the relay node, which will be forwarded to the cloud management platform by the relay node, thereby realizing information interaction with the cloud management platform.
- the confirmation module is further used to reselect an edge node from the M edge nodes as an updated relay node based on the communication status of each edge node in the M edge nodes before the relay node is disconnected from the cloud management platform, wherein the updated relay node maintains connection with the cloud management platform within a preset time period, and the updated relay node maintains connection with the cloud management platform within a preset time period.
- the relay node maintains connection with N edge nodes.
- the cloud management platform can re-select an edge node from the edge nodes connected to it as an updated relay node before the relay node is disconnected from it.
- the updated relay node can save the connection with the edge node disconnected from the cloud management platform and maintain the connection with the cloud management platform within a preset time period, avoiding the need to frequently select updated relay nodes and forward information through the updated relay nodes.
- the edge nodes that fail to establish a connection with the cloud management platform can interact with the cloud management platform through the updated relay nodes, so that the cloud management platform can manage each edge node.
- the cloud management platform also includes a sending module, which is used to send the updated relay identification information to the updated relay node, wherein the updated relay identification information is sent to N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the third interaction information reported to the cloud management platform to the updated relay node; the receiving module is also used to receive the third interaction information forwarded by the updated relay node.
- a sending module which is used to send the updated relay identification information to the updated relay node, wherein the updated relay identification information is sent to N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the third interaction information reported to the cloud management platform to the updated relay node; the receiving module is also used to receive the third interaction information forwarded by the updated relay node.
- the cloud management platform can send relay identification information including the updated relay node identification to the updated relay node, which will be forwarded by the updated relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the updated relay node information based on the updated relay identification information, and then subsequently send the interactive information reported to the cloud management platform to the updated relay node, which will be forwarded by the updated relay node to the cloud management platform, thereby realizing information interaction with the cloud management platform.
- the confirmation module is also used to confirm that H edge nodes are connected to the cloud management platform based on the communication status of each edge node among the M edge nodes, and to confirm the first edge node elected from among the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform.
- the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node.
- Relay nodes can be elected from these edge nodes connected to the cloud management platform, so that edge nodes that fail to establish a connection with the cloud management platform can forward information through relay nodes to achieve information interaction with the cloud management platform.
- an embodiment of the present application provides a computer-readable storage medium, comprising computer program instructions.
- the computer program instructions are executed by a computing device cluster
- the computing device cluster executes the edge node communication method based on cloud computing technology as described in the first aspect.
- an embodiment of the present application provides a computing device cluster, comprising at least one computing device, each computing device comprising a processor and a memory; the processor of at least one computing device is used to execute instructions stored in the memory of at least one computing device, so that the computing device cluster executes the edge node communication method based on cloud computing technology as described in the first aspect.
- an embodiment of the present application provides a computer program product.
- the computer program product is executed by a computing device cluster
- the computing device cluster executes the edge node communication method based on cloud computing technology as described in the first aspect.
- a device wherein the device has the function of implementing the computing device cluster behavior in the method provided in the first aspect.
- the function can be implemented by hardware, or by hardware executing corresponding software.
- the hardware or software includes one or more modules corresponding to the above functions.
- the computer-readable storage medium described in the third aspect, the computing device cluster described in the fourth aspect, the computer program product described in the fifth aspect, and the apparatus described in the sixth aspect all correspond to the method of the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
- FIG1 is a schematic diagram of an application scenario of an edge node communication method based on cloud computing technology provided by an embodiment of the present application
- FIG2 is a schematic diagram of a flow chart of an edge node communication method based on cloud computing technology provided by an embodiment of the present application;
- FIG3 is a schematic diagram of the architecture of Kubernetes provided in an embodiment of the present application.
- FIG4 is a schematic diagram of the architecture of the KubeEdge system provided in an embodiment of the present application.
- FIG5 is a schematic diagram of the architecture of a KubeEdge system provided in another embodiment of the present application.
- FIG6a is a schematic diagram of the information structure of cloud-edge relay information provided in an embodiment of the present application.
- FIG6 b is a schematic diagram of the information structure of edge-to-edge relay information provided in an embodiment of the present application.
- FIG7 is a schematic diagram of a process for processing uplink information by the cloud management platform in the KubeEdge system shown in FIG5 ;
- FIG8 is a schematic diagram of a process for processing downlink information by the cloud management platform in the KubeEdge system shown in FIG5 ;
- FIG9 is a schematic diagram of a process of processing information by an edge node in the KubeEdge system described in FIG5 ;
- 10a and 10b are schematic diagrams of application scenarios of an edge node communication method based on cloud computing technology provided by another embodiment of the present application;
- FIG11 is a schematic diagram of a module of a cloud management platform provided in an embodiment of the present application.
- FIG12 is a schematic diagram of the structure of a computing device provided by an embodiment of the present application.
- FIG13 is a schematic diagram of the structure of a computing device cluster provided in one embodiment of the present application.
- FIG. 14 is a schematic diagram of the structure of a computing device cluster provided in another embodiment of the present application.
- words such as “exemplary” or “for example” are used to indicate examples, illustrations or descriptions. Any embodiment or design described as “exemplary” or “for example” in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as “exemplary” or “for example” is intended to present related concepts in a specific way.
- Edge node It can refer to a network node with fewer intermediate links from the end-user access, which has better response capabilities and connection speed for the end-user access. It can also refer to a device that collects data and sends data to the network layer.
- Cloud management platform A cloud platform that manages edge nodes, which can provide functions including edge node access, edge node management, and edge node data processing, thereby supporting the application of edge node technology based on cloud computing in various industries.
- Kubernetes It is an open source containerized application management framework for multiple nodes in a cluster. The goal of Kubernetes is to make the deployment of containerized applications simple and efficient. In Kubernetes, you can create multiple containers, run application instances in the containers, and then use the built-in load balancing strategy to achieve the load balancing of this group. Management, discovery, and access to application instances, all of these details do not require operations and maintenance personnel to perform complex manual configuration and processing.
- KubeEdge A cloud-native edge computing management platform based on Kubernetes.
- FIG. 1 is a schematic diagram of an application scenario of an edge node communication method based on cloud computing technology provided by an embodiment of the present invention.
- a cloud management platform 22 is set in a cloud system 20, and the cloud system 20 also includes an infrastructure 21 for providing cloud computing resources, wherein multiple cloud data centers can be set in the infrastructure 21, and exemplary multiple cloud data centers include cloud data center 216, cloud data center 217, cloud data center 218..., and the cloud management platform 22 is connected to the infrastructure 21 for communication.
- the edge node set 30 can be set at the customer site. Due to different business needs, the edge node set 30 includes multiple edge nodes, and exemplary multiple edge nodes include edge node 31, edge node 32, edge node 33, edge node 34...
- the cloud management platform 22 can be used to manage the infrastructure 21 and each edge node in the edge node set 30.
- edge node communication management scenario shown in Figure 1 if a certain edge node is not expected to establish a connection with the cloud management platform 22 for the purpose of avoiding data leakage, or because the edge node moves, the current location may be beyond the range where a connection can be established with the cloud management platform 22. Since these edge nodes fail to connect to the cloud management platform 22, they are unable to interact with the cloud management platform 22 for information.
- the present application provides an edge node communication method and a cloud management platform 22 based on cloud computing technology.
- the method is applied to the cloud management platform 22 in the cloud system 20.
- the selected relay node can maintain connection with the edge nodes that are not connected to the cloud management platform 22, and forward information through the relay node, so that these edge nodes that are not connected to the cloud management platform 22 can exchange information with the cloud management platform 22 through the relay node, so that the cloud management platform 22 can manage each edge node.
- the edge node set 30 includes M edge nodes. At a certain time t1, H edge nodes among the M edge nodes are connected to the cloud management platform 22, and N edge nodes among the M edge nodes are disconnected from the cloud management platform 22.
- the cloud management platform 22 can select an edge node from the H edge nodes as a relay node.
- FIG. 2 is a simplified flow chart of an edge node communication method based on cloud computing technology provided by an embodiment of the present invention.
- an edge node set 30 includes M edge nodes, H edge nodes of the M edge nodes are connected to the cloud management platform 22, and N edge nodes of the M edge nodes fail to connect to the cloud management platform 22.
- the method includes but is not limited to the following steps:
- step S201 the cloud management platform 22 confirms that a first edge node among H edge nodes serves as a relay node, wherein the relay node is connected to N edge nodes.
- M edge nodes can be interconnected through a node communication link. For each of the M edge nodes, information can be exchanged with other nodes through the node communication link. For example, two edge nodes that are close to each other can communicate directly, and two edge nodes that are far away can communicate through the transit of one or more other edge nodes.
- the communication status of each edge node includes whether it can establish a connection with the cloud management platform 22, that is, the cloud management platform 22 can determine the edge node connected to it through the communication status of each edge node. If the cloud management platform 22 confirms that H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node in the M edge nodes, and N edge nodes fail to connect to the cloud management platform 22, the cloud management platform 22 can select the first edge node from the H edge nodes as a relay node. The first edge node can be connected to the N edge nodes to realize the communication relay between the N edge nodes and the cloud management platform 22.
- the first edge node may be an edge node among the H edge nodes that can maintain a connection with the cloud management platform 22 within a preset time period, avoiding the need to frequently select updated relay nodes.
- the preset time period can be set according to actual needs, and this application does not limit this. For example, if there are multiple edge nodes among the H edge nodes that can maintain a connection with the cloud management platform 22 within a preset time period, the cloud management platform 22 can randomly select an edge node from the multiple edge nodes as a relay node.
- the cloud management platform 22 may send relay identification information to the relay node (first edge node), and the relay identification information may include a relay node identification, such as a unique identity of the first edge node.
- the relay identification information may be sent to N edge nodes via the relay node, so that the N edge nodes that have failed to establish a connection with the cloud management platform can obtain the relay node information based on the relay identification information.
- the relay identification information may also be used to instruct each of the N edge nodes to send the interaction information reported to the cloud management platform 22 to the relay node, which is forwarded to the cloud management platform 22 by the relay node.
- the relay node may not need to be designated by the cloud management platform 22, and may be elected between the edge nodes connected to the cloud management platform 22. For example, if the cloud management platform confirms that H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node among the M edge nodes, the relay node may be elected between the H edge nodes. Assuming that the first edge node is elected as the relay node among the H edge nodes, the cloud management platform 22 may confirm that the first edge node is the relay node, and then the relay identification information may be sent to the first edge node later.
- step S202 the cloud management platform sends first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded to the second edge node via the relay node.
- the N edge nodes since the N edge nodes fail to connect to the cloud management platform 22, the N edge nodes cannot directly interact with the cloud management platform 22. If the cloud management platform needs to send the first interaction information to the second edge node among the N edge nodes, the cloud management platform 22 may send the first interaction information to the relay node (the first edge node), and the relay node forwards the first interaction information to the second edge node, so that the cloud management platform 22 can successfully send the information to the second edge node that fails to connect to it.
- the relay node the first edge node
- the second edge node may send the second interaction information to the relay node, and the relay node sends the second interaction information to the cloud management platform 22, so that the cloud management platform 22 can successfully receive the second interaction information reported by the second edge node that cannot be connected to it by receiving the second interaction information forwarded by the relay node.
- the cloud management platform 22 may also call the cloud computing resources of the infrastructure 21 to process the second interaction information to obtain an information processing result.
- the second interaction information may be information collected by the second edge node, or information executed by the second edge node based on a task issued by the cloud management platform 22.
- the relay node may be disconnected from the cloud management platform 22 at a certain time (for example, out of the range of establishing a connection with the cloud management platform 22). For example, at time t2 after time t1, the relay node (first edge node) is disconnected from the cloud management platform 22. For example, the cloud management platform 22 may predict that the relay node will be disconnected from the cloud management platform 22 at time t2 based on the movement trajectory of the first edge node. The cloud management platform 22 may reselect an edge node from the M edge nodes as an updated relay node before the first edge node is disconnected from it. The updated relay node remains connected to the cloud management platform 22 within a preset time period, and the updated relay node may remain connected to N edge nodes.
- the cloud management platform confirms the third edge node among the H edge nodes as the updated relay node.
- the cloud management platform 22 may send the updated relay identification information to the updated relay node (the third edge node), and the updated relay identification information may be sent to the N edge nodes via the updated relay node.
- the updated relay identification information may be used to instruct each of the N edge nodes to send the interaction information reported to the cloud management platform 22 to the updated relay node, which is then forwarded to the cloud management platform 22 by the updated relay node.
- the cloud management platform 22 may also send the updated relay identification information to the current relay node (first edge node), and the current relay node forwards the updated relay identification information to the updated relay node (third edge node).
- the updated relay identification information may be sent to N edge nodes via the updated relay node or the current relay node.
- the cloud management platform 22 can designate a relay node to be updated at time t3 (between time t1 and time t2).
- the third edge node can be an edge node among H edge nodes that can maintain a connection with the cloud management platform 22 within a preset time period, avoiding the need to frequently select updated relay nodes.
- the cloud management platform 22 can provide a tenant-oriented Kubernetes service, containers can be run on edge nodes, and containers can interact with the Kubernetes service.
- a tenant can refer to a user of the cloud management platform 22.
- the cloud management platform 22 can also provide tenant-oriented virtual machine services, virtual machines can run on edge nodes, and the virtual machines can interact with the virtual machine services.
- Kubernetes may include management nodes and working nodes.
- the management node is mainly used to manage working nodes, and the working node is mainly used to run containerized application instances. Developers can manage Kubernetes through an application programming interface client (such as kubectl).
- the management node may include a Kubernetes application programming interface server (which may be called kube-apiserver), a scheduler (which may be called kube-scheduler), a controller manager (which may be called kube-controller manager) and a database (which may be called etcd); the working node may include a node agent (which may be called agent).
- kube-apiserver Kubernetes application programming interface server
- scheduler which may be called kube-scheduler
- controller manager which may be called kube-controller manager
- a database which may be called etcd
- the working node may include a node agent (which may be called agent).
- kube-apiserver is the unified external interface of the cluster control plane.
- Pod is the smallest scheduling unit that can be created and managed in Kubernetes.
- Pod consists of one or more containers.
- kube-scheduler is mainly used for scheduling Pods and is responsible for allocating Pods to working nodes.
- kube-controller manager includes a variety of controllers that come with Kubernetes, which are used to manage Kubernetes resources. etcd can be understood as storage, which is used to save some relevant data in the cluster.
- Agent is an agent deployed on the working node, which is used to register working nodes with kube-apiserver, manage Pods, and report resource information of working nodes.
- a KubeEdge system provided by an embodiment of the present application may include two parts: a cloud management side and an edge node side.
- the cloud management side may include a cloud management platform 22, and the cloud management platform 22 may include a cloud processing component (also referred to as CloudCore).
- CloudCore can be used to process commands related to edge nodes, applications and other resources in Kubernetes, and send them to the edge node side. It can also receive related information about edge nodes, applications and other resources reported by the edge processing component and synchronize them to Kubernetes.
- CloudCore may include an edge node controller (also referred to as EdgeController) module and a cloud communication interface (also referred to as CloudHub) module.
- the EdgeController module is used to implement edge node management and application status metadata cloud-edge collaboration;
- the CloudHub module is used to implement the encapsulation of interactive information between the cloud management side and the edge node side.
- the EdgeController module can interact with the Kubernetes application programming interface server.
- the edge node side may include multiple edge nodes, each edge node may include an edge processing component (also called EdgeCore), EdgeCore may be used to receive and implement commands for information about edge nodes, applications and other resources issued by CloudCore, and may also collect information about edge nodes, applications and other resources and report it to CloudCore.
- EdgeCore may include an edge communication interface (also called EdgeHub) module.
- the EdgeHub module may be used to implement communication between the edge node side and the cloud management side.
- EdgeCore can also include information management (also known as MetaManager) modules, edge node agent (also known as Edged) modules, etc.
- MetaManager can be used to implement local persistence of node-level metadata
- Edged can be used to implement lightweight Pod lifecycle management.
- Each edge node also has edge node resources, which can refer to resources that can run edge computing tasks, such as central processing unit (CPU), graphics processing unit (GPU), memory, hard disk (including mechanical hard disk or solid state disk, etc.) and network interface.
- each edge node can establish a cloud-edge communication channel with the CloudHub module on the cloud management side through the EdgeHub module. If an edge node does not establish a cloud-edge communication channel with the cloud management side (for example, the edge node does not establish a cloud-edge communication channel with the cloud management side to avoid data leakage, or the current location of the edge node is beyond the range of communication with the cloud management side), the edge node will not be able to report information to the cloud management side, nor will it be able to receive information sent by the cloud management side.
- the KubeEdge system can be provided with a node relay communication mechanism.
- the CloudHub module may include a cloud relay (also called CloudRelay) module and a first communication mechanism (CloudHandlechanges) module.
- the CloudRelay module is a module in CloudCore used to process relay information, and is used to process cloud-edge relay communication information, such as the encapsulation of cloud-to-edge information and the decapsulation of edge-to-cloud information.
- the CloudHandlechanges module can define a cloud-edge communication mechanism with relay communication functions, which may include relay information interception, health check and other operations. It is understandable that the CloudRelay module can also be deployed outside the CloudHub module, and this application does not limit this.
- the EdgeHub module may include an edge relay (also known as EdgeRelay) module and a second communication mechanism (EdgeHandlechanges) module.
- the EdgeRelay module is a module in EdgeCore used to process relay information, for example, it is used to process relay information from the cloud management side, other edge nodes, and other modules in its own node.
- the EdgeRelay module may have functions such as cloud-side information parsing, cloud-side information encapsulation, cloud-edge forwarding of relay information, and relay node configuration information processing.
- the EdgeRelay module may have functions such as edge-to-edge information parsing, edge-to-edge information encapsulation, and edge-to-edge forwarding of relay information.
- the EdgeRelay module can also store information that needs to be persisted (such as relay node identification, cluster node address, etc.) in a database.
- the database can be set on the edge node, and the database is SQLite.
- the EdgeHandlechanges module can define a cloud-edge communication mechanism and an edge-edge communication mechanism with relay communication functions, for example, it can include some relay information interception operations. It can be understood that the EdgeRelay module can also be deployed outside the EdgeHub module, and this application does not limit this.
- the custom resource definitions (CRD) in etcd defines dynamic relay information as cloud native resources, which may include relay mode switch information, relay node identifiers, cluster node addresses, and reserved extension information for subnet-related configurations.
- Kubernetes may also include a relay selection (also called RelaySelector) module, which may configure CRD by calling kube-apiserver.
- a relay control information format (also referred to as Relayrc) may be defined in CRD, and Relayrc may include three fields: Open, RelayID, and Data.
- the Open field represents whether the current relay mode is turned on
- the RelayID field represents the unique identifier of the current relay node
- the Data field represents the unique identifier and address information of all nodes in the cluster stored in the current relay information storage version.
- the deletion event generally involves the closing of the relay mode.
- the cloud management platform 22 and the edge node can switch from the relay mode to the normal mode based on the deletion event.
- the update event generally involves the opening/closing of the relay mode, or the switching of the relay node, or the update of the Data field information, etc.
- the cloud management platform 22 and the edge node can execute the corresponding instructions based on the change type involved in the update event.
- the cloud management platform 22 may select a relay node based on the communication status of each edge node, where the communication status includes whether a connection can be established with the cloud management platform 22 .
- the cloud management platform 22 may also first determine the edge nodes that can be connected to the cloud management platform 22 based on the communication status of each edge node, and then select an edge node as a relay node from these edge nodes that can be connected to the cloud management platform 22 based on the node resources of the edge node (CPU available resources, memory available resources, bandwidth available resources, etc.), and other edge nodes that cannot establish a connection with the cloud management platform 22 access the cloud management platform 22 through the relay node, and other edge nodes that can be connected to the cloud management platform 22 except the relay node do not need to access the cloud management platform 22 through the relay node.
- the node resources of the edge node CPU available resources, memory available resources, bandwidth available resources, etc.
- all edge nodes except the relay node may also be non-relay nodes, and the interaction information between the non-relay nodes and the cloud management platform 22 is forwarded through the relay nodes.
- modules involved in FIG. 4 and FIG. 5 may refer to a series of computer program instruction segments that can perform specific functions, or may be functional modules formed by the cooperation of computer program instruction segments and hardware.
- the division is a logical function division, and there may be other division methods in actual implementation, which is not limited in this application.
- the KubeEdge system can have a node relay communication mechanism by redefining the cloud-edge and edge-edge information formats.
- Beehive is a communication framework in KubeEdge, which can be used for communication between KubeEdge modules.
- the information structure of the original cloud-edge information can include three fields: information header (Header), information routing (Router) field, and information content (Content).
- the original cloud-edge information can be encapsulated according to the information mechanism of Beehive to obtain the cloud-edge relay information format.
- the original cloud-edge information (including Header+Router+Content) is serialized and encapsulated into the Content in the new cloud-edge information, and the fields in the Router in the new cloud-edge information used to characterize the information source or information destination of the original cloud-edge information are modified to define the new cloud-edge information as relay type information.
- the Operation field in the Router can be modified, that is, the cloud management platform 22 can determine whether it is regular cloud edge information or relay type information through the Operation field;
- the Group field in the Router can be modified, that is, the edge node can determine whether it is regular cloud edge information or relay type information through the Group field.
- the node identifier (also called NodeID) and business identifier (ProjectID) of the node can be encapsulated into the information and forwarded to the cloud management platform 22 through the relay node.
- the relay node can be designated by the cloud management platform 22 or generated through election. The relay node can forward the information of the non-relay node to the cloud management platform 22, or forward the information of the cloud management platform 22 to the non-relay node.
- the edge relay information format can adopt a format that can store fields such as NodeID and ProjectID of non-relay nodes. As shown in Figure 6b, the edge relay information format can be obtained by reusing the original KubeEdge information structure mux.MessageContainer.
- the original edge information structure can include three field parts: information header (Header), information (Message), and parameters (Parameters). By encapsulating the original edge information (Header+Message+Parameters) into the Message in the new edge information, and encapsulating NodeID and ProjectID into the Header in the new edge information, the new edge information is defined as relay type information.
- the cloud management platform 22 and the edge node communicate based on the existing communication method, for example, the edge node establishes a communication connection with the cloud management platform 22, and the edge node directly exchanges information with the cloud management platform 22.
- the cloud management platform 22 and the edge node exchange information by encapsulating the original information into relay type information.
- FIG. 7 it is a schematic diagram of an exemplary process of introducing the cloud management platform 22 processing uplink information.
- CloudCore includes a CloudRelay module for processing relay information, and relay node related information is persistently stored in etcd through CRD.
- CloudCore may receive the first information through a CloudHub module, and a source of the first information may be an edge node side.
- whether the relay mode is turned on may refer to whether the CloudCore turns on the relay mode.
- the relay mode if it is determined that the relay mode is not turned on, it can be considered that the first information received by the CloudHub module is non-relay type information, and CloudCore can use the original process to process the first information.
- the original process processing may refer to CloudCore processing non-relay type information based on the existing information processing method, which is not described in detail in this application.
- the first information can be parsed by the CloudRelay module to obtain the parsed first information, for example, by deserializing the Content in the first information to obtain the parsed first information. Since the structure of the parsed first information is the same as the original cloud edge information structure, CloudCore can process the parsed first information based on the existing information processing method.
- FIG8 it is a schematic diagram of an exemplary process of introducing the cloud management platform 22 processing downlink information.
- CloudCore can send the second information to the edge side through the CloudHub module. Before sending the second information, the second information can be verified to determine whether the second information is repeated. If it is repeated, the sending of the second information can be abandoned, otherwise step S81 can be executed.
- whether the relay mode is turned on may refer to whether the CloudCore turns on the relay mode.
- the relay mode if it is determined that the relay mode is not turned on, it can be considered that the second information sent by the CloudHub module is non-relay type information, and CloudCore can use the original process to send the second information.
- the original process processing may refer to CloudCore sending non-relay type information based on the existing information sending method, which is not described in detail in this application.
- the non-relay node needs to receive the information sent from the cloud through the relay node. If the relay mode is turned on, it can further detect whether there is a relay node. If there is a relay node, it can be considered that the second information sent is relay type information. If there is no relay node, it can be considered that the second information sent is non-relay type information.
- the second information sent is non-relay type information
- CloudCore can use the original process to send the second information
- the second information sent can be considered to be relay type information, and the second information can be encapsulated through the CloudRelay module to obtain the encapsulated second information.
- the second information can be encapsulated based on the method shown in Figure 6a. Since the structure of the encapsulated second information is the same as the original cloud edge information structure, CloudCore can send the encapsulated second information based on the existing information sending method.
- FIG9 is a flow chart showing an exemplary process of processing information at an edge node.
- EdgeCore includes an EdgeRelay module for processing relay information.
- the EdgeRelay module processes relay information from the cloud, other edge nodes, and other modules in its own node.
- information that needs to be persisted can be stored in SQLite.
- the EdgeHub module can communicate with the EdgeRelay module, other modules in the node, and the CloudHub module.
- the EdgeRelay module can forward information sent from the cloud to non-relay nodes, parse information from the EdgeRelay modules of other nodes and send it to the EdgeHub module, and encapsulate information from the EdgeHub module and forward it to the EdgeRelay modules of other nodes.
- the information received by the EdgeHub module may come from three sources: from the cloud management side, from the EdgeRelay module of the node, or from other processing modules of the node.
- the information transmitted from the cloud management side can be forwarded after verifying whether it is relay type information.
- the information transmitted from the EdgeRelay module of this node if the node is verified to be a relay node, the information needs to be packaged and sent to the cloud; if the node is verified to be a non-relay node, the information is confirmed to be transmitted from other relay nodes, and the information is forwarded to other processing modules of this node after processing.
- the information can be forwarded to the cloud management platform 22 according to the normal process, otherwise you can continue to verify whether this node is a relay node. If this node is a relay node, confirm that the information is normal information transmitted from other modules of this node and send it to the cloud management platform 22; otherwise, the information is forwarded to the EdgeRelay module of this node for further processing.
- the edge node processes the information received by the EdgeHub module, including the following steps:
- the EdgeHub module receives the third information.
- S9_1 determine whether the third information is sent by the CloudHub module.
- S9_4 If the third information is relay notification information, send the third information to the EdgeRelay module to broadcast the third information to non-relay nodes.
- the relay notification information may include the next relay node identifier. For example, if the relay node is in motion, in order for the non-relay node to maintain communication with the cloud management platform 22, the non-relay node may need to forward information through different relay nodes due to the update of the relay node. If the third information is determined to be relay notification information, the third information is broadcast to the non-relay node through the EdgeRelay module so that the non-relay node can learn the next relay node identifier.
- S9_6 If the relay mode is not enabled, determine whether the third information is relay notification information.
- S9_7 If the third information is relay notification information, send the third information to the EdgeRelay module to broadcast the third information to non-relay nodes.
- the third information can be considered as non-relay type information.
- EdgeCore can process the third information based on the existing information processing method, which is not elaborated in this application.
- S9_9 If the third information is not sent by the CloudHub module, determine whether the third information is sent by the EdgeRelay module.
- the third information is sent to the CloudHub module.
- the node if the node is a relay node, it indicates that the node has the ability to communicate with the cloud management platform 22 and can directly send the third information to the CloudHub module.
- S9_14 If the node is not a relay node, determine that the third information is relay type information, and send the third information to the EdgeRelay module to forward it to the relay node.
- this node is not a relay node, that is, this node is a non-relay node, since the non-relay node cannot communicate directly with the cloud management platform, the non-relay node needs to forward information through the relay node, that is, the EdgeHub module of this node needs to send the third information to the EdgeRelay module of this node to forward it to the EdgeRelay module of the relay node.
- S9_15 If the third information is transmitted by the EdgeRelay module, determine whether the node is a relay node.
- the third information is transmitted by the EdgeRelay module and the node is a relay node
- the third information is the encapsulated relay type information transmitted by the EdgeRelay module
- the EdgeHub module can send the third information to the CloudHub module.
- the third information can be considered to be information from the relay node, and the third information processed by the EdgeRelay module can be forwarded to other processing modules of the current node.
- FIG. 10a and 10b a schematic diagram of an application scenario of an edge node communication method based on cloud computing technology provided in an embodiment of the present application is exemplarily introduced below.
- the information center may include one or more ground stations arranged at a fixed position and a satellite data processing center that communicates with the ground station.
- the ground station may also be called an earth station or an earth terminal station.
- the ground station can transmit signals to the satellite, and receive signals transmitted by the satellite or forwarded by other ground stations.
- the ground station may be located on the surface of the earth or in the atmosphere of the earth.
- the ground station and the satellite can communicate through radio waves in ultra-high frequency or extremely high frequency bands (such as millimeter waves). After the satellite is launched into a predetermined orbit, the satellite covers the ground with a conical signal. The higher the altitude of the satellite in orbit, the larger the signal coverage area, but the information transmission delay between the satellite and the ground will also be higher.
- an information center includes a ground station set on the surface of the earth.
- a satellite may only have a window period in which it can communicate with the information center during an orbital period.
- multiple satellites can be deployed to form a satellite constellation to achieve full coverage of ground signals.
- the information center can use the KubeEdge system shown in Figure 5 to manage the satellite communication cluster, and use dynamic relay to enable each satellite to interact with the information center at any time.
- the information center may be deployed with a cloud management platform 22, through which each satellite is managed and the computing resources of the satellite data processing center are called to process the information reported by the satellite.
- the information center may form a satellite communication cluster with each satellite (each edge node), and the deployment of the satellite communication cluster may be completed on the ground. After each satellite is launched into the corresponding satellite orbit, the satellite communication cluster operates in the default communication mode.
- Each edge node may attempt to establish a communication connection with the cloud management platform 22.
- the cloud management platform 22 can only establish communication connections with some edge nodes at a certain time.
- Each edge node (each satellite) can communicate with each other through an intersatellite link (referring to a link used for communication between satellites, also known as an intersatellite link or a cross link). That is, for a satellite that currently has no communication connection with the cloud management platform 22, the information it interacts with the cloud management platform 22 can be forwarded to the cloud management platform 22 by other satellites (as relay nodes) that can establish communication connections with the cloud management platform 22.
- the cloud management platform 22 can determine that a certain edge node is a relay node according to a preset relay selection algorithm. After determining the relay node, the relevant information of the relay node can be stored in the CRD. It can be understood that the selected relay node is an edge node that can communicate directly with the cloud management platform 22, and each subsequent switched relay node must also ensure that it is an edge node that can communicate directly with the cloud management platform 22. For example, for each satellite, the cloud management platform 22 can know the trajectory of each satellite, that is, it can determine the position of each satellite at any time.
- the preset relay selection algorithm can be to select a satellite as a relay node based on the position of each satellite. For example, a satellite that enters the communication range of the information center is set as a relay node. Before the satellite is about to leave the communication range of the information center, the next satellite that enters the communication range of the information center is selected as a relay node.
- the information of the relay node (such as the unique identifier and address of the relay node) can be queried from the CRD, and the cloud management platform 22 can send the relay identification information to the relay node.
- the relay identification information may include relay mode switch information, relay node identification, cluster node address, etc.
- the cloud management platform 22 After the cloud management platform 22 sends the relay identification information to the relay node, it can wait for feedback information from the relay node. When the feedback information of the relay node is received, it indicates that the relay node has successfully received the relay identification information, and the cloud management platform 22 can switch to relay. model.
- the relay node After receiving the relay identification information, the relay node can switch to the relay mode.
- the relay node can also broadcast the relay identification information to the non-relay nodes. For example, the relay mode switch information, relay node identification, and cluster node address are broadcast to the non-relay nodes.
- the non-relay node may be an edge node that is currently unable to establish a communication connection with the cloud management platform 22.
- the non-relay node may switch to the relay mode.
- the non-relay node may first report the node status information (such as node survival status, node resource information, etc.) to the cloud management platform 22 once through the relay node.
- the interaction information between the non-relay node and the cloud management platform 22 may be forwarded through the relay node.
- the cloud management platform 22 may send resource management information, application lifecycle management information, task information, etc. to each non-relay node through the relay node.
- Each non-relay node may also report task execution information, etc. to the cloud management platform 22 through the relay node.
- the information reported by the non-relay nodes to the cloud management platform 22 can be encapsulated by the relay nodes (encapsulated based on the cloud-edge information format) and then forwarded to the cloud management platform 22.
- the information sent by the cloud management platform 22 to the non-relay nodes can also be encapsulated by the relay nodes (encapsulated based on the edge information format) and then forwarded to the non-relay nodes.
- edge node node1 As shown in Figure 10a, assuming that the edge node that can currently communicate with the cloud management platform 22 is edge node node1, by setting edge node node1 as a relay node, other edge nodes node2, edge node node3 and edge node node4 can interact with the cloud management platform 22 through edge node node1.
- the node addition or deletion information can be stored in the CRD.
- the cloud management platform 22 can send a new cluster node address to the relay node, which is broadcasted to each non-relay node by the relay node.
- the cloud management platform 22 since the satellite can only communicate with the cloud management platform 22 for a unit window time in one cycle of rotation around the earth, in order to avoid the relay node being unable to communicate with the cloud management platform 22, it is necessary to switch the relay node. Before the current relay node is about to leave the communication range of the information center, the cloud management platform 22 sends the relay identification information of the updated relay node (hereinafter referred to as the new relay identification information) to the current relay node. After the current relay node receives the new relay identification information, the new relay identification information can be forwarded to the updated relay node.
- the new relay identification information the relay identification information of the updated relay node
- the updated relay node can send a feedback information to the cloud management platform 22 through the current relay node, and the cloud management platform 22 and the current relay node can update the relay information based on the new relay identification information.
- the current relay node can also broadcast the new relay identification information to other non-relay nodes, notify other non-relay nodes to update the relay information, or the updated relay node broadcasts the new relay identification information to other non-relay nodes. Thereafter, the interaction information between the non-relay node and the cloud management platform 22 can be forwarded through the updated relay node.
- edge node node3 and edge node node4 can interact with the cloud management platform 22 through edge node node2.
- edge node node1 after leaving the communication range of the information center, it also needs to interact with the cloud management platform 22 through edge node node2.
- the edge node can autonomously elect a relay node through a preset distributed election algorithm, or a failure retry mechanism can be added to the sending/forwarding process; for situations where interactive information is unreachable, such as when the information of the cloud management platform 22 cannot be received for a long time, the relay mode is automatically switched to the normal mode.
- the satellite communication cluster may also only deploy the preset distributed election algorithm to realize the generation and switching of relay nodes, that is, the cloud management platform 22 does not designate the relay nodes.
- the generation and switching of relay nodes based on the preset distributed election algorithm has three characteristics: distributed, endogenous, and dynamic.
- the distributed characteristic is that the generation and switching process of relay nodes is distributed, and is realized based on distributed elections and distributed information interaction between edge nodes.
- the endogenous characteristic is that the generation and switching process of relay nodes is spontaneously initiated and completed by the edge node, and there is no need to rely on the external cloud management platform 22 to issue relay node switching commands and selection commands.
- the dynamic characteristic is whether The need to generate a relay node or switch a relay node is dynamically determined by each edge node based on the communication status with the cloud management platform 22 .
- the preset distributed election algorithm may include electing a relay node based on the communication capabilities of each edge node and the cloud management platform 22, node resources (such as CPU available resources, memory available resources, bandwidth available resources, etc.), and after the relay node is generated, the relay identification information may also be broadcast so that other edge nodes can know the identification of the currently elected relay node, so as to access the cloud management platform 22 through the relay node.
- node resources such as CPU available resources, memory available resources, bandwidth available resources, etc.
- the way to trigger the election of the relay node may be that the currently designated (specified by the cloud management platform 22) or elected relay node fails, or the currently designated or elected relay node cannot establish a communication connection with the cloud management platform 22 within a preset time, or a certain edge node does not receive the relay identification information and cannot establish a communication connection with the cloud management platform 22 within a preset time, etc.
- the KubeEdge system with a node relay communication mechanism can also be used to manage smart car clusters, robot clusters, drone clusters, etc., to solve the situation where the moving smart cars, robots, drones, etc. cannot all communicate with the cloud management platform 22.
- the cloud management platform 22 can be deployed on a server at a specified location, such as a server set up in a computing center, and the edge nodes can be each smart car, each robot, and each drone.
- a cloud management platform 22 is provided for an embodiment of the present application.
- the cloud management platform 22 may include a confirmation module 221, a sending module 222, a receiving module 223, a processing module 224, and a sending module 225.
- the cloud management platform 22 is used to manage M edge nodes, H edge nodes among the M edge nodes are connected to the cloud management platform 22, and N edge nodes among the M edge nodes fail to connect to the cloud management platform 22.
- the confirmation module 221 is used to confirm that the first edge node among the H edge nodes is used as a relay node, wherein the relay node is connected to the N edge nodes.
- the sending module 222 is configured to send the first interaction information to be sent to the second edge node among the N edge nodes to the relay node.
- the first interaction information is forwarded to the second edge node via the relay node.
- the receiving module 223 is configured to receive second interaction information sent by the relay node.
- the second interaction information is sent by the second edge node to the relay node.
- the processing module 224 is used to call the cloud computing resources of the infrastructure 21 to process the second interaction information.
- the sending module 225 is used to send the relay identification information to the relay node.
- the relay identification information includes the relay node identification, and the relay identification information is sent to the N edge nodes via the relay node.
- the relay identification information is used to indicate that the second edge node among the N edge nodes sends the second interaction information reported to the cloud management platform 22 to the relay node.
- the confirmation module 221 is also used to confirm that H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node among the M edge nodes, and select the first edge node from the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform 22.
- the confirmation module 221 is further configured to reselect an edge node from the M edge nodes as an updated relay node based on the communication status of each edge node in the M edge nodes before the relay node is disconnected from the cloud management platform 22.
- the updated relay node maintains connection with the cloud management platform 22 within a preset time period, and the updated relay node can maintain connection with N edge nodes.
- the confirmation module 221 is further used to confirm that the H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node among the M edge nodes, and to confirm that the first edge node elected from among the H edge nodes is used as a relay node.
- the sending module 225 is further used to send the updated relay identification information to the updated relay node.
- the updated relay identification information is sent to the N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes sends the third interaction information reported to the cloud management platform to the updated relay node.
- the receiving module 223 is also used to receive the third interaction information forwarded by the updated relay node.
- the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 can all be implemented by software, or can be implemented by hardware. Exemplarily, the following takes the confirmation module 221 as an example to introduce the implementation method of the confirmation module 221. Similarly, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 The implementation of the sending module 225 may refer to the implementation of the confirming module 221 .
- the confirmation module 221 may include code running on a computing instance.
- the computing instance may include at least one of a physical host (computing device), a virtual machine, and a container. Further, the above-mentioned computing instance may be one or more.
- the confirmation module 221 may include code running on multiple hosts/virtual machines/containers. It should be noted that the multiple hosts/virtual machines/containers used to run the code may be distributed in the same region (region) or in different regions.
- the multiple hosts/virtual machines/containers used to run the code may be distributed in the same availability zone (AZ) or in different AZs, each AZ including one data center or multiple data centers with close geographical locations. Among them, usually a region may include multiple AZs.
- VPC virtual private cloud
- multiple hosts/virtual machines/containers used to run the code can be distributed in the same virtual private cloud (VPC) or in multiple VPCs.
- VPC virtual private cloud
- a VPC is set up in a region.
- a communication gateway needs to be set up in each VPC to achieve interconnection between VPCs through the communication gateway.
- the confirmation module 221 may include at least one computing device, such as a server, etc.
- the confirmation module 221 may also be a device implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD).
- ASIC application-specific integrated circuit
- PLD programmable logic device
- the PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
- CPLD complex programmable logical device
- FPGA field-programmable gate array
- GAL generic array logic
- the multiple computing devices included in the confirmation module 221 can be distributed in the same region or in different regions.
- the multiple computing devices included in the confirmation module 221 can be distributed in the same AZ or in different AZs.
- the multiple computing devices included in the confirmation module 221 can be distributed in the same VPC or in multiple VPCs.
- the multiple computing devices can be any combination of computing devices such as servers, ASICs, PLDs, CPLDs, FPGAs, and GALs.
- the confirmation module 221 can be used to execute any step in the edge node communication method based on cloud computing technology
- the sending module 222 can be used to execute any step in the edge node communication method based on cloud computing technology
- the receiving module 223 can be used to execute any step in the edge node communication method based on cloud computing technology
- the processing module 224 can be used to execute any step in the edge node communication method based on cloud computing technology
- the sending module 225 can be used to execute any step in the edge node communication method based on cloud computing technology.
- the steps that the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 are responsible for implementing can be specified as needed.
- the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 respectively implement different steps in the edge node communication method based on cloud computing technology to realize all the functions of the cloud management platform 22.
- a computing device 100 is provided in an embodiment of the present application, and the computing device 100 includes: a bus 102, a processor 104, a memory 106, and a communication interface 108.
- the processor 104, the memory 106, and the communication interface 108 communicate with each other through the bus 102.
- the computing device 100 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 100.
- the bus 102 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc.
- the bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one line is used in FIG. 12, but it does not mean that there is only one bus or one type of bus.
- the bus 104 may include a path for transmitting information between various components of the computing device 100 (e.g., the memory 106, the processor 104, and the communication interface 108).
- the processor 104 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP) or a digital signal processor (DSP).
- processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP) or a digital signal processor (DSP).
- CPU central processing unit
- GPU graphics processing unit
- MP microprocessor
- DSP digital signal processor
- the memory 106 may include a volatile memory, such as a random access memory (RAM).
- the processor 104 may also include a non-volatile memory (non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).
- ROM read-only memory
- HDD hard disk drive
- SSD solid state drive
- the memory 106 stores executable program codes
- the processor 104 executes the executable program codes to respectively implement the functions of the aforementioned confirmation module 221, the sending module 222, the receiving module 223, the processing module 224, and the sending module 225, thereby realizing the edge node communication method based on cloud computing technology. That is, the memory 106 stores instructions for executing the edge node communication method based on cloud computing technology.
- the processor 104 executes the executable program codes to respectively implement the functions of the aforementioned confirmation module 221, the sending module 222, the receiving module 223, the processing module 224, and the sending module 225 as an example.
- the communication interface 108 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 100 and other devices or a communication network.
- a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 100 and other devices or a communication network.
- the embodiment of the present application also provides a computing device cluster 10.
- the computing device cluster 10 includes at least one computing device.
- the computing device may be a server for data storage, or a local server in a local data center.
- the computing device may also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.
- the computing device cluster 10 includes at least one computing device 100.
- the memory 514 in one or more computing devices 500 in the computing device cluster may store instructions for executing the edge node communication method based on cloud computing technology on the same cloud management platform.
- one or more computing devices 100 in the computing device cluster may also be used to execute some instructions of the cloud management platform for executing the edge node communication method based on cloud computing technology.
- a combination of one or more computing devices 100 may jointly execute instructions of the cloud management platform for executing the edge node communication method based on cloud computing technology.
- the memory 106 in different computing devices 100 in the computing device cluster can store different instructions for executing some functions of the cloud management platform. That is, the instructions stored in the memory 106 in different computing devices 100 can implement the functions of one or more modules in the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225.
- one or more computing devices in the computing device cluster 10 can be connected via a network.
- the network may be a wide area network or a local area network, etc.
- FIG14 shows a possible implementation.
- two computing devices 100A and 100B are connected via a network, taking the functions of one or more modules in the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224, and the sending module 225 as an example.
- the network is connected via a communication interface in each computing device.
- the memory 106 in the computing device 100A stores instructions for executing the functions of the confirmation module 221, the sending module 222, and the receiving module 223.
- the memory 106 in the computing device 100B stores instructions for executing the functions of the processing module 224 and the sending module 225.
- connection method between the computing device cluster 10 shown in Figure 14 can be considered to be that the edge node communication method based on cloud computing technology provided in this application requires a large amount of data storage and reading, so it is considered to hand over the functions implemented by the processing module 224 and the sending module 225 to the computing device 100B for execution.
- the functions of the computing device 100A shown in FIG14 may also be completed by multiple computing devices 100.
- the functions of the computing device 100B may also be completed by multiple computing devices 100.
- the memory 106 of one or more computing devices 100 in the computing device cluster 10 may also respectively store some instructions for executing the edge node communication method based on cloud computing technology.
- the combination of one or more computing devices 100 can jointly execute the instructions for executing the edge node communication method based on cloud computing technology.
- the embodiment of the present application also provides a computer program product including instructions.
- the computer program product may be a software or program product including instructions that can be run on a computing device or stored in any available medium.
- the at least one computing device executes an edge node communication method based on cloud computing technology.
- the embodiment of the present application also provides a computer-readable storage medium.
- the computer-readable storage medium can be any available medium that can be stored by the computing device or a data storage device such as a data center containing one or more available media.
- the available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).
- the computer-readable storage medium includes instructions that instruct the computing device to execute an edge node communication method based on cloud computing technology.
- the disclosed devices and methods can be implemented in other ways.
- the device embodiments described above are schematic.
- the division of the modules or units is a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.
- Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
- the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
- the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application.
- the aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
本申请要求于2023年02月10日提交中国专利局,申请号为202310100895.5、申请名称为“基于云计算技术的边缘节点通信方法及相关设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the China Patent Office on February 10, 2023, with application number 202310100895.5 and application name “Edge node communication method and related equipment based on cloud computing technology”, all contents of which are incorporated by reference in this application.
本申请涉及云计算技术领域,尤其涉及一种基于云计算技术的边缘节点通信方法及相关设备。The present application relates to the field of cloud computing technology, and in particular to an edge node communication method and related equipment based on cloud computing technology.
基于云计算的边缘计算技术是云计算在边缘侧的延伸应用,由于计算资源更接近用户或者数据源的物理位置,从而能够产生更快的网络服务响应,以及满足用户在实时业务、安全与隐私保护等方面的各种需求。Edge computing technology based on cloud computing is an extended application of cloud computing on the edge side. Since computing resources are closer to the physical location of users or data sources, it can generate faster network service responses and meet users' various needs in real-time business, security and privacy protection.
在现有的基于云计算的边缘计算技术中,对于边缘节点的管理通常是在云端管理节点部署管理组件,通过管理组件对边缘节点以及运行在边缘节点上的应用进行管理。每个边缘节点上可部署一个代理,管理组件可以与每个边缘节点上的代理建立云边通信通道,使得云端管理节点可与每个边缘节点进行云边信息传输。In the existing cloud computing-based edge computing technology, the management of edge nodes is usually done by deploying management components on the cloud management node, and managing the edge nodes and the applications running on the edge nodes through the management components. An agent can be deployed on each edge node, and the management component can establish a cloud-edge communication channel with the agent on each edge node, so that the cloud management node can transmit cloud-edge information with each edge node.
在一些特殊应用场景中,例如出于避免数据泄密的考量不期望某个边缘节点与云端管理节点建立云边通信通道,或者某个边缘节点当前的位置可能超出了可与云端管理节点通信的范围,由于这部分边缘节点未能连接到云端管理节点,导致无法与云端管理节点进行信息交互。In some special application scenarios, for example, it is not expected that a certain edge node will establish a cloud-edge communication channel with the cloud management node to avoid data leakage, or the current location of a certain edge node may be beyond the communication range with the cloud management node. Since these edge nodes cannot connect to the cloud management node, they cannot interact with the cloud management node.
发明内容Summary of the invention
有鉴于此,有必要提供一种基于云计算技术的边缘节点通信方法,可以使得未能与云管理平台建立连接的边缘节点亦可与云管理平台进行信息交互。In view of this, it is necessary to provide an edge node communication method based on cloud computing technology, which can enable edge nodes that fail to establish a connection with a cloud management platform to also exchange information with the cloud management platform.
本申请实施例第一方面公开了一种基于云计算技术的边缘节点通信方法,应用于云管理平台,云管理平台用于管理M个边缘节点,其中M个边缘节点中的H个边缘节点与云管理平台连接,M个边缘节点中的N个边缘节点与云管理平台断开连接,边缘节点通信方法包括:云管理平台确认H个边缘节点中的第一边缘节点作为中继节点,其中中继节点与N个边缘节点连接;云管理平台将需发送至N个边缘节点中的第二边缘节点的第一交互信息发送至中继节点,第一交互信息经由中继节点转发至第二边缘节点。In a first aspect, an embodiment of the present application discloses an edge node communication method based on cloud computing technology, which is applied to a cloud management platform. The cloud management platform is used to manage M edge nodes, wherein H edge nodes among the M edge nodes are connected to the cloud management platform, and N edge nodes among the M edge nodes are disconnected from the cloud management platform. The edge node communication method includes: the cloud management platform confirms a first edge node among the H edge nodes as a relay node, wherein the relay node is connected to the N edge nodes; the cloud management platform sends first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded to the second edge node via the relay node.
采用上述技术方案,云管理平台通过从与其连接的边缘节点中选取一边缘节点作为中继节点,选择的中继节点可与未能与云管理平台连接的边缘节点保持连接,通过中继节点进行信息转发,未能与云管理平台建立连接的边缘节点可通过中继节点与云管理平台进行信息交互,使得云管理平台可对每个边缘节点进行管理,例如,对于未能与云管理平台建立连接的边缘节点,云管理平台可将下发给该边缘节点的交互信息发送给中继节点,由中继节点转发给该边缘节点。By adopting the above technical solution, the cloud management platform selects an edge node from the edge nodes connected to it as a relay node. The selected relay node can maintain connection with the edge nodes that cannot be connected to the cloud management platform, and forward information through the relay node. The edge nodes that cannot establish a connection with the cloud management platform can interact with the cloud management platform through the relay node, so that the cloud management platform can manage each edge node. For example, for the edge nodes that cannot establish a connection with the cloud management platform, the cloud management platform can send the interaction information sent to the edge node to the relay node, and the relay node forwards it to the edge node.
在一些实施例中,基于云计算技术的边缘节点通信方法还包括:云管理平台接收中继节点发送的第二交互信息,第二交互信息由第二边缘节点发送至中继节点。In some embodiments, the edge node communication method based on cloud computing technology also includes: the cloud management platform receives second interaction information sent by the relay node, and the second interaction information is sent by the second edge node to the relay node.
采用上述技术方案,对于未能与云管理平台建立连接的边缘节点,可将需要发送给云管理平台的交互信息发送给中继节点,由中继节点转发给云管理平台,实现与云管理平台进行信息交互。By adopting the above technical solution, for edge nodes that fail to establish a connection with the cloud management platform, the interactive information that needs to be sent to the cloud management platform can be sent to the relay node, which will forward it to the cloud management platform to realize information interaction with the cloud management platform.
在一些实施例中,云管理平台还与提供云计算资源的基础设施连接,基于云计算技 术的边缘节点通信方法还包括:云管理平台调用基础设施的云计算资源对第二交互信息进行处理。In some embodiments, the cloud management platform is also connected to the infrastructure that provides cloud computing resources. The edge node communication method of the technology also includes: the cloud management platform calls the cloud computing resources of the infrastructure to process the second interaction information.
采用上述技术方案,云管理平台可通过调用与其连接的基础设施的云计算资源对第二交互信息进行处理,例如第二交互信息可以是边缘节点采集到的信息、或边缘节点基于云管理平台下发的任务而执行的信息等,基础设施可以包括一个或多个云数据中心。By adopting the above technical solution, the cloud management platform can process the second interaction information by calling the cloud computing resources of the infrastructure connected to it. For example, the second interaction information may be information collected by the edge node, or information executed by the edge node based on the task issued by the cloud management platform, etc. The infrastructure may include one or more cloud data centers.
在一些实施例中,云管理平台确认H个边缘节点中的第一边缘节点作为中继节点,包括:云管理平台基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台连接,及从H个边缘节点中选择第一边缘节点作为中继节点,通信状态包括是否能与云管理平台建立连接。In some embodiments, the cloud management platform confirms a first edge node among H edge nodes as a relay node, including: the cloud management platform confirms that the H edge nodes are connected to the cloud management platform based on the communication status of each edge node among the M edge nodes, and selects the first edge node from the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform.
采用上述技术方案,云管理平台可通过获取每个边缘节点的通信状态,确定当前与云管理平台连接的边缘节点,从这些与云管理平台连接的边缘节点中选择一边缘节点作为中继节点,由于中继节点可与云管理平台进行信息交互,使得未能与云管理平台建立连接的边缘节点可通过中继节点进行信息转发,实现与云管理平台进行信息交互。By adopting the above technical solution, the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node, and select an edge node as a relay node from these edge nodes connected to the cloud management platform. Since the relay node can interact with the cloud management platform, the edge nodes that fail to establish a connection with the cloud management platform can forward information through the relay node, thereby realizing information interaction with the cloud management platform.
在一些实施例中,云管理平台接收中继节点发送的第二交互信息,包括:云管理平台下发中继标识信息至中继节点,中继标识信息包括中继节点标识,其中,中继标识信息经由中继节点发送至N个边缘节点,中继标识信息用于指示N个边缘节点中的第二边缘节点将上报至云管理平台的第二交互信息发送给中继节点;云管理平台接收中继节点转发的第二交互信息。In some embodiments, the cloud management platform receives second interaction information sent by the relay node, including: the cloud management platform sends relay identification information to the relay node, the relay identification information includes the relay node identification, wherein the relay identification information is sent to N edge nodes via the relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the second interaction information reported to the cloud management platform to the relay node; the cloud management platform receives the second interaction information forwarded by the relay node.
采用上述技术方案,云管理平台在选定中继节点之后,可下发包括中继节点标识的中继标识信息至中继节点,由中继节点转发给各个未能与云管理平台建立连接的边缘节点,使得这些未能与云管理平台建立连接的边缘节点可以基于中继标识信息获知中继节点信息,进而可将上报至云管理平台的交互信息发送给中继节点,由中继节点转发给云管理平台,实现与云管理平台进行信息交互。By adopting the above technical solution, after selecting a relay node, the cloud management platform can send relay identification information including the relay node identification to the relay node, which will be forwarded by the relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the relay node information based on the relay identification information, and then send the interactive information reported to the cloud management platform to the relay node, which will be forwarded to the cloud management platform by the relay node, thereby realizing information interaction with the cloud management platform.
在一些实施例中,基于云计算技术的边缘节点通信方法还包括:在中继节点与云管理平台断开连接之前,云管理平台基于M个边缘节点中的每个边缘节点的通信状态,从M个边缘节点中重新选择一个边缘节点作为更新的中继节点,其中更新的中继节点与云管理平台在预设时间段内保持连接,更新的中继节点与N个边缘节点保持连接。In some embodiments, the edge node communication method based on cloud computing technology also includes: before the relay node is disconnected from the cloud management platform, the cloud management platform reselects an edge node from the M edge nodes as an updated relay node based on the communication status of each of the M edge nodes, wherein the updated relay node remains connected to the cloud management platform within a preset time period, and the updated relay node remains connected to N edge nodes.
采用上述技术方案,由于中继节点的移动,可能会在预设时间之后与云管理平台断开连接(例如超出通信连接范围),云管理平台可以在中继节点与其断开连接之前,从与其连接的边缘节点中重新选取一边缘节点作为更新的中继节点,更新的中继节点可与云管理平台断开连接的边缘节点保存连接,且与云管理平台在预设时间段内保持连接,避免需频繁选择更新的中继节点,通过更新的中继节点进行信息转发,未能与云管理平台建立连接的边缘节点可通过该更新的中继节点与云管理平台进行信息交互,使得云管理平台可对每个边缘节点进行管理。By adopting the above technical solution, due to the movement of the relay node, it may be disconnected from the cloud management platform after a preset time (for example, out of the communication connection range). The cloud management platform can re-select an edge node from the edge nodes connected to it as an updated relay node before the relay node is disconnected from it. The updated relay node can save the connection with the edge node disconnected from the cloud management platform and maintain the connection with the cloud management platform within a preset time period, avoiding the need to frequently select updated relay nodes and forward information through the updated relay nodes. The edge nodes that fail to establish a connection with the cloud management platform can interact with the cloud management platform through the updated relay nodes, so that the cloud management platform can manage each edge node.
在一些实施例中,基于云计算技术的边缘节点通信方法还包括:云管理平台将更新的中继标识信息下发至更新的中继节点,其中,更新的中继标识信息经由更新的中继节点发送至N个边缘节点,中继标识信息用于指示N个边缘节点中的第二边缘节点将上报至云管理平台的第三交互信息发送给更新的中继节点;云管理平台接收更新的中继节点转发的第三交互信息。In some embodiments, the edge node communication method based on cloud computing technology also includes: the cloud management platform sends the updated relay identification information to the updated relay node, wherein the updated relay identification information is sent to N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the third interaction information reported to the cloud management platform to the updated relay node; the cloud management platform receives the third interaction information forwarded by the updated relay node.
采用上述技术方案,云管理平台在选定更新的中继节点之后,可下发包括该更新的中继节点标识的中继标识信息至更新的中继节点,由更新的中继节点转发给各个未能与云管理平台建立连接的边缘节点,使得这些未能与云管理平台建立连接的边缘节点可以基于更新的中继标识信息获知更新的中继节点信息,进而后续可将上报至云管理平台的交互信息发送给更新的中继节点,由更新的中继节点转发给云管理平台,实现与云管理平台进行信息交互。By adopting the above technical solution, after selecting an updated relay node, the cloud management platform can send relay identification information including the updated relay node identification to the updated relay node, which will be forwarded by the updated relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the updated relay node information based on the updated relay identification information, and then subsequently send the interactive information reported to the cloud management platform to the updated relay node, which will be forwarded by the updated relay node to the cloud management platform, thereby realizing information interaction with the cloud management platform.
在一些实施例中,云管理平台确认H个边缘节点中的第一边缘节点作为中继节点,包括:云管理平台基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云 管理平台连接,及确认从H个边缘节点之间选举产生的第一边缘节点作为中继节点,通信状态包括是否能与云管理平台建立连接。In some embodiments, the cloud management platform confirms that the first edge node among the H edge nodes is used as a relay node, including: the cloud management platform confirms that the H edge nodes are connected to the cloud based on the communication status of each edge node among the M edge nodes. The management platform is connected, and the first edge node selected from the H edge nodes is confirmed as a relay node. The communication status includes whether a connection can be established with the cloud management platform.
采用上述技术方案,云管理平台可通过获取每个边缘节点的通信状态,确定当前与云管理平台连接的边缘节点,中继节点可从这些与云管理平台连接的边缘节点中选举产生,使得未能与云管理平台建立连接的边缘节点可通过中继节点进行信息转发,实现与云管理平台进行信息交互。By adopting the above technical solution, the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node. Relay nodes can be elected from these edge nodes connected to the cloud management platform, so that edge nodes that fail to establish a connection with the cloud management platform can forward information through relay nodes to achieve information interaction with the cloud management platform.
第二方面,本申请实施例提供一种云管理平台,云管理平台用于管理M个边缘节点,其中M个边缘节点中的H个边缘节点与云管理平台连接,M个边缘节点中的N个边缘节点与云管理平台断开连接,云管理平台包括:确认模块,用于确认H个边缘节点中的第一边缘节点作为中继节点,其中中继节点与N个边缘节点连接;发送模块,用于将需发送至N个边缘节点中的第二边缘节点的第一交互信息发送至中继节点,第一交互信息经由中继节点转发至第二边缘节点。In the second aspect, an embodiment of the present application provides a cloud management platform, which is used to manage M edge nodes, wherein H edge nodes among the M edge nodes are connected to the cloud management platform, and N edge nodes among the M edge nodes are disconnected from the cloud management platform, and the cloud management platform includes: a confirmation module, used to confirm that a first edge node among the H edge nodes is used as a relay node, wherein the relay node is connected to the N edge nodes; a sending module, used to send first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded to the second edge node via the relay node.
采用上述技术方案,云管理平台通过从与其连接的边缘节点中选取一边缘节点作为中继节点,选择的中继节点可与未能与云管理平台连接的边缘节点保持连接,通过中继节点进行信息转发,未能与云管理平台建立连接的边缘节点可通过中继节点与云管理平台进行信息交互,使得云管理平台可对每个边缘节点进行管理,例如,对于未能与云管理平台建立连接的边缘节点,云管理平台可将下发给该边缘节点的交互信息发送给中继节点,由中继节点转发给该边缘节点。By adopting the above technical solution, the cloud management platform selects an edge node from the edge nodes connected to it as a relay node. The selected relay node can maintain connection with the edge nodes that cannot be connected to the cloud management platform, and forward information through the relay node. The edge nodes that cannot establish a connection with the cloud management platform can interact with the cloud management platform through the relay node, so that the cloud management platform can manage each edge node. For example, for the edge nodes that cannot establish a connection with the cloud management platform, the cloud management platform can send the interaction information sent to the edge node to the relay node, and the relay node forwards it to the edge node.
在一些实施例中,云管理平台还包括:接收模块,用于接收中继节点发送的第二交互信息,第二交互信息由第二边缘节点发送至中继节点。In some embodiments, the cloud management platform further includes: a receiving module, configured to receive second interaction information sent by the relay node, where the second interaction information is sent by the second edge node to the relay node.
采用上述技术方案,对于未能与云管理平台建立连接的边缘节点,可将需要发送给云管理平台的交互信息发送给中继节点,由中继节点转发给云管理平台,使得云管理平台可与各个未能与其建立连接的边缘节点进行信息交互。By adopting the above technical solution, for edge nodes that fail to establish a connection with the cloud management platform, the interactive information that needs to be sent to the cloud management platform can be sent to the relay node, which will forward it to the cloud management platform, so that the cloud management platform can interact with each edge node that fails to establish a connection with it.
在一些实施例中,云管理平台还与提供云计算资源的基础设施连接,云管理平台还包括:处理模块,用于调用基础设施的云计算资源对第二交互信息进行处理。In some embodiments, the cloud management platform is also connected to an infrastructure that provides cloud computing resources. The cloud management platform also includes: a processing module for invoking the cloud computing resources of the infrastructure to process the second interaction information.
采用上述技术方案,云管理平台可通过调用与其连接的基础设施的云计算资源对第二交互信息进行处理,例如第二交互信息可以是边缘节点采集到的信息、或边缘节点基于云管理平台下发的任务而执行的信息等,基础设施可以包括一个或多个云数据中心。By adopting the above technical solution, the cloud management platform can process the second interaction information by calling the cloud computing resources of the infrastructure connected to it. For example, the second interaction information may be information collected by the edge node, or information executed by the edge node based on the task issued by the cloud management platform, etc. The infrastructure may include one or more cloud data centers.
在一些实施例中,确认模块还用于基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台连接,及从H个边缘节点中选择第一边缘节点作为中继节点,通信状态包括是否能与云管理平台建立连接。In some embodiments, the confirmation module is also used to confirm that H edge nodes are connected to the cloud management platform based on the communication status of each edge node among the M edge nodes, and select a first edge node from the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform.
采用上述技术方案,云管理平台可通过获取每个边缘节点的通信状态,确定当前与云管理平台连接的边缘节点,从这些与云管理平台连接的边缘节点中选择一边缘节点作为中继节点,由于中继节点可与云管理平台进行信息交互,使得未能与云管理平台建立连接的边缘节点可通过中继节点进行信息转发,实现与云管理平台进行信息交互。By adopting the above technical solution, the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node, and select an edge node as a relay node from these edge nodes connected to the cloud management platform. Since the relay node can interact with the cloud management platform, the edge nodes that fail to establish a connection with the cloud management platform can forward information through the relay node, thereby realizing information interaction with the cloud management platform.
在一些实施例中,云管理平台还包括下发模块,下发模块用于下发中继标识信息至中继节点,中继标识信息包括中继节点标识,其中,中继标识信息经由中继节点发送至N个边缘节点,中继标识信息用于指示N个边缘节点中的第二边缘节点将上报至云管理平台的第二交互信息发送给中继节点。In some embodiments, the cloud management platform also includes a sending module, which is used to send relay identification information to the relay node, and the relay identification information includes a relay node identification, wherein the relay identification information is sent to N edge nodes via the relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the second interaction information reported to the cloud management platform to the relay node.
采用上述技术方案,云管理平台在选定中继节点之后,可下发包括中继节点标识的中继标识信息至中继节点,由中继节点转发给各个未能与云管理平台建立连接的边缘节点,使得这些未能与云管理平台建立连接的边缘节点可以基于中继标识信息获知中继节点信息,进而可将上报至云管理平台的交互信息发送给中继节点,由中继节点转发给云管理平台,实现与云管理平台进行信息交互。By adopting the above technical solution, after selecting a relay node, the cloud management platform can send relay identification information including the relay node identification to the relay node, which will be forwarded by the relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the relay node information based on the relay identification information, and then send the interactive information reported to the cloud management platform to the relay node, which will be forwarded to the cloud management platform by the relay node, thereby realizing information interaction with the cloud management platform.
在一些实施例中,确认模块还用于在中继节点与云管理平台断开连接之前,基于M个边缘节点中的每个边缘节点的通信状态,从M个边缘节点中重新选择一个边缘节点作为更新的中继节点,其中更新的中继节点与云管理平台在预设时间段内保持连接,更新 的中继节点与N个边缘节点保持连接。In some embodiments, the confirmation module is further used to reselect an edge node from the M edge nodes as an updated relay node based on the communication status of each edge node in the M edge nodes before the relay node is disconnected from the cloud management platform, wherein the updated relay node maintains connection with the cloud management platform within a preset time period, and the updated relay node maintains connection with the cloud management platform within a preset time period. The relay node maintains connection with N edge nodes.
采用上述技术方案,由于中继节点的移动,可能会在预设时间之后与云管理平台断开连接(例如超出通信连接范围),云管理平台可以在中继节点与其断开连接之前,从与其连接的边缘节点中重新选取一边缘节点作为更新的中继节点,更新的中继节点可与云管理平台断开连接的边缘节点保存连接,且与云管理平台在预设时间段内保持连接,避免需频繁选择更新的中继节点,通过更新的中继节点进行信息转发,未能与云管理平台建立连接的边缘节点可通过该更新的中继节点与云管理平台进行信息交互,使得云管理平台可对每个边缘节点进行管理。By adopting the above technical solution, due to the movement of the relay node, it may be disconnected from the cloud management platform after a preset time (for example, out of the communication connection range). The cloud management platform can re-select an edge node from the edge nodes connected to it as an updated relay node before the relay node is disconnected from it. The updated relay node can save the connection with the edge node disconnected from the cloud management platform and maintain the connection with the cloud management platform within a preset time period, avoiding the need to frequently select updated relay nodes and forward information through the updated relay nodes. The edge nodes that fail to establish a connection with the cloud management platform can interact with the cloud management platform through the updated relay nodes, so that the cloud management platform can manage each edge node.
在一些实施例中,云管理平台还包括下发模块,下发模块用于将更新的中继标识信息下发至更新的中继节点,其中,更新的中继标识信息经由更新的中继节点发送至N个边缘节点,中继标识信息用于指示N个边缘节点中的第二边缘节点将上报至云管理平台的第三交互信息发送给更新的中继节点;接收模块还用于接收更新的中继节点转发的第三交互信息。In some embodiments, the cloud management platform also includes a sending module, which is used to send the updated relay identification information to the updated relay node, wherein the updated relay identification information is sent to N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes will send the third interaction information reported to the cloud management platform to the updated relay node; the receiving module is also used to receive the third interaction information forwarded by the updated relay node.
采用上述技术方案,云管理平台在选定更新的中继节点之后,可下发包括该更新的中继节点标识的中继标识信息至更新的中继节点,由更新的中继节点转发给各个未能与云管理平台建立连接的边缘节点,使得这些未能与云管理平台建立连接的边缘节点可以基于更新的中继标识信息获知更新的中继节点信息,进而后续可将上报至云管理平台的交互信息发送给更新的中继节点,由更新的中继节点转发给云管理平台,实现与云管理平台进行信息交互。By adopting the above technical solution, after selecting an updated relay node, the cloud management platform can send relay identification information including the updated relay node identification to the updated relay node, which will be forwarded by the updated relay node to each edge node that has failed to establish a connection with the cloud management platform, so that these edge nodes that have failed to establish a connection with the cloud management platform can obtain the updated relay node information based on the updated relay identification information, and then subsequently send the interactive information reported to the cloud management platform to the updated relay node, which will be forwarded by the updated relay node to the cloud management platform, thereby realizing information interaction with the cloud management platform.
在一些实施例中,确认模块还用于基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台连接,及确认从H个边缘节点之间选举产生的第一边缘节点作为中继节点,通信状态包括是否能与云管理平台建立连接。In some embodiments, the confirmation module is also used to confirm that H edge nodes are connected to the cloud management platform based on the communication status of each edge node among the M edge nodes, and to confirm the first edge node elected from among the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform.
采用上述技术方案,云管理平台可通过获取每个边缘节点的通信状态,确定当前与云管理平台连接的边缘节点,中继节点可从这些与云管理平台连接的边缘节点中选举产生,使得未能与云管理平台建立连接的边缘节点可通过中继节点进行信息转发,实现与云管理平台进行信息交互。By adopting the above technical solution, the cloud management platform can determine the edge nodes currently connected to the cloud management platform by obtaining the communication status of each edge node. Relay nodes can be elected from these edge nodes connected to the cloud management platform, so that edge nodes that fail to establish a connection with the cloud management platform can forward information through relay nodes to achieve information interaction with the cloud management platform.
第三方面,本申请实施例提供一种计算机可读存储介质,包括计算机程序指令,当计算机程序指令由计算设备集群执行时,使得计算设备集群执行如第一方面所述的基于云计算技术的边缘节点通信方法。In a third aspect, an embodiment of the present application provides a computer-readable storage medium, comprising computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes the edge node communication method based on cloud computing technology as described in the first aspect.
第四方面,本申请实施例提供一种计算设备集群,包括至少一个计算设备,每个计算设备包括处理器和存储器;至少一个计算设备的处理器用于执行至少一个计算设备的存储器中存储的指令,以使得计算设备集群执行如第一方面所述的基于云计算技术的边缘节点通信方法。In a fourth aspect, an embodiment of the present application provides a computing device cluster, comprising at least one computing device, each computing device comprising a processor and a memory; the processor of at least one computing device is used to execute instructions stored in the memory of at least one computing device, so that the computing device cluster executes the edge node communication method based on cloud computing technology as described in the first aspect.
第五方面,本申请实施例提供一种计算机程序产品,当计算机程序产品被计算设备集群运行时,使得计算设备集群执行如第一方面所述的基于云计算技术的边缘节点通信方法。In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is executed by a computing device cluster, the computing device cluster executes the edge node communication method based on cloud computing technology as described in the first aspect.
第六方面,提供一种装置,所述装置具有实现上述第一方面所提供的方法中计算设备集群行为的功能。功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块。In a sixth aspect, a device is provided, wherein the device has the function of implementing the computing device cluster behavior in the method provided in the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.
可以理解地,上述提供的第三方面所述的计算机可读存储介质,第四方面所述的计算设备集群,第五方面所述的计算机程序产品,第六方面所述的装置均与上述第一方面的方法对应,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。It can be understood that the computer-readable storage medium described in the third aspect, the computing device cluster described in the fourth aspect, the computer program product described in the fifth aspect, and the apparatus described in the sixth aspect all correspond to the method of the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
图1为本申请一实施例提供的一种基于云计算技术的边缘节点通信方法的应用场景示意图; FIG1 is a schematic diagram of an application scenario of an edge node communication method based on cloud computing technology provided by an embodiment of the present application;
图2为本申请一实施例提供的基于云计算技术的边缘节点通信方法的流程示意图;FIG2 is a schematic diagram of a flow chart of an edge node communication method based on cloud computing technology provided by an embodiment of the present application;
图3为本申请一实施例提供的Kubernetes的架构示意图;FIG3 is a schematic diagram of the architecture of Kubernetes provided in an embodiment of the present application;
图4为本申请一实施例提供的KubeEdge系统的架构示意图;FIG4 is a schematic diagram of the architecture of the KubeEdge system provided in an embodiment of the present application;
图5为本申请另一实施例提供的KubeEdge系统的架构示意图;FIG5 is a schematic diagram of the architecture of a KubeEdge system provided in another embodiment of the present application;
图6a为本申请一实施例提供的云边中继信息的信息结构示意图;FIG6a is a schematic diagram of the information structure of cloud-edge relay information provided in an embodiment of the present application;
图6b为本申请一实施例提供的边边中继信息的信息结构示意图;FIG6 b is a schematic diagram of the information structure of edge-to-edge relay information provided in an embodiment of the present application;
图7为图5所示的KubeEdge系统中的云管理平台对上行信息进行处理的流程示意图;FIG7 is a schematic diagram of a process for processing uplink information by the cloud management platform in the KubeEdge system shown in FIG5 ;
图8为图5所示的KubeEdge系统中的云管理平台对下行信息进行处理的流程示意图;FIG8 is a schematic diagram of a process for processing downlink information by the cloud management platform in the KubeEdge system shown in FIG5 ;
图9为图5所述的KubeEdge系统中的边缘节点对信息进行处理的流程示意图;FIG9 is a schematic diagram of a process of processing information by an edge node in the KubeEdge system described in FIG5 ;
图10a与10b为本申请另一实施例提供的基于云计算技术的边缘节点通信方法的应用场景示意图;10a and 10b are schematic diagrams of application scenarios of an edge node communication method based on cloud computing technology provided by another embodiment of the present application;
图11为本申请一实施例提供的云管理平台的模块示意图;FIG11 is a schematic diagram of a module of a cloud management platform provided in an embodiment of the present application;
图12为本申请一实施例提供的一种计算设备的结构示意图;FIG12 is a schematic diagram of the structure of a computing device provided by an embodiment of the present application;
图13为本申请一实施例提供的一种计算设备集群的结构示意图;FIG13 is a schematic diagram of the structure of a computing device cluster provided in one embodiment of the present application;
图14为本申请另一实施例提供的一种计算设备集群的结构示意图。FIG. 14 is a schematic diagram of the structure of a computing device cluster provided in another embodiment of the present application.
需要说明的是,本申请中“至少一个”是指一个或者多个,“多个”是指两个或多于两个。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。本申请的说明书和权利要求书及附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不是用于描述特定的顺序或先后次序。It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more than two. "And/or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The terms "first", "second", "third", "fourth", etc. (if any) in the specification, claims and drawings of this application are used to distinguish similar objects, rather than to describe a specific order or sequence.
在本申请实施例中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
为便于理解本申请实施例,接下来对本请的应用场景进行介绍,本申请实施例描述的业务场景是为了更加清楚的说明本申请实施例的技术方案,并不构成对于本申请实施例提供的技术方案的限定,本领域普通技术人员可知,随着新业务场景的出现,本申请实施例提供的技术方案对于类似的技术问题,同样适用。To facilitate understanding of the embodiments of the present application, the application scenarios of the present application are introduced below. The business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
为了便于理解本申请实施例中的技术方案,下面首先对本申请实施例中所涉及的部分术语进行解释:In order to facilitate understanding of the technical solutions in the embodiments of the present application, some of the terms involved in the embodiments of the present application are first explained below:
边缘节点:可以是指距离最终用户接入具有较少的中间环节的网络节点,对最终接入用户有较好的响应能力和连接速度,也可以是指实现采集数据及向网络层发送数据的设备。Edge node: It can refer to a network node with fewer intermediate links from the end-user access, which has better response capabilities and connection speed for the end-user access. It can also refer to a device that collects data and sends data to the network layer.
云管理平台:管理边缘节点的云平台,可提供包括边缘节点接入、边缘节点管理、边缘节点数据处理等功能,从而支撑基于云计算的边缘节点技术在各种行业应用。Cloud management platform: A cloud platform that manages edge nodes, which can provide functions including edge node access, edge node management, and edge node data processing, thereby supporting the application of edge node technology based on cloud computing in various industries.
Kubernetes:是一个开源的,用于管理集群中多个节点上的容器化的应用,Kubernetes的目标是让部署容器化的应用简单并且高效,在Kubernetes中,可以创建多个容器,由容器运行应用实例,然后通过内置的负载均衡策略,实现对这一组 应用实例的管理、发现、访问,而这些细节都不需要运维人员去进行复杂的手工配置和处理。Kubernetes: It is an open source containerized application management framework for multiple nodes in a cluster. The goal of Kubernetes is to make the deployment of containerized applications simple and efficient. In Kubernetes, you can create multiple containers, run application instances in the containers, and then use the built-in load balancing strategy to achieve the load balancing of this group. Management, discovery, and access to application instances, all of these details do not require operations and maintenance personnel to perform complex manual configuration and processing.
KubeEdge:一种基于Kubernetes的云原生边缘计算管理平台。KubeEdge: A cloud-native edge computing management platform based on Kubernetes.
请参见图1,图1是本发明实施例提供一种基于云计算技术的边缘节点通信方法的应用场景示意图。如图1所述,云管理平台22设置在云系统20中,云系统20中还包括提供云计算资源的基础设施21,其中,基础设施21中可设置有多个云数据中心,示例性的多个云数据中心包含云数据中心216、云数据中心217、云数据中心218……,云管理平台22与基础设施21进行通信连接。边缘节点集30可设置在客户现场,因针对不同的业务需求,边缘节点集30内包含有多个边缘节点,示例性的多个边缘节点包含边缘节点31、边缘节点32、边缘节点33、边缘节点34……。云管理平台22可用于管理基础设施21及边缘节点集30中的各个边缘节点。Please refer to Figure 1, which is a schematic diagram of an application scenario of an edge node communication method based on cloud computing technology provided by an embodiment of the present invention. As shown in Figure 1, a cloud management platform 22 is set in a cloud system 20, and the cloud system 20 also includes an infrastructure 21 for providing cloud computing resources, wherein multiple cloud data centers can be set in the infrastructure 21, and exemplary multiple cloud data centers include cloud data center 216, cloud data center 217, cloud data center 218..., and the cloud management platform 22 is connected to the infrastructure 21 for communication. The edge node set 30 can be set at the customer site. Due to different business needs, the edge node set 30 includes multiple edge nodes, and exemplary multiple edge nodes include edge node 31, edge node 32, edge node 33, edge node 34... The cloud management platform 22 can be used to manage the infrastructure 21 and each edge node in the edge node set 30.
在图1所示的边缘节点通信管理场景中,若出于避免数据泄密的考量不期望某个边缘节点与云管理平台22建立连接,或者由于边缘节点的移动,导致当前的位置可能超出了可与云管理平台22建立连接的范围,由于这部分边缘节点未能连接到云管理平台22,导致无法与云管理平台22进行信息交互。In the edge node communication management scenario shown in Figure 1, if a certain edge node is not expected to establish a connection with the cloud management platform 22 for the purpose of avoiding data leakage, or because the edge node moves, the current location may be beyond the range where a connection can be established with the cloud management platform 22. Since these edge nodes fail to connect to the cloud management platform 22, they are unable to interact with the cloud management platform 22 for information.
为解决上述问题,本申请提供了一种基于云计算技术的边缘节点通信方法及云管理平台22,该方法应用于云系统20中的云管理平台22,通过从与云管理平台22连接的边缘节点中选取一边缘节点作为中继节点,选择的中继节点可与未能与云管理平台22连接的边缘节点保持连接,通过中继节点进行信息转发,使得这些未能与云管理平台22连接的边缘节点可通过中继节点与云管理平台22进行信息交互,使得云管理平台22可对每个边缘节点进行管理。To solve the above problems, the present application provides an edge node communication method and a cloud management platform 22 based on cloud computing technology. The method is applied to the cloud management platform 22 in the cloud system 20. By selecting an edge node as a relay node from the edge nodes connected to the cloud management platform 22, the selected relay node can maintain connection with the edge nodes that are not connected to the cloud management platform 22, and forward information through the relay node, so that these edge nodes that are not connected to the cloud management platform 22 can exchange information with the cloud management platform 22 through the relay node, so that the cloud management platform 22 can manage each edge node.
例如,边缘节点集30内包含有M个边缘节点,在某一时刻t1,M个边缘节点中的H个边缘节点与云管理平台22连接,M个边缘节点中的N个边缘节点与云管理平台22断开连接,云管理平台22可以从H个边缘节点中选取一边缘节点作为中继节点。M、H及N为正整数,N+H=M。For example, the edge node set 30 includes M edge nodes. At a certain time t1, H edge nodes among the M edge nodes are connected to the cloud management platform 22, and N edge nodes among the M edge nodes are disconnected from the cloud management platform 22. The cloud management platform 22 can select an edge node from the H edge nodes as a relay node. M, H and N are positive integers, and N+H=M.
具体地,请继续参加图2,图2是本发明实施例提供的一种基于云计算技术的边缘节点通信方法的简易流程图,如图2所示,以边缘节点集30内包含有M个边缘节点,M个边缘节点中的H个边缘节点与云管理平台22连接,M个边缘节点中的N个边缘节点未能与云管理平台22连接为例进行说明,该方法包括但不限于以下步骤:Specifically, please continue to refer to FIG. 2, which is a simplified flow chart of an edge node communication method based on cloud computing technology provided by an embodiment of the present invention. As shown in FIG. 2, an edge node set 30 includes M edge nodes, H edge nodes of the M edge nodes are connected to the cloud management platform 22, and N edge nodes of the M edge nodes fail to connect to the cloud management platform 22. The method includes but is not limited to the following steps:
步骤S201,云管理平台22确认H个边缘节点中的第一边缘节点作为中继节点,其中中继节点与N个边缘节点连接。In step S201, the cloud management platform 22 confirms that a first edge node among H edge nodes serves as a relay node, wherein the relay node is connected to N edge nodes.
在一些实施例中,M个边缘节点可通过节点通信链路互联在一起,对于M个边缘节点中的每个边缘节点而言,可通过节点通信链路与其他节点进行信息交互,例如,两个距离较近的边缘节点之间可直接进行通信,两个距离较远的边缘节点之间可通过其他一个或多个边缘节点的中转,进行通信。In some embodiments, M edge nodes can be interconnected through a node communication link. For each of the M edge nodes, information can be exchanged with other nodes through the node communication link. For example, two edge nodes that are close to each other can communicate directly, and two edge nodes that are far away can communicate through the transit of one or more other edge nodes.
在一些实施例中,各个边缘节点的通信状态包括是否能与云管理平台22建立连接,即云管理平台22可通过各个边缘节点的通信状态,确定与其连接的边缘节点。若云管理平台22基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台22连接,N个边缘节点未能与云管理平台22连接,云管理平台22可以从H个边缘节点中选择第一边缘节点作为中继节点。第一边缘节点可与N个边缘节点连接,以实现作为该N个边缘节点与云管理平台22之间的通信中转。In some embodiments, the communication status of each edge node includes whether it can establish a connection with the cloud management platform 22, that is, the cloud management platform 22 can determine the edge node connected to it through the communication status of each edge node. If the cloud management platform 22 confirms that H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node in the M edge nodes, and N edge nodes fail to connect to the cloud management platform 22, the cloud management platform 22 can select the first edge node from the H edge nodes as a relay node. The first edge node can be connected to the N edge nodes to realize the communication relay between the N edge nodes and the cloud management platform 22.
在一些实施例中,第一边缘节点可以是H个边缘节点中,可与云管理平台22在预设时间段内保持连接的边缘节点,避免需频繁选择更新的中继节点。预设时间段可以根据实际需求进行设定,本申请对此不作限定。例如,若H个边缘节点中可与云管理平台22在预设时间段内保持连接的边缘节点包括多个,云管理平台22可以从该多个边缘节点中随机选择一个边缘节点作为中继节点。 In some embodiments, the first edge node may be an edge node among the H edge nodes that can maintain a connection with the cloud management platform 22 within a preset time period, avoiding the need to frequently select updated relay nodes. The preset time period can be set according to actual needs, and this application does not limit this. For example, if there are multiple edge nodes among the H edge nodes that can maintain a connection with the cloud management platform 22 within a preset time period, the cloud management platform 22 can randomly select an edge node from the multiple edge nodes as a relay node.
在一些实施例中,在云管理平台22确认第一边缘节点作为中继节点之后,云管理平台22可以下发中继标识信息至中继节点(第一边缘节点),中继标识信息可以包括中继节点标识,例如第一边缘节点的唯一身份标识。中继标识信息可经由中继节点发送至N个边缘节点,使得未能与云管理平台建立连接的N个边缘节点可以基于中继标识信息获知中继节点信息。中继标识信息还可用于指示N个边缘节点中的各个边缘节点将上报至云管理平台22的交互信息发送给中继节点,由中继节点转发至云管理平台22。In some embodiments, after the cloud management platform 22 confirms that the first edge node is a relay node, the cloud management platform 22 may send relay identification information to the relay node (first edge node), and the relay identification information may include a relay node identification, such as a unique identity of the first edge node. The relay identification information may be sent to N edge nodes via the relay node, so that the N edge nodes that have failed to establish a connection with the cloud management platform can obtain the relay node information based on the relay identification information. The relay identification information may also be used to instruct each of the N edge nodes to send the interaction information reported to the cloud management platform 22 to the relay node, which is forwarded to the cloud management platform 22 by the relay node.
在一些实施例中,中继节点也可以无需云管理平台22进行指定,可以由与云管理平台22连接的边缘节点之间选举产生。例如,若云管理平台基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台22连接,可以由H个边缘节点之间选举产生中继节点。假设H个边缘节点之间选举第一边缘节点作为中继节点,云管理平台22可确认第一边缘节点作为中继节点,进而后续可以下发中继标识信息至第一边缘节点。In some embodiments, the relay node may not need to be designated by the cloud management platform 22, and may be elected between the edge nodes connected to the cloud management platform 22. For example, if the cloud management platform confirms that H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node among the M edge nodes, the relay node may be elected between the H edge nodes. Assuming that the first edge node is elected as the relay node among the H edge nodes, the cloud management platform 22 may confirm that the first edge node is the relay node, and then the relay identification information may be sent to the first edge node later.
步骤S202,云管理平台将需发送至N个边缘节点中的第二边缘节点的第一交互信息发送至中继节点,第一交互信息经由中继节点转发至第二边缘节点。In step S202, the cloud management platform sends first interaction information to be sent to a second edge node among the N edge nodes to the relay node, and the first interaction information is forwarded to the second edge node via the relay node.
在一些实施例中,由于N个边缘节点未能与云管理平台22连接,N个边缘节点无法直接与云管理平台22进行信息交互。若云管理平台需将第一交互信息发送给N个边缘节点中的第二边缘节点,云管理平台22可将第一交互信息发送至中继节点(第一边缘节点),由中继节点将第一交互信息转发至第二边缘节点,使得云管理平台22可顺利下发信息至未能与其连接的第二边缘节点。In some embodiments, since the N edge nodes fail to connect to the cloud management platform 22, the N edge nodes cannot directly interact with the cloud management platform 22. If the cloud management platform needs to send the first interaction information to the second edge node among the N edge nodes, the cloud management platform 22 may send the first interaction information to the relay node (the first edge node), and the relay node forwards the first interaction information to the second edge node, so that the cloud management platform 22 can successfully send the information to the second edge node that fails to connect to it.
在一些实施例中,若第二边缘节点需将第二交互信息发送给云管理平台22,第二边缘节点可将第二交互信息发送至中继节点,由中继节点将第二交互信息发送给云管理平台22,使得云管理平台22可通过接收中继节点转发的第二交互信息,实现顺利接收未能与其连接的第二边缘节点上报的第二交互信息。In some embodiments, if the second edge node needs to send the second interaction information to the cloud management platform 22, the second edge node may send the second interaction information to the relay node, and the relay node sends the second interaction information to the cloud management platform 22, so that the cloud management platform 22 can successfully receive the second interaction information reported by the second edge node that cannot be connected to it by receiving the second interaction information forwarded by the relay node.
在一些实施例中,云管理平台22在接收到第二交互信息之后,还可调用基础设施21的云计算资源对第二交互信息进行处理,得到信息处理结果。例如,第二交互信息可以是第二边缘节点采集到的信息、或第二边缘节点基于云管理平台22下发的任务而执行的信息等。In some embodiments, after receiving the second interaction information, the cloud management platform 22 may also call the cloud computing resources of the infrastructure 21 to process the second interaction information to obtain an information processing result. For example, the second interaction information may be information collected by the second edge node, or information executed by the second edge node based on a task issued by the cloud management platform 22.
在一些实施例中,随着中继节点的移动,中继节点可能会在某个时间与云管理平台22断开连接(例如超出与云管理平台22建立连接的范围),例如,在时刻t1之后的时刻t2,中继节点(第一边缘节点)与云管理平台22断开连接。例如,云管理平台22可根据第一边缘节点的移动轨迹预测中继节点会在时刻t2与云管理平台22断开连接。云管理平台22可以在第一边缘节点与其断开连接之前,从M个边缘节点中重新选择一个边缘节点作为更新的中继节点,更新的中继节点与云管理平台22在预设时间段内保持连接,且更新的中继节点可与N个边缘节点保持连接。In some embodiments, as the relay node moves, the relay node may be disconnected from the cloud management platform 22 at a certain time (for example, out of the range of establishing a connection with the cloud management platform 22). For example, at time t2 after time t1, the relay node (first edge node) is disconnected from the cloud management platform 22. For example, the cloud management platform 22 may predict that the relay node will be disconnected from the cloud management platform 22 at time t2 based on the movement trajectory of the first edge node. The cloud management platform 22 may reselect an edge node from the M edge nodes as an updated relay node before the first edge node is disconnected from it. The updated relay node remains connected to the cloud management platform 22 within a preset time period, and the updated relay node may remain connected to N edge nodes.
例如,云管理平台确认H个边缘节点中的第三边缘节点作为更新的中继节点。云管理平台22可将更新的中继标识信息下发至更新的中继节点(第三边缘节点),更新的中继标识信息可经由更新的中继节点发送至N个边缘节点,更新的中继标识信息可用于指示N个边缘节点中的每个边缘节点将上报至云管理平台22的交互信息发送给更新的中继节点,由更新的中继节点转发至云管理平台22。For example, the cloud management platform confirms the third edge node among the H edge nodes as the updated relay node. The cloud management platform 22 may send the updated relay identification information to the updated relay node (the third edge node), and the updated relay identification information may be sent to the N edge nodes via the updated relay node. The updated relay identification information may be used to instruct each of the N edge nodes to send the interaction information reported to the cloud management platform 22 to the updated relay node, which is then forwarded to the cloud management platform 22 by the updated relay node.
在一些实施例中,云管理平台22也可以将更新的中继标识信息下发至当前的中继节点(第一边缘节点),由当前的中继节点将更新的中继标识信息转发给更新的中继节点(第三边缘节点)。更新的中继标识信息可经由更新中继节点或当前的中继节点发送至N个边缘节点。In some embodiments, the cloud management platform 22 may also send the updated relay identification information to the current relay node (first edge node), and the current relay node forwards the updated relay identification information to the updated relay node (third edge node). The updated relay identification information may be sent to N edge nodes via the updated relay node or the current relay node.
例如,云管理平台22可以在时刻t3(位于时刻t1与时刻t2之间)进行更新的中继节点的指定,第三边缘节点可以是H个边缘节点中,可与云管理平台22在预设时间段内保持连接的边缘节点,避免需频繁选择更新的中继节点。 For example, the cloud management platform 22 can designate a relay node to be updated at time t3 (between time t1 and time t2). The third edge node can be an edge node among H edge nodes that can maintain a connection with the cloud management platform 22 within a preset time period, avoiding the need to frequently select updated relay nodes.
在本申请实施例的一个具体应用场景中,云管理平台22可以提供面向租户的Kubernetes服务,边缘节点上可运行容器,容器可与Kubernetes服务进行交互。租户可以是指云管理平台22的用户。In a specific application scenario of the embodiment of the present application, the cloud management platform 22 can provide a tenant-oriented Kubernetes service, containers can be run on edge nodes, and containers can interact with the Kubernetes service. A tenant can refer to a user of the cloud management platform 22.
在本申请实施例的其他应用场景中,云管理平台22也可以提供面向租户的虚拟机服务,边缘节点上可运行虚拟机,虚拟机可与虚拟机服务进行交互。In other application scenarios of the embodiments of the present application, the cloud management platform 22 can also provide tenant-oriented virtual machine services, virtual machines can run on edge nodes, and the virtual machines can interact with the virtual machine services.
为了便于说明,本申请实施例将具体介绍云管理平台22提供面向租户的Kubernetes服务的场景,值得注意的是,Kubernetes服务的场景并不对本申请进行限定,本领域技术人员基于本申请揭示的技术方案可以在虚拟机服务的场景中合理应用,本申请实施例对此不作限定。如图3所示,示意出了Kubernetes的相关组成部件。Kubernetes可以包括管理节点和工作节点,管理节点主要用于管理工作节点,工作节点主要用于运行容器化的应用实例。开发人员可以通过应用编程接口客户端(例如kubectl)管理Kubernetes。管理节点中可以包括Kubernetes应用编程接口服务器(可称为kube-apiserver),调度器(可称为kube-scheduler)、控制器管理器(可称为kube-controller manager)和数据库(可称为etcd);工作节点中可以包括节点代理(可称为agent)。For ease of explanation, the embodiment of the present application will specifically introduce the scenario in which the cloud management platform 22 provides tenant-oriented Kubernetes services. It is worth noting that the scenario of Kubernetes services does not limit the present application. Based on the technical solution disclosed in the present application, those skilled in the art can reasonably apply it in the scenario of virtual machine services, and the embodiment of the present application does not limit this. As shown in Figure 3, the relevant components of Kubernetes are schematically shown. Kubernetes may include management nodes and working nodes. The management node is mainly used to manage working nodes, and the working node is mainly used to run containerized application instances. Developers can manage Kubernetes through an application programming interface client (such as kubectl). The management node may include a Kubernetes application programming interface server (which may be called kube-apiserver), a scheduler (which may be called kube-scheduler), a controller manager (which may be called kube-controller manager) and a database (which may be called etcd); the working node may include a node agent (which may be called agent).
其中,kube-apiserver是集群控制面的统一的对外接口。Pod是Kubernetes中可以创建和管理的最小调度单元,Pod由一个或多个容器组成。kube-scheduler主要用于对Pod的调度工作,负责将Pod分配到工作节点上。kube-controller manager包括Kubernetes自带的多种控制器,用于Kubernetes资源的管理,etcd可以理解为存储,用于保存集群中一些相关的数据,agent是部署在工作节点的代理,用于向kube-apiserver注册工作节点、管理Pod和上报工作节点的资源信息等。Among them, kube-apiserver is the unified external interface of the cluster control plane. Pod is the smallest scheduling unit that can be created and managed in Kubernetes. Pod consists of one or more containers. kube-scheduler is mainly used for scheduling Pods and is responsible for allocating Pods to working nodes. kube-controller manager includes a variety of controllers that come with Kubernetes, which are used to manage Kubernetes resources. etcd can be understood as storage, which is used to save some relevant data in the cluster. Agent is an agent deployed on the working node, which is used to register working nodes with kube-apiserver, manage Pods, and report resource information of working nodes.
如图4所示,本申请一个实施例提供的KubeEdge系统,该系统可以包括云管理侧与边缘节点侧两个部分。As shown in FIG. 4 , a KubeEdge system provided by an embodiment of the present application may include two parts: a cloud management side and an edge node side.
云管理侧可以包括云管理平台22,云管理平台22可以包括云端处理组件(也可称为CloudCore),CloudCore可用于处理Kubernetes中的边缘节点、应用等资源的相关信息命令,并下发到边缘节点侧,也可接收边缘处理组件上报的边缘节点、应用等资源的相关信息,同步到Kubernetes中。CloudCore可以包括边缘节点控制器(也可称为EdgeController)模块和云端通信接口(也可称为CloudHub)模块。其中,EdgeController模块用于实现边缘节点的管理和应用状态元数据云边协同;CloudHub模块用于实现云管理侧与边缘节点侧的交互信息的封装。EdgeController模块可与Kubernetes应用编程接口服务器交互。The cloud management side may include a cloud management platform 22, and the cloud management platform 22 may include a cloud processing component (also referred to as CloudCore). CloudCore can be used to process commands related to edge nodes, applications and other resources in Kubernetes, and send them to the edge node side. It can also receive related information about edge nodes, applications and other resources reported by the edge processing component and synchronize them to Kubernetes. CloudCore may include an edge node controller (also referred to as EdgeController) module and a cloud communication interface (also referred to as CloudHub) module. Among them, the EdgeController module is used to implement edge node management and application status metadata cloud-edge collaboration; the CloudHub module is used to implement the encapsulation of interactive information between the cloud management side and the edge node side. The EdgeController module can interact with the Kubernetes application programming interface server.
边缘节点侧可以包括多个边缘节点,每个边缘节点可以包括边缘处理组件(也可称为EdgeCore),EdgeCore可用于接收CloudCore下发的边缘节点、应用等资源的相关信息命令,并具体实施,还可采集边缘节点、应用等资源的相关信息,并上报到CloudCore。如图4所示,EdgeCore可以包括边缘端通信接口(也可称为EdgeHub)模块。EdgeHub模块可用于实现边缘节点侧与云管理侧的通信。The edge node side may include multiple edge nodes, each edge node may include an edge processing component (also called EdgeCore), EdgeCore may be used to receive and implement commands for information about edge nodes, applications and other resources issued by CloudCore, and may also collect information about edge nodes, applications and other resources and report it to CloudCore. As shown in Figure 4, EdgeCore may include an edge communication interface (also called EdgeHub) module. The EdgeHub module may be used to implement communication between the edge node side and the cloud management side.
可以理解的,EdgeCore还可以包括信息管理(也可称为MetaManager)模块、边缘节点代理(也称为Edged)模块等。MetaManager模块可用于实现节点级的元数据的本地持久化;Edged模块可用于轻量化实现Pod生命周期管理。每个边缘节点还具有边缘节点资源,边缘节点资源可以是指可以运行边缘计算任务的资源,如中央处理器(Central Processing Unit,CPU)、图形处理器(Graphics Processing Unit,GPU)、内存、硬盘(包括机械硬盘或固态硬盘等)和网络接口等。It is understandable that EdgeCore can also include information management (also known as MetaManager) modules, edge node agent (also known as Edged) modules, etc. The MetaManager module can be used to implement local persistence of node-level metadata; the Edged module can be used to implement lightweight Pod lifecycle management. Each edge node also has edge node resources, which can refer to resources that can run edge computing tasks, such as central processing unit (CPU), graphics processing unit (GPU), memory, hard disk (including mechanical hard disk or solid state disk, etc.) and network interface.
对于图4所示的KubeEdge系统,每个边缘节点可以通过EdgeHub模块与云管理侧的CloudHub模块建立云边通信通道,若某个边缘节点未与云管理侧建立云边通信通道(例如出于避免数据泄密的考量边缘节点不与云管理侧建立云边通信通道,或者边缘节点当前的位置超出了可与云管理侧通信的范围),将会导致该边缘节点无法向云管理侧上报信息,也无法接收云管理侧下发的信息。 For the KubeEdge system shown in Figure 4, each edge node can establish a cloud-edge communication channel with the CloudHub module on the cloud management side through the EdgeHub module. If an edge node does not establish a cloud-edge communication channel with the cloud management side (for example, the edge node does not establish a cloud-edge communication channel with the cloud management side to avoid data leakage, or the current location of the edge node is beyond the range of communication with the cloud management side), the edge node will not be able to report information to the cloud management side, nor will it be able to receive information sent by the cloud management side.
鉴于此,如图5所示,通过对图4所示的KubeEdge系统进行改进,可以使得KubeEdge系统具备节点中继通信机制。In view of this, as shown in FIG5 , by improving the KubeEdge system shown in FIG4 , the KubeEdge system can be provided with a node relay communication mechanism.
在云管理侧,CloudHub模块可以包括云端中继(也可称为CloudRelay)模块与第一通信机制(CloudHandlechanges)模块。CloudRelay模块为CloudCore中用于处理中继信息的模块,用于处理云边中继通信的信息,例如云到边信息的封装以及边到云信息的解封装,CloudHandlechanges模块可定义具备中继通信功能的云边通信机制,例如可以包括中继信息拦截、健康检查等操作。可以理解的,CloudRelay模块也可以布设于CloudHub模块之外,本申请对此不作限定。On the cloud management side, the CloudHub module may include a cloud relay (also called CloudRelay) module and a first communication mechanism (CloudHandlechanges) module. The CloudRelay module is a module in CloudCore used to process relay information, and is used to process cloud-edge relay communication information, such as the encapsulation of cloud-to-edge information and the decapsulation of edge-to-cloud information. The CloudHandlechanges module can define a cloud-edge communication mechanism with relay communication functions, which may include relay information interception, health check and other operations. It is understandable that the CloudRelay module can also be deployed outside the CloudHub module, and this application does not limit this.
在边缘节点侧,EdgeHub模块可以包括边缘中继(也可称为EdgeRelay)模块与第二通信机制(EdgeHandlechanges)模块。EdgeRelay模块为EdgeCore中用于处理中继信息的模块,例如用于处理来自云管理侧、其他边缘节点、自身节点中的其他模块的中继信息。在云边(云管理侧与边缘节点侧之间)信息处理方面,EdgeRelay模块可具有云侧信息解析、云侧信息封装、中继信息云边转发、中继节点配置信息处理等功能。在边边(边缘节点与边缘节点之间)信息处理方面,EdgeRelay模块可具有边边信息解析、边边信息封装、中继信息边边转发等功能,EdgeRelay模块还可以将需要持久化的信息(例如中继节点标识、集群节点地址等)存放至数据库,例如数据库可以设置在边缘节点上,数据库为SQLite。EdgeHandlechanges模块可定义具备中继通信功能的云边通信机制与边边通信机制,例如可以包括一些中继信息拦截等操作。可以理解,EdgeRelay模块也可以布设于EdgeHub模块之外,本申请对此不作限定。On the edge node side, the EdgeHub module may include an edge relay (also known as EdgeRelay) module and a second communication mechanism (EdgeHandlechanges) module. The EdgeRelay module is a module in EdgeCore used to process relay information, for example, it is used to process relay information from the cloud management side, other edge nodes, and other modules in its own node. In terms of cloud-edge (between the cloud management side and the edge node side) information processing, the EdgeRelay module may have functions such as cloud-side information parsing, cloud-side information encapsulation, cloud-edge forwarding of relay information, and relay node configuration information processing. In terms of edge-to-edge (between edge nodes and edge nodes) information processing, the EdgeRelay module may have functions such as edge-to-edge information parsing, edge-to-edge information encapsulation, and edge-to-edge forwarding of relay information. The EdgeRelay module can also store information that needs to be persisted (such as relay node identification, cluster node address, etc.) in a database. For example, the database can be set on the edge node, and the database is SQLite. The EdgeHandlechanges module can define a cloud-edge communication mechanism and an edge-edge communication mechanism with relay communication functions, for example, it can include some relay information interception operations. It can be understood that the EdgeRelay module can also be deployed outside the EdgeHub module, and this application does not limit this.
在一些实施例中,为了实现节点中继通信功能,etcd中的自定义资源(custom resource definitions,CRD)定义有动态中继信息为云原生资源,可以包括中继模式开关信息、中继节点标识、集群节点地址、为子网相关配置预留扩展信息等。Kubernetes还可包括中继选择(也可称为RelaySelector)模块,RelaySelector模块可通过调用kube-apiserver对CRD进行配置。In some embodiments, in order to implement the node relay communication function, the custom resource definitions (CRD) in etcd defines dynamic relay information as cloud native resources, which may include relay mode switch information, relay node identifiers, cluster node addresses, and reserved extension information for subnet-related configurations. Kubernetes may also include a relay selection (also called RelaySelector) module, which may configure CRD by calling kube-apiserver.
在一些实施例中,可以在CRD中定义中继控制信息格式(也可称为Relayrc),Relayrc可以包括Open、RelayID以及Data三个字段。Open字段代表当前中继模式是否开启,RelayID字段代表当前中继节点唯一标识,Data字段代表在当前中继信息存储版本中保存集群所有节点的唯一标识与地址信息,通过监测Relayrc的变动事件(添加事件、删除事件、更新事件)可实现更新CRD中的中继信息存储版本,添加事件一般涉及中继模式的开启,云管理平台22与边缘节点可以基于添加事件从普通模式切换至中继模式,删除事件一般涉及中继模式的关闭,云管理平台22与边缘节点可以基于删除事件从中继模式切换至普通模式,更新事件一般可涉及中继模式的开启/关闭,或者中继节点切换,或者Data字段信息更新等,云管理平台22与边缘节点可以基于更新事件所涉及的变动类型,执行对应的指令。In some embodiments, a relay control information format (also referred to as Relayrc) may be defined in CRD, and Relayrc may include three fields: Open, RelayID, and Data. The Open field represents whether the current relay mode is turned on, the RelayID field represents the unique identifier of the current relay node, and the Data field represents the unique identifier and address information of all nodes in the cluster stored in the current relay information storage version. By monitoring the change events (addition events, deletion events, and update events) of Relayrc, the relay information storage version in CRD can be updated. Addition events generally involve the opening of the relay mode. The cloud management platform 22 and the edge node can switch from the normal mode to the relay mode based on the addition event. The deletion event generally involves the closing of the relay mode. The cloud management platform 22 and the edge node can switch from the relay mode to the normal mode based on the deletion event. The update event generally involves the opening/closing of the relay mode, or the switching of the relay node, or the update of the Data field information, etc. The cloud management platform 22 and the edge node can execute the corresponding instructions based on the change type involved in the update event.
在一些实施例中,云管理平台22可以根据各个边缘节点的通信状态,进行中继节点的选择,通信状态包括是否能与云管理平台22建立连接。In some embodiments, the cloud management platform 22 may select a relay node based on the communication status of each edge node, where the communication status includes whether a connection can be established with the cloud management platform 22 .
在一些实施例中,云管理平台22也可以先根据各个边缘节点的通信状态确定可与云管理平台22连接的边缘节点,再基于边缘节点的节点资源(CPU可用资源、内存可用资源、带宽可用资源等)从这些可与云管理平台22连接的边缘节点中选择一个边缘节点作为中继节点,其他无法与云管理平台22建立连接的边缘节点通过该中继节点接入云管理平台22,除中继节点以外的其他可与云管理平台22连接的边缘节点,则不需要通过中继节点接入云管理平台22。In some embodiments, the cloud management platform 22 may also first determine the edge nodes that can be connected to the cloud management platform 22 based on the communication status of each edge node, and then select an edge node as a relay node from these edge nodes that can be connected to the cloud management platform 22 based on the node resources of the edge node (CPU available resources, memory available resources, bandwidth available resources, etc.), and other edge nodes that cannot establish a connection with the cloud management platform 22 access the cloud management platform 22 through the relay node, and other edge nodes that can be connected to the cloud management platform 22 except the relay node do not need to access the cloud management platform 22 through the relay node.
在一些实施例中,当云管理平台22确认某个边缘节点为中继节点之后,除中继节点以外的所有边缘节点也可以全部为非中继节点,非中继节点与云管理平台22的交互信息通过中继节点进行转发。In some embodiments, after the cloud management platform 22 confirms that a certain edge node is a relay node, all edge nodes except the relay node may also be non-relay nodes, and the interaction information between the non-relay nodes and the cloud management platform 22 is forwarded through the relay nodes.
可以理解,图4与图5中所涉及的模块可以是指能够完成特定功能的一系列计算机程序指令段,也可以是计算机程序指令段与硬件配合形成的功能模块,模块的 划分为一种逻辑功能划分,实际实现时可以有另外的划分方式,本申请对此不作限定。It can be understood that the modules involved in FIG. 4 and FIG. 5 may refer to a series of computer program instruction segments that can perform specific functions, or may be functional modules formed by the cooperation of computer program instruction segments and hardware. The division is a logical function division, and there may be other division methods in actual implementation, which is not limited in this application.
在一些实施例中,可以通过对云边、边边信息格式进行新的定义使得KubeEdge系统具备节点中继通信机制。In some embodiments, the KubeEdge system can have a node relay communication mechanism by redefining the cloud-edge and edge-edge information formats.
Beehive是KubeEdge中的一个通信框架,可用于KubeEdge模块之间的通信。对于云边中继信息格式而言,原有云边信息的信息结构可以包括:信息头(Header)、信息路由(Router)字段、信息内容(Content)三个字段部分。如图6a所示,可以遵照Beehive的信息机制对原有云边信息进行封装,得到云边中继信息格式。例如,将原有云边信息(包含了Header+Router+Content)进行序列化后封装至新的云边信息中的Content,及对新的云边信息中的Router中用于表征原有云边信息的信息来源或者信息目的地的字段进行修改,实现定义新的云边信息为中继类型信息。例如,对于发送至云管理侧的中继类型信息,可以对Router中的Operation字段进行修改,即云管理平台22可以通过Operation字段确定是常规的云边信息还是中继类型信息;对于发送至边缘节点侧的中继类型信息,可以对Router中的Group字段进行修改,即边缘节点可以通过Group字段确定是常规的云边信息还是中继类型信息。Beehive is a communication framework in KubeEdge, which can be used for communication between KubeEdge modules. For the cloud-edge relay information format, the information structure of the original cloud-edge information can include three fields: information header (Header), information routing (Router) field, and information content (Content). As shown in Figure 6a, the original cloud-edge information can be encapsulated according to the information mechanism of Beehive to obtain the cloud-edge relay information format. For example, the original cloud-edge information (including Header+Router+Content) is serialized and encapsulated into the Content in the new cloud-edge information, and the fields in the Router in the new cloud-edge information used to characterize the information source or information destination of the original cloud-edge information are modified to define the new cloud-edge information as relay type information. For example, for the relay type information sent to the cloud management side, the Operation field in the Router can be modified, that is, the cloud management platform 22 can determine whether it is regular cloud edge information or relay type information through the Operation field; for the relay type information sent to the edge node side, the Group field in the Router can be modified, that is, the edge node can determine whether it is regular cloud edge information or relay type information through the Group field.
对于边边中继信息格式而言,由于非中继节点与云管理平台22进行信息交互需要通过中继节点进行转发,当非中继节点上报信息至云管理平台22时,可以将本节点的节点标识(也可称为NodeID)和业务标识(ProjectID)封装至信息,及通过中继节点转发给云管理平台22。中继节点可以由云管理平台22指定,或者通过选举产生,中继节点可以实现将非中继节点的信息转发至云管理平台22,或者将云管理平台22的信息转发至非中继节点。边边中继信息格式可以采用可存储非中继节点的NodeID与ProjectID等字段的格式,如图6b所示,可以通过复用KubeEdge原有信息结构体mux.MessageContainer得到边边中继信息格式,原有边边信息结构体可以包括:信息头(Header)、信息(Message)、参数(Parameters)三个字段部分,通过将原有边边信息(Header+Message+Parameters)封装至新的边边信息中的Message,及将NodeID和ProjectID封装至新的边边信息中的Header,实现定义新的边边信息为中继类型信息。As for the edge-to-edge relay information format, since the information exchange between the non-relay node and the cloud management platform 22 needs to be forwarded through the relay node, when the non-relay node reports information to the cloud management platform 22, the node identifier (also called NodeID) and business identifier (ProjectID) of the node can be encapsulated into the information and forwarded to the cloud management platform 22 through the relay node. The relay node can be designated by the cloud management platform 22 or generated through election. The relay node can forward the information of the non-relay node to the cloud management platform 22, or forward the information of the cloud management platform 22 to the non-relay node. The edge relay information format can adopt a format that can store fields such as NodeID and ProjectID of non-relay nodes. As shown in Figure 6b, the edge relay information format can be obtained by reusing the original KubeEdge information structure mux.MessageContainer. The original edge information structure can include three field parts: information header (Header), information (Message), and parameters (Parameters). By encapsulating the original edge information (Header+Message+Parameters) into the Message in the new edge information, and encapsulating NodeID and ProjectID into the Header in the new edge information, the new edge information is defined as relay type information.
在一些实施例中,在普通模式下,云管理平台22与边缘节点是基于现有的通信方式进行通信,例如边缘节点与云管理平台22建立通信连接,边缘节点与云管理平台22直接进行信息交互。在中继模式下,云管理平台22与边缘节点之间是通过将原有信息封装成中继类型信息,进行信息交互。In some embodiments, in the normal mode, the cloud management platform 22 and the edge node communicate based on the existing communication method, for example, the edge node establishes a communication connection with the cloud management platform 22, and the edge node directly exchanges information with the cloud management platform 22. In the relay mode, the cloud management platform 22 and the edge node exchange information by encapsulating the original information into relay type information.
如图7所示,示例性的介绍云管理平台22对上行信息进行处理的流程示意图。As shown in FIG. 7 , it is a schematic diagram of an exemplary process of introducing the cloud management platform 22 processing uplink information.
在该实施例中,CloudCore包括有用于处理中继信息的CloudRelay模块,且在etcd中通过CRD对中继节点相关信息进行持久化存储。In this embodiment, CloudCore includes a CloudRelay module for processing relay information, and relay node related information is persistently stored in etcd through CRD.
S70,接收第一信息。S70, receiving first information.
在一些实施例中,CloudCore可以通过CloudHub模块接收第一信息,第一信息的来源可以是边缘节点侧。In some embodiments, CloudCore may receive the first information through a CloudHub module, and a source of the first information may be an edge node side.
S71,检测中继模式是否开启。S71, detecting whether the relay mode is turned on.
在一些实施例中,中继模式是否开启可以是指CloudCore是否开启了中继模式。In some embodiments, whether the relay mode is turned on may refer to whether the CloudCore turns on the relay mode.
S72,若中继模式未开启,采用原有流程处理第一信息。S72: If the relay mode is not enabled, the first information is processed using the original process.
在一些实施例中,若确定中继模式未开启,可以认为CloudHub模块接收到的第一信息是非中继类型信息,CloudCore可以采用原有流程处理第一信息。原有流程处理可以是指CloudCore基于现有的信息处理方式对非中继类型信息进行处理,本申请对此不在赘述。In some embodiments, if it is determined that the relay mode is not turned on, it can be considered that the first information received by the CloudHub module is non-relay type information, and CloudCore can use the original process to process the first information. The original process processing may refer to CloudCore processing non-relay type information based on the existing information processing method, which is not described in detail in this application.
S73,若中继模式开启,基于第一信息中的Operation字段确定第一信息是否为中继类型信息。 S73: If the relay mode is on, determine whether the first information is relay type information based on the Operation field in the first information.
S74,若确定第一信息不是中继类型信息,采用原有流程处理第一信息。S74: If it is determined that the first information is not relay type information, the original process is used to process the first information.
S75,若确定第一信息为中继类型信息,对第一信息进行解析,并采用原有流程处理解析后的第一信息。S75: If it is determined that the first information is relay type information, the first information is parsed, and the parsed first information is processed using the original process.
在一些实施例中,若确定第一信息为中继类型信息,可以通过CloudRelay模块对第一信息进行解析,得到解析后的第一信息,例如通过对第一信息中的Content进行反序列化,得到解析后的第一信息。由于解析后的第一信息的结构与原有的云边信息结构相同,CloudCore可以基于现有的信息处理方式对解析后的第一信息进行处理。In some embodiments, if it is determined that the first information is relay type information, the first information can be parsed by the CloudRelay module to obtain the parsed first information, for example, by deserializing the Content in the first information to obtain the parsed first information. Since the structure of the parsed first information is the same as the original cloud edge information structure, CloudCore can process the parsed first information based on the existing information processing method.
如图8所示,示例性的介绍云管理平台22对下行信息进行处理的流程示意图。As shown in FIG8 , it is a schematic diagram of an exemplary process of introducing the cloud management platform 22 processing downlink information.
S80,对待下发的第二信息进行验证。S80, verifying the second information to be sent.
在一些实施例中,CloudCore可以通过CloudHub模块下发第二信息至边缘侧,在下发第二信息之前,可以对第二信息进行验证,确定第二信息是否是重复下发的信息。若是重复下发的信息,可以放弃对第二信息的下发,否则可以执行步骤S81。In some embodiments, CloudCore can send the second information to the edge side through the CloudHub module. Before sending the second information, the second information can be verified to determine whether the second information is repeated. If it is repeated, the sending of the second information can be abandoned, otherwise step S81 can be executed.
S81,检测中继模式是否开启。S81, detecting whether the relay mode is turned on.
在一些实施例中,中继模式是否开启可以是指CloudCore是否开启了中继模式。In some embodiments, whether the relay mode is turned on may refer to whether the CloudCore turns on the relay mode.
S82,若中继模式未开启,采用原有流程下发第二信息。S82: If the relay mode is not enabled, the second information is sent using the original process.
在一些实施例中,若确定中继模式未开启,可以认为CloudHub模块下发的第二信息是非中继类型信息,CloudCore可以采用原有流程下发第二信息。原有流程处理可以是指CloudCore基于现有的信息下发方式对非中继类型信息进行下发,本申请对此不在赘述。In some embodiments, if it is determined that the relay mode is not turned on, it can be considered that the second information sent by the CloudHub module is non-relay type information, and CloudCore can use the original process to send the second information. The original process processing may refer to CloudCore sending non-relay type information based on the existing information sending method, which is not described in detail in this application.
S83,若中继模式开启,检测是否存在中继节点。S83: If the relay mode is on, detect whether there is a relay node.
在一些实施例中,非中继节点需要通过中继节点来接收云端下发的信息,若中继模式开启,可以进一步检测是否存在中继节点。若存在中继节点,可以认为下发的第二信息是中继类型信息,若不存在中继节点,可以认为下发的第二信息是非中继类型信息。In some embodiments, the non-relay node needs to receive the information sent from the cloud through the relay node. If the relay mode is turned on, it can further detect whether there is a relay node. If there is a relay node, it can be considered that the second information sent is relay type information. If there is no relay node, it can be considered that the second information sent is non-relay type information.
S84,若不存在中继节点,采用原有流程下发第二信息。S84: If there is no relay node, the second information is sent using the original process.
在一些实施例中,若不存在中继节点,可以认为下发的第二信息是非中继类型信息,CloudCore可以采用原有流程下发第二信息。In some embodiments, if there is no relay node, it can be considered that the second information sent is non-relay type information, and CloudCore can use the original process to send the second information.
S85,若存在中继节点,对第二信息进行封装,并采用原有流程下发封装后的第二信息。S85: If there is a relay node, encapsulate the second information and send the encapsulated second information using the original process.
在一些实施例中,若存在中继节点,可以认为下发的第二信息是中继类型信息,可以通过CloudRelay模块对第二信息进行封装,得到封装后的第二信息,例如可以基于图6a所示的方式对第二信息进行封装。由于封装后的第二信息的结构与原有的云边信息结构相同,CloudCore可以基于现有的信息下发方式对封装后的第二信息进行下发。In some embodiments, if there is a relay node, the second information sent can be considered to be relay type information, and the second information can be encapsulated through the CloudRelay module to obtain the encapsulated second information. For example, the second information can be encapsulated based on the method shown in Figure 6a. Since the structure of the encapsulated second information is the same as the original cloud edge information structure, CloudCore can send the encapsulated second information based on the existing information sending method.
如图9所示,示例性的介绍在边缘节点对信息进行处理的流程示意图。FIG9 is a flow chart showing an exemplary process of processing information at an edge node.
在该实施例中,EdgeCore包括用于处理中继信息的EdgeRelay模块,通过EdgeRelay模块处理来自云端、其他边缘节点、自身节点中的其他模块的中继信息,同时可以将需要持久化的信息(例如CRD定义的一些与中继模式相关的信息)存放到SQLite中。EdgeHub模块可以和EdgeRelay模块、节点中的其他模块、CloudHub模块进行通信。EdgeRelay模块可以将云端下发的信息转发给非中继节点、将其他节点的EdgeRelay模块传来的信息解析后发送给EdgeHub模块、将EdgeHub模块传来的信息封装后转发给其他节点的EdgeRelay模块。In this embodiment, EdgeCore includes an EdgeRelay module for processing relay information. The EdgeRelay module processes relay information from the cloud, other edge nodes, and other modules in its own node. At the same time, information that needs to be persisted (such as some information related to the relay mode defined by CRD) can be stored in SQLite. The EdgeHub module can communicate with the EdgeRelay module, other modules in the node, and the CloudHub module. The EdgeRelay module can forward information sent from the cloud to non-relay nodes, parse information from the EdgeRelay modules of other nodes and send it to the EdgeHub module, and encapsulate information from the EdgeHub module and forward it to the EdgeRelay modules of other nodes.
在一些实施例中,EdgeHub模块接收到的信息来源可以有三种情形:云管理侧传来的、本节点的EdgeRelay模块传来的,或者本节点的其他处理模块传来的。对于 云管理侧传来的信息,可以在验证是否是中继类型信息之后,对信息进行转发操作。对于本节点EdgeRelay模块传来的信息,如果验证本节点为中继节点,需要将信息封装发送给云端;如果验证本节点为非中继节点,确认信息为其他中继节点传来的信息,在处理后将信息转发给本节点其他处理模块。对于本节点其他模块传来的信息,可以先验证本节点是否开启中继模式,如果未开启中继模式,可以按正常流程将信息转发给云管理平台22,否则可继续验证本节点是否为中继节点。若本节点为中继节点,确认信息是本节点其他模块转来的正常信息,发送给云管理平台22;否则,将信息转给本节点的EdgeRelay模块进行进一步处理。In some embodiments, the information received by the EdgeHub module may come from three sources: from the cloud management side, from the EdgeRelay module of the node, or from other processing modules of the node. The information transmitted from the cloud management side can be forwarded after verifying whether it is relay type information. For the information transmitted from the EdgeRelay module of this node, if the node is verified to be a relay node, the information needs to be packaged and sent to the cloud; if the node is verified to be a non-relay node, the information is confirmed to be transmitted from other relay nodes, and the information is forwarded to other processing modules of this node after processing. For the information transmitted from other modules of this node, you can first verify whether the relay mode of this node is turned on. If the relay mode is not turned on, the information can be forwarded to the cloud management platform 22 according to the normal process, otherwise you can continue to verify whether this node is a relay node. If this node is a relay node, confirm that the information is normal information transmitted from other modules of this node and send it to the cloud management platform 22; otherwise, the information is forwarded to the EdgeRelay module of this node for further processing.
在一些实施例中,边缘节点对EdgeHub模块接收的信息进行处理可以包括如下步骤:In some embodiments, the edge node processes the information received by the EdgeHub module, including the following steps:
S9_0,EdgeHub模块接收第三信息。S9_0, the EdgeHub module receives the third information.
S9_1,确定第三信息是否由CloudHub模块下发。S9_1, determine whether the third information is sent by the CloudHub module.
S9_2,若确定第三信息是由CloudHub模块下发,检测中继模式是否开启。S9_2: If it is determined that the third information is sent by the CloudHub module, check whether the relay mode is turned on.
S9_3,若中继模式开启,确定第三信息是否为中继通知信息。S9_3, if the relay mode is turned on, determine whether the third information is relay notification information.
S9_4,若第三信息为中继通知信息,将第三信息发送给EdgeRelay模块,以向非中继节点广播第三信息。S9_4: If the third information is relay notification information, send the third information to the EdgeRelay module to broadcast the third information to non-relay nodes.
在一些实施例中,中继通知信息可以包括下一个中继节点标识,例如中继节点是处于运动状态,为了使得非中继节点可以与云管理平台22保持通信,由于中继节点的更新,非中继节点可能需要通过不同的中继节点进行信息转发。若确定第三信息为中继通知信息,通过EdgeRelay模块向非中继节点广播第三信息,使得非中继节点可以获知下一个中继节点标识。In some embodiments, the relay notification information may include the next relay node identifier. For example, if the relay node is in motion, in order for the non-relay node to maintain communication with the cloud management platform 22, the non-relay node may need to forward information through different relay nodes due to the update of the relay node. If the third information is determined to be relay notification information, the third information is broadcast to the non-relay node through the EdgeRelay module so that the non-relay node can learn the next relay node identifier.
S9_5,若第三信息不是中继通知信息,确定本节点为中继节点且第三信息为中继类型信息,将第三信息发送给EdgeRelay模块进行封装,以转发至非中继节点。S9_5, if the third information is not relay notification information, determine that the node is a relay node and the third information is relay type information, and send the third information to the EdgeRelay module for encapsulation to forward it to the non-relay node.
S9_6,若中继模式未开启,确定第三信息是否为中继通知信息。S9_6: If the relay mode is not enabled, determine whether the third information is relay notification information.
S9_7,若第三信息为中继通知信息,将第三信息发送给EdgeRelay模块,以向非中继节点广播第三信息。S9_7: If the third information is relay notification information, send the third information to the EdgeRelay module to broadcast the third information to non-relay nodes.
S9_8,若第三信息不是中继通知信息,采用原有流程处理第三信息。S9_8, if the third information is not relay notification information, the third information is processed using the original process.
在一些实施例中,若中继模式未开启且确认第三信息不是中继通知信息,可以认为第三信息是非中继类型信息,EdgeCore可以基于现有的信息处理方式对第三信息进行处理,本申请对此不在赘述。In some embodiments, if the relay mode is not turned on and it is confirmed that the third information is not relay notification information, the third information can be considered as non-relay type information. EdgeCore can process the third information based on the existing information processing method, which is not elaborated in this application.
S9_9,若第三信息不是由CloudHub模块下发,确定第三信息是否由EdgeRelay模块传来。S9_9: If the third information is not sent by the CloudHub module, determine whether the third information is sent by the EdgeRelay module.
S9_10,若第三信息不是由EdgeRelay模块传来的,检测中继模式是否开启。S9_10, if the third information is not sent by the EdgeRelay module, check whether the relay mode is turned on.
S9_11,若中继模式未开启,将第三信息发送给CloudHub模块。S9_11, if the relay mode is not enabled, send the third information to the CloudHub module.
S9_12,若中继模式开启,确定本节点是否为中继节点。S9_12: If the relay mode is on, determine whether this node is a relay node.
S9_13,若本节点是中继节点,将第三信息发送给CloudHub模块。S9_13, if the node is a relay node, the third information is sent to the CloudHub module.
在一些实施例中,若本节点是中继节点,表明本节点具备与云管理平台22通信的能力,可以直接将第三信息发送给CloudHub模块。In some embodiments, if the node is a relay node, it indicates that the node has the ability to communicate with the cloud management platform 22 and can directly send the third information to the CloudHub module.
S9_14,若本节点不是中继节点,确定第三信息为中继类型信息,将第三信息发送给EdgeRelay模块,以转发给中继节点。S9_14: If the node is not a relay node, determine that the third information is relay type information, and send the third information to the EdgeRelay module to forward it to the relay node.
在一些实施例中,若本节点不是中继节点,即本节点为非中继节点,由于非中继节点无法直接与云管理平台通信,非中继节点需要通过中继节点进行信息转发,即本节点的EdgeHub模块需将第三信息发送给本节点的EdgeRelay模块,以转发给中继节点的EdgeRelay模块。In some embodiments, if this node is not a relay node, that is, this node is a non-relay node, since the non-relay node cannot communicate directly with the cloud management platform, the non-relay node needs to forward information through the relay node, that is, the EdgeHub module of this node needs to send the third information to the EdgeRelay module of this node to forward it to the EdgeRelay module of the relay node.
S9_15,若第三信息是由EdgeRelay模块传来的,确定本节点是否为中继节点。S9_15: If the third information is transmitted by the EdgeRelay module, determine whether the node is a relay node.
S9_16,若本节点是中继节点,将第三信息发送给CloudHub模块。S9_16, if the node is a relay node, the third information is sent to the CloudHub module.
在一些实施例中,若第三信息是由EdgeRelay模块传来的且本节点是中继节点, 可以认为第三信息是EdgeRelay模块传来的已封装的中继类型信息,EdgeHub模块可以将第三信息发送给CloudHub模块。In some embodiments, if the third information is transmitted by the EdgeRelay module and the node is a relay node, It can be considered that the third information is the encapsulated relay type information transmitted by the EdgeRelay module, and the EdgeHub module can send the third information to the CloudHub module.
S9_17,若本节点不是中继节点,将第三信息发送给本节点的其他模块。S9_17, if the node is not a relay node, send the third information to other modules of the node.
在一些实施例中,若第三信息是由EdgeRelay模块传来的且本节点不是中继节点,可以认为第三信息是源自中继节点传来的信息,可以将经过EdgeRelay模块处理的第三信息转发给本节点其他处理模块。In some embodiments, if the third information is transmitted by the EdgeRelay module and the current node is not a relay node, the third information can be considered to be information from the relay node, and the third information processed by the EdgeRelay module can be forwarded to other processing modules of the current node.
下面结合图10a与10b,示例性的介绍本申请一实施例提供的基于云计算技术的边缘节点通信方法的应用场景示意图。10a and 10b , a schematic diagram of an application scenario of an edge node communication method based on cloud computing technology provided in an embodiment of the present application is exemplarily introduced below.
该实施例以信息中心为云系统20,各个卫星(与地球自转非同步的轨道卫星)为边缘节点为例进行说明。信息中心可以包括一个或多个设置在固定位置的地面站以及与地面站通信的卫星数据处理中心,地面站又可称地球站或地球终端站。地面站可向卫星发射信号,以及接收卫星发射的信号或者其它地面站转发来的信号等。地面站可位于地球表面或地球的大气层之中。地面站与卫星之间可以通过超高频率或极高频率频段(例如毫米波)的无线电波进行通信。当将卫星发射到既定轨道之后,卫星以锥形信号覆盖地面,卫星的在轨高度越高,信号覆盖面越大,但卫星与地面之间的信息传输延迟也会越高。This embodiment is described by taking the information center as the cloud system 20 and each satellite (orbital satellite that is not synchronized with the rotation of the earth) as an edge node as an example. The information center may include one or more ground stations arranged at a fixed position and a satellite data processing center that communicates with the ground station. The ground station may also be called an earth station or an earth terminal station. The ground station can transmit signals to the satellite, and receive signals transmitted by the satellite or forwarded by other ground stations. The ground station may be located on the surface of the earth or in the atmosphere of the earth. The ground station and the satellite can communicate through radio waves in ultra-high frequency or extremely high frequency bands (such as millimeter waves). After the satellite is launched into a predetermined orbit, the satellite covers the ground with a conical signal. The higher the altitude of the satellite in orbit, the larger the signal coverage area, but the information transmission delay between the satellite and the ground will also be higher.
以信息中心包括一个设置在地球表面的地面站为例,对于信息中心而言,某个卫星在运行的一个轨道周期内可能只有一段可以与信息中心通信的窗口期。为了避免单颗卫星信号覆盖不足的问题,可以通过部署多颗卫星组成卫星星座来实现地面信号的全覆盖。假设信息中心用于与卫星星座中的各个卫星通信,在某一时刻,信息中心可能只能与部分卫星建立通信连接。在这种卫星通信场景下,信息中心可以使用图5所示的KubeEdge系统管理卫星通信集群,通过动态中继方式来使得各个卫星在任意时刻均能与信息中心进行信息交互。For example, an information center includes a ground station set on the surface of the earth. For the information center, a satellite may only have a window period in which it can communicate with the information center during an orbital period. In order to avoid the problem of insufficient signal coverage of a single satellite, multiple satellites can be deployed to form a satellite constellation to achieve full coverage of ground signals. Assuming that the information center is used to communicate with each satellite in the satellite constellation, at a certain moment, the information center may only be able to establish a communication connection with some satellites. In this satellite communication scenario, the information center can use the KubeEdge system shown in Figure 5 to manage the satellite communication cluster, and use dynamic relay to enable each satellite to interact with the information center at any time.
信息中心可部署有云管理平台22,通过云管理平台22对各个卫星进行管理以及调用卫星数据处理中心的计算资源对卫星上报的信息进行处理。信息中心可与各个卫星(各个边缘节点)构成卫星通信集群,可以在地面完成卫星通信集群的部署,各个卫星发射到对应的卫星轨道之后,卫星通信集群以默认通信方式运行。各个边缘节点可以尝试与云管理平台22建立通信连接。The information center may be deployed with a cloud management platform 22, through which each satellite is managed and the computing resources of the satellite data processing center are called to process the information reported by the satellite. The information center may form a satellite communication cluster with each satellite (each edge node), and the deployment of the satellite communication cluster may be completed on the ground. After each satellite is launched into the corresponding satellite orbit, the satellite communication cluster operates in the default communication mode. Each edge node may attempt to establish a communication connection with the cloud management platform 22.
对于云管理平台22而言,由于卫星的信号覆盖范围有限,云管理平台22在某一时刻仅可与部分边缘节点建立通信连接。各个边缘节点(各个卫星)之间可以通过星间链路(是指用于卫星之间通信的链路,也可称为星际链路或交叉链路)进行通信。即对于当前未与云管理平台22建立通信连接的卫星而言,其与云管理平台22交互的信息可由其他可与云管理平台22建立通信连接的卫星(作为中继节点)转发给云管理平台22。For the cloud management platform 22, due to the limited signal coverage of the satellite, the cloud management platform 22 can only establish communication connections with some edge nodes at a certain time. Each edge node (each satellite) can communicate with each other through an intersatellite link (referring to a link used for communication between satellites, also known as an intersatellite link or a cross link). That is, for a satellite that currently has no communication connection with the cloud management platform 22, the information it interacts with the cloud management platform 22 can be forwarded to the cloud management platform 22 by other satellites (as relay nodes) that can establish communication connections with the cloud management platform 22.
在一些实施例中,云管理平台22可以根据预设中继选择算法确定某个边缘节点为中继节点,在确定中继节点之后,可以将中继节点的相关信息存入CRD中。可以理解的,选定的中继节点是可直接与云管理平台22通信的边缘节点,之后每次切换的中继节点同样需确保是可直接与云管理平台22通信的边缘节点。例如,对于各个卫星而言,云管理平台22是可以获知各个卫星的运行轨迹的,即可确定各个卫星在任意时刻的位置,预设中继选择算法可以是根据各个卫星的位置来选择某个卫星作为中继节点。比如,将某个进入信息中心的通信范围的卫星设定为中继节点,在该卫星即将离开信息中心的通信范围之前,再次选定下一个进入信息中心的通信范围的卫星为中继节点。In some embodiments, the cloud management platform 22 can determine that a certain edge node is a relay node according to a preset relay selection algorithm. After determining the relay node, the relevant information of the relay node can be stored in the CRD. It can be understood that the selected relay node is an edge node that can communicate directly with the cloud management platform 22, and each subsequent switched relay node must also ensure that it is an edge node that can communicate directly with the cloud management platform 22. For example, for each satellite, the cloud management platform 22 can know the trajectory of each satellite, that is, it can determine the position of each satellite at any time. The preset relay selection algorithm can be to select a satellite as a relay node based on the position of each satellite. For example, a satellite that enters the communication range of the information center is set as a relay node. Before the satellite is about to leave the communication range of the information center, the next satellite that enters the communication range of the information center is selected as a relay node.
在监测到CRD信息发生变动时,可以从CRD查询到中继节点的信息(例如中继节点的唯一标识、地址等),云管理平台22可以向中继节点下发中继标识信息。中继标识信息可以包括中继模式开关信息、中继节点标识、集群节点地址等。云管理平台22向中继节点下发中继标识信息之后,可等待中继节点的反馈信息。当接收到中继节点的反馈信息时,表明中继节点已成功收到中继标识信息,云管理平台22可以切换为中继 模式。When a change in CRD information is detected, the information of the relay node (such as the unique identifier and address of the relay node) can be queried from the CRD, and the cloud management platform 22 can send the relay identification information to the relay node. The relay identification information may include relay mode switch information, relay node identification, cluster node address, etc. After the cloud management platform 22 sends the relay identification information to the relay node, it can wait for feedback information from the relay node. When the feedback information of the relay node is received, it indicates that the relay node has successfully received the relay identification information, and the cloud management platform 22 can switch to relay. model.
中继节点接收到中继标识信息之后,可以切换为中继模式。中继节点还可向非中继节点广播中继标识信息。例如向非中继节点广播中继模式开关信息、中继节点标识、集群节点地址。After receiving the relay identification information, the relay node can switch to the relay mode. The relay node can also broadcast the relay identification information to the non-relay nodes. For example, the relay mode switch information, relay node identification, and cluster node address are broadcast to the non-relay nodes.
在一些实施例中,非中继节点可以是当前未能与云管理平台22建立通信连接的边缘节点。非中继节点在接收到中继节点广播的中继标识信息之后,可以切换为中继模式。非中继节点在切换为中继模式之后,可先通过中继节点向云管理平台22上报一次节点状态信息(例如节点存活状态、节点资源信息等)。此后非中继节点与云管理平台22的交互信息可通过中继节点进行转发,例如云管理平台22可以通过中继节点向各非中继节点下发资源管控信息、应用的生命周期管理信息、任务信息等。各个非中继节点同样可以通过中继节点向云管理平台22上报任务执行信息等。非中继节点向云管理平台22上报的信息,可以由中继节点对信息进行封装(基于云边信息格式进行封装)后转发给云管理平台22,云管理平台22下发至非中继节点的信息,同样可以由中继节点对信息进行封装(基于边边信息格式进行封装)后转发到非中继节点。In some embodiments, the non-relay node may be an edge node that is currently unable to establish a communication connection with the cloud management platform 22. After receiving the relay identification information broadcast by the relay node, the non-relay node may switch to the relay mode. After switching to the relay mode, the non-relay node may first report the node status information (such as node survival status, node resource information, etc.) to the cloud management platform 22 once through the relay node. Thereafter, the interaction information between the non-relay node and the cloud management platform 22 may be forwarded through the relay node. For example, the cloud management platform 22 may send resource management information, application lifecycle management information, task information, etc. to each non-relay node through the relay node. Each non-relay node may also report task execution information, etc. to the cloud management platform 22 through the relay node. The information reported by the non-relay nodes to the cloud management platform 22 can be encapsulated by the relay nodes (encapsulated based on the cloud-edge information format) and then forwarded to the cloud management platform 22. The information sent by the cloud management platform 22 to the non-relay nodes can also be encapsulated by the relay nodes (encapsulated based on the edge information format) and then forwarded to the non-relay nodes.
如图10a所示,假设当前可与云管理平台22通信的边缘节点为边缘节点node1,通过将边缘节点node1设置为中继节点,使得其他边缘节点node2、边缘节点node3与边缘节点node4可以通过边缘节点node1与云管理平台22进行信息交互。As shown in Figure 10a, assuming that the edge node that can currently communicate with the cloud management platform 22 is edge node node1, by setting edge node node1 as a relay node, other edge nodes node2, edge node node3 and edge node node4 can interact with the cloud management platform 22 through edge node node1.
在一些实施例中,若存在边缘节点的加入或者删除操作时,可以将节点的加入或者删除信息存储至CRD,在监测到CRD信息发生变动时,云管理平台22可以下发新的集群节点地址至中继节点,由中继节点广播给各个非中继节点。In some embodiments, if there is an operation of adding or deleting an edge node, the node addition or deletion information can be stored in the CRD. When the CRD information is monitored to change, the cloud management platform 22 can send a new cluster node address to the relay node, which is broadcasted to each non-relay node by the relay node.
在一些实施例中,由于卫星在绕地球转动的一个周期内只能与云管理平台22通信一个单位窗口时间,为了避免中继节点无法与云管理平台22进行通信,需要进行中继节点的切换。可以在当前中继节点将要脱离信息中心的通信范围之前,云管理平台22将更新的中继节点的中继标识信息(以下称为新中继标识信息)发送给当前中继节点,当前中继节点接收到新中继标识信息之后,可以将新中继标识信息转发给更新的中继节点。更新的中继节点在接收到新中继标识信息之后,可以通过当前中继节点向云管理平台22发送一个反馈信息,云管理平台22与当前中继节点可以基于新中继标识信息进行中继信息的更新。当前中继节点还可以向其他非中继节点广播新中继标识信息,通知其他非中继节点进行中继信息的更新,或者由更新的中继节点向其他非中继节点广播新中继标识信息。此后非中继节点与云管理平台22的交互信息可通过更新的中继节点进行转发。In some embodiments, since the satellite can only communicate with the cloud management platform 22 for a unit window time in one cycle of rotation around the earth, in order to avoid the relay node being unable to communicate with the cloud management platform 22, it is necessary to switch the relay node. Before the current relay node is about to leave the communication range of the information center, the cloud management platform 22 sends the relay identification information of the updated relay node (hereinafter referred to as the new relay identification information) to the current relay node. After the current relay node receives the new relay identification information, the new relay identification information can be forwarded to the updated relay node. After receiving the new relay identification information, the updated relay node can send a feedback information to the cloud management platform 22 through the current relay node, and the cloud management platform 22 and the current relay node can update the relay information based on the new relay identification information. The current relay node can also broadcast the new relay identification information to other non-relay nodes, notify other non-relay nodes to update the relay information, or the updated relay node broadcasts the new relay identification information to other non-relay nodes. Thereafter, the interaction information between the non-relay node and the cloud management platform 22 can be forwarded through the updated relay node.
如图10b所示,假设当前的中继节点为边缘节点node1,更新的中继节点为边缘节点node2,边缘节点node3与边缘节点node4可以通过边缘节点node2与云管理平台22进行信息交互,对于边缘节点node1而言,在脱离信息中心的通信范围之后,同样需要通过边缘节点node2与云管理平台22进行信息交互。As shown in Figure 10b, assuming that the current relay node is edge node node1, and the updated relay node is edge node node2, edge node node3 and edge node node4 can interact with the cloud management platform 22 through edge node node2. For edge node node1, after leaving the communication range of the information center, it also needs to interact with the cloud management platform 22 through edge node node2.
在一些实施例中,卫星通信集群在实际运行过程中,可能会出现中继标识信息下发失败、中继节点转发新的中继标识信息失败、或者交互信息不可达(例如无法顺利传输至云管理平台22)等情形。对于中继标识信息下发失败或中继节点转发中继标识信息失败的情况,可以通过预设分布式选举算法实现边缘节点自主选举产生一个中继节点,或者在下发/转发流程中加入失败重试机制;对于交互信息不可达情形,例如长时间接收不到云管理平台22的信息时,自动从中继模式切换为普通模式。In some embodiments, during the actual operation of the satellite communication cluster, there may be situations such as failure to send relay identification information, failure to forward new relay identification information by the relay node, or unreachable interactive information (for example, failure to be successfully transmitted to the cloud management platform 22). For situations where the relay identification information fails to be sent or the relay node fails to forward the relay identification information, the edge node can autonomously elect a relay node through a preset distributed election algorithm, or a failure retry mechanism can be added to the sending/forwarding process; for situations where interactive information is unreachable, such as when the information of the cloud management platform 22 cannot be received for a long time, the relay mode is automatically switched to the normal mode.
在一些实施例中,卫星通信集群也可以仅部署该预设分布式选举算法实现中继节点的产生、切换,即不由云管理平台22进行中继节点的指定。基于预设分布式选举算法实现中继节点的产生、切换具备分布式、内源性、动态性三种特性。分布式特性即中继节点的产生、切换过程是分布式的,基于边缘节点之间的分布式选举与分布式信息交互实现的。内源性特性即是由边缘节点自发发起并完成中继节点的产生、切换过程,不需要依赖外部的云管理平台22来发布中继节点切换命令及选择命令。动态性特性即是否 需要产生中继节点或者切换中继节点,是由各个边缘节点根据与云管理平台22的通信状态进行动态判断的。In some embodiments, the satellite communication cluster may also only deploy the preset distributed election algorithm to realize the generation and switching of relay nodes, that is, the cloud management platform 22 does not designate the relay nodes. The generation and switching of relay nodes based on the preset distributed election algorithm has three characteristics: distributed, endogenous, and dynamic. The distributed characteristic is that the generation and switching process of relay nodes is distributed, and is realized based on distributed elections and distributed information interaction between edge nodes. The endogenous characteristic is that the generation and switching process of relay nodes is spontaneously initiated and completed by the edge node, and there is no need to rely on the external cloud management platform 22 to issue relay node switching commands and selection commands. The dynamic characteristic is whether The need to generate a relay node or switch a relay node is dynamically determined by each edge node based on the communication status with the cloud management platform 22 .
在一些实施例中,预设分布式选举算法可以包括基于各个边缘节点与云管理平台22的通信能力、节点资源(例如CPU可用资源、内存可用资源、带宽可用资源等)选举产生一个中继节点,中继节点产生之后同样可以通过广播中继标识信息,使得其他各个边缘节点可以获知当前选举产生的中继节点的标识,以便通过中继节点接入云管理平台22。触发进行中继节点选举的方式可以是当前指定的(云管理平台22指定)或者选举产生的中继节点出现故障,或者当前指定的或者选举产生的中继节点在预设时间内无法与云管理平台22建立通信连接,或者某个边缘节点未接收到中继标识信息,且在预设时间内无法与云管理平台22建立通信连接等。In some embodiments, the preset distributed election algorithm may include electing a relay node based on the communication capabilities of each edge node and the cloud management platform 22, node resources (such as CPU available resources, memory available resources, bandwidth available resources, etc.), and after the relay node is generated, the relay identification information may also be broadcast so that other edge nodes can know the identification of the currently elected relay node, so as to access the cloud management platform 22 through the relay node. The way to trigger the election of the relay node may be that the currently designated (specified by the cloud management platform 22) or elected relay node fails, or the currently designated or elected relay node cannot establish a communication connection with the cloud management platform 22 within a preset time, or a certain edge node does not receive the relay identification information and cannot establish a communication connection with the cloud management platform 22 within a preset time, etc.
在一些实施例中,同样可以使用具备节点中继通信机制的KubeEdge系统管理智能车集群、机器人集群、无人机集群等,以解决移动中的智能车、机器人、无人机等无法全部与云管理平台22进行通信的情形。对于智能车集群、机器人集群、无人机集群而言,云管理平台22可以部署在指定位置的服务器,例如设置在某个计算中心的服务器,边缘节点可以是各个智能车、各个机器人、各个无人机。In some embodiments, the KubeEdge system with a node relay communication mechanism can also be used to manage smart car clusters, robot clusters, drone clusters, etc., to solve the situation where the moving smart cars, robots, drones, etc. cannot all communicate with the cloud management platform 22. For smart car clusters, robot clusters, and drone clusters, the cloud management platform 22 can be deployed on a server at a specified location, such as a server set up in a computing center, and the edge nodes can be each smart car, each robot, and each drone.
如图11所示,为本申请一实施例提供一种云管理平台22。云管理平台22可以包括确认模块221、发送模块222、接收模块223、处理模块224及下发模块225。以云管理平台22用于管理M个边缘节点,M个边缘节点中的H个边缘节点与云管理平台22连接,M个边缘节点中的N个边缘节点未能与云管理平台22连接为例进行说明。As shown in FIG11 , a cloud management platform 22 is provided for an embodiment of the present application. The cloud management platform 22 may include a confirmation module 221, a sending module 222, a receiving module 223, a processing module 224, and a sending module 225. The cloud management platform 22 is used to manage M edge nodes, H edge nodes among the M edge nodes are connected to the cloud management platform 22, and N edge nodes among the M edge nodes fail to connect to the cloud management platform 22.
确认模块221,用于确认H个边缘节点中的第一边缘节点作为中继节点。其中中继节点与N个边缘节点连接。The confirmation module 221 is used to confirm that the first edge node among the H edge nodes is used as a relay node, wherein the relay node is connected to the N edge nodes.
发送模块222,用于将需发送至N个边缘节点中的第二边缘节点的第一交互信息发送至中继节点。第一交互信息经由中继节点转发至第二边缘节点。The sending module 222 is configured to send the first interaction information to be sent to the second edge node among the N edge nodes to the relay node. The first interaction information is forwarded to the second edge node via the relay node.
接收模块223,用于接收中继节点发送的第二交互信息。第二交互信息由第二边缘节点发送至中继节点。The receiving module 223 is configured to receive second interaction information sent by the relay node. The second interaction information is sent by the second edge node to the relay node.
处理模块224,用于调用基础设施21的云计算资源对第二交互信息进行处理。The processing module 224 is used to call the cloud computing resources of the infrastructure 21 to process the second interaction information.
下发模块225,用于下发中继标识信息至中继节点。中继标识信息包括中继节点标识,中继标识信息经由中继节点发送至N个边缘节点,中继标识信息用于指示N个边缘节点中的第二边缘节点将上报至云管理平台22的第二交互信息发送给中继节点。The sending module 225 is used to send the relay identification information to the relay node. The relay identification information includes the relay node identification, and the relay identification information is sent to the N edge nodes via the relay node. The relay identification information is used to indicate that the second edge node among the N edge nodes sends the second interaction information reported to the cloud management platform 22 to the relay node.
在一些实施例中,确认模块221还用于基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台22连接,及从H个边缘节点中选择第一边缘节点作为中继节点,通信状态包括是否能与云管理平台22建立连接。In some embodiments, the confirmation module 221 is also used to confirm that H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node among the M edge nodes, and select the first edge node from the H edge nodes as a relay node, and the communication status includes whether a connection can be established with the cloud management platform 22.
在一些实施例中,确认模块221还用于在中继节点与云管理平台22断开连接之前,基于M个边缘节点中的每个边缘节点的通信状态,从M个边缘节点中重新选择一个边缘节点作为更新的中继节点。其中更新的中继节点与云管理平台22在预设时间段内保持连接,更新的中继节点可与N个边缘节点保持连接。In some embodiments, the confirmation module 221 is further configured to reselect an edge node from the M edge nodes as an updated relay node based on the communication status of each edge node in the M edge nodes before the relay node is disconnected from the cloud management platform 22. The updated relay node maintains connection with the cloud management platform 22 within a preset time period, and the updated relay node can maintain connection with N edge nodes.
在一些实施例中,确认模块221还用于基于M个边缘节点中的每个边缘节点的通信状态确认H个边缘节点与云管理平台22连接,及确认从H个边缘节点之间选举产生的第一边缘节点作为中继节点。In some embodiments, the confirmation module 221 is further used to confirm that the H edge nodes are connected to the cloud management platform 22 based on the communication status of each edge node among the M edge nodes, and to confirm that the first edge node elected from among the H edge nodes is used as a relay node.
在一些实施例中,下发模块225还用于将更新的中继标识信息下发至更新的中继节点。其中,更新的中继标识信息经由更新的中继节点发送至N个边缘节点,中继标识信息用于指示N个边缘节点中的第二边缘节点将上报至云管理平台的第三交互信息发送给更新的中继节点。接收模块223还用于接收更新的中继节点转发的第三交互信息。In some embodiments, the sending module 225 is further used to send the updated relay identification information to the updated relay node. The updated relay identification information is sent to the N edge nodes via the updated relay node, and the relay identification information is used to indicate that the second edge node among the N edge nodes sends the third interaction information reported to the cloud management platform to the updated relay node. The receiving module 223 is also used to receive the third interaction information forwarded by the updated relay node.
其中,确认模块221、发送模块222、接收模块223、处理模块224及下发模块225均可以通过软件实现,或者可以通过硬件实现。示例性的,接下来以确认模块221为例,介绍确认模块221的实现方式。类似的,发送模块222、接收模块223、处理模块224及下 发模块225的实现方式可以参考确认模块221的实现方式。Among them, the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 can all be implemented by software, or can be implemented by hardware. Exemplarily, the following takes the confirmation module 221 as an example to introduce the implementation method of the confirmation module 221. Similarly, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 The implementation of the sending module 225 may refer to the implementation of the confirming module 221 .
模块作为软件功能单元的一种举例,确认模块221可以包括运行在计算实例上的代码。其中,计算实例可以包括物理主机(计算设备)、虚拟机、容器中的至少一种。进一步地,上述计算实例可以是一台或者多台。例如,确认模块221可以包括运行在多个主机/虚拟机/容器上的代码。需要说明的是,用于运行该代码的多个主机/虚拟机/容器可以分布在相同的区域(region)中,也可以分布在不同的region中。进一步地,用于运行该代码的多个主机/虚拟机/容器可以分布在相同的可用区(availability zone,AZ)中,也可以分布在不同的AZ中,每个AZ包括一个数据中心或多个地理位置相近的数据中心。其中,通常一个region可以包括多个AZ。As an example of a software functional unit, the confirmation module 221 may include code running on a computing instance. Among them, the computing instance may include at least one of a physical host (computing device), a virtual machine, and a container. Further, the above-mentioned computing instance may be one or more. For example, the confirmation module 221 may include code running on multiple hosts/virtual machines/containers. It should be noted that the multiple hosts/virtual machines/containers used to run the code may be distributed in the same region (region) or in different regions. Furthermore, the multiple hosts/virtual machines/containers used to run the code may be distributed in the same availability zone (AZ) or in different AZs, each AZ including one data center or multiple data centers with close geographical locations. Among them, usually a region may include multiple AZs.
同样,用于运行该代码的多个主机/虚拟机/容器可以分布在同一个虚拟私有云(virtual private cloud,VPC)中,也可以分布在多个VPC中。其中,通常一个VPC设置在一个region内,同一region内两个VPC之间,以及不同region的VPC之间跨区通信需在每个VPC内设置通信网关,经通信网关实现VPC之间的互连。Similarly, multiple hosts/virtual machines/containers used to run the code can be distributed in the same virtual private cloud (VPC) or in multiple VPCs. Usually, a VPC is set up in a region. For cross-region communication between two VPCs in the same region and between VPCs in different regions, a communication gateway needs to be set up in each VPC to achieve interconnection between VPCs through the communication gateway.
模块作为硬件功能单元的一种举例,确认模块221可以包括至少一个计算设备,如服务器等。或者,确认模块221也可以是利用专用集成电路(application-specific integrated circuit,ASIC)实现、或可编程逻辑器件(programmable logic device,PLD)实现的设备等。其中,上述PLD可以是复杂程序逻辑器件(complex programmable logical device,CPLD)、现场可编程门阵列(field-programmable gate array,FPGA)、通用阵列逻辑(generic array logic,GAL)或其任意组合实现。As an example of a hardware functional unit, the confirmation module 221 may include at least one computing device, such as a server, etc. Alternatively, the confirmation module 221 may also be a device implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
确认模块221包括的多个计算设备可以分布在相同的region中,也可以分布在不同的region中。确认模块221包括的多个计算设备可以分布在相同的AZ中,也可以分布在不同的AZ中。同样,确认模块221包括的多个计算设备可以分布在同一个VPC中,也可以分布在多个VPC中。其中,所述多个计算设备可以是服务器、ASIC、PLD、CPLD、FPGA和GAL等计算设备的任意组合。The multiple computing devices included in the confirmation module 221 can be distributed in the same region or in different regions. The multiple computing devices included in the confirmation module 221 can be distributed in the same AZ or in different AZs. Similarly, the multiple computing devices included in the confirmation module 221 can be distributed in the same VPC or in multiple VPCs. The multiple computing devices can be any combination of computing devices such as servers, ASICs, PLDs, CPLDs, FPGAs, and GALs.
需要说明的是,在其他实施例中,确认模块221可以用于执行基于云计算技术的边缘节点通信方法中的任意步骤,发送模块222可以用于执行基于云计算技术的边缘节点通信方法中的任意步骤,接收模块223可以用于执行基于云计算技术的边缘节点通信方法中的任意步骤,处理模块224可以用于执行基于云计算技术的边缘节点通信方法中的任意步骤,下发模块225可以用于执行基于云计算技术的边缘节点通信方法中的任意步骤,确认模块221、发送模块222、接收模块223、处理模块224及下发模块225负责实现的步骤可根据需要指定,通过确认模块221、发送模块222、接收模块223、处理模块224及下发模块225分别实现基于云计算技术的边缘节点通信方法中不同的步骤来实现云管理平台22的全部功能。It should be noted that, in other embodiments, the confirmation module 221 can be used to execute any step in the edge node communication method based on cloud computing technology, the sending module 222 can be used to execute any step in the edge node communication method based on cloud computing technology, the receiving module 223 can be used to execute any step in the edge node communication method based on cloud computing technology, the processing module 224 can be used to execute any step in the edge node communication method based on cloud computing technology, and the sending module 225 can be used to execute any step in the edge node communication method based on cloud computing technology. The steps that the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 are responsible for implementing can be specified as needed. The confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225 respectively implement different steps in the edge node communication method based on cloud computing technology to realize all the functions of the cloud management platform 22.
如图12所示,为本申请实施例提供的一种计算设备100,计算设备100包括:总线102、处理器104、存储器106和通信接口108。处理器104、存储器106和通信接口108之间通过总线102通信。计算设备100可以是服务器或终端设备。应理解,本申请不限定计算设备100中的处理器、存储器的个数。As shown in FIG12 , a computing device 100 is provided in an embodiment of the present application, and the computing device 100 includes: a bus 102, a processor 104, a memory 106, and a communication interface 108. The processor 104, the memory 106, and the communication interface 108 communicate with each other through the bus 102. The computing device 100 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 100.
总线102可以是外设部件互连标准(peripheral component interconnect,PCI)总线或扩展工业标准结构(extended industry standard architecture,EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,图12中仅用一条线表示,但并不表示仅有一根总线或一种类型的总线。总线104可包括在计算设备100各个部件(例如,存储器106、处理器104、通信接口108)之间传送信息的通路。The bus 102 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one line is used in FIG. 12, but it does not mean that there is only one bus or one type of bus. The bus 104 may include a path for transmitting information between various components of the computing device 100 (e.g., the memory 106, the processor 104, and the communication interface 108).
处理器104可以包括中央处理器(central processing unit,CPU)、图形处理器(graphics processing unit,GPU)、微处理器(micro processor,MP)或者数字信号处理器(digital signal processor,DSP)等处理器中的任意一种或多种。The processor 104 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP) or a digital signal processor (DSP).
存储器106可以包括易失性存储器(volatile memory),例如随机存取存储器(random access memory,RAM)。处理器104还可以包括非易失性存储器(non-volatile memory),例如只读存储器(read-only memory,ROM),快闪存储器,机械硬盘(hard disk drive,HDD)或固态硬盘(solid state drive,SSD)。The memory 106 may include a volatile memory, such as a random access memory (RAM). The processor 104 may also include a non-volatile memory (non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).
存储器106中存储有可执行的程序代码,处理器104执行该可执行的程序代码以分别实现前述确认模块221、发送模块222、接收模块223、处理模块224及下发模块225的功能,从而实现基于云计算技术的边缘节点通信方法。也即,存储器106上存有用于执行基于云计算技术的边缘节点通信方法的指令。在图12中以处理器104执行该可执行的程序代码以分别实现前述确认模块221、发送模块222、接收模块223、处理模块224及下发模块225的功能为例。The memory 106 stores executable program codes, and the processor 104 executes the executable program codes to respectively implement the functions of the aforementioned confirmation module 221, the sending module 222, the receiving module 223, the processing module 224, and the sending module 225, thereby realizing the edge node communication method based on cloud computing technology. That is, the memory 106 stores instructions for executing the edge node communication method based on cloud computing technology. In FIG12, the processor 104 executes the executable program codes to respectively implement the functions of the aforementioned confirmation module 221, the sending module 222, the receiving module 223, the processing module 224, and the sending module 225 as an example.
通信接口108使用例如但不限于网络接口卡、收发器一类的收发模块,来实现计算设备100与其他设备或通信网络之间的通信。The communication interface 108 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 100 and other devices or a communication network.
本申请实施例还提供了一种计算设备集群10。该计算设备集群10包括至少一台计算设备。该计算设备可以是用于进行数据存储的服务器,或者是本地数据中心中的本地服务器。在一些实施例中,计算设备也可以是台式机、笔记本电脑或者智能手机等终端设备。The embodiment of the present application also provides a computing device cluster 10. The computing device cluster 10 includes at least one computing device. The computing device may be a server for data storage, or a local server in a local data center. In some embodiments, the computing device may also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.
如图13所示,计算设备集群10包括至少一个计算设备100。计算设备集群中的一个或多个计算设备500中的存储器514中可以存有相同的云管理平台用于执行基于云计算技术的边缘节点通信方法的指令。As shown in Fig. 13, the computing device cluster 10 includes at least one computing device 100. The memory 514 in one or more computing devices 500 in the computing device cluster may store instructions for executing the edge node communication method based on cloud computing technology on the same cloud management platform.
在一些可能的实现方式中,该计算设备集群中的一个或多个计算设备100也可以用于执行云管理平台用于执行基于云计算技术的边缘节点通信方法的部分指令。换言之,一个或多个计算设备100的组合可以共同执行云管理平台用于执行基于云计算技术的边缘节点通信方法的指令。In some possible implementations, one or more computing devices 100 in the computing device cluster may also be used to execute some instructions of the cloud management platform for executing the edge node communication method based on cloud computing technology. In other words, a combination of one or more computing devices 100 may jointly execute instructions of the cloud management platform for executing the edge node communication method based on cloud computing technology.
需要说明的是,计算设备集群中的不同的计算设备100中的存储器106可以存储不同的指令,用于执行云管理平台的部分功能。也即,不同的计算设备100中的存储器106存储的指令可以实现确认模块221、发送模块222、接收模块223、处理模块224及下发模块225中的一个或多个模块的功能。It should be noted that the memory 106 in different computing devices 100 in the computing device cluster can store different instructions for executing some functions of the cloud management platform. That is, the instructions stored in the memory 106 in different computing devices 100 can implement the functions of one or more modules in the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224 and the sending module 225.
如图14所示,计算设备集群10中的一个或多个计算设备可以通过网络连接。其中,所述网络可以是广域网或局域网等等。图14示出了一种可能的实现方式。如图14所示,两个计算设备100A和100B之间通过网络进行连接,以实现确认模块221、发送模块222、接收模块223、处理模块224及下发模块225中的一个或多个模块的功能为例。具体地,通过各个计算设备中的通信接口与所述网络进行连接。在这一类可能的实现方式中,计算设备100A中的存储器106中存有执行确认模块221、发送模块222及接收模块223的功能的指令。同时,计算设备100B中的存储器106中存有执行处理模块224及下发模块225的功能的指令。As shown in FIG14 , one or more computing devices in the computing device cluster 10 can be connected via a network. The network may be a wide area network or a local area network, etc. FIG14 shows a possible implementation. As shown in FIG14 , two computing devices 100A and 100B are connected via a network, taking the functions of one or more modules in the confirmation module 221, the sending module 222, the receiving module 223, the processing module 224, and the sending module 225 as an example. Specifically, the network is connected via a communication interface in each computing device. In this type of possible implementation, the memory 106 in the computing device 100A stores instructions for executing the functions of the confirmation module 221, the sending module 222, and the receiving module 223. At the same time, the memory 106 in the computing device 100B stores instructions for executing the functions of the processing module 224 and the sending module 225.
图14所示的计算设备集群10之间的连接方式可以是考虑到本申请提供的基于云计算技术的边缘节点通信方法需要大量地存储数据和读取数据,因此考虑将处理模块224及下发模块225实现的功能交由计算设备100B执行。The connection method between the computing device cluster 10 shown in Figure 14 can be considered to be that the edge node communication method based on cloud computing technology provided in this application requires a large amount of data storage and reading, so it is considered to hand over the functions implemented by the processing module 224 and the sending module 225 to the computing device 100B for execution.
应理解,图14中示出的计算设备100A的功能也可以由多个计算设备100完成。同样,计算设备100B的功能也可以由多个计算设备100完成。It should be understood that the functions of the computing device 100A shown in FIG14 may also be completed by multiple computing devices 100. Similarly, the functions of the computing device 100B may also be completed by multiple computing devices 100.
在一些可能的实现方式中,该计算设备集群10中的一个或多个计算设备100的存储器106中也可以分别存有用于执行基于云计算技术的边缘节点通信方法的部分指令。换言之,一个或多个计算设备100的组合可以共同执行用于执行基于云计算技术的边缘节点通信方法的指令。In some possible implementations, the memory 106 of one or more computing devices 100 in the computing device cluster 10 may also respectively store some instructions for executing the edge node communication method based on cloud computing technology. In other words, the combination of one or more computing devices 100 can jointly execute the instructions for executing the edge node communication method based on cloud computing technology.
本申请实施例还提供了一种包含指令的计算机程序产品。所述计算机程序产品可以是包含指令的,能够运行在计算设备上或被储存在任何可用介质中的软件或程序产品。当所述计算机程序产品在至少一个计算设备上运行时,使得至少一个计算设备执行基于云计算技术的边缘节点通信方法。 The embodiment of the present application also provides a computer program product including instructions. The computer program product may be a software or program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computing device, the at least one computing device executes an edge node communication method based on cloud computing technology.
本申请实施例还提供了一种计算机可读存储介质。所述计算机可读存储介质可以是计算设备能够存储的任何可用介质或者是包含一个或多个可用介质的数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘)等。该计算机可读存储介质包括指令,所述指令指示计算设备执行基于云计算技术的边缘节点通信方法。The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by the computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute an edge node communication method based on cloud computing technology.
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
在本申请所提供的几个实施例中,应所述理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例是示意性的,例如,所述模块或单元的划分,为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are schematic. For example, the division of the modules or units is a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者所述技术方案的全部或部分可以以软件产品的形式体现出来,所述软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。 The above description is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application.
Claims (19)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310100895.5A CN118524130A (en) | 2023-02-10 | 2023-02-10 | Edge node communication method and related equipment based on cloud computing technology |
| CN202310100895.5 | 2023-02-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024165016A1 true WO2024165016A1 (en) | 2024-08-15 |
Family
ID=92262035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2024/076306 Ceased WO2024165016A1 (en) | 2023-02-10 | 2024-02-06 | Edge node communication method based on cloud computing technology, and related device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN118524130A (en) |
| WO (1) | WO2024165016A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120281770A (en) * | 2025-06-10 | 2025-07-08 | 中铁电气化局集团第一工程有限公司 | Data transmission method and device based on cloud edge cooperative system and cloud edge cooperative system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111935246A (en) * | 2020-07-21 | 2020-11-13 | 山东省计算中心(国家超级计算济南中心) | User generated content uploading method and system based on cloud edge collaboration |
| WO2020253266A1 (en) * | 2019-06-15 | 2020-12-24 | 华为技术有限公司 | Method for providing edge service, apparatus and device |
| CN112910713A (en) * | 2021-03-02 | 2021-06-04 | 山东省计算中心(国家超级计算济南中心) | Cloud-edge data distribution transmission method, edge node, control center and storage medium |
| CN115277544A (en) * | 2021-04-13 | 2022-11-01 | 华为云计算技术有限公司 | Path construction method based on cloud service and related equipment thereof |
| WO2022235303A1 (en) * | 2021-05-03 | 2022-11-10 | Vmware, Inc. | On demand routing mesh for routing packets through sd-wan edge forwarding nodes in an sd-wan |
-
2023
- 2023-02-10 CN CN202310100895.5A patent/CN118524130A/en active Pending
-
2024
- 2024-02-06 WO PCT/CN2024/076306 patent/WO2024165016A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020253266A1 (en) * | 2019-06-15 | 2020-12-24 | 华为技术有限公司 | Method for providing edge service, apparatus and device |
| CN111935246A (en) * | 2020-07-21 | 2020-11-13 | 山东省计算中心(国家超级计算济南中心) | User generated content uploading method and system based on cloud edge collaboration |
| CN112910713A (en) * | 2021-03-02 | 2021-06-04 | 山东省计算中心(国家超级计算济南中心) | Cloud-edge data distribution transmission method, edge node, control center and storage medium |
| CN115277544A (en) * | 2021-04-13 | 2022-11-01 | 华为云计算技术有限公司 | Path construction method based on cloud service and related equipment thereof |
| WO2022235303A1 (en) * | 2021-05-03 | 2022-11-10 | Vmware, Inc. | On demand routing mesh for routing packets through sd-wan edge forwarding nodes in an sd-wan |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120281770A (en) * | 2025-06-10 | 2025-07-08 | 中铁电气化局集团第一工程有限公司 | Data transmission method and device based on cloud edge cooperative system and cloud edge cooperative system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118524130A (en) | 2024-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11237858B2 (en) | Software-defined data center, and deployment method for service cluster therein | |
| US10601728B2 (en) | Software-defined data center and service cluster scheduling and traffic monitoring method therefor | |
| US20170264496A1 (en) | Method and device for information processing | |
| CN110366276B (en) | Service-based architecture base station | |
| WO2019062836A1 (en) | Network slice management method, and device for same | |
| CN108390937B (en) | Remote monitoring method, device and storage medium | |
| CN109218046A (en) | The management method and system and storage medium of network slice | |
| JP2021519033A (en) | Methods for managing first access network nodes, equipment, general node B (gNB) of 5G networks, non-transient computer-readable media, computer program products, and datasets. | |
| CN109842507B (en) | A network slice management method and device | |
| CN109327319B (en) | Method, device and system for deploying network slicing | |
| CN111867142A (en) | A method, device and system for establishing a communication bearer | |
| WO2021147358A1 (en) | Network interface establishing method, apparatus, and system | |
| WO2023165137A1 (en) | Cross-cluster network communication system and method | |
| WO2023035777A1 (en) | Network configuration method, proxy component, controller, electronic device and storage medium | |
| CN113051027A (en) | Virtual machine flow table information sending method and device of cloud management system | |
| WO2024165016A1 (en) | Edge node communication method based on cloud computing technology, and related device | |
| CN115701039A (en) | Backup method and device of DBNG-UP | |
| CN116724545A (en) | A method, device and system for data packet transmission | |
| US20250286932A1 (en) | Data Transmission Method and Apparatus | |
| KR20230115880A (en) | Communication method and apparatus for xr serice in wireless communication system | |
| CN112671811B (en) | Network access method and equipment | |
| CN114301734A (en) | Access processing method and related equipment thereof | |
| CN112462647B (en) | Radio station network control system and method | |
| CN112637869B (en) | Converged network | |
| CN117478583A (en) | Network link switching method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24752871 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 24752871 Country of ref document: EP Kind code of ref document: A1 |