CN111416869A - Method for adjusting node weight in distributed cluster - Google Patents
Method for adjusting node weight in distributed cluster Download PDFInfo
- Publication number
- CN111416869A CN111416869A CN202010223013.0A CN202010223013A CN111416869A CN 111416869 A CN111416869 A CN 111416869A CN 202010223013 A CN202010223013 A CN 202010223013A CN 111416869 A CN111416869 A CN 111416869A
- Authority
- CN
- China
- Prior art keywords
- node
- weight
- adjustment
- value
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000012544 monitoring process Methods 0.000 claims abstract description 15
- 230000004622 sleep time Effects 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 abstract description 5
- 230000005856 abnormality Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5009—Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/101—Server selection for load balancing based on network conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
A method for adjusting node weight in a distributed cluster comprises the steps of monitoring the request minimum success rate, the request maximum failure rate and the request maximum time consumption of each node in the cluster in real time, determining the initial weight of each node according to configuration information of each node, setting the weight maximum value and the weight minimum value, and determining the time interval and the precision of weight adjustment; when the node receives a weight adjustment instruction sent by the monitoring module, calculating the weight adjustment interval of the node, and if the weight adjustment interval is less than or equal to the minimum weight value, finishing the adjustment; if the weight adjusting interval is larger than the weight minimum value, continuing to perform weight adjustment; calculating the traffic distribution proportion of each node in the cluster, and distributing traffic requests to each node according to the proportion; adjusting the weight value of the node; and circulating the method until the weight adjustment is finished. According to the method, the weight of the abnormal node is rapidly converged to an optimal value by dynamically adjusting the weight of the node, so that the residual capacity of the abnormal node is fully utilized.
Description
Technical Field
The invention belongs to the technical field of distributed clusters, and particularly relates to a method for adjusting node weight in a distributed cluster.
Background
In a distributed cluster, the situation that the performance of a node is reduced due to network, hardware, backend service abnormality and the like which are partially depended on by the node is often encountered. When such a failed node occurs in the cluster, rapid handling for the abnormal node is crucial. The current common method is to isolate nodes and rejoin the cluster for use after the nodes return to normal. However, this method has a problem that the residual capacity of the node cannot be fully utilized.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method for adjusting the weight of nodes in a distributed cluster.
The invention provides a method for adjusting node weight in a distributed cluster, which comprises the following steps,
step S1, the monitoring module monitors the request minimum success rate, the request maximum failure rate and the request maximum time consumption of each node in the cluster in real time, and when the index value of any node in the cluster exceeds a threshold value, the weight adjusting module is triggered to adjust the weight of the node;
step S2, determining the initial weight of each node according to the configuration information of each node, and setting the maximum value and the minimum value of the weight of each node;
step S3, determining the time interval and precision of weight adjustment;
step S4, when the node receives the weight adjustment instruction sent by the monitoring module, calculating the weight adjustment area of the node, if the weight adjustment area of the node is less than or equal to the weight minimum value of the node, the adjustment is finished; if the weight adjustment area of the node is larger than the minimum weight value of the node, continuing to perform weight adjustment;
step S5, the traffic distribution module calculates the traffic distribution proportion of each node in the cluster and distributes traffic requests to each node according to the proportion;
step S6, after waiting for the time interval of weight adjustment, if the node still meets the weight adjustment condition in the monitoring module, setting the maximum weight value of the node as the weight value of the node during current adjustment, and if the maximum weight value of the node does not meet the weight adjustment condition, setting the minimum weight value of the node as the weight value of the node during current adjustment;
step S7, loop through steps S5 to S7 until the weight adjustment is finished.
Further, in step S2, an initial weight of each node is determined according to the configuration information of each node. Setting the maximum value of the weight of each node=Weight minimum=0, i is the number of each node in the cluster.
Further, in step S3, a time interval sleepTime of weight adjustment and a precision minPrecision of weight adjustment are determined.
Further, in step S4, when the ith nodeReceiving the weight tone sent by the monitoring moduleWhen the instruction is complete, calculateBetween weight adjustment zonesIf, ifIf so, the adjustment is finished; if it isCalculatingWeight at jth adjustmentAnd j is the number of adjustments.
In a still further aspect of the present invention,between weight adjustment zonesIs calculated by the formula,
Wherein,is the maximum value of the weight of the ith node,is the minimum value of the weight of the ith node.
Further, in step S5, a traffic distribution ratio of each node in the cluster is calculated, and the traffic request is distributed to each node, i-th node, in proportionDistribution ratio ofIs calculated by the formulaWhereinis the kth nodeN is the total number of nodes in the cluster.
According to the method and the device, when the performance of the cluster node is reduced, the weight of the abnormal node can be quickly converged to the optimal value, the accuracy and the efficiency of weight adjustment are improved, and the resource utilization rate of the abnormal node is further improved.
Detailed Description
The embodiment provides a method for adjusting node weight in a distributed cluster, which comprises three modules, a monitoring module, a weight adjusting module and a flow distribution module.
The method comprises the following specific steps of,
step S1, the monitoring module monitors the request minimum success rate, the request maximum failure rate and the request maximum time consumption of each node in the cluster in real time, and when the index value of any node in the cluster exceeds a threshold value, the weight adjusting module is triggered to adjust the weight of the node;
step S2, the weight adjusting module determines the initial weight of each node according to the configuration information of each node, and sets the maximum value and the minimum value of the weight of each node;
step S3, determining the time interval and precision of weight adjustment;
step S4, when the node receives the weight adjustment instruction sent by the monitoring module, calculating the weight adjustment area of the node, if the weight adjustment area of the node is less than or equal to the weight minimum value of the node, the adjustment is finished; if the weight adjustment area of the node is larger than the minimum weight value of the node, continuing to perform weight adjustment;
step S5, the traffic distribution module calculates the traffic distribution proportion of each node in the cluster and distributes traffic requests to each node according to the proportion;
step S6, after waiting for the time interval of weight adjustment, if the node still meets the weight adjustment condition in the monitoring module, setting the maximum weight value of the node as the weight value of the node during current adjustment, and if the maximum weight value of the node does not meet the weight adjustment condition, setting the minimum weight value of the node as the weight value of the node during current adjustment;
step S7, loop through steps S5 to S7 until the weight adjustment is finished.
The steps of the method of this embodiment are described in detail below.
In step S2, an initial weight of each node is determined according to the configuration information of each node. Setting the maximum value of the weight of each node=Weight minimum=0, i is the number of each node in the cluster.
In step S3, a time interval sleepTime for weight adjustment and a precision minPrecision for weight adjustment are determined.
In step S4, when the ith nodeWhen a weight adjusting instruction sent by the monitoring module is received, calculation is carried outBetween weight adjustment zonesIf, ifIf so, the adjustment is finished; if it isCalculatingWeight at jth adjustmentAnd j is the number of adjustments.
Wherein,is the maximum value of the weight of the ith node,is the minimum value of the weight of the ith node.
In step S5, the traffic distribution ratio of each node in the cluster is calculated, and the traffic request is distributed to each node, i-th node, in proportionDistribution ratio ofIs calculated by the formulaWhereinis the kth nodeN is the total number of nodes in the cluster.
The foregoing illustrates and describes the principles, general features, and advantages of the present invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are intended to further illustrate the principles of the invention, and that various changes and modifications may be made without departing from the spirit and scope of the invention, which is intended to be protected by the appended claims. The scope of the invention is defined by the claims and their equivalents.
Claims (7)
1. A method for adjusting node weight in a distributed cluster is characterized by comprising the following steps,
step S1, the monitoring module monitors the request minimum success rate, the request maximum failure rate and the request maximum time consumption of each node in the cluster in real time, and when the index value of any node in the cluster exceeds a threshold value, the weight adjusting module is triggered to adjust the weight of the node;
step S2, determining the initial weight of each node according to the configuration information of each node, and setting the maximum value and the minimum value of the weight of each node;
step S3, determining the time interval and precision of weight adjustment;
step S4, when the node receives the weight adjustment instruction sent by the monitoring module, calculating the weight adjustment area of the node, if the weight adjustment area of the node is less than or equal to the weight minimum value of the node, the adjustment is finished; if the weight adjustment area of the node is larger than the minimum weight value of the node, continuing to perform weight adjustment;
step S5, the traffic distribution module calculates the traffic distribution proportion of each node in the cluster and distributes traffic requests to each node according to the proportion;
step S6, after waiting for the time interval of weight adjustment, if the node still meets the weight adjustment condition in the monitoring module, setting the maximum weight value of the node as the weight value of the node during current adjustment, and if the maximum weight value of the node does not meet the weight adjustment condition, setting the minimum weight value of the node as the weight value of the node during current adjustment;
step S7, loop through steps S5 to S7 until the weight adjustment is finished.
4. The method of claim 1, wherein in step S3, a time interval sleepTime for weight adjustment and a precision minPrecision for weight adjustment are determined.
5. The method of claim 1, wherein in step S4, when the ith node is a nodeWhen a weight adjusting instruction sent by the monitoring module is received, calculation is carried outBetween weight adjustment zonesIf, ifIf so, the adjustment is finished; if it isCalculatingWeight at jth adjustmentAnd j is the number of adjustments.
6. The method of claim 4, wherein the node weight adjustment in the distributed cluster,between weight adjustment zonesIs calculated by the formula,
7. The method of claim 1, wherein in step S5, the traffic distribution ratio of each node in the cluster is calculated, and the traffic request is distributed proportionally to each node, i (th) nodeDistribution ratio ofIs calculated by the formulaWhereinis the kth nodeN is the total number of nodes in the cluster.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010223013.0A CN111416869A (en) | 2020-03-26 | 2020-03-26 | Method for adjusting node weight in distributed cluster |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010223013.0A CN111416869A (en) | 2020-03-26 | 2020-03-26 | Method for adjusting node weight in distributed cluster |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111416869A true CN111416869A (en) | 2020-07-14 |
Family
ID=71494614
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010223013.0A Pending CN111416869A (en) | 2020-03-26 | 2020-03-26 | Method for adjusting node weight in distributed cluster |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111416869A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115174583A (en) * | 2022-06-28 | 2022-10-11 | 福州大学 | Server load balancing method based on programmable data plane |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6192401B1 (en) * | 1997-10-21 | 2001-02-20 | Sun Microsystems, Inc. | System and method for determining cluster membership in a heterogeneous distributed system |
CN105282259A (en) * | 2015-11-13 | 2016-01-27 | 深圳联友科技有限公司 | Load balancing allocation method, agent and system used for background cluster service |
US20180278646A1 (en) * | 2015-11-27 | 2018-09-27 | Alibaba Group Holding Limited | Early-Warning Decision Method, Node and Sub-System |
CN109040283A (en) * | 2018-08-23 | 2018-12-18 | 上海海事大学 | A kind of modified load-balancing algorithm based on difference reaction type |
CN109189329A (en) * | 2018-08-08 | 2019-01-11 | 杭州数梦工场科技有限公司 | The method of adjustment and device of memory node weight |
CN110198274A (en) * | 2019-06-21 | 2019-09-03 | 苏宁云计算有限公司 | A kind of control method and its system of group flow |
CN110647400A (en) * | 2019-09-29 | 2020-01-03 | 成都安恒信息技术有限公司 | Node preheating method based on positive feedback |
CN110716808A (en) * | 2019-10-15 | 2020-01-21 | 腾讯科技(深圳)有限公司 | Service processing method, device, computer equipment and storage medium |
-
2020
- 2020-03-26 CN CN202010223013.0A patent/CN111416869A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6192401B1 (en) * | 1997-10-21 | 2001-02-20 | Sun Microsystems, Inc. | System and method for determining cluster membership in a heterogeneous distributed system |
CN105282259A (en) * | 2015-11-13 | 2016-01-27 | 深圳联友科技有限公司 | Load balancing allocation method, agent and system used for background cluster service |
US20180278646A1 (en) * | 2015-11-27 | 2018-09-27 | Alibaba Group Holding Limited | Early-Warning Decision Method, Node and Sub-System |
CN109189329A (en) * | 2018-08-08 | 2019-01-11 | 杭州数梦工场科技有限公司 | The method of adjustment and device of memory node weight |
CN109040283A (en) * | 2018-08-23 | 2018-12-18 | 上海海事大学 | A kind of modified load-balancing algorithm based on difference reaction type |
CN110198274A (en) * | 2019-06-21 | 2019-09-03 | 苏宁云计算有限公司 | A kind of control method and its system of group flow |
CN110647400A (en) * | 2019-09-29 | 2020-01-03 | 成都安恒信息技术有限公司 | Node preheating method based on positive feedback |
CN110716808A (en) * | 2019-10-15 | 2020-01-21 | 腾讯科技(深圳)有限公司 | Service processing method, device, computer equipment and storage medium |
Non-Patent Citations (2)
Title |
---|
YOICHI SAKA等: ""A Node-Weight Equalization Problem with Circuit-Based Computations"", 《IEEE》 * |
王雅琳等: "Dynamic self-adaptive ANP algorithm and its application to electric field simulation of aluminum reduction cell", 《JOURNAL OF CENTRAL SOUTH UNIVERSITY》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115174583A (en) * | 2022-06-28 | 2022-10-11 | 福州大学 | Server load balancing method based on programmable data plane |
CN115174583B (en) * | 2022-06-28 | 2024-03-29 | 福州大学 | Server load balancing method based on programmable data plane |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112711479B (en) | Server cluster load balancing system, method, device and storage medium | |
JP2897875B2 (en) | Integrated Network Controller for Dynamic Non-Hierarchical Routing Switching Network | |
US5655120A (en) | Method for load balancing in a multi-processor system where arising jobs are processed by a plurality of processors under real-time conditions | |
WO2020220430A1 (en) | Traffic limiting method and system | |
US20100254409A1 (en) | System and Method for Optimizing Network Bandwidth Usage | |
TWI221391B (en) | System and method for scheduling and transmitting protocol data units | |
CN110198274A (en) | A kind of control method and its system of group flow | |
CN111416869A (en) | Method for adjusting node weight in distributed cluster | |
US7139830B2 (en) | Communication apparatus and congestion regulation control method | |
CN109741170B (en) | Sub-account processing method and system | |
CN106936926B (en) | Method and system for accessing data node | |
US9240960B2 (en) | Port scheduling for a network device | |
CN109150756A (en) | A kind of queue scheduling weight quantization method based on SDN power telecom network | |
CN100502581C (en) | A Carrier Frequency Configuration Adjustment Method Based on Wireless Network Dynamic Load Capability | |
CN107306231A (en) | Business scheduling method, equipment and system | |
Slastikhin et al. | Redundant priority maintenance in the multi-channel systems | |
CN107689917B (en) | Power communication network route allocation method based on non-uniform service balance | |
CN108200185B (en) | Method and device for realizing load balance | |
CN102034343A (en) | Data reporting method of power utilization information acquisition terminal based on random value | |
CN118138590A (en) | Data center load balancing method | |
CN109787920B (en) | System and method for dynamically adjusting bandwidth of forwarding plane of step-by-step system | |
CN115883589A (en) | Dynamic node selection method and system for data repair in distributed storage | |
CN107623638B (en) | Fault processing method and device for load balancing path | |
CN113923166B (en) | Load balancing method and distributed cluster system | |
CN113890847B (en) | Traffic forwarding method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200714 |