CN102457906A - Load balancing control method and system of message queues - Google Patents
Load balancing control method and system of message queues Download PDFInfo
- Publication number
- CN102457906A CN102457906A CN2010105233917A CN201010523391A CN102457906A CN 102457906 A CN102457906 A CN 102457906A CN 2010105233917 A CN2010105233917 A CN 2010105233917A CN 201010523391 A CN201010523391 A CN 201010523391A CN 102457906 A CN102457906 A CN 102457906A
- Authority
- CN
- China
- Prior art keywords
- message queue
- depth
- business service
- queue
- application server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000012544 monitoring process Methods 0.000 claims description 29
- 238000011084 recovery Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 abstract description 17
- 230000015572 biosynthetic process Effects 0.000 description 11
- 230000011664 signaling Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 4
- 238000005538 encapsulation Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 238000000205 computational method Methods 0.000 description 2
- 238000011217 control strategy Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
Images
Landscapes
- Telephonic Communication Services (AREA)
- Computer And Data Communications (AREA)
Abstract
本发明公开了一种消息队列的负载均衡控制方法及系统，用以提升控制消息队列负载均衡的灵活性，并实现客户端对消息队列的灵活切换。消息队列的负载均衡控制方法，包括：轮询每一个消息队列的当前深度，当存在当前深度达到预设的队列深度告警阈值的过载消息队列时，生成告警信息，所述告警信息中包括各过载消息队列的标识信息及其当前深度；根据告警信息中各过载消息队列的当前深度、以及业务服务的平均处理能力，分别确定各过载消息队列需要增加的业务服务数量；选取相应数量且满足配置条件的业务服务，增加配置给告警信息中各过载消息队列的标识信息所指示的过载消息队列。
The invention discloses a load balancing control method and system of a message queue, which are used for improving the flexibility of controlling the load balancing of the message queue and realizing flexible switching of the message queue by a client. A load balancing control method for message queues, comprising: polling the current depth of each message queue, and when there is an overloaded message queue whose current depth reaches a preset queue depth alarm threshold, alarm information is generated, and the alarm information includes each overload message queue. The identification information of the message queue and its current depth; according to the current depth of each overloaded message queue in the alarm information and the average processing capacity of the business service, determine the number of business services that need to be increased for each overloaded message queue; select the corresponding number and meet the configuration conditions For business services, add the overload message queue indicated by the identification information configured for each overload message queue in the alarm information.
Description
Technical field
The present invention relates to the mobile communication technology field, relate in particular to a kind of control method for equalizing load and system of message queue.
Background technology
In the existing mobile communication technology field; The major function of precision marketing system is processing signaling acquisition system, BOSS (Business Operation Support System; Service operation supports) a large amount of real time datas of producing of external system such as system; Filter and processed generation business event,, finally the user is marketed through suitable channel through the processing of application server to business event.
The signaling data that the signaling acquisition system collection is a large amount of, for example calling and called, short message receiving-transmitting, position migration, sub-district switching, switching on and shutting down etc., and send to the front end processor of precision marketing system through the Socket interface, peak rate reaches 1500000/second; The BOSS system also produces the front end processor that a large amount of IT incidents sends to the precision marketing system.A large amount of real time datas that external systems such as signaling acquisition system, BOSS system produce are again lacks of balance, and for example the calling and called in the signaling data, short message receiving-transmitting show non-equilibrium in each time period of every day.Real time data to big data quantity and lack of balance in the precision marketing system; In order to reach the requirement of high real-time and high reliability; The precision marketing system need be designed to elasticity computation structure; Share the data processing of big data quantity and lack of balance, keep out surge pressure, thereby guarantee the real-time and the reliability of precision marketing system.Wherein, through the message encapsulation business event is distributed to message queue in the precision marketing system, therefore needs to realize the load balancing of message queue.
In the prior art, the load balancing scheme of message queue, as shown in Figure 1:
A plurality of message queues are formed the message queue cluster, and message at first sends to major queue, is carried out the distribution of message again by major queue, and the load balancing strategy is controlled by major queue; Extract message in the message queue that client is fixed and carry out Business Processing from the message queue cluster.
In the prior art, there is following problem in the load balancing scheme of message queue:
1, a plurality of message queues are formed the message queue cluster, and message at first sends to major queue, is carried out the distribution of message again by major queue, and the load balancing strategy is controlled by major queue, can't adjust the load balancing strategy neatly;
2, extract message in the message queue that client is fixed and carry out Business Processing from the message queue cluster, client can't be switched message queue pellucidly.
Therefore, how to promote the flexibility of control messages formation load balancing, and realize the flexible switching of client, become the technical problem that needs to be resolved hurrily in the prior art message queue.
Summary of the invention
The embodiment of the invention provides a kind of control method for equalizing load and system of message queue, in order to the flexibility of lifting control messages formation load balancing, and realizes the flexible switching of client to message queue.
The control method for equalizing load of the message queue that the embodiment of the invention provides comprises:
The current degree of depth of each message queue of poll when existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold, generates warning information, comprises the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
According to respectively transshipping the current degree of depth of message queue and the average treatment ability of business service in the warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
The load balancing control system of the message queue that the embodiment of the invention provides comprises:
Monitoring module; The current degree of depth that is used for each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information and send to the Balance Control module, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
RACS is used for respectively transshipping the current degree of depth of message queue and the average treatment ability of business service according to warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase; Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
The control method for equalizing load of the message queue that the embodiment of the invention provides and system; Abandoned by the balanced pattern of major queue control load; The current degree of depth through each message queue of poll; When the queue depth of some or a plurality of message queues reaches the queue depth alarm threshold of setting, the business service quantity that the message queue of confirming respectively to transship need increase, and the business service that will satisfy configuration condition increases configuration to each overload message queue; Thereby reached the purpose of control messages formation load balancing, promoted flexibility; Business service is no longer extracted message and is carried out Business Processing from fixing message queue, but can realize the flexible switching of client to message queue according to actual conditions flexibly for the service of message queue configuration service.
Other features and advantages of the present invention will be set forth in specification subsequently, and, partly from specification, become obvious, perhaps understand through embodiment of the present invention.The object of the invention can be realized through the structure that in the specification of being write, claims and accompanying drawing, is particularly pointed out and obtained with other advantages.
Description of drawings
Fig. 1 is the load balancing scheme sketch map of message queue in the prior art;
Fig. 2 is the configuration diagram of precision marketing system in the embodiment of the invention;
Fig. 3 is the sketch map of service managerZ-HU management service service in the embodiment of the invention;
Fig. 4 is the register flow path figure of business service in the embodiment of the invention;
Fig. 5 is the load balancing control system block diagram of message queue in the embodiment of the invention;
Fig. 6 is the control method for equalizing load flow chart of message queue in the embodiment of the invention;
Fig. 7 is the load balancing control flow chart of first kind of message queue in the embodiment of the invention;
Fig. 8 is the load balancing control flow chart of second kind of message queue in the embodiment of the invention.
Embodiment
The embodiment of the invention provides a kind of control method for equalizing load and system of message queue, in order to the flexibility of lifting control messages formation load balancing, and realizes the flexible switching of client to message queue.
Below in conjunction with Figure of description the preferred embodiments of the present invention are described; Be to be understood that; Preferred embodiment described herein only is used for explanation and explains the present invention; And be not used in qualification the present invention, and under the situation of not conflicting, embodiment and the characteristic among the embodiment among the present invention can make up each other.
The typical application scene of the load balancing controlling schemes of the message queue that at first, the embodiment of the invention is provided adopts the precision marketing system of elasticity computation structure to describe one by one.The elasticity computation structure of precision marketing system is based upon on the SOA (Service-Oriented Architecture, Service-Oriented Architecture Based) of employing based on message-oriented middleware.SOA is a kind of framework model, can carry out distributed deployment, combination and use through network to loosely-coupled coarseness application component according to demand; Service layer is the basis of SOA, can directly be employed to call, thereby effectively in the control system with the mutual artificial dependence of ageng.The framework of precision marketing system, as shown in Figure 2:
In the precision marketing system, each module is articulated to message-oriented middleware through the message encapsulation, and service or outwards request service externally are provided.Three types of critical pieces that elasticity is calculated: monitor service, Balance Control service and business service all are the basis with SOA, in the precision marketing system, all encapsulate and dispose with message based service form.Wherein, the functional entity of having disposed monitor service is called monitoring module, and the functional entity of having disposed the Balance Control service is called the Balance Control module, and the functional entity of having disposed business service is called application server, and message queue is deployed in the queue management device.
The IT incident that the signaling data of signaling acquisition system collection and BOSS system produce sends to the front end processor of precision marketing system; Processing module in the front end processor is filtered and processed the signaling data or the IT incident that receive, obtains business event; Distribution module in the front end processor is responsible for the business event that processing module obtains is distributed; Through the message encapsulation business event is distributed to the message queue in the queue management device, the business service in the application server is extracted business event again and is handled from the message queue of correspondence.
Business service is the service of the concrete business event processing logic of precision marketing system in package, will be deployed to one or more application servers.When the precision marketing system need increase the business event disposal ability, will start a plurality of business service instances, the computing capability that makes full use of application server is carried out distributed treatment.
Different with the business service of other system, each business service that need carry out flexible scheduling all will be to the Balance Control service report running status of precision marketing system, receives to start and cease and desist order.In the embodiment of the invention, designed service managerZ-HU and separated this partial function, as shown in Figure 3, be responsible for and the Balance Control service interaction by service managerZ-HU, accomplish the registration of business service, and start or stop business service.
To a certain specific business service in the application server, its register flow path is as shown in Figure 4, comprises the steps:
S401, service managerZ-HU initiate the register requirement of business service to the Balance Control module, wherein carry the identification information of business service;
S402, Balance Control module are according to the register requirement of business service; Issue the configuration messages that comprises the message queue link information through service managerZ-HU to business service, the message queue link information comprises the identification information of institute's connection message formation, the address information of institute's connection message formation place queue management device;
S403, business service are connected to the message queue of appointment according to the message queue link information in the configuration messages;
Follow-up, this specific business service can be obtained the needs processing from the message queue that is connected business event carries out Business Processing.
It is thus clear that the business service that through part is deployed on the application server of some can be used as cluster, the message queue that each business service is corresponding unique, the corresponding one or more business service of each message queue.
To registered business service, the Balance Control service can also start and cease and desist order to the issue of a certain specific business service, service managerZ-HU receive start or stop order after, start or stop corresponding business service.Wherein:
Start business service:
Service managerZ-HU starts business service as common thread, the issued state Notification of Changes has changed to starting state to this business service of Balance Control service report simultaneously;
Stop business service:
The service managerZ-HU calling external program normally withdraws from business service from circulation, and the issued state Notification of Changes has changed to halted state to this business service of Balance Control service report simultaneously.
Based on the elasticity computation structure of above-mentioned precision marketing system, the embodiment of the invention provides a kind of load balancing control system of message queue, and is as shown in Figure 5, comprises monitoring module 51 and RACS 52, and monitoring module 51 is connected to each message queue.Wherein:
For the ease of distinguishing, the message queue that in the embodiment of the invention the current degree of depth is reached preset queue depth's alarm threshold is called " overload message queue ";
RACS 52 is used for respectively transshipping the current degree of depth of message queue and the average treatment ability of business service according to warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase; Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
In the practical implementation, a kind of possibility implementation of RACS 52 comprises Balance Control module 521 and service managerZ-HU 522, wherein:
Service managerZ-HU 522 is used for according to the control command that starts business service, is respectively each overload message queue and starts respective numbers and be deployed in the business service in the idle application server.
Preferable, Balance Control module 521 also is used for when the current depth recovery of certain overload message queue is arrived under its queue depth's alarm threshold, inquiring about the cpu busy percentage of each application server; If exist cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; Initiate to stop the control command of business service to service managerZ-HU; Wherein indicate busy application server and carry the identification information of this overload message queue, the said second utilance threshold value is higher than the first utilance threshold value;
Service managerZ-HU 522 also is used for according to stopping the control command of business service, stop to dispose for this overload message queue and be deployed in the business service in the busy application server.
Respectively transship the identification information and the current degree of depth thereof of message queue except comprising in the warning information that monitoring module generates, can also comprise: the identification information of other message queue and the current degree of depth thereof; In this case, the another kind of RACS possibility implementation comprises Balance Control module 521 and service managerZ-HU 522, wherein:
Based on same technical conceive; The embodiment of the invention provides a kind of control method for equalizing load of message queue; The current degree of depth through message queue embodies data processing pressure, therefore needs in advance for each message queue is provided with queue depth's alarm threshold, and the queue depth's alarm threshold that is provided with for each message queue can be identical; Also can be inequality, can be provided with flexibly according to the actual requirements.As shown in Figure 6, the control method for equalizing load of the message queue that the embodiment of the invention provides comprises the steps:
The current degree of depth of S601, each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
In the practical implementation, can be according to the current degree of depth of Fixed Time Interval (this Fixed Time Interval can be called monitoring period) each message queue of poll; Also can be when satisfying the trigger condition of setting, for example the user triggers the inquiry of queue depth, the current degree of depth of each message queue of poll.
S602, according to respectively transshipping the current degree of depth of message queue and the average treatment ability of business service in the warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
In the practical implementation, the average treatment ability of business service can be confirmed also pre-configured through following mode:
The application server that business service is provided is carried out POC (Proof of Concept) benchmark test; Draw under the typical services scene; The POC fiducial value of application server and business service maximum quantity, the POC fiducial value is meant the performance number of application server processes message, unit be generally the bar number/minute; The business service maximum quantity is meant the maximum quantity of the business service that application server can be disposed under the optimum performance; Need to prove, in the practical implementation, each application server performance basically identical of business service is provided.Based on POC benchmark test, can obtain the average treatment ability of business service, concrete computational methods are shown in formula [1]:
The average treatment ability of business service=POC fiducial value/business service maximum quantity [1]
Average treatment ability according to business service; And the current degree of depth (generally adopting the bar numerical table of message to show) of overload message queue; Can obtain the business service quantity that each overload message queue need increase; The quantity of supposing the overload message queue is N, then i (the business service quantity that the individual overload message queue of 1≤i≤N) need increase, concrete computational methods are shown in formula [2]:
Business service quantity=the P that needs increase
i/ T [2]
Wherein, P
iRepresent that (the current degree of depth of individual overload message queue of 1≤i≤N), T representes the average treatment ability of business service to i.
S603, choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
Below specify the load balancing controlling schemes of message queue through embodiment.
In order to reach the purpose of control messages formation load balancing; The control command of the startup business service that can initiate by service managerZ-HU receiving balance control module; Thereby guarantee that the precision marketing system is when facing the real time data of big data quantity and lack of balance; Can keep high real-time and high reliability, suppose that monitoring module presses the current degree of depth of each message queue of Fixed Time Interval poll.As shown in Figure 7, comprise the steps:
S701, when current monitoring period arrives, the current degree of depth of each message queue of monitoring module poll, and upgrade the current degree of depth of stored message formation in the monitoring module;
Reach preset queue depth's alarm threshold if the S702 monitoring module monitors the current degree of depth of some or a plurality of message queues, these one or more message queues are called the overload message queue, then carry out S703;
If monitoring module does not monitor the message queue that the current degree of depth reaches queue depth's alarm threshold of setting, then do not carry out any processing, wait for the arrival of next monitoring period;
S703, monitoring module generate warning information and send to the Balance Control module, need comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the warning information;
Describe for example:
Table 1
Suppose that monitoring module has connected four message queues, numbering is respectively 1,2,3,4, and the maximum queue depth of each message queue and queue depth's alarm threshold see also table 1.When current monitoring period arrived, it is as shown in table 1 that monitoring module inquires the current degree of depth of each message queue.Based on above-mentioned Query Result; The current degree of depth that monitoring module monitors message queue 1 and message queue 2 reaches preset queue depth's alarm threshold; Then generate warning information and send to the Balance Control module, need comprise the identification information and the current degree of depth thereof of transshipping message queue in the warning information.The identification information of message queue of wherein transshipping can adopt the numbering of message queue, also can adopt the title etc. of message queue; Can get final product by message queue of unique identification; Suppose to adopt the numbering of message queue, then comprise following information in the warning information: (1,1000000); (2,1000000);
After S704, Balance Control module receive warning information, according to the current degree of depth and the average treatment ability of business service of each overload message queue, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
The business service quantity that supposing to determine message queue 1 needs to increase is M
1, the message queue 2 business service quantity that needs to increase is M
2
The cpu busy percentage of S705, each application server of Balance Control module inquiry; Obtain the idle application server that cpu busy percentage is lower than the first utilance threshold value of setting; The first utilance threshold value can be set according to actual conditions flexibly; For example be set at 10%, 5% or the like, be no more than 50% generally speaking;
S706, Balance Control module initiate to start the control command of business service to service managerZ-HU, wherein indicate idle application server and carry respectively to transship the business service quantity that the identification information and needing of message queue increases;
S707, service managerZ-HU are respectively the business service that each overload message queue starts respective numbers according to the control command of business service in idle application server; Need to prove that because the service managerZ-HU unified management is deployed in the business service in the application server, so service managerZ-HU can be known the business service distributed intelligence of each application server;
For example, be message queue 1 startup M according to the result of calculation of S704
1Individual business service is for message queue 2 starts M
2Individual business service.
S708, service managerZ-HU are to Balance Control module feedback states Notification of Changes, and the report corresponding business service has changed to starting state.
S704 and S705 are the load balancing control strategies of presetting, and according to the cpu busy percentage that inquires, obtain the idle application server of dispersion as far as possible, make new business service of opening be dispersed in each idle application server, help improving bandwidth availability ratio.S706 and S707 are the operating parts to the load balancing control strategy, make that the business service on the more application services device starts, and are connected to message queue parallel processing business event.
In order to realize inquiry to the cpu busy percentage of each application server, in the practical implementation, can use the Linux script that monitor message is write file, be uploaded to the Balance Control module by program through message queue again.
In the practical implementation, after the queue depth of overload message queue recovered normally, the Balance Control module can also be through the cpu busy percentage of each application server of inquiry, and the notification service manager stops corresponding business service, specifically comprises the steps:
Step 1, when the current depth recovery of certain overload message queue is under its queue depth's alarm threshold, the cpu busy percentage of each application server of Balance Control module inquiry;
If step 2 exists cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; The Balance Control module initiates to stop the control command of business service to service managerZ-HU; Wherein indicate busy application server and carry the identification information of this overload message queue, the said second utilance threshold value is higher than the first utilance threshold value;
Step 3, service managerZ-HU be according to the control command that stops business service, stop to dispose for this overload message queue and be deployed in the business service in the busy application server.
In order to reach the purpose of control messages formation load balancing; Can be by the configuration update message that comprises the message queue link information of service managerZ-HU receiving balance control module initiation; Be updated to the business service of overload message queue service; Thereby guarantee that the precision marketing system in the face of the real time data of big data quantity and lack of balance the time, can keep high real-time and high reliability, suppose that monitoring module presses the current degree of depth of each message queue of Fixed Time Interval poll.As shown in Figure 8, comprise the steps:
S801, when current monitoring period arrives, the current degree of depth of each message queue of monitoring module poll, and upgrade the current degree of depth of stored message formation in the monitoring module;
Reach preset queue depth's alarm threshold if the S802 monitoring module monitors the current degree of depth of some or a plurality of message queues, these one or more message queues are called the overload message queue, then carry out S803;
If monitoring module does not monitor the message queue that the current degree of depth reaches queue depth's alarm threshold of setting, then do not carry out any processing, wait for the arrival of next monitoring period;
S803, monitoring module generate warning information and send to the Balance Control module, respectively transship the identification information and the current degree of depth thereof of message queue except comprising in the warning information, also comprise the identification information and the current degree of depth thereof of other message queue;
After S804, Balance Control module receive warning information, according to the current degree of depth and the average treatment ability of business service of each overload message queue, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
S805, Balance Control module increase the pairing business service of message queue that the current degree of depth that disposes respective numbers is lower than queue depth's scheduling threshold value of setting for each overload message queue; Wherein, queue depth's scheduling threshold value is less than queue depth's alarm threshold;
S806, Balance Control module comprise the configuration update message of message queue link information to above-mentioned each business service issue through management server;
S807, corresponding business service are connected to the overload message queue of appointment according to the message queue link information in the configuration update message.
The control method for equalizing load of the message queue that the embodiment of the invention provides and system; Abandoned by the balanced pattern of major queue control load; The current degree of depth through each message queue of poll; When the queue depth of some or a plurality of message queues reaches the queue depth alarm threshold of setting, the business service quantity that the message queue of confirming respectively to transship need increase, and the business service that will satisfy configuration condition increases configuration to each overload message queue; Thereby reached the purpose of control messages formation load balancing, promoted flexibility; Business service is no longer extracted message and is carried out Business Processing from fixing message queue, but can realize the flexible switching of client to message queue according to actual conditions flexibly for the service of message queue configuration service.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, belong within the scope of claim of the present invention and equivalent technologies thereof if of the present invention these are revised with modification, then the present invention also is intended to comprise these changes and modification interior.
Claims (10)
1. the control method for equalizing load of a message queue is characterized in that, comprising:
The current degree of depth of each message queue of poll when existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold, generates warning information, comprises the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
According to respectively transshipping the current degree of depth of message queue and the average treatment ability of business service in the warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase;
Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
2. the method for claim 1 is characterized in that, the said business service of choosing respective numbers and satisfying configuration condition increases configuration and gives and respectively transship the indicated overload message queue of identification information of message queue in the warning information, specifically comprises:
Inquire about the cpu busy percentage of each application server, confirm that cpu busy percentage is lower than the idle application server of the first utilance threshold value of setting, disposes business service in the said application server;
For each overload message queue starts respective numbers and is deployed in the business service in the idle application server.
3. method as claimed in claim 2 is characterized in that, also comprises:
When the current depth recovery of certain overload message queue is arrived under its queue depth's alarm threshold, inquire about the cpu busy percentage of each application server;
If exist cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; Then stop for the configuration of this overload message queue and be deployed in the business service in the busy application server, the said second utilance threshold value is higher than the first utilance threshold value.
4. the method for claim 1 is characterized in that, also comprises in the said warning information: the identification information of other message queue and the current degree of depth thereof; And
The said business service of choosing respective numbers and satisfying configuration condition increases configuration and gives and respectively transship the indicated overload message queue of identification information of message queue in the warning information, specifically comprises:
For each overload message queue increases the pairing business service of message queue that configuration respective numbers and the current degree of depth are lower than queue depth's scheduling threshold value of setting, said queue depth scheduling threshold value is lower than queue depth's alarm threshold;
The configuration update message that comprises the message queue link information to said business service issue; And
Said business service is connected to the overload message queue of appointment according to the message queue link information in the configuration update message.
5. the method for claim 1 is characterized in that, the overload message queue business service quantity that need increase is the merchant of the average treatment ability of the current degree of depth of this overload message queue and business service.
6. the method for claim 1 is characterized in that, according to the current degree of depth of regular time interval each message queue of poll.
7. the load balancing control system of a message queue is characterized in that, comprising:
Monitoring module; The current degree of depth that is used for each message queue of poll; When existing the current degree of depth to reach the overload message queue of preset queue depth's alarm threshold; Generate warning information and send to the Balance Control module, comprise the identification information and the current degree of depth thereof of respectively transshipping message queue in the said warning information;
RACS is used for respectively transshipping the current degree of depth of message queue and the average treatment ability of business service according to warning information, the business service quantity that the message queue of confirming respectively respectively to transship need increase; Choose respective numbers and satisfy the business service of configuration condition, increase configuration and give and respectively transship the indicated overload message queue of identification information of message queue in the warning information.
8. system as claimed in claim 7 is characterized in that said RACS comprises Balance Control module and service managerZ-HU, wherein:
Said Balance Control module is used to inquire about the cpu busy percentage of each application server, confirms that cpu busy percentage is lower than the idle application server of the first utilance threshold value of setting, disposes business service in the said application server; Initiate to start the control command of business service to said service managerZ-HU, wherein indicate idle application server and carry and respectively transship the business service quantity that the identification information and needing of message queue increases;
Said service managerZ-HU is used for according to the control command that starts business service, is respectively each overload message queue and starts respective numbers and be deployed in the business service in the idle application server.
9. system as claimed in claim 8 is characterized in that,
Said Balance Control module also is used for when the current depth recovery of certain overload message queue is arrived under its queue depth's alarm threshold, inquiring about the cpu busy percentage of each application server; If exist cpu busy percentage to be higher than the busy application server of the second utilance threshold value of setting; Initiate to stop the control command of business service to service managerZ-HU; Wherein indicate busy application server and carry the identification information of this overload message queue, the said second utilance threshold value is higher than the first utilance threshold value;
Service managerZ-HU also is used for according to stopping the control command of business service, stop to dispose for this overload message queue and be deployed in the business service in the busy application server.
10. system as claimed in claim 7 is characterized in that,
Also comprise in the warning information that said monitoring module generates: the identification information of other message queue and the current degree of depth thereof; And
Said RACS comprises Balance Control module and service managerZ-HU, wherein:
The Balance Control module; Be used to the pairing business service of message queue that each the overload message queue increase configuration respective numbers and the current degree of depth are lower than queue depth's scheduling threshold value of setting, said queue depth scheduling threshold value is lower than queue depth's alarm threshold; Issue the configuration update message that comprises the message queue link information through said management server to said business service, the message queue link information is used to indicate business service to be connected to the overload message queue of appointment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010523391.7A CN102457906B (en) | 2010-10-26 | 2010-10-26 | A load balancing control method and system for a message queue |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010523391.7A CN102457906B (en) | 2010-10-26 | 2010-10-26 | A load balancing control method and system for a message queue |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102457906A true CN102457906A (en) | 2012-05-16 |
| CN102457906B CN102457906B (en) | 2014-01-08 |
Family
ID=46040428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010523391.7A Active CN102457906B (en) | 2010-10-26 | 2010-10-26 | A load balancing control method and system for a message queue |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102457906B (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103927218A (en) * | 2014-04-30 | 2014-07-16 | 广州唯品会网络技术有限公司 | Event dispatching method and system |
| CN104539661A (en) * | 2014-12-11 | 2015-04-22 | 曙光信息产业(北京)有限公司 | Message queue processing method and device |
| CN105306552A (en) * | 2015-09-30 | 2016-02-03 | 中国科学院计算技术研究所 | Consumption equilibrium method and system based on message queues |
| CN105721553A (en) * | 2016-01-25 | 2016-06-29 | 中国联合网络通信有限公司广东省分公司 | Self-adaptive cluster message dispatcher |
| CN106878197A (en) * | 2017-02-22 | 2017-06-20 | 郑州云海信息技术有限公司 | A management system and method for cloud platform message transmission |
| CN106886457A (en) * | 2015-12-16 | 2017-06-23 | 泰康保险集团股份有限公司 | Message queue processing method and processing device |
| CN107592364A (en) * | 2017-09-22 | 2018-01-16 | 中汇信息技术（上海）有限公司 | A kind of distributed message exchange method and system |
| CN108134830A (en) * | 2017-12-20 | 2018-06-08 | 马上消费金融股份有限公司 | Load balancing method, system, device and storage medium based on message queue |
| CN108848039A (en) * | 2018-04-24 | 2018-11-20 | 平安科技（深圳）有限公司 | The method and storage medium that server, message are distributed |
| CN109145593A (en) * | 2018-07-04 | 2019-01-04 | 杭州涂鸦信息技术有限公司 | A kind of method, apparatus and computer equipment of Internet of Things net filtration invalid data |
| CN109976977A (en) * | 2019-03-28 | 2019-07-05 | 努比亚技术有限公司 | Application service loads decompression method, server and storage medium |
| CN110149392A (en) * | 2019-05-17 | 2019-08-20 | 优信拍（北京）信息科技有限公司 | A kind of management method and device of PUSH message |
| CN110290217A (en) * | 2019-07-01 | 2019-09-27 | 腾讯科技（深圳）有限公司 | Processing method and processing device, storage medium and the electronic device of request of data |
| CN111078389A (en) * | 2018-10-18 | 2020-04-28 | 杭州海康威视数字技术股份有限公司 | Junk data cleaning method and device, electronic equipment and readable storage medium |
| CN111541619A (en) * | 2020-04-30 | 2020-08-14 | 中国人民银行清算总中心 | Self-adaptive active load adjusting method and device of enterprise information networking checking system |
| CN111782488A (en) * | 2020-07-10 | 2020-10-16 | 中国工商银行股份有限公司 | Message queue monitoring method and device, electronic equipment and medium |
| CN112612607A (en) * | 2020-12-16 | 2021-04-06 | 平安消费金融有限公司 | Data processing method, device, computer equipment and medium based on message queue |
| CN113835905A (en) * | 2021-09-28 | 2021-12-24 | 北京奇艺世纪科技有限公司 | Message queue load balancing method and device, electronic equipment and medium |
| CN115484211A (en) * | 2022-09-14 | 2022-12-16 | 中国银行股份有限公司 | Double-activity processing method and system for size payment system |
| CN119629680A (en) * | 2024-11-18 | 2025-03-14 | 中国联合网络通信集团有限公司 | A method, device and readable storage medium for smoothing message peaks |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014002A (en) * | 2006-12-12 | 2007-08-08 | 华为技术有限公司 | Cluster message transmitting method and distributed cluster system |
| CN101753444A (en) * | 2009-12-31 | 2010-06-23 | 卓望数码技术（深圳）有限公司 | Method and device for load balancing |
| US20100229182A1 (en) * | 2009-03-05 | 2010-09-09 | Fujitsu Limited | Log information issuing device, log information issuing method, and program |
-
2010
- 2010-10-26 CN CN201010523391.7A patent/CN102457906B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101014002A (en) * | 2006-12-12 | 2007-08-08 | 华为技术有限公司 | Cluster message transmitting method and distributed cluster system |
| US20100229182A1 (en) * | 2009-03-05 | 2010-09-09 | Fujitsu Limited | Log information issuing device, log information issuing method, and program |
| CN101753444A (en) * | 2009-12-31 | 2010-06-23 | 卓望数码技术（深圳）有限公司 | Method and device for load balancing |
Non-Patent Citations (1)
| Title |
|---|
| 嵇智辉，倪宏，刘磊: "动态消息队列负载均衡策略的研究与应用", 《计算机工程》, vol. 35, no. 8, 30 April 2009 (2009-04-30) * |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103927218B (en) * | 2014-04-30 | 2017-07-04 | 广州唯品会网络技术有限公司 | Event distributing method and system |
| CN103927218A (en) * | 2014-04-30 | 2014-07-16 | 广州唯品会网络技术有限公司 | Event dispatching method and system |
| CN104539661A (en) * | 2014-12-11 | 2015-04-22 | 曙光信息产业(北京)有限公司 | Message queue processing method and device |
| CN105306552A (en) * | 2015-09-30 | 2016-02-03 | 中国科学院计算技术研究所 | Consumption equilibrium method and system based on message queues |
| CN106886457A (en) * | 2015-12-16 | 2017-06-23 | 泰康保险集团股份有限公司 | Message queue processing method and processing device |
| CN106886457B (en) * | 2015-12-16 | 2020-09-04 | 泰康保险集团股份有限公司 | Message queue processing method and device |
| CN105721553A (en) * | 2016-01-25 | 2016-06-29 | 中国联合网络通信有限公司广东省分公司 | Self-adaptive cluster message dispatcher |
| CN105721553B (en) * | 2016-01-25 | 2019-06-25 | 中国联合网络通信有限公司广东省分公司 | A kind of adaptive cluster message distributor |
| CN106878197A (en) * | 2017-02-22 | 2017-06-20 | 郑州云海信息技术有限公司 | A management system and method for cloud platform message transmission |
| CN107592364B (en) * | 2017-09-22 | 2020-08-11 | 中汇信息技术（上海）有限公司 | Distributed message exchange method and system |
| CN107592364A (en) * | 2017-09-22 | 2018-01-16 | 中汇信息技术（上海）有限公司 | A kind of distributed message exchange method and system |
| CN108134830A (en) * | 2017-12-20 | 2018-06-08 | 马上消费金融股份有限公司 | Load balancing method, system, device and storage medium based on message queue |
| CN108848039B (en) * | 2018-04-24 | 2021-11-02 | 平安科技（深圳）有限公司 | Server, message distribution method and storage medium |
| CN108848039A (en) * | 2018-04-24 | 2018-11-20 | 平安科技（深圳）有限公司 | The method and storage medium that server, message are distributed |
| CN109145593A (en) * | 2018-07-04 | 2019-01-04 | 杭州涂鸦信息技术有限公司 | A kind of method, apparatus and computer equipment of Internet of Things net filtration invalid data |
| CN111078389A (en) * | 2018-10-18 | 2020-04-28 | 杭州海康威视数字技术股份有限公司 | Junk data cleaning method and device, electronic equipment and readable storage medium |
| CN111078389B (en) * | 2018-10-18 | 2023-09-05 | 杭州海康威视数字技术股份有限公司 | A garbage data cleaning method, device, electronic equipment and readable storage medium |
| CN109976977A (en) * | 2019-03-28 | 2019-07-05 | 努比亚技术有限公司 | Application service loads decompression method, server and storage medium |
| CN110149392A (en) * | 2019-05-17 | 2019-08-20 | 优信拍（北京）信息科技有限公司 | A kind of management method and device of PUSH message |
| CN110290217A (en) * | 2019-07-01 | 2019-09-27 | 腾讯科技（深圳）有限公司 | Processing method and processing device, storage medium and the electronic device of request of data |
| CN110290217B (en) * | 2019-07-01 | 2022-04-26 | 腾讯科技（深圳）有限公司 | Data request processing method and device, storage medium and electronic device |
| CN111541619A (en) * | 2020-04-30 | 2020-08-14 | 中国人民银行清算总中心 | Self-adaptive active load adjusting method and device of enterprise information networking checking system |
| CN111541619B (en) * | 2020-04-30 | 2023-05-05 | 中国人民银行清算总中心 | Self-adaptive active load adjusting method and device for enterprise information networking checking system |
| CN111782488A (en) * | 2020-07-10 | 2020-10-16 | 中国工商银行股份有限公司 | Message queue monitoring method and device, electronic equipment and medium |
| CN111782488B (en) * | 2020-07-10 | 2024-02-02 | 中国工商银行股份有限公司 | Message queue monitoring method, device, electronic equipment and medium |
| CN112612607A (en) * | 2020-12-16 | 2021-04-06 | 平安消费金融有限公司 | Data processing method, device, computer equipment and medium based on message queue |
| CN113835905A (en) * | 2021-09-28 | 2021-12-24 | 北京奇艺世纪科技有限公司 | Message queue load balancing method and device, electronic equipment and medium |
| CN113835905B (en) * | 2021-09-28 | 2023-09-05 | 北京奇艺世纪科技有限公司 | Message queue load balancing method and device, electronic equipment and medium |
| CN115484211A (en) * | 2022-09-14 | 2022-12-16 | 中国银行股份有限公司 | Double-activity processing method and system for size payment system |
| CN119629680A (en) * | 2024-11-18 | 2025-03-14 | 中国联合网络通信集团有限公司 | A method, device and readable storage medium for smoothing message peaks |
| CN119629680B (en) * | 2024-11-18 | 2025-10-28 | 中国联合网络通信集团有限公司 | Method, device and readable storage medium for smoothing message peaks |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102457906B (en) | 2014-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102457906A (en) | Load balancing control method and system of message queues | |
| US10887247B2 (en) | Dynamic resource allocation for sensor devices on a cellular network | |
| CN111131401B (en) | Service request response method and system | |
| US10904303B2 (en) | Control message from streaming source to facilitate scaling | |
| EP2972855B1 (en) | Automatic configuration of external services based upon network activity | |
| US20160344582A1 (en) | Call home cluster | |
| US10383259B2 (en) | System and method for thermal control in a chassis | |
| CN114391250B (en) | Bandwidth management method and device, computer storage medium and chip | |
| CN101909048A (en) | Centralized trans-coding treatment method and device | |
| CN102646062A (en) | A cloud computing platform application cluster elastic expansion method | |
| CN102984012A (en) | Management method and system for service resources | |
| CN112231123A (en) | Message processing method, device, storage medium and electronic device | |
| CN104750544A (en) | Process management system and process management method applied in distributed system | |
| CN110865921A (en) | Data monitoring method, apparatus, readable storage medium and electronic device | |
| CN105893211A (en) | Method and system for monitoring | |
| CN102902594A (en) | Resource management system and resource management method | |
| CN109388501B (en) | Communication matching method, device, equipment and medium based on face recognition request | |
| CN108667920B (en) | A fog computing environment business traffic acceleration system and its business traffic acceleration method | |
| CN107341045A (en) | A kind of scheduling virtual machine management method and scheduler | |
| CN1979423A (en) | Multi-processor load distribution-regulation method | |
| KR101272077B1 (en) | System and method for providing push service | |
| CN103873576A (en) | Monitoring and management method and system based on virtual system | |
| CN107729141B (en) | Service distribution method, device and server | |
| CN117675812A (en) | Task processing method, system and terminal based on distributed message middleware | |
| CN105808448A (en) | Memory management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |