CN116319810A - Distributed system flow control method, device, equipment, medium and product - Google Patents

Abstract

The invention discloses a flow control method, device, equipment, medium and product of a distributed system. The present invention relates to the fields of computer technology, financial technology and information technology. The method includes: allocating the received service request to the target server in the distributed system; determining the current server concurrency and/or service category concurrency of the target server according to the service request; and/or the concurrency of the service category to control the flow of the target server; if the target server accepts the service request, then determine the current system concurrency of the distributed system according to the service request; according to the system concurrency The amount controls the flow of the distributed system. By using this method, by performing dual flow control on the distributed system, the flow control of each server in the distributed system can be effectively realized, and the stability and high availability of the distributed cluster's response to the service can be ensured.

Description

Distributed system flow control method, device, equipment, medium and product

technical field

Embodiments of the present invention relate to the fields of computer technology, financial technology, and information technology, and in particular, to a flow control method, device, equipment, storage medium, and program product of a distributed system.

Background technique

A highly available system generally provides some self-protection capabilities, and usually requires various means to provide system availability, such as caching, downgrading, and current limiting. When encountering a sudden business traffic peak and system performance cannot be supported, if there are no similar measures to protect the system, the entire system may collapse. In a sudden high traffic scenario, it is impossible to obtain a particularly high service capacity in a short period of time anyway. Therefore, whether the system is about to crash or needs to be restarted after the system crashes, a flow control mechanism is needed to enable the system to serve or restore services.

Although the existing flow control based on redis cache can realize global control of flow, in the distributed application service scenario, external services conform to global flow control, which may make the service distributed in a single or multiple servers, resulting in these The server service is congested, while other servers are relatively idle, which affects the overall external service of the application.

Contents of the invention

Embodiments of the present invention provide a flow control method, device, device, and storage medium for a distributed system, which can implement flow control for each server in the distributed system, and ensure the stability and high availability of the distributed cluster's response to services.

In a first aspect, an embodiment of the present invention provides a flow control method for a distributed system, including:

Distributing the received service request to the target server in the distributed system;

Determine the current server concurrency and/or service category concurrency of the target server according to the service request; wherein, the server concurrency is the total service request concurrency of the target server, and the service category concurrency is the The total concurrent service requests of the service category corresponding to the service request;

performing flow control on the target server according to the server concurrency and/or service category concurrency;

If the target server accepts the service request, then determine the current system concurrency of the distributed system according to the service request;

Perform flow control on the distributed system according to the system concurrency.

In the second aspect, the embodiment of the present invention also provides a flow control device for a distributed system, including:

A service request allocation module, configured to allocate received service requests to target servers in the distributed system;

The server concurrency determination module is configured to determine the current server concurrency and/or service category concurrency of the target server according to the service request; wherein the server concurrency is the total service request concurrency of the target server, The concurrent volume of the business category is the total concurrent volume of business requests belonging to the business category corresponding to the business request;

A server flow control module, configured to control the flow of the target server according to the concurrent amount of the server and/or the concurrent amount of the business category;

A system concurrency determining module, configured to determine the current system concurrency of the distributed system according to the service request if the target server accepts the service request;

A system flow control module, configured to control the flow of the distributed system according to the system concurrency.

In the third aspect, the embodiment of the present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, the computer program of the present invention is implemented. The flow control method of the distributed system described in any one of the embodiments.

In the fourth aspect, the embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the flow of the distributed system as described in any one of the embodiments of the present invention is realized. Control Method.

In the fifth aspect, the embodiment of the present invention also provides a computer program product, including a computer program, when the computer program is executed by a processor, it implements the flow control method of a distributed system as described in any one of the embodiments of the present invention .

In the embodiment of the present invention, by allocating the received service request to the target server in the distributed system; determining the current server concurrency and/or service category concurrency of the target server according to the service request; according to the Server concurrency and/or business class concurrency control the flow of the target server; if the target server accepts the service request, then determine the current system concurrency of the distributed system according to the service request; Perform flow control on the distributed system according to the system concurrency. The technical solution of this embodiment can effectively control the flow of each server in the distributed system by performing dual flow control on the distributed system, and ensure the stability and high availability of the distributed cluster's response to services.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention, and thus It should be regarded as a limitation on the scope, and those skilled in the art can also obtain other related drawings based on these drawings without creative work.

FIG. 1 is a flowchart of a flow control method for a distributed system provided by an embodiment of the present invention;

FIG. 2 is a flow chart of another flow control method for a distributed system provided by an embodiment of the present invention;

FIG. 3 is a flowchart of another flow control method for a distributed system provided by an embodiment of the present invention;

FIG. 4 is a flowchart of another flow control method for a distributed system provided by an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a flow control device for a distributed system provided by an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

Detailed ways

The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

It should be noted that like numerals and letters denote similar items in the following figures, therefore, once an item is defined in one figure, it does not require further definition and explanation in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", etc. are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance. The acquisition, storage, use, and processing of data in the technical solution of this application all comply with the relevant provisions of national laws and regulations.

Redis: An in-memory database that mainly uses distributed caching. When the server is a multi-server cluster, Redis can well solve the problem of synchronizing cached data between multiple servers.

Fig. 1 is a flow chart of a flow control method of a distributed system provided by an embodiment of the present invention. This embodiment is applicable to the flow control of a distributed system, and the method can be executed by a flow control device of a distributed system The flow control device of the distributed system can be implemented in the form of hardware and/or software, and the flow control device of the distributed system can be configured in an electronic device, and the electronic device can be a mobile terminal, a PC or a server. As shown in Figure 1, the method includes:

S110. Distributing the received service request to the target server in the distributed system.

Wherein, the service request may be a data service request of an external system received by the data service bus in the distributed system, for example, providing a service addressing service and the like. The target server can be any application server that has registered service information in the distributed system.

Specifically, the distribution of service requests is random, and the data service bus randomly distributes the received service requests to the target servers in the distributed system.

S120. Determine the current server concurrency and/or service category concurrency of the target server according to the service request.

Wherein, the server concurrency is the total service request concurrency of the target server, and the service category concurrency is the total service request concurrency belonging to the service category corresponding to the service request.

Specifically, multiple service categories can be supported in the system at the same time, for example, it can be reflected in the call-in code in the service request message, and different call-in codes correspond to different service categories.

Specifically, the system can implement data collection at the service request access point, for example, it can collect key characteristic data required by the logic of the control strategy. At the same time, the number of business requests can be determined according to the business requests, and then the system will add the server concurrency to the number of business requests to obtain the current server concurrency of the target server. Obtain the service category identifier of the service request according to the key feature data collected above, and then add the service category concurrency corresponding to the service category identifier to the number of service requests to obtain the current service category concurrency of the target server.

Optionally, the method of determining the current server concurrency and/or business category concurrency of the target server according to the business request may be: adding the server concurrency to the number of business requests to obtain the current server concurrency of the target server; Business category identifier; add the number of business requests to the concurrent service category corresponding to the service category identifier to obtain the current concurrent service category of the target server.

Specifically, the service category identifier may be data identifying a specific service category in the key characteristic data of the service request. Exemplarily, the call-in code in the key feature data in the service request message may be used as a service category identifier, and different service category identifiers may be used to correspond to different service categories.

Specifically, the system can implement data collection at the service request access point. The number of business requests is determined according to the business requests, and then the system adds the server concurrency to the number of business requests to obtain the current server concurrency of the target server. Obtain the service category identifier of the service request according to the key feature data collected above, and then add the service category concurrency corresponding to the service category identifier to the number of service requests to obtain the current service category concurrency of the target server.

In this embodiment, by determining the current server concurrency and/or business category concurrency of the target server, the relevant flow control strategy can be called to perform judgment logic processing according to the number of concurrency, and to determine the access request based on the comparison result in the future. Implement a pass or block operation.

S130. Perform flow control on the target server according to the server concurrency and/or the service category concurrency.

Specifically, flow control can be controlled by visiting services, only allowing services that meet the requirements to enter the system, and the excess will be rejected, queued or waited, reduced, etc.

Specifically, firstly, according to the above-mentioned determined server concurrency and/or service category concurrency, threshold judgment is made on the current traffic state, and the set related flow control policy judgment logic is invoked for processing, and traffic control is performed on the target server according to the comparison result, that is Decide whether to accept or reject the business request.

Optionally, before performing traffic control on the target server according to the concurrency of the server and/or the concurrency of the service category, it also includes: configuring the first set threshold corresponding to the target server and the second set threshold corresponding to each service category; wherein , the sum of the second set thresholds of each service category is less than or equal to the first set threshold.

Specifically, the first set threshold may be a preset threshold, which is set accordingly according to the total concurrency of the target server. The second set threshold may be a preset threshold, and the set threshold may be composed of multiple thresholds, which are set correspondingly according to the concurrency of the service category of the target server. That is, different service categories may correspond to a second set threshold corresponding to the service category, and the foregoing threshold setting may be set according to actual needs, and is not specifically limited in this embodiment of the present invention. Wherein, the sum of the second set thresholds of each service category is less than or equal to the first set threshold.

Optionally, the way to control the flow of the target server according to the concurrency of the server and/or the concurrency of the service category may be: if the concurrency of the server is less than the first set threshold, and the concurrency of the service category is less than the second set threshold corresponding to the service category If the threshold is set, the target server accepts the service request; if the concurrent amount of the server is greater than or equal to the first set threshold, and/or the concurrent amount of the business category is greater than or equal to the second set threshold, then the set flow control policy is invoked to perform traffic control on the target server. flow control.

Specifically, setting the flow control policy may be a set flow control policy, wherein the flow control policy may include whether to accept the service request immediately, to accept the service request after a delay, or to reject the service request. When the set conditions are met, the set flow control strategy can be invoked to control the flow. The specific flow control strategy can be set according to actual needs, and is not specifically limited in the embodiment of the present invention.

Specifically, compare the concurrent amount of the server with the set first threshold, and compare the concurrent amount of the business category with the second threshold corresponding to the business category. If the concurrent amount of the server is less than the first threshold, And if the concurrent amount of the service category is less than the second set threshold corresponding to the service category, the target server accepts the service request. If the concurrency of the server is greater than or equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold, the set flow control policy is invoked to control the flow of the target server.

Optionally, the method of invoking the set flow control policy to control the flow of the target server may be: rejecting the service request.

When the aforementioned server concurrency is greater than or equal to the first set threshold, and/or the service category concurrency is greater than or equal to the second set threshold, the service request may be directly rejected.

Optionally, the method of invoking the set flow control strategy to control the flow of the target server may be: cache the service request for a set time, if the target server reaches the server concurrency within the set time and is less than the first set threshold, and the business type If the concurrency amount is less than the second set threshold value corresponding to the service category, the target server accepts the service request; if the target server remains in the state where the server concurrency amount is greater than or equal to the first set threshold value within the set time period, and/or the service category concurrency If the amount is greater than or equal to the second set threshold, the service request is rejected.

Specifically, when the above-mentioned concurrency of the server is greater than or equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold, the service request can be put into the cache first. When the target server reaches a state where the server concurrency is less than the first set threshold and the service category concurrency is less than the second set threshold corresponding to the service category, the target server accepts the service request. If the target server remains in a state where the server concurrency is greater than or equal to the first set threshold and/or the service category concurrency is greater than or equal to the second set threshold within the set time period, the service request is rejected. Wherein, the set duration can be set to 5 seconds or 10s, etc., which is set according to actual needs, and is not specifically limited in the embodiment of the present invention.

Optionally, the method of invoking and setting the flow control policy to control the flow of the target server may be: forwarding the service request to other servers in the distributed system, so that other servers perform flow control on the service request.

Specifically, when the above-mentioned server concurrency is greater than or equal to the first set threshold, and/or the service category concurrency is greater than or equal to the second set threshold, or if the target server still maintains the server concurrency greater than or equal to Or it is equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold, then the service request can be forwarded to other servers in the distributed system, so that other servers can control the flow of service requests . Wherein, other servers control the flow of service requests in the same way as the above-mentioned way, and will not be repeated here.

In this embodiment, through the flow control policy, the flow control of each server in the distributed system can be implemented, so as to ensure the stability and high availability of the service response of the distributed cluster.

Optionally, after rejecting the service request, the method further includes: updating the server concurrency and/or service category concurrency of the target server according to the number of service requests.

Specifically, after the service request is rejected, the server concurrency and/or service category concurrency of the target server is updated based on the target server's server concurrency and/or service category concurrency minus the number of service requests.

In this embodiment, by updating the concurrency amount, each server continues to implement flow control according to the above method to ensure the accuracy of flow control.

S140. If the target server accepts the service request, determine the current system concurrency of the distributed system according to the service request.

Specifically, if the above-mentioned target server accepts the service request, determine the corresponding system concurrency according to the obtained key information of the above-mentioned service request, and then add the system concurrency corresponding to the key information to the number of business requests to obtain the key information of the distributed system The current system concurrency.

Optionally, the way to determine the system concurrency of the distributed system according to the business request may be: obtain the key information of the business request; wherein, the key information includes: business category, business subcategory, and security node information; the system corresponding to the key information Concurrency adds up the number of business requests to obtain the current system concurrency of the key information of the distributed system.

Specifically, the system can support multiple service categories at the same time, and obtain key information of service requests, wherein the key information includes: service category, service subcategory, and security node information. The call-in codes in the service request message are A1271D001, A1271D002, etc., corresponding to different service categories. Under each service category, the specific service subcategory is defined by the sub-service number in the message. For example, such as NEDPCST001, NEDPCST002, etc., that is, the specific service subcategory, which corresponds to different service categories through the security node information in the message. source of the outbound call system. For example, A1271D001 corresponds to ORACLE online real-time synchronous query, sub-service number NEDPCST001 indicates customer credit rating query, NEDPCST002 indicates customer point query; security node information 10001 can be the risk application system, and 10002 can be the customer marketing system. Finally, the corresponding system concurrency will be determined according to the key information and the number of business requests will be accumulated to obtain the current system concurrency of the key information of the distributed system.

S150. Perform flow control on the distributed system according to the system concurrency.

Specifically, flow control can control incoming services based on indicators such as flow rate, number of concurrent threads, and response time. Only services that meet the requirements are allowed to enter the system, and the excess will be rejected, queued or waited, and reduced.

Specifically, first judge the current traffic state based on the threshold of the system concurrency determined above, call the set relevant flow control strategy judgment logic for processing, and control the flow of the distributed system according to the comparison result, that is, decide whether to accept the service request or Deny the business request.

Optionally, the way to control the flow of the distributed system according to the system concurrency can be: obtain the third set threshold corresponding to the key information from the Redis cache; if the system concurrency is less than the third set threshold, process the business request ; If the system concurrency is greater than or equal to the third set threshold, reject the service request.

Specifically, the third set threshold may be a preset threshold, which is set accordingly according to key information in the Redis cache. The specific threshold setting can be set according to actual needs, and is not specifically limited in this embodiment of the present invention.

Specifically, the third set threshold corresponding to the key information is acquired from the Redis cache. The system concurrency is compared with the third set threshold, and if the system concurrency is less than the third set threshold, the service request is processed. If the system concurrency is greater than or equal to the third set threshold, the service request is rejected.

In this embodiment, Redis cache is used to control the concurrency of various specific business service requests globally, even including the service request system, in the case of high concurrency of business application requests, so as to ensure that the application system is effective according to actual business needs. , Balance and control the access of various transactions, and use redis cache to realize the global flow control scenario.

Optionally, after rejecting the business request, the method further includes: updating the system concurrency corresponding to the key information according to the number of business requests.

Specifically, after the service request is rejected, the system concurrency and/or service category concurrency of the distributed system is updated according to the system concurrency and/or service category concurrency of the distributed system minus the above service request quantity.

In the embodiment of the present invention, by distributing the received service request to the target server in the distributed system; determining the current server concurrency and/or service category concurrency of the target server according to the service request; according to the server concurrency and/or service category The concurrency is used to control the flow of the target server; if the target server accepts the business request, the current system concurrency of the distributed system is determined according to the business request; the flow of the distributed system is controlled according to the system concurrency. By using this method, by performing dual flow control on the distributed system, the flow control of each server in the distributed system can be effectively realized, and the stability and high availability of the distributed cluster's response to the service can be ensured.

Fig. 2 is a flow chart of another distributed system flow control method provided by the embodiment of the present invention. The embodiment of the present invention is based on the embodiment of the above invention. See Fig. 2, the method provided by the embodiment of the present invention Specifically include the following steps:

S210. Distribute the received service request to the target server in the distributed system.

S220. Add the server concurrency to the number of service requests to obtain the current server concurrency of the target server.

S230. Obtain the service category identifier of the service request.

Wherein, the corresponding relationship between setting rules and interactive tasks may be one-to-one, one-to-many, or many-to-many. In this embodiment, after the setting rule is determined, one or more corresponding interactive tasks may be determined according to the setting rule.

S240. Accumulate the concurrent amount of the service type corresponding to the service type identifier to the number of service requests to obtain the current concurrent amount of the service type of the target server.

S250. Perform flow control on the target server according to the concurrency of the server and/or the concurrency of the business category.

S260. Determine the system concurrency of the distributed system according to the service request.

S270. Perform flow control on the distributed system according to the system concurrency.

Fig. 3 is a flow chart of another distributed system flow control method provided by the embodiment of the present invention. The embodiment of the present invention is based on the embodiment of the above invention. See Fig. 3, the method provided by the embodiment of the present invention Specifically include the following steps:

S310. Distribute the received service request to the target server in the distributed system.

S320. Determine the current server concurrency and/or service category concurrency of the target server according to the service request.

S330. Compare the concurrency of the server and the concurrency of the service category with the first set threshold and the second set threshold, respectively.

S340. If the concurrency of the server is less than the first set threshold and the concurrency of the service category is less than the second set threshold corresponding to the service category, the target server accepts the service request.

S350. If the concurrent amount of the server is greater than or equal to the first set threshold, and/or the concurrent amount of the service category is greater than or equal to the second set threshold, call the set flow control policy to control the flow of the target server.

S360. Determine the system concurrency of the distributed system according to the service request.

S370. Perform flow control on the distributed system according to the system concurrency.

FIG. 4 is a flowchart of another flow control method for a distributed system provided by an embodiment of the present invention.

Specific steps are as follows:

S410. Distribute the received service request to the target server in the distributed system.

S420. Determine the current server concurrency and/or service category concurrency of the target server according to the service request.

S430. Perform flow control on the target server according to the server concurrency and/or the service category concurrency.

S440. Acquire key information of the service request; wherein, the key information includes: service category, service subcategory, and security node information.

S450. Accumulate the system concurrency amount corresponding to the key information to the number of service requests to obtain the current system concurrency amount of the key information of the distributed system.

S460. Obtain a third set threshold corresponding to the key information from the Redis cache. Comparing the system concurrency with the third set threshold.

S470. If the system concurrency is less than the third set threshold, process the service request.

S480. If the system concurrency is greater than or equal to the third set threshold, reject the service request.

FIG. 5 is a schematic structural diagram of a flow control device for a distributed system provided by an embodiment of the present invention. As shown in Figure 5, a business request allocation module 510, a server concurrency determination module 520, a server flow control module 530, a system concurrency determination module 540 and a system flow control module 550;

A service request allocation module 510, configured to allocate received service requests to target servers in the distributed system;

The server concurrency determination module 520 is configured to determine the current server concurrency and/or service category concurrency of the target server according to the service request; wherein, the server concurrency is the total service request concurrency of the target server , the concurrent volume of the business category is the total concurrent volume of business requests belonging to the business category corresponding to the business request;

The server flow control module 530 is configured to control the flow of the target server according to the concurrent amount of the server and/or the concurrent amount of the service category;

A system concurrency determination module 540, configured to determine the current system concurrency of the distributed system according to the service request if the target server accepts the service request;

The system flow control module 550 is configured to control the flow of the distributed system according to the system concurrency.

In the embodiment of the present invention, by allocating the received service request to the target server in the distributed system; determining the current server concurrency and/or service category concurrency of the target server according to the service request; according to the Server concurrency and/or business class concurrency control the flow of the target server; if the target server accepts the service request, then determine the current system concurrency of the distributed system according to the service request; Perform flow control on the distributed system according to the system concurrency. By using this method, by performing dual flow control on the distributed system, the flow control of each server in the distributed system can be effectively realized, and the stability and high availability of the distributed cluster's response to services can be ensured.

Optionally, the server concurrency determining module 520 can be specifically used for:

adding the server concurrency to the number of business requests to obtain the current server concurrency of the target server;

Obtain the service category identifier of the service request;

Adding the service class concurrency corresponding to the service class identifier to the number of service requests to obtain the current service class concurrency of the target server.

Optionally, the server flow control module 530 may be specifically used for:

If the server concurrency is less than a first set threshold, and the service category concurrency is less than a second set threshold corresponding to the service category, then the target server accepts the service request;

If the concurrency of the server is greater than or equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold, call the set flow control policy to perform the target server flow control.

Optionally, the server flow control module 530 may be specifically used for:

The service request is rejected.

Optionally, the server flow control module 530 may be specifically used for:

Cache the service request for a set duration, if within the set duration, the target server achieves that the server concurrency is less than the first set threshold, and the service category concurrency is less than the second threshold corresponding to the service category If the state of the threshold is set, the target server accepts the service request;

If the target server remains within the set time period, the concurrency of the server is greater than or equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold state, the service request is rejected.

Optionally, the server flow control module 530 may be specifically used for:

Forwarding the service request to other servers in the distributed system, so that other servers perform flow control on the service request.

Optionally, after rejecting the service request, the device may also be specifically used to:

Updating the server concurrency and/or service category concurrency of the target server according to the number of service requests.

Optionally, before performing flow control on the target server according to the server concurrency and/or service category concurrency, the device may also be specifically used for:

Configuring a first set threshold corresponding to the target server and a second set threshold corresponding to each service category; wherein, the sum of the second set thresholds of each service category is less than or equal to the first set threshold.

Optionally, the system concurrency determination module 540 can be specifically used for:

Obtain key information of the service request; wherein, the key information includes: service category, service subcategory, and security node information;

The system concurrency corresponding to the key information is added to the number of service requests to obtain the current system concurrency of the key information of the distributed system.

Optionally, the system flow control module 550 may be specifically used for:

Obtaining the third set threshold corresponding to the key information from the Redis cache;

If the system concurrency is less than the third set threshold, process the service request;

If the system concurrency is greater than or equal to the third set threshold, reject the service request.

Optionally, after rejecting the service request, the device may also be specifically used to:

The system concurrency corresponding to the key information is updated according to the number of service requests.

The flow control device of the distributed system provided by the embodiment of the present invention can execute the flow control method of the distributed system provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.

FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. Figure 6 shows a block diagram of an electronic device 12 suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in FIG. 6 is only an example, and should not limit the functions and scope of use of this embodiment of the present invention. Device 12 is typically an electronic device for implementing flow control in a distributed system.

As shown in FIG. 6, electronic device 12 takes the form of a general-purpose computing device. Components of electronic device 12 may include, but are not limited to: one or more processors 16, memory 28, bus 18 connecting various system components (including memory 28 and processor 16).

Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (Industry Standard Architecture, ISA) bus, Micro Channel Architecture (Micro Channel Architecture, MCA) bus, Enhanced ISA bus, Video Electronics Standards Association (Video Electronics Standards Association , VESA) local bus and peripheral component interconnect (Peripheral Component Interconnect, PCI) bus.

Electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 12 and include both volatile and nonvolatile media, removable and non-removable media.

Memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (Random Access Memory, RAM) 30 and/or cache memory 32 . The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard drive"). Although not shown in FIG. 6, a disk drive for reading and writing to a removable non-volatile disk (such as a "floppy disk") may be provided, as well as a removable non-volatile disk (such as a Compact Disc- Read Only Memory, CD-ROM), Digital Video Disc (Digital Video Disc-Read Only Memory, DVD-ROM) or other optical media) CD-ROM drive. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present invention.

A program 36 having a set (at least one) of program modules 26, such as but not limited to, an operating system, one or more application programs, other program modules, and program data, may be stored, for example, in storage 28. Each or some combination of these may include implementations of network environments. Program modules 26 generally perform the functions and/or methodologies of the described embodiments of the invention.

The electronic device 12 can also communicate with one or more external devices 14 (such as keyboards, pointing devices, cameras, displays 24, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device 12, and/or Or communicate with any device (eg, network card, modem, etc.) that enables the electronic device 12 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 22 . Moreover, the electronic device 12 can also communicate with one or more networks (such as a local area network (Local Area Network, LAN), wide area network, Wide Area Network, WAN) and/or public networks, such as the Internet) through the network adapter 20 . As shown, network adapter 20 communicates with other modules of electronic device 12 via bus 18 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disk arrays (Redundant Arrays) of Independent Disks, RAID) systems, tape drives, and data backup storage systems.

The processor 16 executes various functional applications and data processing by running the programs stored in the memory 28, for example, realizing the flow control method of the distributed system provided by the above-mentioned embodiments of the present invention.

An embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the program is executed by a processing device, the flow control method of a distributed system as in the embodiment of the present invention is implemented. The computer-readable medium mentioned above in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and the server can communicate using any currently known or future-developed network protocols such as HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), and can communicate with digital data in any form or medium (eg, communication network) interconnections. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), internetworks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.

The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: when the target user triggers the intelligent customer service service, acquires the user identification of the target user; Determine at least one interactive task according to the user identification; wherein the interactive task includes a plurality of task elements; determine a target interactive task from the at least one interactive task according to the task elements; execute the target interactive task to interact with the target users to interact with.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, or combinations thereof, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of a unit does not constitute a limitation of the unit itself under certain circumstances.

The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), System on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

An embodiment of the present invention also provides a computer program product, including a computer program. When the computer program is executed by a processor, the flow control method of a distributed system as provided in any embodiment of the present application is implemented.

During the implementation of the computer program product, the computer program code for performing the operation of the present invention can be written in one or more programming languages or a combination thereof, and the programming language includes an object-oriented programming language, such as Java, Smalltalk , C++, and also conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).

Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the appended claims.

Claims (15)

1. A flow control method of a distributed system, characterized in that, the distributed system includes a plurality of servers; comprising: Distributing the received service request to the target server in the distributed system; Determine the current server concurrency and/or service category concurrency of the target server according to the service request; wherein, the server concurrency is the total service request concurrency of the target server, and the service category concurrency is the The total concurrent service requests of the service category corresponding to the service request; performing flow control on the target server according to the server concurrency and/or service category concurrency; If the target server accepts the service request, then determine the current system concurrency of the distributed system according to the service request; Perform flow control on the distributed system according to the system concurrency. 2. The method according to claim 1, wherein determining the current server concurrency and/or service category concurrency of the target server according to the service request includes: adding the server concurrency to the number of business requests to obtain the current server concurrency of the target server; Obtain the service category identifier of the service request; Adding the service class concurrency corresponding to the service class identifier to the number of service requests to obtain the current service class concurrency of the target server. 3. The method according to claim 1, characterized in that, performing flow control on the target server according to the concurrent amount of the server and/or the concurrent amount of the service category comprises: If the server concurrency is less than a first set threshold, and the service category concurrency is less than a second set threshold corresponding to the service category, then the target server accepts the service request; If the concurrency of the server is greater than or equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold, call the set flow control policy to perform the target server flow control. 4. The method according to claim 3, wherein calling a set flow control policy to control the flow of the target server comprises: The service request is rejected. 5. The method according to claim 3, wherein calling a set flow control policy to control the flow of the target server comprises: Cache the service request for a set duration, if within the set duration, the target server achieves that the server concurrency is less than the first set threshold, and the service category concurrency is less than the second threshold corresponding to the service category If the state of the threshold is set, the target server accepts the service request; If the target server remains within the set time period, the concurrency of the server is greater than or equal to the first set threshold, and/or the concurrency of the service category is greater than or equal to the second set threshold state, the service request is rejected. 6. The method according to claim 3, wherein calling a set flow control policy to control the flow of the target server comprises: Forwarding the service request to other servers in the distributed system, so that other servers perform flow control on the service request. 7. The method according to claim 4 or 5, characterized in that, after rejecting the service request, further comprising: Updating the server concurrency and/or service category concurrency of the target server according to the number of service requests. 8. The method according to claim 3, further comprising: before performing flow control on the target server according to the concurrent amount of the server and/or the concurrent amount of the service category: Configuring a first set threshold corresponding to the target server and a second set threshold corresponding to each service category; wherein, the sum of the second set thresholds of each service category is less than or equal to the first set threshold. 9. The method according to claim 1, wherein determining the system concurrency of the distributed system according to the service request comprises: Obtain key information of the service request; wherein, the key information includes: service category, service subcategory, and security node information; The system concurrency corresponding to the key information is added to the number of service requests to obtain the current system concurrency of the key information of the distributed system. 10. The method according to claim 9, wherein the flow control of the distributed system according to the system concurrency includes: Obtaining the third set threshold corresponding to the key information from the Redis cache; If the system concurrency is less than the third set threshold, process the service request; If the system concurrency is greater than or equal to the third set threshold, reject the service request. 11. The method according to claim 10, further comprising: after rejecting the service request: The system concurrency corresponding to the key information is updated according to the number of service requests. 12. A flow control device for a distributed system, comprising: A service request allocation module, configured to allocate received service requests to target servers in the distributed system; The server concurrency determination module is configured to determine the current server concurrency and/or service category concurrency of the target server according to the service request; wherein the server concurrency is the total service request concurrency of the target server, The concurrent volume of the business category is the total concurrent volume of business requests belonging to the business category corresponding to the business request; A server flow control module, configured to control the flow of the target server according to the concurrent amount of the server and/or the concurrent amount of the business category; A system concurrency determining module, configured to determine the current system concurrency of the distributed system according to the service request if the target server accepts the service request; A system flow control module, configured to control the flow of the distributed system according to the system concurrency. 13. An electronic device, characterized in that it includes a memory, a processor, and a computer program stored on the memory and that can be run on the processor, wherein the computer program according to claim 1 is implemented when the processor executes the computer program. - The flow control method of the distributed system described in any one of 11. 14. A computer-readable storage medium, on which a computer program is stored, wherein when the program is executed by a processor, the flow control method for a distributed system according to any one of claims 1-11 is implemented. 15. A computer program product, comprising a computer program, characterized in that, when the computer program is executed by a processor, the flow control method for a distributed system according to any one of claims 1-11 is implemented.

Images