WO2022111313A1 - Request processing method and micro-service system - Google Patents

Abstract

A request processing method and a micro-service system, which relate to the field of Fintech. The method comprises: a micro-service system receiving a first request sent by a first client and carrying a first resource identifier (201); if it is determined that the first resource identifier does not carry a service instance identifier, allocating a first service instance to the first request (202); by means of the first service instance, acquiring, from a database, a first resource indicated by the first resource identifier (203); sending the first resource to the first client and caching the first resource in the first service instance (204); and updating the first resource identifier according to a first service instance identifier of the first service instance, so as to obtain a second resource identifier for indicating the first resource (205). The micro-service system determines a service instance for a request of a certain resource, and the resource is cached after the service instance acquires the resource from the database, so as to facilitate subsequent direct response of the service instance to the request when the request for the resource reaches the micro-service system again.

Description

A request processing method and microservice system

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application with the application number 202011327754.X and the application title "A Request Processing Method and Microservice System" filed with the China Patent Office on November 24, 2020, the entire contents of which are incorporated by reference in this application.

technical field

The embodiments of the present application relate to the field of financial technology (Fintech), and in particular, to a request processing method and a microservice system.

Background technique

With the development of computer technology, more and more technologies (such as big data or cloud computing) are applied in the financial field, and the traditional financial industry is gradually transforming into financial technology. to respond to user requests.

At present, when microservices are enabled, they will be registered with the registration center in the microservice system, such as Eureka. Through the allocation processing of the registration center, for any microservice, it can correspond to one or more service instances. When the client sends a service request to the microservice system, the name of the microservice to be requested is attached, and the gateway in the microservice system parses out the service instance corresponding to the microservice, and finally forwards the service request from the client to one of them randomly. A service instance. In the design of large-scale website architecture, in order to improve the service response speed when the microservice system responds to a large number of database access requests, the microservice system generally caches the data identified by the primary key in the database into each service instance, so that A stateless service can be provided.

The above method requires each service instance to pre-cache the full amount of data or hotspot data in the database. When the scale of the service instance cluster is large or the amount of data in the database is large, the redundancy cost is relatively high.

To sum up, there is an urgent need for a simple, efficient, and low-cost method for responding to a service request.

SUMMARY OF THE INVENTION

The present application provides a request processing method and a microservice system, which are used to respond to service requests in a simple, efficient, and low-cost manner.

In a first aspect, an embodiment of the present application provides a request processing method, the method includes: a microservice system receives a first request that carries a first resource identifier sent by a first client; if the microservice system determines that the first request If the resource identifier does not carry the service instance identifier, a first service instance is allocated for the first request; the microservice system obtains the first service instance indicated by the first resource identifier from the database through the first service instance resource; the microservice system sends the first resource to the first client and caches the first resource in the first service instance; the microservice system according to the first service instance The first service instance identifier of the first resource identifier is updated to obtain the second resource identifier used to indicate the first resource.

Based on this solution, the microservice system confirms whether the service instance identifier is carried by confirming the first resource identifier in the request sent by the client. On the one hand, the microservice system can obtain the first resource indicated by the first resource identifier from the database through the service instance, and send it to the client and cache it in the service instance. On the other hand, the microservice system can also The first resource identifier is updated, and the update process includes adding the identifier of the service instance, so that when the subsequent client requests the first resource, the service instance that has cached the first resource can directly access the service instance. respond. In this method, the microservice system determines a service instance for a request for a resource, and the service instance caches the resource after obtaining the resource from the database, so that subsequent requests for the resource can reach the microservice system again. At the time, the service instance can directly respond to the request, avoiding the need to cache all resources for each service instance in the microservice system, which greatly reduces the redundancy of the system.

In a possible implementation method, the method further includes: if the microservice system determines that the first resource identifier carries a second service instance identifier, assigning the first request to the second service instance identifier A service instance; the microservice system sends the first resource indicated by the first resource identifier cached by the second service instance to the first client.

Based on this solution, in the process of confirming the first resource identifier by the microservice system, if it is confirmed that the identifier of the second service instance is carried in it, it means that the microservice system has passed the second service instance identifier before the first request enters the microservice system. The service instance caches the first resource corresponding to the first request, and uses the second service instance identifier to update the first resource identifier, so the microservice system checks that the first resource identifier carries the second service instance identifier , the microservice system can directly forward the first request to the second service instance, and the second service instance uses the locally cached first resource corresponding to the first request to directly respond to the first request, thereby improving the response to the request. The efficiency of the response.

In a possible implementation method, the first resource identifier further carries a third service instance identifier, and the third service instance corresponding to the third service instance identifier is a backup service instance of the second service instance; The method further includes: if the microservice system determines that the second service instance is in an unavailable state, allocating the first request to the third service instance.

Based on this solution, in the process of allocating a service instance that can serve the first request to the micro-service system, in addition to assigning a second service instance to it, it can also be assigned a third service instance (wherein the third service instance can be multiple), the third service instance is the backup service instance of the second service instance, so that before the microservice system prepares to allocate the first request to the second service instance, by determining whether the status of the second service instance is is available, that is, it is determined whether the second service instance is in a serviceable state, and when the microservice system determines that the second service instance is in an unavailable state, the microservice system can allocate the first request based on the identifier of the third service instance. to a third service instance to respond to the first request by the third service instance. In this method, the third service instance is a service instance with better performance except the second service instance that is determined in advance based on the real-time and dynamic resources and load conditions of the service instance cluster and can serve the first request. Achieve the goal of high availability under the failure condition of the second service instance.

In a possible implementation method, the method further includes: receiving, by the microservice system, a second request sent by a second client that carries the second resource identifier; the second client is obtained through a refresh mechanism the second resource identifier; the microservice system determines that the second resource identifier carries the first service instance identifier, and allocates the second request to the first service instance; the microservice The system sends the first resource cached by the first service instance to the second client.

Based on this solution, when the first request sent by the first client is a request sent to the micro-service system for the first time, the micro-service system can allocate a service instance that can serve the first request—the first service instance, and The identifier corresponding to the first resource is updated from the first resource identifier to the second resource identifier, so that if the subsequent client (ie the second client) requests the first resource corresponding to the first request again, that is, the second The second request sent by the client to the microservice system carries the second resource identifier, and the second resource identifier is obtained by the second client through the refresh mechanism. The microservice system can directly use the first service instance to request the second client terminal responds. This method is based on the fact that the first resource has been cached in the first service instance in the microservice system, and the microservice system also updates the identifier of the first resource, that is, the relationship between the first resource and the first service instance is established. A binding/correspondence relationship, so that the microservice system can quickly respond to a request for the same resource (eg, the first resource) based on the first service instance.

In a possible implementation method, the micro-service system updates the first resource identifier according to the first service instance identifier of the first service instance, and obtains a second resource identifier for indicating the first resource, The method includes: the micro-service system sequentially splices the first resource identifier and the first service instance identifier according to a set sequence, and obtains a second resource identifier for indicating the first resource.

Based on this solution, after the microservice system determines that the service instance that can serve it is the first service instance for the first request entering it for the first time, it can update the first resource identifier that identifies the first resource, such as splicing sequentially The first resource identifier and the first service instance identifier, so that the result after splicing can be the second resource identifier. In this method, the second resource identifier is obtained by adding the first service instance identifier to the first resource identifier, that is, the binding/correspondence relationship between the first resource and the first service instance is established, which is convenient for the microservice system to After the second resource identifier is parsed, the first service instance can be quickly determined and the request can be forwarded.

In a possible implementation method, before the obtaining the second resource identifier used to indicate the first resource, the method further includes: determining, by the micro-service system, a backup service instance of the first service instance; the micro-service system The service system sequentially splices the first resource identifier and the first service instance identifier according to the set order, and obtains the second resource identifier used to indicate the first resource, including: the micro-service system follows the set order in order The first resource identifier, the first service instance identifier and the standby service instance identifier of the standby service instance are spliced together to obtain a second resource identifier for indicating the first resource.

Based on this solution, in the process of allocating a service instance for the first request entering it for the first time, the micro-service system can not only determine the first service instance, but also determine the backup service instance of the first service instance (wherein the backup service instance The number can be multiple), so that when the first service instance is unavailable, the microservice system allocates the request to the standby service instance of the first service instance, so that the microservice system can determine the first service instance. When the first resource identifier is updated, the identifier of the standby service instance can be added to it, so that when the first service instance is unavailable, the microservice system can quickly allocate the request to the first service instance. The backup service instance goes up to achieve the goal of high availability.

In a possible implementation method, the micro-service system splices the first resource identifier, the first service instance identifier and the standby service instance identifier of the standby service instance in sequence according to the set order, and obtains an indicator for indicating The second resource identifier of the first resource includes: the microservice system encrypts the first microservice instance identifier and the standby service instance identifier of the standby service instance to obtain encrypted information; The first resource identifier and the encrypted information are sequentially spliced in a certain order to obtain a second resource identifier for indicating the first resource.

In a possible implementation method, the allocating the first service instance to the first request includes: for any service instance in the service instance cluster, the microservice system determines the available resources of the service instance and the Used load; according to the available resources and the used load, determine the idle degree of the service instance; the microservice system determines the service instance whose idle degree meets the set condition as the first service instance.

Based on this solution, the micro-service system allocates a first service instance to the request if it determines that it does not carry a service instance identifier for the first request that enters it. The allocation process can be based on real-time, dynamic resource and The idle degree of each service instance is determined according to the load situation, so that the service instance whose idle degree satisfies the set condition can be determined as the first service instance. By evaluating the idleness of the service instances in the service instance cluster, and taking the service instance whose idleness meets the set condition as the first service instance, the purpose of caching the resource corresponding to the request with the service instance in the best state is realized.

In a possible implementation method, the micro-service system determines the available resources and used load of the service instance for any service instance in the service instance cluster, including: any service instance of the service instance, determine the number of unused central processing unit CPU cores and unused memory of the service instance as the available resources, and determine the number of requested accesses and requests of the service instance in the preset historical period The access duration is determined as the used load; the determining the idle degree of the service instance according to the available resources and the used load includes: the micro server system compares the available resources with the used load The load ratio is determined as the idleness degree of the service instance.

Based on this solution, in the process of determining the idleness of service instances in the service instance cluster by the microservice system, it can be carried out based on the real-time resources and load conditions of the service instance cluster in the current state. The number of CPU cores and memory used as the representation of available resources, and the number of requested accesses received by the service instance and the access duration can be used as the representation of the used load. Based on the available resources and the used load, an The idleness of the service instance is evaluated, which can be specifically expressed as the ratio of the available resources to the used load is defined as the idleness of the service instance.

In a second aspect, the present application provides a micro-service system, the micro-service system includes: a receiving unit, configured to receive a first request that carries a first resource identifier sent by a first client; a processing unit, configured to determine if the If the first resource identifier does not carry a service instance identifier, a first service instance is allocated to the first request; an acquiring unit is configured to obtain the first resource identifier from the database through the first service instance. the first resource; the processing unit is further configured to send the first resource to the first client and cache the first resource in the first service instance; the processing unit is further configured to for updating the first resource identifier according to the first service instance identifier of the first service instance to obtain a second resource identifier for indicating the first resource.

Based on this solution, the microservice system confirms whether the service instance identifier is carried by confirming the first resource identifier in the request sent by the client. On the one hand, the microservice system can obtain the first resource indicated by the first resource identifier from the database through the service instance, and send it to the client and cache it in the service instance. On the other hand, the microservice system can also The first resource identifier is updated, and the update process includes adding the identifier of the service instance, so that when the subsequent client requests the first resource, the service instance that has cached the first resource can directly access the service instance. respond. In this method, the microservice system determines a service instance for a request for a resource, and the service instance caches the resource after obtaining the resource from the database, so that subsequent requests for the resource can reach the microservice system again. At the time, the service instance can directly respond to the request, avoiding the need to cache all resources for each service instance in the microservice system, which greatly reduces the redundancy of the system.

In a possible implementation method, the processing unit is further configured to: if it is determined that the first resource identifier carries a second service instance identifier, assign the first request to the second service instance ; Send the first resource indicated by the first resource identifier cached by the second service instance to the first client.

Based on this solution, in the process of confirming the first resource identifier by the microservice system, if it is confirmed that the identifier of the second service instance is carried in it, it means that the microservice system has passed the second service instance identifier before the first request enters the microservice system. The service instance caches the first resource corresponding to the first request, and uses the second service instance identifier to update the first resource identifier, so the microservice system checks that the first resource identifier carries the second service instance identifier , the microservice system can directly forward the first request to the second service instance, and the second service instance uses the locally cached first resource corresponding to the first request to directly respond to the first request, thereby improving the response to the request. The efficiency of the response.

In a possible implementation method, the first resource identifier further carries a third service instance identifier, and the third service instance corresponding to the third service instance identifier is a backup service instance of the second service instance; The processing unit is further configured to: if it is determined that the second service instance is in an unavailable state, assign the first request to the third service instance.

Based on this solution, in the process of allocating a service instance that can serve the first request to the micro-service system, in addition to assigning a second service instance to it, it can also be assigned a third service instance (wherein the third service instance can be multiple), the third service instance is the backup service instance of the second service instance, so that before the microservice system prepares to allocate the first request to the second service instance, by determining whether the status of the second service instance is is available, that is, it is determined whether the second service instance is in a serviceable state, and when the microservice system determines that the second service instance is in an unavailable state, the microservice system can allocate the first request based on the identifier of the third service instance. to a third service instance to respond to the first request by the third service instance. In this method, the third service instance is a service instance with better performance except the second service instance that is determined in advance based on the real-time and dynamic resources and load conditions of the service instance cluster and can serve the first request. Achieve the goal of high availability under the failure condition of the second service instance.

In a possible implementation method, the receiving unit is further configured to: receive a second request sent by a second client that carries the second resource identifier; the second client obtains the second resource through a refresh mechanism the second resource identifier; the processing unit is further configured to: determine that the second resource identifier carries the first service instance identifier, then allocate the second request to the first service instance; The first resource cached by the first service instance is sent to the second client.

Based on this solution, when the first request sent by the first client is a request sent to the micro-service system for the first time, the micro-service system can allocate a service instance that can serve the first request—the first service instance, and The identifier corresponding to the first resource is updated from the first resource identifier to the second resource identifier, so that if the subsequent client (ie the second client) requests the first resource corresponding to the first request again, that is, the second The second request sent by the client to the microservice system carries the second resource identifier, and the second resource identifier is obtained by the second client through the refresh mechanism. The microservice system can directly use the first service instance to request the second client terminal responds. This method is based on the fact that the first resource has been cached in the first service instance in the microservice system, and the microservice system also updates the identifier of the first resource, that is, the relationship between the first resource and the first service instance is established. A binding/correspondence relationship, so that the microservice system can quickly respond to a request for the same resource (eg, the first resource) based on the first service instance.

In a possible implementation method, the processing unit is specifically configured to: splicing the first resource identifier and the first service instance identifier in sequence according to the set order, to obtain the first resource indicating the first resource. 2. Resource ID.

Based on this solution, after the microservice system determines that the service instance that can serve it is the first service instance for the first request entering it for the first time, it can update the first resource identifier that identifies the first resource, such as splicing sequentially The first resource identifier and the first service instance identifier, so that the result after splicing can be the second resource identifier. In this method, the second resource identifier is obtained by adding the first service instance identifier to the first resource identifier, that is, the binding/correspondence relationship between the first resource and the first service instance is established, which is convenient for the microservice system to After the second resource identifier is parsed, the first service instance can be quickly determined and the request can be forwarded.

In a possible implementation method, the processing unit is further configured to: determine a backup service instance of the first service instance; the processing unit is specifically configured to: sequentially splicing the first resources according to a set order The identifier, the first service instance identifier, and the standby service instance identifier of the standby service instance, to obtain a second resource identifier for indicating the first resource.

Based on this solution, in the process of allocating a service instance for the first request entering it for the first time, the micro-service system can not only determine the first service instance, but also determine the backup service instance of the first service instance (wherein the backup service instance The number can be multiple), so that when the first service instance is unavailable, the microservice system allocates the request to the standby service instance of the first service instance, so that the microservice system can determine the first service instance. When the first resource identifier is updated, the identifier of the standby service instance can be added to it, so that when the first service instance is unavailable, the microservice system can quickly allocate the request to the first service instance. The backup service instance goes up to achieve the goal of high availability.

In a possible implementation method, the processing unit is specifically configured to: encrypt the first service instance identifier and the standby service instance identifier of the standby service instance to obtain encrypted information; splicing the The first resource identifier and the encrypted information obtain a second resource identifier for indicating the first resource.

In a possible implementation method, the processing unit is specifically configured to: for any service instance in the service instance cluster, determine the available resources and used load of the service instance; The used load is determined as the idle degree of the service instance; the service instance whose idle degree satisfies the set condition is determined as the first service instance.

Based on this solution, the micro-service system allocates a first service instance to the request if it determines that it does not carry a service instance identifier for the first request that enters it. The allocation process can be based on real-time, dynamic resource and The idle degree of each service instance is determined according to the load situation, so that the service instance whose idle degree satisfies the set condition can be determined as the first service instance. By evaluating the idleness of the service instances in the service instance cluster, and taking the service instance whose idleness meets the set condition as the first service instance, the purpose of caching the resource corresponding to the request with the service instance in the best state is realized.

In a possible implementation method, the processing unit is specifically configured to: for any service instance in the service instance cluster, determine the number of unused central processing unit CPU cores and unused memory of the service instance as The available resources, and the number of requested accesses and the requested access duration of the service instance in the preset historical period are determined as the used load; the ratio of the available resources to the used load is determined as the used load. Describes the idleness of the service instance.

Based on this solution, in the process of determining the idleness of service instances in the service instance cluster by the microservice system, it can be carried out based on the real-time resources and load conditions of the service instance cluster in the current state. The number of CPU cores and memory used as the representation of available resources, and the number of requested accesses received by the service instance and the access duration can be used as the representation of the used load. Based on the available resources and the used load, an The idleness of the service instance is evaluated, which can be specifically expressed as the ratio of the available resources to the used load is defined as the idleness of the service instance. In a third aspect, an embodiment of the present application provides a computing device, including:

memory for storing program instructions;

The processor is configured to call the program instructions stored in the memory, and execute any one of the implementation methods of the first aspect according to the obtained program.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute any implementation of the first aspect method.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

FIG. 1 is a schematic diagram of a possible system architecture provided by an embodiment of the present application;

FIG. 2 provides a request processing method according to an embodiment of the present application;

FIG. 3 provides a microservice system according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a computing device according to an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

At present, when the microservice system responds to the service request sent by the client (the service request will carry the primary key identifier of the resource in the database), in order to achieve high availability, it will be pre-cached on any service instance in the service instance cluster. Each primary key in the database identifies the corresponding resource, so that each service instance can provide a stateless service. However, in this process, when the scale of the service instance cluster is large or the amount of data in the database is large, the redundancy cost is relatively high.

In view of the above technical problems, the present application provides a schematic diagram of a possible system architecture, as shown in FIG. 1 , the architecture includes a client 110 , a microservice system 120 and a database 130 . The microservice system 120 may further include a gateway 1201, a registry 1202, an alias management unit 1203, and a service instance cluster 1204, wherein the service instance cluster 1204 may include multiple service instances.

The gateway 1201 in the microservice system 120 may receive a service request sent by the client 110, and the service request carries the resource identifier of the resource to be requested. After the gateway 1201 receives the service request, by parsing the resource identifier in it, on the one hand, the gateway 1201 can determine the primary key identifier of the resource to be requested in the database 130, wherein the database 130 is a primary key for the stored in it On the other hand, the gateway 1201 can also determine whether the resource identifier contains the identifier of the service instance in the microservice system 120, and make corresponding response actions according to the identification result. The identification results may include:

Case 1. The resource identifier does not include the identifier of the service instance.

If the resolution result of the resource identifier by the gateway 1201 is that the identifier of the service instance is not included, the gateway 1201 may send instruction information to the alias management unit 1203 in the microservice system 120, instructing the alias management unit 1203 to respond to the service in the microservice system 120. The idleness of each service instance in the instance cluster 1204 is determined. After the alias management unit 1203 determines the idleness of each service instance, the alias management unit 1203 must return the identifier of the service instance whose idleness meets the preset condition to the gateway. 1201, so that the gateway 1201 can send the current service request together with the received service instance identifier to the identified service instance, so that the identified service instance can respond to the current service request.

Scenario 2: The resource identifier includes the identifier of the service instance.

If the result of gateway 1201's analysis of the resource identifier is that the identifier of the service instance is included, the gateway 1201 can directly send the current service request to the identified service instance, so that the identified service instance can respond to the current service request. respond.

Wherein, when the alias management unit 1203 determines the idleness of each service instance in the service instance cluster 1204 in the microservice system 120, the service can be determined according to the real-time available resources and the used load of each service instance in the current state. The idleness of the instance, wherein the preset condition may be to determine the service instance with the most idleness in the service instance cluster 1204 as the service instance that can respond to this service request. Therefore, the alias management unit 1203 The identity of the service instance is returned to gateway 1201 . Optionally, the preset condition may also be to determine a number of service instances with the greatest degree of idleness in the service instance cluster 1204 as service instances that can respond to this service request, and determine the number of service instances with the greatest degree of idleness among the several service instances. The service instance is determined as the service instance responding to this service request, that is, the main service instance, and the service instances other than the main service instance among the several service instances are determined as the standby service instances of the main service instance, and the alias management unit In the process of sending the primary service instance ID and the backup service instance ID to the gateway 1201, 1203 is marked differently, so that the gateway 1201 can accurately distinguish the primary service instance and the backup service instance. This method can achieve high availability when the primary service instance fails.

Therefore, in case 1, after the gateway 1201 receives the identifiers of several service instances sent by the alias management unit 1203, the gateway 1201 can send the service request this time and the received service instance according to the identified primary service instance. The identifier (including the identifier of the primary service instance and the identifier of the standby service instance) is sent to the identified primary service instance, so that the identified primary service instance can respond to this service request.

It is noted that the process of responding to the current service request by the identified primary service instance may specifically include: on the one hand, the primary service instance can identify the primary key of the current service request, the primary service instance's identity, and the standby service instance. The identifier of the service request is processed to obtain a resource identifier representing another form of representation of the resource corresponding to the service request. On the other hand, the main service instance can be based on the primary key identifier in the service request. From the database connected to the microservice system 120 Obtain the resource corresponding to the primary key identifier in 130, and after storing the acquired resource locally (referring to the main service instance), continue to send the acquired resource and the resource identifier in another form to the gateway 1201, a On the one hand, the gateway 1201 returns the resource to the client 110, thereby realizing the response to this service request; on the other hand, the gateway 1201 establishes a corresponding relationship between the resource identifier of another form and the primary key identifier of this time and stores it , so that when a subsequent client requests the same resource, the gateway 1201 confirms that another representation of the resource identifier corresponding to the resource identifier is stored in the locally cached comparison relationship, so that the gateway 1201 can refresh the other The resource identifier in one form is returned to the client, so the client can request resources from the microservice system 120 by virtue of the resource identifier in another form, and the main service instance that has cached the resource (the main service instance is available) status) to respond quickly to the client.

Further explanation is that in the above process, only the resource requested by the service is locally cached by the primary service instance, and the resource requested by the service is not locally cached by the backup service instance of the primary service instance. This method can also reduce the redundancy of the system when high availability conditions are met.

Therefore, in case 2, after the gateway 1201 resolves the identification of the main service instance and the identification of the standby service instance, the gateway 1201 can continue to determine whether the main service instance is in an available state, if the main service instance is in an available state, Then the gateway 1201 can directly send this service request to the main service instance, and the main service instance directly responds to the client 110 through the locally cached resources corresponding to this service request; if the gateway 1201 determines that the main service instance In an unavailable state, the gateway 1201 can send the current service request to the standby service instance, so that the standby service instance can respond to the current service request.

It is noted that, since the backup service instance of the primary service instance does not cache the resources requested by the service locally, when the primary service instance is unavailable, the backup service instance can refer to the above-mentioned primary service instance in the process of responding to the service request. The process of responding to the request will not be repeated here.

Continuing to explain, since the state of each service instance in the service instance cluster can be in a stable state for a long time, under the time node when the primary service instance and backup service instance that can serve it are first determined for the service request, in order to Reduce redundant caching of the same resource. At this time, although only the main service instance caches the resources requested by the service locally, and does not allow the standby service instance to cache the resources requested by the service, the service request of the same resource does not cache the resources requested by the service. After reaching the microservice system 120, when the gateway 1202 in the microservice system 120 determines that the primary service instance is unavailable, the gateway 1202 can forward the service request to the backup service instance of the primary service instance, even though the backup service instance is not locally available. Cache the resources requested by the service, but because the standby service instance is a service instance that is more idle than other service instances other than the non-primary service instance in the service instance cluster, that is, the standby service instance has the best performance in the current state. (based on the relatively stable performance of each service instance in the service instance cluster at different time nodes), so at this time, let the standby service instance obtain the resources corresponding to the service request according to the execution method of the original main service instance, The standby service instance will also be faster for the client to request the service. The registry 1202 can receive the information that the service instance that is put into use is registered on it, and register the service instance, so that the registry 1202 can obtain the status of each service instance in the service instance cluster 1204, such as determined by heartbeat Whether the service instance is available, and obtain the data of the available resources and used load of the service instance.

The alias management unit 1203 can be configured to receive the indication information sent by the gateway 1201 to determine the idleness of each service instance in the service instance cluster 1204 , and after receiving the indication information, the alias management unit 1203 can obtain the service instance from the registration 1202 The available resources and used load data of each service instance in the cluster 1204, and then by performing related calculations on the available resources and the used load, the idle degree of each service instance can be determined, and the idle degree satisfies the preset conditions. The identity of the instance is returned to gateway 1201 .

The service instance cluster 1204 includes multiple service instances, and each service instance can be used to cache data corresponding to some primary key identifiers in the database 130 connected to the microservice system 120 .

In response to the above technical problems and the system architecture shown in FIG. 1, an embodiment of the present application provides a request processing method. As shown in FIG. 2, the method can be executed by the microservice system shown in FIG. 1, and includes the following steps:

Step 201: The microservice system receives a first request that carries a first resource identifier and is sent by a first client.

In this step, the first request sent by the client is generated based on the primary key identifier in the database connected to the microservice system. In other words, the first resource corresponding to the first request sent by the client is stored in the data by means of the primary key, so that the client can request the resource from the database by virtue of the primary key identifier. Among them, in the process of the client requesting resources from the database, it can be realized through the micro-service system, specifically, the resources in the database are cached through the service instance in the micro-service system, which can reduce the direct connection between the client and the database. interaction, thereby reducing the pressure on the database.

In this step, the first request may be received through the gateway in the microservice system.

Step 202, if the microservice system determines that the first resource identifier does not carry a service instance identifier, allocate a first service instance to the first request.

In this step, after the gateway in the microservice system receives the first request, the gateway may continue to analyze the first resource identifier to determine whether the first resource identifier carries the primary key identifier in the database, whether there is another It carries the service instance identifier. If the gateway determines that the first resource identifier does not carry the service instance identifier, that is, the gateway determines that the first resource identifier is only the primary key identifier in the database, the gateway may allocate the first service instance to the first request. The gateway may allocate the first service instance for the first request through an alias management unit in the microservice system.

Step 203, the microservice system obtains the first resource indicated by the first resource identifier from the database through the first service instance.

In this step, after the gateway in the microservice system determines the first service instance that can serve the first request, on the one hand, the gateway can forward the first request to the first service instance, so that the first service instance can Obtain the first resource indicated by the first resource identifier from the database connected to the microservice system, that is, let the first service instance pull the first resource indicated by the primary key identifier in the database from the database; on the other hand, the gateway can also The first service instance identifier of the first service instance is also forwarded to the first service instance, so that the first service instance can update the first resource identifier based on its own identifier, thereby generating a first resource identifier that can be used to indicate the first resource. 2. Resource ID.

Step 204, the microservice system sends the first resource to the first client and caches the first resource in the first service instance.

In this step, after the first service instance in the microservice system pulls the first resource indicated by the first resource identifier from the database, on the one hand, the first service instance can cache the first resource locally, and on the other hand Aspects The first service instance may send the first resource to the gateway, so as to send the first resource to the first client through the gateway, thereby implementing a response to the first request sent by the client.

Step 205, the micro-service system updates the first resource identifier according to the first service instance identifier of the first service instance, and obtains a second resource identifier for indicating the first resource.

In this step, the first resource identifier may be updated by the first service instance in the microservice system according to its own identifier to obtain a second resource identifier that can be used to indicate the first resource.

Based on this solution, the microservice system confirms whether the service instance identifier is carried by confirming the first resource identifier in the request sent by the client. On the one hand, the microservice system can obtain the first resource indicated by the first resource identifier from the database through the service instance, and send it to the client and cache it in the service instance. On the other hand, the microservice system can also The first resource identifier is updated, and the update process includes adding the identifier of the service instance, so that when the subsequent client requests the first resource, the service instance that has cached the first resource can directly access the service instance. respond. In this method, the microservice system determines a service instance for a request for a resource, and the service instance caches the resource after obtaining the resource from the database, so that subsequent requests for the resource can reach the microservice system again. At the time, the service instance can directly respond to the request, avoiding the need to cache all resources for each service instance in the microservice system, which greatly reduces the redundancy of the system.

Some of the above steps will be described in detail below with reference to examples.

In an implementation of the above step 202, if the micro-service system determines that the first resource identifier carries a second service instance identifier, it allocates the first request to the second service instance; the micro-service system assigns the first request to the second service instance; The service system sends the first resource indicated by the first resource identifier cached by the second service instance to the first client.

For example, after the gateway in the microservice system receives the first request, it analyzes the first resource identifier through the gateway and finds that the first resource identifier carries the second service instance identifier, which means that when the first request enters the microservice Before the service system, there has been at least one service request that has entered the microservice system, and the second service instance in the microservice system has responded to the service request. It is understandable that at least one service request here requires The requested resource and the resource to be requested by the first request are the resources indicated by the same primary key identifier; further in the process of the microservice system responding to the service request, the microservice system has updated the resource identifier of the service request, The updated resource identifier carries the identifier of the second service instance. Therefore, the gateway can directly forward the first request to the second service instance, so that the second service instance uses the locally cached first resource indicated by the first resource identifier to respond to the client, which improves the The efficiency with which a microservice system responds to clients.

In some embodiments of the present application, the first resource identifier further carries a third service instance identifier, and the third service instance corresponding to the third service instance identifier is a backup service instance of the second service instance ; The method further includes: if the micro-service system determines that the second service instance is in an unavailable state, assigning the first request to the third service instance.

In the above example, when the microservice system uses its internal second service instance to respond to the service request, in order to ensure the high availability of the service, the microservice system not only determines the service request for the service request It (referring to the service request) is the second service instance, and the microservice system also determines a third service instance that can serve the service request, where the third service instance is a backup service instance of the second service instance, and the third service instance The number of instances can be one or more. It should be noted that, in order to reduce the redundancy of the micro-service system, in the embodiment of this application, only the database resources corresponding to the service request are cached locally by the second service instance, and the database corresponding to the service request is not required to be locally cached by the third service instance. Resources are cached. In this way, the microservice system can update the primary key identifier of the service request based on the second service instance identifier of the second service instance and the third service instance identifier of the third service instance, so that the obtained first resource identifier carries the primary key identifier , the second service instance identifier and the third service instance identifier. Therefore, before the gateway in the microservice system prepares to forward the first request to the second service instance, the gateway may first determine the status of the second service instance, and when it is determined that the second service instance is unavailable, the gateway may The first request is forwarded to an alternate service instance of the second service instance, that is, the third service instance, so that the third service instance responds to the first request. Wherein, when the third service instance does not locally cache the first resource corresponding to the first request, the process of the third service instance responding to the first request may refer to the process of the first service instance responding to the first request in the preceding steps. The process is not repeated in this application.

It is noted that, since the state of each service instance in the service instance cluster can be in a stable state for a long time, in order to reduce the For redundant caching of the same resource, although only the primary service instance caches the resources requested by the service locally, and does not allow the standby service instance to cache the resources requested by the service, when the service request for the same resource arrives After the microservice system, when the gateway in the microservice system determines that the primary service instance is unavailable, the gateway can forward the service request to the backup service instance of the primary service instance, although the backup service instance does not cache the service request locally. resources, but because the standby service instance is a service instance that is more idle than other service instances other than the non-primary service instance in the service instance cluster, that is, the standby service instance is the service instance with the best performance in the current state ( Based on the performance of each service instance in the service instance cluster at different time nodes, the performance is relatively stable), so at this time, let the standby service instance obtain the resources corresponding to the service request according to the execution method of the original main service instance. The service request on the terminal will also be relatively fast, which means that when the status of the second service instance is unavailable, the gateway forwards the first request to the standby service instance of the second service instance, that is, the third service instance. In the above, the speed of responding to the first request through the third service instance will also be relatively fast, which achieves the goal of low resource redundancy and fast response to the service request.

In an embodiment of the foregoing step 205, the micro-service system receives a second request sent by a second client that carries the identifier of the second resource; the second client obtains the second resource through a refresh mechanism identifier; the microservice system determines that the second resource identifier carries the first service instance identifier, and then assigns the second request to the first service instance; the microservice system assigns the first service instance identifier to the first service instance. The first resource cached by a service instance is sent to the second client.

For example, when the first service instance in the microservice system in the foregoing example responds to the first request sent by the first client, the first service instance updates the first resource identifier to the second resource identifier, and updates the second resource identifier to the second resource identifier. The identifier is sent to the gateway in the microservice system, so that the gateway establishes and stores the corresponding relationship between the primary key identifier of the first request and the second resource identifier. Therefore, at a certain point in time after the first request occurs, if there is a second client that continues to send a service request with the same resource (ie, the first resource) as the first request to the database, the service request can be processed by the microservice system The gateway in the received, through the analysis of the service request, the gateway determines that the primary key identifier of the service request is stored in the comparison relationship of the local cache, so the gateway can send the second resource identifier to the second client through the refresh mechanism, In this way, the second client can re-send a service request to the micro-service system by virtue of the received second resource identifier, that is, the second request, when the gateway in the micro-service system receives the second request, through the second request Analysis of the second resource identifier carried in the request shows that the first service instance identifier is carried in it. Therefore, in order to speed up the response efficiency to the client, the gateway can directly assign the second request to the first service instance, so that the first service instance can be The instance sends the locally cached first resource to the second client.

In an embodiment of the above step 205, the micro-service system updates the first resource identifier according to the first service instance identifier of the first service instance, and obtains a second resource identifier for indicating the first resource , including: the micro-service system sequentially splices the first resource identifier and the first service instance identifier according to the set order, and obtains a second resource identifier for indicating the first resource.

For example, for the gateway in the microservice system in the foregoing example, after receiving the first service instance identifier of the first service instance sent by the alias management unit in the microservice system, the gateway may combine the first service instance identifier with the first request Sent to the first service instance, on the one hand, the first service instance can obtain the first resource from the database through the primary key identifier to respond to the first client; on the other hand, in order to reduce the operating pressure of the gateway, the A service instance splices the first resource identifier (that is, the primary key identifier in the database) and the first service instance identifier in sequence according to the set order, so that the second resource identifier for indicating the first resource can be obtained, wherein the second resource identifier , a binding/correspondence relationship between the first resource and the first service instance can be established, so the first resource identifier can be updated through the first service instance in the microservice system.

In some embodiments of the present application, before the obtaining the second resource identifier used to indicate the first resource, the method further includes: determining, by the microservice system, a backup service instance of the first service instance; the The micro-service system sequentially splices the first resource identifier and the first service instance identifier according to the set order to obtain the second resource identifier used to indicate the first resource, including: the micro-service system follows the set order The first resource identifier, the first microservice instance identifier, and the standby service instance identifier of the standby service instance are sequentially spliced to obtain a second resource identifier for indicating the first resource.

For example, in the foregoing example, when the alias management unit in the microservice system receives the indication information sent by the gateway in the microservice system to determine the service instance that can serve the first request, in order to meet the high availability of the service, the alias management unit In addition to determining the first service instance that can serve it for the first request, the alias management unit can also determine the backup service instance of the first service instance, so that when the first service instance is unavailable, there can be a quick response. The standby service instance to realize the switching and transfer of service requests. Therefore, the alias management unit can send the first service instance identifier of the first service instance and the standby service instance identifier of the standby service instance of the first service instance to the first service instance together, so that the first service instances can follow the set order. Splicing the first resource identifier (that is, the primary key identifier in the database), the first service instance identifier and the standby service instance identifier, so that the second resource identifier for indicating the first resource can be obtained, wherein, through the second resource identifier, it is possible to establish Since the binding/correspondence relationship between the first resource and the first service instance and the backup service instance of the first service instance is initiated, the first resource identifier can be updated through the first service instance in the microservice system.

In some embodiments of the present application, the micro-service system sequentially concatenates the first resource identifier, the first service instance identifier, and the standby service instance identifier of the standby service instance in a set order to obtain Indicating the second resource identifier of the first resource, including: the micro-service system encrypts the first service instance identifier and the standby service instance identifier of the standby service instance to obtain encrypted information; The first resource identifier and the encrypted information are sequentially spliced in a certain order to obtain a second resource identifier for indicating the first resource.

For example, after the first service instance in the microservice system receives the first request, the first service instance identifier, and the standby service instance identifier of the standby service instance of the first service instance, the service instance identifier may be the host's ip, host name, port and other information, the first service instance can first use the Base64 encoding method to process its own identification and the standby service instance identification, convert them into encrypted strings, and then the first service instance can The resource identifier (ie, the primary key identifier in the database) is encrypted with the encrypted character string, so that the second resource identifier can be obtained.

In an implementation of the above step 202, the allocating the first service instance to the first request includes: the microservice system determines, for any service instance in the service instance cluster, the available resources of the service instance and the Used load; according to the available resources and the used load, determine the idle degree of the service instance; the microservice system determines the service instance whose idle degree meets the set condition as the first service instance.

In some embodiments of the present application, the micro-service system determines the available resources and used load of the service instance for any service instance in the service instance cluster, including: the micro-server system is for the service instance cluster. For any service instance in the service instance, determine the number of unused central processing unit CPU cores and unused memory of the service instance as the available resources, and determine the number of requested accesses and Determining the requested access duration as the used load; and determining the idle degree of the service instance according to the available resources and the used load, including: the micro server system associates the available resources with the used load. Use the ratio of load to determine the idle degree of the service instance.

For example, in the preceding example, the alias management unit in the microservice system receives the indication information sent by the gateway in the microservice system, and the indication information is used to instruct the alias management unit to allocate the first service instance for the first request. At this time, the alias management unit The unit can determine the idleness of each service instance in the service instance cluster in the microservice system, and the determination process can be implemented by the following load balancing algorithm:

可表示为：

可用内存资源

可表示为：

其中c ₀为常数；其中

以及

均用于表示机器的可用资源； First, for the machines (ie, service instances) 1 to n in the service instance cluster, the number of cpu cores of the machine is C _i , the available memory is R _i , and the resource of the machine is L; then, the cpu resources

can be expressed as:

Available memory resources

can be expressed as:

where c ₀ is a constant; where

as well as

are used to represent the available resources of the machine;

则有

用于表示机器的已用负载； Next, define the proportion of the number of cached primary key identifiers on machine i as N _i (the resource corresponding to the primary key identifier of the machine that has been accessed must be cached), then the number proportion is set to be

then there are

Used to represent the used load of the machine;

则有

用于表示机器的已用负载； Next, define the total access duration of the primary key identifier that machine i received access to in the past 24 hours as T _i (unit: minutes), then the time proportion is set to be

then there are

Used to represent the used load of the machine;

其中根据经验值c ₁:c ₂＝1:3，c ₃:c ₄＝1:1。 Finally, define the machine idle rate E _i , E _i can be derived from the following formula:

Wherein according to the empirical value c ₁ :c ₂ =1:3, c ₃ :c ₄ =1:1.

According to the above formula, the alias management unit can obtain the idle rate of each machine, that is, the alias management unit can obtain the idle degree of each service instance.

In order to achieve better response efficiency, in this embodiment of the present application, the setting condition may be defined as: the service instance with the largest current idle degree in the service instance cluster responds to the first request. Therefore, by comparing the idleness of each service instance in the service instance cluster, the alias management unit can obtain that the service instance with the highest idleness is Em=max(E _i ), i=1, 2, 3...n, and so on The alias management unit determines the service instance with the highest idle degree as the first service instance.

Hereinafter, an example is used to compare the stateless service application caching solution in the background art with the example binding solution of the present application.

Assume that for a service instance cluster with 100 service instances, and each service instance is a virtual host with 8 cores and 16GB, the available memory is 14GB at the beginning. The microservice system with the service instance cluster is used for the database resource access cache of large-scale platforms. It is assumed that the number of primary keys accessed is 10 million. The cache information of each primary key includes id, primary service instance, standby service instance, name, The sub-system, creating users, etc., are about 1KB in size, and the cache of all primary keys needs about 10^7/10^6=10GB.

The following compares the caching effects of different schemes:

The solution of the background art: all primary keys are cached on each machine: each service instance will occupy 10GB of memory, a total of about 100*10GB=1TB, and the redundant data volume is 1TB/10GB=100 times. And with the increase of primary keys, the number of caches of each service instance will continue to increase linearly; in order to provide a unified stateless service for each service instance, the service instance resources occupied during expansion will also increase linearly, and the expansion plans are relatively comparable. Simple. When the hotspot primary key changes, since the cache content of all service instances is consistent, requests can be evenly distributed to each service instance, and the cluster pressure is relatively stable.

The load balancing solution proposed in this application: the number and load of existing service instances in a service instance cluster can be integrated, and a service instance with a lower load value can be selected. For 10 million primary keys, the total amount of cached data is 10GB. By default, the primary key data will not be cached on the standby service instance of the primary service instance, so there is no redundancy. The average cache data of each node is 10GB/100=100MB. Compared with the solution of the background art, the demand for cluster resources can be greatly reduced. When the data volume doubles, the average data volume per service instance also doubles. When a service instance is expanded, the load balancing algorithm can automatically add more newly-added primary keys to the expanded service instance, thereby ensuring the overall load balance of the service instance cluster. When the hotspot primary key changes, the load balancing algorithm can also take into account the access duration and the amount of cached data, so as to achieve more efficient load balancing.

Based on the same concept, an embodiment of the present application provides a micro-service system. As shown in FIG. 3 , the scheduling system includes a receiving unit 301, a processing unit 302, and an obtaining unit 303:

The receiving unit 301 is configured to receive a first request carrying a first resource identifier sent by a first client.

The processing unit 302 is configured to allocate a first service instance to the first request if it is determined that the first resource identifier does not carry a service instance identifier.

The obtaining unit 303 is configured to obtain the first resource indicated by the first resource identifier from the database through the first service instance.

The processing unit 302 is further configured to send the first resource to the first client and cache the first resource in the first service instance.

The processing unit 302 is further configured to update the first resource identifier according to the first service instance identifier of the first service instance to obtain a second resource identifier used to indicate the first resource.

Further, for the micro-service system, the processing unit 302 is further configured to: if it is determined that the first resource identifier carries a second service instance identifier, assign the first request to the second service instance; Send the first resource indicated by the first resource identifier cached by the second service instance to the first client.

Further, for the micro-service system, the first resource identifier also carries a third service instance identifier, and the third service instance corresponding to the third service instance identifier is a backup service instance of the second service instance; The processing unit 302 is further configured to: if it is determined that the second service instance is in an unavailable state, assign the first request to the third service instance.

Further, for the micro-service system, the receiving unit 301 is further configured to: receive a second request that carries the second resource identifier sent by a second client; the second client obtains the first request through a refresh mechanism two resource identifiers; the processing unit 302 is further configured to: determine that the second resource identifier carries the first service instance identifier, then allocate the second request to the first service instance; assign the first service instance identifier to the first service instance; The first resource cached by a service instance is sent to the second client.

Further, for the micro-service system, the processing unit 302 is specifically configured to: splicing the first resource identifier and the first service instance identifier in sequence according to the set order to obtain a second identifier for indicating the first resource. Resource ID.

Further, for the micro-service system, the processing unit 302 is further configured to: determine a backup service instance of the first service instance; the processing unit is specifically configured to: sequentially splicing the first resource identifiers according to the set order , the first service instance identifier and the standby service instance identifier of the standby service instance to obtain a second resource identifier used to indicate the first resource.

Further, for the micro-service system, the processing unit 302 is specifically configured to: encrypt the first service instance identifier and the standby service instance identifier of the standby service instance to obtain encrypted information; splicing the first service instance in sequence according to the set order. A resource identifier and the encrypted information are used to obtain a second resource identifier for indicating the first resource.

Further, for the micro-service system, the processing unit 302 is specifically configured to: for any service instance in the service instance cluster, determine the available resources and used load of the service instance; The idle degree of the service instance is determined by using the load; the service instance whose idle degree satisfies the set condition is determined as the first service instance.

Further, for the micro-service system, the processing unit 302 is specifically configured to: for any service instance in the service instance cluster, determine the number of unused central processing unit CPU cores and unused memory of the service instance as all the service instances. the available resources, and determine the number of requested accesses and the requested access duration of the service instance in the preset historical period as the used load; determine the ratio of the available resources to the used load as the used load The idleness of the service instance.

Embodiments of the present application further provide a computing device, and the computing device may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), and the like. The computing device may include a central processing unit (Center Processing Unit, CPU), a memory, an input/output device, etc., the input device may include a keyboard, a mouse, a touch screen, etc., and the output device may include a display device, such as a liquid crystal display (Liquid Crystal Display, LCD), Cathode Ray Tube (CRT), etc.

The memory, which may include read only memory (ROM) and random access memory (RAM), provides the processor with program instructions and data stored in the memory. In this embodiment of the present application, the memory may be used to store program instructions for requesting the processing method;

The processor is configured to call the program instructions stored in the memory, and execute the request processing method according to the obtained program.

As shown in FIG. 4, a schematic diagram of a computing device provided by an embodiment of the present application, the computing device includes:

A processor 401, a memory 402, a transceiver 403, and a bus interface 404; wherein, the processor 401, the memory 402 and the transceiver 403 are connected through a bus 405;

The processor 401 is configured to read the program in the memory 402 and execute the above request processing method;

The processor 401 may be a central processing unit (CPU for short), a network processor (NP for short), or a combination of CPU and NP. It can also be a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (ASIC for short), a programmable logic device (PLD for short) or a combination thereof. The above PLD may be a complex programmable logic device (CPLD for short), a field-programmable gate array (FPGA for short), a generic array logic (GAL for short) or any of the above. combination.

The memory 402 is used to store one or more executable programs, and can store data used by the processor 401 when performing operations.

Specifically, the program may include program code, and the program code includes computer operation instructions. The memory 402 may include a volatile memory (volatile memory), such as random-access memory (RAM for short); the memory 402 may also include a non-volatile memory (non-volatile memory), such as a flash memory ( flash memory), a hard disk drive (HDD for short) or a solid-state drive (SSD for short); the memory 402 may also include a combination of the above-mentioned types of memory.

Memory 402 stores the following elements, executable modules or data structures, or a subset thereof, or an extended set thereof:

Operation instructions: including various operation instructions, which are used to realize various operations.

Operating System: Includes various system programs for implementing various basic services and handling hardware-based tasks.

The bus 405 may be a peripheral component interconnect (PCI for short) bus or an extended industry standard architecture (Extended industry standard architecture, EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. For ease of presentation, only one thick line is used in FIG. 4, but it does not mean that there is only one bus or one type of bus.

The bus interface 404 may be a wired communication access port, a wireless bus interface or a combination thereof, wherein the wired bus interface may be, for example, an Ethernet interface. The Ethernet interface can be an optical interface, an electrical interface or a combination thereof. The wireless bus interface may be a WLAN interface.

Embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, where the computer-executable instructions are used to cause the computer to execute the request processing method.

As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, or as a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

While the preferred embodiments of the present application have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of this application.

Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims (11)

A request processing method, comprising: The microservice system receives the first request that carries the first resource identifier and sent by the first client; The micro-service system allocates a first service instance for the first request if it is determined that the first resource identifier does not carry a service instance identifier; The micro-service system obtains the first resource indicated by the first resource identifier from the database through the first service instance; The microservice system sends the first resource to the first client and caches the first resource in the first service instance; The micro-service system updates the first resource identifier according to the first service instance identifier of the first service instance, and obtains a second resource identifier for indicating the first resource. The method of claim 1, wherein: The method also includes: The micro-service system allocates the first request to the second service instance if it is determined that the first resource identifier carries a second service instance identifier; The microservice system sends the first resource indicated by the first resource identifier cached by the second service instance to the first client. The method according to claim 2, wherein the first resource identifier further carries a third service instance identifier, and the third service instance corresponding to the third service instance identifier is an identifier of the second service instance. Standby service instance; The method also includes: If it is determined that the second service instance is in an unavailable state, the microservice system allocates the first request to the third service instance. The method of claim 1, wherein: The method also includes: The micro-service system receives a second request sent by a second client that carries the second resource identifier; the second client obtains the second resource identifier through a refresh mechanism; The micro-service system determines that the second resource identifier carries the first service instance identifier, and allocates the second request to the first service instance; The microservice system sends the first resource cached by the first service instance to the second client. The method of any one of claims 1-4, wherein, The micro-service system updates the first resource identifier according to the first service instance identifier of the first service instance, and obtains a second resource identifier for indicating the first resource, including: The micro-service system sequentially splices the first resource identifier and the first service instance identifier according to a set sequence, to obtain a second resource identifier for indicating the first resource. The method of claim 5, wherein: Before the obtaining the second resource identifier used to indicate the first resource, the method further includes: The microservice system determines an alternate service instance of the first service instance; The micro-service system sequentially splices the first resource identifier and the first service instance identifier according to the set order to obtain a second resource identifier for indicating the first resource, including: The micro-service system splices the first resource identifier, the first micro-service instance identifier, and the standby service instance identifier of the standby service instance in sequence according to the set order, and obtains a second identifier for indicating the first resource. Resource ID. The method of claim 6, wherein: The micro-service system splices the first resource identifier, the first service instance identifier and the standby service instance identifier of the standby service instance in sequence according to the set order, and obtains a second resource for indicating the first resource identification, including: The micro-service system encrypts the first service instance identifier and the standby service instance identifier of the standby service instance to obtain encrypted information; The micro-service system sequentially splices the first resource identifier and the encrypted information according to the set order, to obtain a second resource identifier for indicating the first resource. The method of any one of claims 1-4, wherein, The allocating a first service instance for the first request includes: The microservice system determines the available resources and used load of the service instance for any service instance in the service instance cluster; and determines the idleness of the service instance according to the available resources and the used load; The micro-service system determines the service instance whose idle degree meets the set condition as the first service instance. The method of claim 8, wherein: For any service instance in the service instance cluster, the microservice system determines the available resources and used load of the service instance, including: For any service instance in the service instance cluster, the micro-server system determines the number of unused central processing unit CPU cores and unused memory of the service instance as the available resources, and sets the service instance in the pre-defined service instance. Let the number of requested accesses and the requested access duration in the historical period be determined as the used load; The determining the idleness level of the service instance according to the available resources and the used load includes: The micro-server system determines the ratio of the available resources to the used load as the idle degree of the service instance. A microservice system, characterized in that it includes: a receiving unit, configured to receive a first request carrying a first resource identifier sent by a first client; a processing unit, configured to allocate a first service instance to the first request if it is determined that the first resource identifier does not carry a service instance identifier; an obtaining unit, configured to obtain the first resource indicated by the first resource identifier from the database through the first service instance; the processing unit, further configured to send the first resource to the first client and cache the first resource in the first service instance; The processing unit is further configured to update the first resource identifier according to the first service instance identifier of the first service instance to obtain a second resource identifier used to indicate the first resource. A computer-readable storage medium, characterized in that the storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute the method according to any one of claims 1-9.

Images