CN110289999B - A data processing method, system and device - Google Patents

Abstract

The embodiment of the invention relates to the field of financial technology (Fintech), and discloses a data processing method, a system and a device, wherein the method comprises the following steps: after receiving the identifier of the first client device and the data to be processed sent by the first client device, querying a preset corresponding relation table to obtain a target service group corresponding to the identifier of the first client device, and processing the data to be processed by using a main server in the target service group. In the embodiment of the invention, by setting at least one service group and the master server and the slave server included in each service group, the master server in each service group can exist in real time, namely, at least one service group can be in a state of being available at any moment; in this way, the main server in the service group corresponding to the first client device executes the data processing process related to the first client device, so that high availability of processing the data of the client device can be ensured.

Description

A data processing method, system and device

technical field

The present invention relates to the technical field of financial technology (Fintech), in particular to a data processing method, system and device.

Background technique

With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into financial technology (Fintech). However, due to the security and real-time requirements of the financial industry, financial technology has also raised the higher requirement. The field of financial technology generates a large amount of data every day, such as loan data between the loan business system and customers, marketing data between the insurance business system and customers, liquidation data of the management business system, etc.; because different business systems correspond to different data, resulting in Different business systems have different requirements for data processing. Therefore, how to realize the data processing of different business systems is very important for the normal development of the financial technology field.

In an existing implementation manner, dedicated servers corresponding to each business system can be set in the financial technology field, so that multiple dedicated servers can be used to process data of different business systems respectively. For example, the dedicated server corresponding to the loan business system can be a loan server. If the loan server receives the data sent by the loan business system, it can use the resources in the loan server (such as hard disk, disk, central processing unit, network, etc.) to The data is processed. However, in this implementation, each business system corresponds to a dedicated server. If the resources on a certain dedicated server are damaged, professionals are usually required to maintain the dedicated server (such as repairing the dedicated server, or setting up a new dedicated server). server). In this way, the business system needs to wait for the completion of the maintenance process before continuing to execute the data processing process. It can be seen that the above implementation method may cause the data processing process of the business system to be blocked, so that high availability of data processing cannot be achieved.

To sum up, there is an urgent need for a data processing method to solve the technical problem of low availability of data processing caused by using a dedicated server corresponding to each business system to process data.

Contents of the invention

Embodiments of the present invention provide a data processing method, system, and device to solve the technical problem of low availability of data processing caused by using a dedicated server corresponding to each business system to process data.

In the first aspect, an embodiment of the present invention provides a data processing method, the method is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a master server and one or more slave servers; the method includes:

Receiving a data request message sent by the first client device, the data request message including the identifier of the first client device and data to be processed; further, querying a preset correspondence table to obtain the first client device The target service group corresponding to the device identifier, and use the main server in the target service group to process the data to be processed; wherein, the preset correspondence table stores the identifiers of one or more client devices and the Describe the corresponding relationship of at least one service group.

In the above design, by setting at least one service group and the master server and one or more slave servers included in each service group, it can be ensured that the master server in each service group exists in real time (for example, if a certain service If the primary server of the group is damaged, a new primary server can be assigned to the service group), so that at least one service group can be in a state of being available at all times; thus, by assigning the corresponding service group to the first client device, the second The main server in the service group corresponding to a client device executes the data processing process related to the first client device, ensuring high availability of the data processing process.

In a possible design, if the master server in the target service group fails, select a first slave server from one or more slave servers in the target service group, and use the first slave server The server processes the data to be processed.

In the above design, if the primary server in a certain service group is damaged, a new primary server can be selected from other servers included in the service group, so that the new primary server can be used to process pending data. On the one hand, through When the main server is damaged, a new main server is automatically selected, which eliminates the need for manual maintenance, so the operation is simple, easy to implement, and can reduce maintenance costs; on the other hand, by using the new main server to process the pending data, the user does not need to input data again The data processing result can be obtained by requesting a message, so that the user experience is better.

In a possible design, the preset correspondence table further includes the IP address of the main server in each service group; the processing of the data to be processed using the main server in the target service group includes: According to the IP address of the main server in the target service group included in the preset correspondence table, send the data to be processed to the main server in the target service group, so that the The main server processes the data to be processed.

In the above design, by adding the corresponding relationship between the client device, the service group, and the IP address of the master server in the service group in the preset correspondence table, the master who processes the data to be processed can be determined by querying the preset correspondence table. server, instead of analyzing each server in each service group, which can improve the efficiency of data processing.

In a possible design, if there is no service group corresponding to the identifier of the first client device in the preset correspondence table, the at least one service group is selected according to the performance of the at least one service group. Select the first service group from the group, and use the main server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by the The disk capacity of the master server and one or more slave servers is determined.

In the above design, by selecting the service group with the best current performance in at least one service group as the service group corresponding to the new client device, it can not only improve the efficiency of processing the data of the client device, but also ensure that at least one service group The load balance of the group improves the data processing capability of the data processing system.

In a possible design, after the first service group is selected from the at least one service group according to the performance of the at least one service group, the first service group may also be generated in the preset correspondence table. The correspondence between the identifier of the client device and the first service group.

In the above design, after assigning the target service group to the new client device, the correspondence between the new client device and the target service group can be updated to the preset correspondence table, thereby improving the real-time performance of the preset correspondence table, Further, the accuracy of data processing based on the preset correspondence table is improved.

In a possible design, before using the main server in the target service group to process the data to be processed, it may also be determined that the first client device is legal.

In the above design, by verifying the legality of the client device before processing the data of the client device, it is possible to avoid processing the data of other client devices and ensure the orderliness and security of data processing of different client devices. safety.

In a second aspect, the data processing system provided by an embodiment of the present invention includes one or more client devices, a proxy server, and at least one service group, and each service group in the at least one service group includes at least one master server and one or more slave servers;

The client device is configured to generate a data request message according to a user's trigger operation, and send the data request message to the proxy server; the data request message includes the identifier of the client device and data to be processed ;

The proxy server is configured to, after receiving the data request message sent by the client device, query a preset correspondence table to determine the target service group corresponding to the identifier of the client device, and send the data to be processed To the main server in the target service group; the preset correspondence table stores the correspondence between the identifiers of the one or more client devices and the at least one service group;

The main server in the target service group is configured to process the data to be processed after receiving the data to be processed sent by the proxy server.

In a possible design, the system further includes a storage server; the storage server is configured to: receive the information respectively reported by the master server and one or more slave servers in each service group, and generate The preset correspondence table; correspondingly, the proxy server is further configured to: acquire the preset correspondence table from the storage server.

In a possible design, the preset correspondence table also includes the IP of the master server in each service group; when the master server in the target service group fails, the One or more slave servers in the target service group select a first slave server whose performance is greater than a first preset performance, and send the IP of the first slave server to the storage server; correspondingly, the storage server It is further used for: after receiving the IP of the first slave server, using the IP of the first slave server to update the IP of the master server in the target service group in the preset correspondence table.

In a third aspect, an embodiment of the present invention provides a data processing device, the device is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a master server and one or more slave servers; the apparatus includes:

A transceiver module, configured to receive a data request message sent by the first client device, where the data request message includes the identifier of the first client device and data to be processed;

A query module, configured to query a preset correspondence table to obtain a target service group corresponding to the identifier of the first client device; the preset correspondence table stores one or more client device identifiers and the A correspondence relationship of at least one service group;

A processing module, configured to use the main server in the target service group to process the data to be processed.

In a possible design, the processing module is further configured to: select a first slave server from one or more slave servers in the target service group if the master server in the target service group fails , and use the first slave server to process the data to be processed.

In a possible design, the preset correspondence table further includes the Internet Protocol address IP of the main server in each service group; the processing module is further configured to: according to the target included in the preset correspondence table the IP of the main server in the service group, and send the data to be processed to the main server in the target service group, so that the main server in the target service group processes the data to be processed.

In a possible design, the processing module is further configured to: if there is no service group corresponding to the identifier of the first client device in the preset correspondence table, according to the at least one service group Select the first service group from the at least one service group, and use the main server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by The disk capacity of the master server in each service group and the disk capacity of one or more slave servers are determined.

In a possible design, the processing module is further configured to: generate a correspondence between the identifier of the first client device and the first service group in the preset correspondence table.

In a possible design, the processing module is further configured to: determine that the first client device is legal.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, including instructions, which, when run on a computer, cause the computer to execute any of the methods described in the first aspect.

In a fifth aspect, an embodiment of the present invention provides a computer program product, which, when run on a computer, causes the computer to execute any method described in the first aspect.

These implementation manners or other implementation manners of the present invention will be more concise and understandable in the description of the following embodiments.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

FIG. 1 is a schematic diagram of an architecture corresponding to a data processing method provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of the architecture of a data processing system provided by an embodiment of the present invention;

FIG. 3 is a schematic flowchart corresponding to a data processing method provided by an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a data processing device provided by an embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Financial technology (Fintech) refers to a new innovative technology brought to the financial field after the integration of information technology into the financial field. By using advanced information technology to assist in the realization of financial operations, transaction execution and financial system improvement, the financial system can be improved. Processing efficiency, business scale, and can reduce costs and financial risks. Generally speaking, the field of financial technology usually involves a large amount of data, such as loan data in the credit business system, card sales data in the sales business system, transfer data in the payment business system, etc. How to use technology to mine large amounts of data? Finding out the characteristics required by the financial field has always been the goal pursued by the financial technology field.

Since the scheme of setting up a dedicated server for each business system cannot guarantee high availability of data processing, in order to ensure high availability of data processing, in a possible implementation, multiple dedicated servers can be set for the same business system ( Two or more), in this way, if a dedicated server is damaged, other dedicated servers can be used to process the data of the business system to ensure the continuity of data processing in the business system.

Taking two dedicated servers for the same business system as an example, Figure 1 is a schematic diagram of the system architecture corresponding to this implementation, as shown in Figure 1, the system can be set with a client device 110, a load balancing server 120, a dedicated A server 131 , a dedicated server 132 and a network attached storage (Network Attached Storage, NAS) server 140 . Wherein, the load balancing server 120 can be respectively connected with the client device 110, the dedicated server 131 and the dedicated server 132, and the NAS server 140 can be connected with the dedicated server 131 and the dedicated server 132 respectively; The connection may be implemented in a wired manner, or the connection may also be implemented in a wireless manner, which is not specifically limited.

In the embodiment of the present invention, the NAS server 140 may be composed of multiple hard disks, and the NAS server 140 may store multiple data related to the client device 110, such as text data, audio data, video data, and the like. Correspondingly, the identity information of the client device 110 may be stored on the dedicated server 131 and/or the dedicated server 132, wherein the identity information of the client device 110 may include a user name of the client device 100, a password corresponding to the user name, etc. In this way, the dedicated server 131 and/or the dedicated server 132 can access the NAS server 140 through the identity information of the client device 110, so as to process the data of the client device 110. In an example, the dedicated server 131 and the dedicated server 132 may share the identity information of the client device 110 by transmitting data streams. For example, dedicated server 131 and dedicated server 132 can be provided with synchronization tools (such as sersync tool), if dedicated server 131 detects that the identity information of client device 110 is updated from the first identity information to the second identity information at a certain moment information, then the difference data in the second identity information that is different from the first identity information can be transmitted to the dedicated server 132 through the sersync tool; in this way, the dedicated server 132 can update the identity of the client device 110 stored internally according to the received difference data Information, so as to realize the data sharing process between the dedicated server 131 and the dedicated server 132.

In a specific implementation, the client device 110 can generate a data request message according to the user's trigger instruction, and then send the data request message to the load balancing server 120; and the load situation of the dedicated server 132 (such as the occupancy rate of the internal memory and/or the hard disk, the number of cores of the central processing unit, etc.) select a target dedicated server (such as the dedicated server 132) from the dedicated server 131 and the dedicated server 132, and then can use The data processing request is sent to the dedicated server 132; in some cases, if the dedicated server 132 fails, the load balancing server 120 can send the data processing request to the dedicated server 131; further, if the data processing request is to modify file a, After receiving the data processing request, the dedicated server 132 (or dedicated server 131) can verify the identity of the client device 110 in advance, and if it is determined that the identity of the client device 110 is legal, it can obtain the NAS that matches the client device 100. file a in server 140, and modify file a.

According to the above content, it can be seen that in this implementation, in addition to setting up multiple dedicated servers, it is also necessary to set up a NAS server 140 independent of multiple dedicated servers, although this implementation can be used when a certain dedicated server fails Other dedicated servers process the data, but if the NAS server 140 breaks down (such as damage to a certain hard disk forming the NAS server 140, network failure, insufficient memory, etc.), then any dedicated server cannot process the data, resulting in data loss. Processing is not available; that is, the above implementation process still cannot achieve high availability of data.

In addition, the above implementation also has the following problems:

(1) Since the independent NAS server 140 is set, the cost of the system is relatively high.

(2) The process of synchronizing data streams between dedicated server 131 and dedicated server 132 uses the same network as the process of processing data based on NAS server 140, which causes the process of synchronizing data streams to occupy a large network space, which may make the data processing process The network in the network is blocked, and the efficiency of data processing is low.

(3) The dedicated server 131 and the dedicated server 132 access the same NAS device, which makes it impossible to dynamically allocate data corresponding to different dedicated servers according to actual business scenarios, thus making the scalability of data processing poor.

Based on this, an embodiment of the present invention provides a data processing system to achieve high availability of data processing, improve data processing efficiency and scalability, and reduce costs.

Figure 2 is a schematic diagram of the architecture of a data processing system provided by an embodiment of the present invention. As shown in Figure 2, the system may include one or more client devices (such as the client device 211 shown in Figure 2, the client device 212 and client device 213), proxy server 220, storage server group 230, and at least one service group (such as service group 241, service group 242, and service group 243 illustrated in FIG. 2). Wherein, the proxy server 220 can be connected with at least one client device, storage server group 230, and at least one service group respectively, and each service group of at least one service group can be connected with the storage server group 230, and the mode of realizing connection can be wired connection , or may also be a wireless connection, which is not specifically limited.

In the embodiment of the present invention, multiple servers can be set in each service group, and any two servers in the multiple servers can realize data sharing, for example, data sharing can be realized through the RAFT protocol. Taking service group 241 as an example, server 2411-server 2413 can be set in service group 241. Correspondingly, service group 241 can select a master server from servers 2411-2413 in various ways, for example, it can be obtained from The main server is elected from the servers 2411 to 2413, or the main server may be set by those skilled in the art based on experience, which is not specifically limited. In one example, the service group 241 can select the server with the best performance (such as the server 2411 ) from the servers 2411 to 2413 as the master server, so that the server 1412 and the server 2413 can be used as two slave servers managed by the master server 2411 . Wherein, the performance of the server can be determined by any one or multiple items of the available capacity of the disk in the server, the amount of memory occupied, the number of cores of the central processing unit (Central Processing Unit, CPU), and the network traffic, and is not specifically limited. .

It should be noted that the service group in Figure 2 is only an exemplary simple description, and the number of servers in the service group listed is only for the convenience of illustrating the solution, and does not constitute a limitation on the solution. In specific implementation , the number of servers in the service group may be greater than 3, for example, it may be 5 or more. In an example, in order to ensure the accuracy of the RAFT protocol election, the number of servers in each service group may be set to be an odd number.

In a possible implementation manner, one or more storage servers may also be set in the storage server cluster 230, such as storage servers 231 to 233, and any two storage servers among storage servers 231 to 233 may implement data sharing. Correspondingly, the storage server cluster 230 can also select a main storage server (such as the storage server 231) from the storage server 231 to the storage server 233 in the above-mentioned manner, so that the storage server 232 and the storage server 233 can be managed by the main storage server 231 The two slave storage servers.

In specific implementation, after any service group in service group 241～service group 243 determines the main server, it can report the identification of the client device corresponding to the service group, the information of the main server and the information of the secondary server to the main storage server 231 . For example, taking the service group 241 as an example, after determining the master server 2411, the slave server 2412, and the slave server 2413, the master server 2411 can send the identifier of the service group 241 to which it belongs and the identifier of the client device corresponding to the service group 241 , currently available disk capacity, Internet Protocol Address (Internet Protocol Address, IP), port number, server number and other information are sent to the main storage server 231, and the slave server 2412 and slave server 2413 can respectively send the information of the service group 241 to which they belong. The identification and the currently available disk capacity are sent to the primary storage server 231 . In this way, the main storage server 231 can establish a preset correspondence table according to the identifiers of the client devices corresponding to the service group 241-service group 243, the information of the master server, and the information of the slave server, and can use the preset correspondence table through the RAFT protocol Shared to the secondary storage server 232 and the secondary storage server 233, therefore, the primary storage server 231, the secondary storage server 232 and the secondary storage server 233 may respectively store the same preset correspondence table.

Table 1 is a schematic table of a preset correspondence table provided by an embodiment of the present invention.

Table 1: An illustration of a preset correspondence table

As shown in Table 1, the preset correspondence table may include the identifier of each service group, the identifier of the client device corresponding to each service group, the identifiers of the master server and slave server included in each service group, and the available disk information such as the capacity and the IP address of the main server. Taking the service group 241 as an example, based on the content shown in Table 1, the client device corresponding to the service group 241 can be the client device 212, the master server in the service group 241 can be the master server 2411, and the slave server can be the slave server 2412 And from the server 2413; the available disk capacity in the master server 2411 is 500M, the available disk capacity from the server 2412 is 300M, and the available disk capacity from the server 2413 is 200M; the IP address of the master server 2411 can be http:// 2411.com.

Taking the service group 241 as an example, in a possible implementation, if the main server 2411 in the service group 241 fails (such as disk damage, insufficient disk space, insufficient memory, network failure, hardware device damage, software operation failure, etc. ), then the service group 241 can re-elect a new master server (such as server 2413) from the slave server 2412 and the slave server 2413 according to the RAFT protocol. Further, the new main server 2413 can report its IP address and the failure information of the old main server 2411 to the main storage server 231, so that the main storage server 231 can The fault information updates the preset correspondence table.

In one example, the primary storage server 231 may mark the new primary server 2412 as the primary server 2412, and may identify the state of the old primary server 2411 as unavailable, and then generate and push an alarm corresponding to the old primary server 2411 Information to operation and maintenance personnel. In another example, the master storage server 231 can mark the new master server 2412 as the master server 2412, and can mark the old master server 2411 as the slave server 2411, and the method shown in Table 1 can be used in this example The default correspondence table is updated as shown in Table 2.

Table 2: An illustration of an updated preset correspondence table

It can be understood that, after the master storage server 231 updates the preset correspondence table, it can also share the updated preset correspondence table with the slave storage server 232 and the slave storage server 233 through the RAFT protocol, so that the master storage server 231, The same preset correspondence table may be stored in the secondary storage server 232 and the secondary storage server 233 respectively.

In the embodiment of the present invention, if the main server in the service group fails, the service group can elect a new main server from other servers, so that the new main server can be used to process the data request message of the client device; That is to say, through the automatic selection of the primary server by the service group, the automatic recovery of the failure can be realized, so that the data processing process has high availability.

Based on the system architecture shown in Figure 2, Figure 3 is a schematic flowchart corresponding to the data processing method provided by the embodiment of the present invention, the method comprising:

Step 301, the first client device sends a data request message to the proxy server.

In the embodiment of the present invention, client device 211 to client device 213 may be client devices corresponding to different business systems, for example, client device 211 is a client device corresponding to a loan business system, and client device 212 is an insurance business system The corresponding client device and client device 213 are client devices corresponding to the sales business system; thus, the loan business system can process the loan data generated in the process of executing the business of the loan business system through the client device 211, and the insurance business The system can process the insurance data generated during the execution of business by the insurance business system through the client device 212 , and the sales business system can process the sales data generated during the business execution of the sales business system through the client device 213 .

The data processing method in the embodiment of the present invention is described below by taking the loan business system processing loan data as an example. It is understandable that other business systems can also refer to this method to implement the process of processing their own data, and the details are not limited.

In one example, a (World Wide Web, web) browser may be set in the client device 211, and users in the loan business system may obtain a resource management interface by inputting a preset link in the web browser; wherein, the resource management interface Multiple function icons can be set on it, such as "modify resource" function icon, "delete resource" function icon, "obtain resource" function icon and so on. Taking the deletion of loan data a as an example, if the client device 211 detects that the user triggers the "delete resource" function icon, it can prompt the user to enter the identifier of the resource to be deleted in the resource management interface, and then when it detects that the user has entered the loan data a After the identification, a data request message is generated according to the identification of the loan data a, and the data request message may include the identification of the client device 211 and the identification of the loan data a.

Further, the client device 211 may send the data request message to the proxy server 200, wherein there may be multiple ways of sending the data request message to the proxy server 200, for example, the data request message may be sent through wired devices such as optical fibers and network cables, Alternatively, the data request message may be sent through wireless devices such as sound waves and bluetooth, which is not specifically limited.

In step 302, the proxy server queries a preset correspondence table to determine a target service group corresponding to the first client device.

As shown in Figure 2, in an example, after determining the main storage server 231, the secondary storage server 232, and the secondary storage server 233 in the storage service group 230, the information (such as IP address) of the primary storage server 231 can be sent to the proxy server 220; In this way, the proxy server 220 can communicate with the main storage server 231 according to the IP address of the main storage server 231, obtain the preset correspondence table stored in the main storage server 231, and store the preset correspondence table in the preset storage Space, such as stored in the disk or hard disk of the proxy server 220.

In the embodiment of the present invention, there are many ways for the proxy server 220 to obtain the preset correspondence table. Relationship table, for example, the proxy server 220 can send a request message to the main storage server 231 every 5 minutes, correspondingly, after the main storage server 231 receives the request message, it can send the preset corresponding relationship table to the proxy server 220; The server 220 may update the preset correspondence table stored in the preset storage space every 5 minutes. In another possible implementation, the proxy server 220 can update the preset correspondence table stored in the preset storage space in real time according to the instruction of the main storage server 231. For example, if the main storage server 2411 is damaged and the main storage server 231 has updated the preset correspondence table, then the main storage server 231 can actively send the updated preset correspondence table to the proxy server 220; thus, the proxy server 220 can use the preset correspondence table received in real time to update the preset The preset correspondence table stored in the storage space.

In a specific implementation, if the proxy server 220 receives the data request message sent by the client device 211, it can obtain the preset correspondence table stored in the preset storage space, and then can query the preset correspondence table according to the identifier of the client device 211. , if there is a target service group corresponding to the client device 211 in the preset correspondence table, the result of the query may be that the query is successful; if there is no service group corresponding to the client device 211 in the preset correspondence table, the result of the query is Can fail for the query. The process of determining the main server corresponding to the client device by the proxy server 220 is described below from these two situations respectively.

Case 1

In case one, the target service group corresponding to the client device exists in the preset correspondence table.

Based on the preset correspondence table shown in Table 1, if the client device is the client device 211 , the proxy server 220 may determine that the service group corresponding to the client device 211 is the service group 241 .

Scenario 2

In the second situation, the service group corresponding to the client device does not exist in the preset correspondence table.

Based on the preset correspondence table shown in Table 1, if the client device is the client device 214, the proxy server 220 may determine that there is no service group corresponding to the client device 214 in the preset correspondence table; thus, the proxy server 220 The target service group may be selected from the service groups 241 - 243 according to the performance of the service groups 241 - 243 , and the main server in the target service group may be used as the main server corresponding to the client device 211 . Wherein, the performance of the service group 241-server 243 may be determined by the total disk capacity of the servers included in the service group 241-server 243.

For example, based on the default correspondence table shown in Table 1, the total available space of the servers 2411-2413 included in the service group 241 is 1000M, and the total available space of the servers 2421-2423 included in the service group 242 is 600M. The total available space of the servers 2431 - 2433 included in the service group 243 is 1400M; it can be seen that the performance of the service groups 241 - 243 from high to low can be: service group 243 > service group 241 > server 242 . Since the service group with the best performance is the service group 243 , the proxy server 220 may use the master server 2432 in the service group 243 as the master server corresponding to the client device 211 .

In the embodiment of the present invention, by selecting the service group with the best current performance in at least one service group as the service group corresponding to the new client device, it can not only improve the efficiency of processing the data of the client device, but also ensure that at least one The load balance of the service group improves the data processing capability of the data processing system.

Step 303, the proxy server 220 sends the data processing request to the master server in the target service group.

In a specific implementation, if the target service group corresponding to the client device is the service group 241, since the main server in the service group 241 is the main server 2411, the proxy server 220 can obtain the IP address of the main server 2411 from the preset correspondence table. address (ie http://2411.com), and then forward the identifier of the loan data a to the main server 2411 according to the IP address of the main server 2411. Specifically, the proxy server 220 can generate a message according to the IP address of the proxy server 220, the IP address http://2411.com of the main server 2411 and the identification of the loan data a, and the sender address of the message can be the proxy server 220 The IP address of the receiver, the address of the recipient may be http://2411.com, and the content of the message may include the identification of the loan data a, or may also include other information, such as the identification of the client device 211.

Step 304, the main server in the target service group processes the data to be processed.

In a specific implementation, if the main server 2411 receives a data processing request, it can query and determine the location of the loan data a from the disk of the main server 2411, and can delete the loan data a from the disk. In one example, after the loan data a is successfully deleted, the main server 2411 may send a response message of successful data processing to the proxy server 220, so that the proxy server 220 forwards the response message of successful data processing to the client device 211, thus, The client device 211 can display the information that the loan data a is successfully deleted to the user of the loan business system on the web interface.

In a possible implementation manner, after receiving the data processing request, the main server 2411 may further authenticate the client device 211 before deleting the loan data a from the disk. Specifically, the client device 211 may send the first authorization information to the main server 2411 in advance, and correspondingly, the data request message sent by the client device 211 to the proxy server 220 may include the second authentication information of the client device 211 , so that the packet sent by the proxy server 220 to the main server 2411 may also include the second authentication information of the client device 211. In this way, after receiving the data processing request, the main server 2411 can use the first authentication information of the client device 211 and the second authentication information of the client device 211 to verify the legitimacy of the client device 211, if it is determined that the client device 211 is legal, the loan data a can be deleted from the disk, if it is determined that the client device 211 is not legal, it can send a response message of data processing failure to the proxy server 220, so that the proxy server 220 forwards the response message of data processing failure To the client device 211, in this way, the client device 211 can display the information of failure to delete the loan data a to the user of the loan business system on the web interface.

In a specific implementation, if the first authentication information and the second authentication information of the client device 211 are user name and password, then the main server 2411 can determine that the client device 211 legal, if the first authentication information of the client device 211 is a private key, and the second authentication information of the client device 211 is a public key, then when the first authentication information matches the second authentication information, the main server 2411 can It is determined that the client device 211 is legitimate. It should be noted that the first authentication information and the second authentication information of the client device 211 may also be other information, such as barcode information, which is not specifically limited.

In the embodiment of the present invention, by verifying the legality of the client device before processing the data of the client device, it is possible to avoid processing data of other client devices and ensure the orderliness of data processing of different client devices and security.

In the above embodiments of the present invention, the data request message sent by the first client device is received, and the data request message includes the identification of the first client device and the data to be processed; further, querying the preset correspondence table , obtain the target service group corresponding to the identifier of the first client device, and use the main server in the target service group to process the data to be processed; one or more clients are stored in the preset correspondence table The corresponding relationship between the identifier of the end device and the at least one service group. In the embodiment of the present invention, by setting at least one service group and the master server and one or more slave servers included in each service group, it can be ensured that the master server in each service group exists in real time (for example, if a certain If the primary server of the service group is damaged, a new primary server can be assigned to the service group), so that at least one service group can be in a state available at all times; thus, by assigning the corresponding service group to the first client device, it can pass The main server in the service group corresponding to the first client device executes the data processing process related to the first client device to ensure the high availability of the data processing process; and, by setting the preset correspondence table, based on the preset correspondence relationship Tables can determine the main server that processes the data to be processed, instead of analyzing each server in the service group, so that the efficiency of data processing can be improved.

With regard to the above-mentioned method flow, the embodiment of the present invention also provides a data processing device, and the specific content of the device can be implemented with reference to the above-mentioned method.

Fig. 4 is a schematic structural diagram of a data processing device provided by an embodiment of the present invention, the device is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group including a master server and one or more slave servers; the apparatus includes:

A transceiver module 401, configured to receive a data request message sent by a first client device, where the data request message includes an identifier of the first client device and data to be processed;

The query module 402 is configured to query a preset correspondence table to obtain the target service group corresponding to the identifier of the first client device; the preset correspondence table stores the identifiers of one or more client devices and the Describe the corresponding relationship of at least one service group;

The processing module 403 is configured to process the data to be processed by using the main server in the target service group.

Optionally, the processing module 403 is further configured to:

If the master server in the target service group fails, select a first slave server from one or more slave servers in the target service group, and use the first slave server to process the data to be processed.

Optionally, the preset correspondence table also includes the IP address of the main server in each service group;

The processing module 403 is specifically configured to: send the data to be processed to the main server in the target service group according to the IP address of the main server in the target service group included in the preset correspondence table, and make the main server in the target service group process the data to be processed.

Optionally, the device processing module 403 is further configured to:

If there is no service group corresponding to the identifier of the first client device in the preset correspondence table, selecting a first service group from the at least one service group according to the performance of the at least one service group, And use the master server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by the master server in each service group and one or more slaves The disk capacity of the server is determined.

Optionally, the processing module 403 is further configured to:

Generate a correspondence between the identifier of the first client device and the first service group in the preset correspondence table.

Optionally, the processing module 403 is further configured to:

It is determined that the first client device is legitimate.

It can be seen from the foregoing that in the above embodiments of the present invention, the data request message sent by the first client device is received, and the data request message includes the identifier of the first client device and the data to be processed; further , querying the preset correspondence table, obtaining the target service group corresponding to the identifier of the first client device, and using the master server in the target service group to process the data to be processed; in the preset correspondence table A correspondence relationship between one or more identifiers of client devices and the at least one service group is stored. In the embodiment of the present invention, by setting at least one service group and the master server and one or more slave servers included in each service group, it can be ensured that the master server in each service group exists in real time (for example, if a certain If the primary server of the service group is damaged, a new primary server can be assigned to the service group), so that at least one service group can be in a state available at all times; thus, by assigning the corresponding service group to the first client device, it can pass The main server in the service group corresponding to the first client device executes the data processing process related to the first client device to ensure the high availability of the data processing process; and, by setting the preset correspondence table, based on the preset correspondence relationship Tables can determine the main server that processes the data to be processed, instead of analyzing each server in the service group, so that the efficiency of data processing can be improved.

Based on the same inventive concept, an embodiment of the present invention also provides a computer-readable storage medium, including instructions, which, when run on a computer, cause the computer to execute the data processing method as described in FIG. 3 .

Based on the same inventive concept, an embodiment of the present invention further provides a computer program product, which, when run on a computer, causes the computer to execute the data processing method as described in any of FIG. 3 .

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

While preferred embodiments of the invention have been described, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment as well as all changes and modifications which fall within the scope of the invention.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (14)

1. A data processing method, wherein the method is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a main server and one or a plurality of slave servers; the method comprising: receiving a data request message sent by the first client device, where the data request message includes the identifier of the first client device and data to be processed; Querying the preset correspondence table to obtain the target service group corresponding to the identifier of the first client device; the preset correspondence table stores the identifiers of one or more client devices and the at least one service group Corresponding relationship, the service type provided by the at least one service group corresponding to the first client device is different from the service type provided by other service groups; using a master server in the target service group to process the data to be processed; If the master server in the target service group fails, select a first slave server from one or more slave servers in the target service group, and use the first slave server to process the data to be processed. 2. The method according to claim 1, wherein the preset correspondence table also includes the Internet protocol address IP of the master server in each service group; the use of the master server in the target service group Processing said data to be processed, including: According to the IP of the main server in the target service group included in the preset correspondence table, send the data to be processed to the main server in the target service group, so that the main server in the target service group The server processes the data to be processed. 3. The method according to claim 1, characterized in that the method further comprises: If there is no service group corresponding to the identifier of the first client device in the preset correspondence table, selecting a first service group from the at least one service group according to the performance of the at least one service group, And use the main server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by the disk capacity of the main server in each service group and one or Determined by the disk capacity of multiple slave servers. 4. The method according to claim 3, wherein after selecting the first service group from the at least one service group according to the performance of the at least one service group, further comprising: Generate a correspondence between the identifier of the first client device and the first service group in the preset correspondence table. 5. The method according to any one of claims 1 to 4, characterized in that before using the master server in the target service group to process the data to be processed, further comprising: It is determined that the first client device is legitimate. 6. A data processing system, characterized in that the data processing system includes one or more client devices, a proxy server and at least one service group, each service group in the at least one service group includes at least one master server and one or more slave servers; The client device is configured to generate a data request message according to a user's trigger operation, and send the data request message to the proxy server; the data request message includes the identifier of the client device and data to be processed ; The proxy server is configured to, after receiving the data request message sent by the client device, query a preset correspondence table to determine the target service group corresponding to the identifier of the client device, and send the data to be processed To the main server in the target service group; the preset correspondence table stores the correspondence between the identifiers of the one or more client devices and the at least one service group, corresponding to the first client device The type of service provided by the at least one service group is different from the type of service provided by other service groups; The main server in the target service group is configured to process the data to be processed after receiving the data to be processed sent by the proxy server; The target service group is configured to select a first slave server from one or more slave servers in the target service group if the master server fails, and use the first slave server to process the pending Data processing. 7. The system according to claim 6, further comprising a storage server; the storage server is configured to: receive information reported respectively by the master server and one or more slave servers in each service group , and generating the preset correspondence table according to the information; The proxy server is further configured to: obtain the preset correspondence table from the storage server. 8. The system according to claim 7, wherein the preset correspondence table further includes the IP of the main server in each service group; When the master server in the target service group fails, the target service group selects a first slave server whose performance is greater than a first preset performance from one or more slave servers in the target service group, and sends the The IP of the first slave server is sent to the storage server; The storage server is further configured to: after receiving the IP of the first slave server, update the IP of the master server in the target service group in the preset correspondence table to the IP of the first slave server . 9. A data processing device, characterized in that the device is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a main server and one or A plurality of slave servers; said means comprising: A transceiver module, configured to receive a data request message sent by the first client device, where the data request message includes the identifier of the first client device and data to be processed; A query module, configured to query a preset correspondence table to obtain a target service group corresponding to the identifier of the first client device; the preset correspondence table stores one or more client device identifiers and the A correspondence relationship of at least one service group, the service type provided by the at least one service group corresponding to the first client device is different from the service type provided by other service groups; A processing module, configured to use the main server in the target service group to process the data to be processed; the processing module is also used to: if the main server in the target service group fails, then from the target service group One or more of the slave servers selects a first slave server, and uses the first slave server to process the data to be processed. 10. The device according to claim 9, wherein the preset correspondence table further includes the IP of the main server in each service group; The processing module is specifically configured to: send the data to be processed to the main server in the target service group according to the IP of the main server in the target service group included in the preset correspondence table, so that The main server in the target service group processes the data to be processed. 11. The device according to claim 9, wherein the device processing module is further used for: If there is no service group corresponding to the identifier of the first client device in the preset correspondence table, selecting a first service group from the at least one service group according to the performance of the at least one service group, And use the main server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by the disk capacity of the main server in each service group and one or Determined by the disk capacity of multiple slave servers. 12. The device according to claim 11, wherein the processing module is further used for: Generate a correspondence between the identifier of the first client device and the first service group in the preset correspondence table. 13. The device according to any one of claims 9 to 12, wherein the processing module is further used for: It is determined that the first client device is legitimate. 14. A computer-readable storage medium, wherein instructions are stored thereon, and when the medium is run on a computer, the computer is made to execute the method according to any one of claims 1 to 5.

Images