CN114265905A - Data monitoring method and device - Google Patents

Abstract

The present application provides a data monitoring method and device. The method includes: acquiring a plurality of tasks to be processed, and determining at least two target terminals from a terminal cluster; assigning different tasks to be processed to each target terminal, so that the The target terminal determines the data to be detected from the first database according to the assigned task to be processed, and compares the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected; Obtain the data comparison result corresponding to the data to be detected, and determine the data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected, so as to realize the concurrent data comparison. , reducing the time required for data comparison, thereby effectively improving the efficiency of data comparison.

Description

Data monitoring method and device

technical field

The present disclosure relates to the technical field of databases, and in particular, to a data monitoring method and device.

Background technique

In the daily operation and maintenance of the database, data synchronization is often required, that is, the source data in the master database is synchronized to the slave database. After synchronizing the data, data comparison needs to be performed to verify the consistency of the data in the master-slave database, so as to determine the data synchronization state between the master-slave database.

At present, when comparing data, a single-point comparison method is generally used for comparison, that is, a single terminal device compares the source data to be compared in the master database with the backup data in the slave database to determine the data. Compare results.

However, since the comparison method is used for data comparison, when the number of source data to be compared is large, the time required for data comparison is longer, resulting in low data comparison efficiency.

SUMMARY OF THE INVENTION

In order to overcome the problems existing in the related art, the present disclosure provides a data monitoring method and apparatus.

According to a first aspect of the embodiments of the present disclosure, there is provided a data monitoring method, the method comprising:

Acquire multiple pending tasks, and determine at least two target terminals from the terminal cluster;

Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the backup data in the second database. Yes, obtain the data comparison result corresponding to the data to be detected;

A data comparison result corresponding to the data to be detected is acquired, and a data synchronization state between the first database and the second database is determined according to the data comparison result corresponding to the data to be detected.

Optionally, the method is applied to a first terminal in a terminal cluster, and the terminal cluster further includes a second terminal;

The determining of at least two target terminals from the terminal cluster includes:

acquiring status information of the second terminal and/or status information of the first terminal;

At least two target terminals are determined from the second terminal and the first terminal according to the state information of the second terminal and/or the state information of the first terminal.

Optionally, the status information includes terminal status and/or running status;

The determining at least two target terminals from the second terminal and the first terminal according to the state information of the second terminal and/or the state information of the first terminal includes:

In response to the state information of the second terminal and/or the state information of the first terminal meeting a first preset condition, the second terminal and/or the first terminal are used as target terminals; wherein the The first preset condition includes that the running state is an idle state and/or the terminal state is an alive state.

Optionally, the method further includes:

The heartbeat recording time corresponding to the first terminal in the first preset storage device is updated every preset time.

Optionally, the first preset storage device further includes the heartbeat recording time corresponding to each second terminal;

The method also includes:

Calculate the time difference between the heartbeat recording time corresponding to the current moment and the second terminal;

In the case that the time difference value is less than the first preset time threshold, determining that the terminal state of the second terminal is the alive state;

When the time difference is greater than or equal to the first preset time threshold, it is determined that the terminal state of the second terminal is a non-survival state.

Optionally, the first database stores source data; the backup data in the second database is obtained by synchronizing the source data;

The to-be-processed task includes the to-be-detected time period and/or the to-be-detected data table identifier.

Optionally, a first page is provided by the first terminal, and the first page includes a first re-detection button;

The method also includes:

Obtaining abnormal data in response to the first trigger operation of the first re-detection button; wherein the abnormal data includes data to be detected whose data comparison result is a data abnormal result;

The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Optionally, the method further includes:

Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal.

According to a second aspect of the embodiments of the present disclosure, a data monitoring method is provided, which is applied to a second terminal in a terminal cluster, and the method includes:

Acquire the task to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the task to be processed;

Comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected;

Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first database and the second database according to the data comparison result corresponding to the data to be detected Data synchronization status between databases.

Optionally, comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected, including:

Obtain target field information in the data to be detected; wherein, the target field information includes a target field and a target field value;

Determine from the backup data that the field value corresponding to the target field name is the target data of the target field value;

Calculate the check value corresponding to the target data, and calculate the check value corresponding to the data to be detected;

When the check value corresponding to the target data is different from the check value corresponding to the data to be detected, it is determined that the data comparison result corresponding to the data to be detected is a data abnormality result.

Optionally, the method further includes:

The data to be detected whose data comparison result is an abnormal data result is stored in the second preset storage device.

Optionally, a second page is provided by the second terminal, and the second page includes a second re-detection button;

The method also includes:

Acquiring abnormal data in response to the second trigger operation of the second re-detection button; wherein the abnormal data includes data to be detected whose data comparison result in the second preset storage device is a data abnormal result;

The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Optionally, the to-be-processed task includes a to-be-detected time period and/or a to-be-detected data table identifier;

The determining of the data to be detected from the first database according to the task to be processed includes:

It is determined from the first database that the storage time is in the to-be-detected time period, and/or the data table identifier is the source data identified by the to-be-detected data table, and the determined source data is used as the to-be-detected data.

Optionally, the method further includes:

Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal.

Optionally, the method further includes:

judging whether there is leader terminal mark information in the first preset storage device;

If there is no leader terminal marking information, the current first terminal information is determined, and the leader terminal marking information is determined according to the current first terminal information; wherein, the first terminal is in a working state of the leader state terminal;

saving the leader terminal marking information into a first preset storage device;

If there is leader terminal marking information, acquiring the information of the first terminal in the leader terminal marking information, and acquiring the terminal state of the first terminal corresponding to the information of the first terminal;

In the case where the terminal state of the first terminal is a non-survival state, a new first terminal is determined, and the leader in the first preset storage device is updated according to the information of the new first terminal. The terminal tag information is updated.

According to a third aspect of the embodiments of the present disclosure, there is provided a data monitoring device, the device comprising:

a terminal determination module, used for acquiring a plurality of tasks to be processed, and determining at least two target terminals from the terminal cluster;

The task allocation module is used for allocating different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the second database. Compare the backup data in the to-be-detected data to obtain a data comparison result corresponding to the data to be detected;

A state determination module, configured to obtain the data comparison result corresponding to the data to be detected, and determine the data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected .

Optionally, the apparatus is applied to a first terminal in a terminal cluster, and the terminal cluster further includes a second terminal;

The terminal determination module is specifically used for:

acquiring status information of the second terminal and/or status information of the first terminal;

At least two target terminals are determined from the second terminal and the first terminal according to the state information of the second terminal and/or the state information of the first terminal.

Optionally, the status information includes terminal status and/or running status;

The terminal determination module is also specifically used for:

In response to the state information of the second terminal and/or the state information of the first terminal meeting a first preset condition, the second terminal and/or the first terminal are used as target terminals; wherein the The first preset condition includes that the running state is an idle state and/or the terminal state is an alive state.

Optionally, the device further includes a time update module;

The time update module is used for:

The heartbeat recording time corresponding to the first terminal in the first preset storage device is updated every preset time.

Optionally, the first preset storage device further includes the heartbeat recording time corresponding to each second terminal;

The terminal determination module is also used for:

Calculate the time difference between the heartbeat recording time corresponding to the current moment and the second terminal;

In the case that the time difference value is less than the first preset time threshold, determining that the terminal state of the second terminal is the alive state;

When the time difference is greater than or equal to the first preset time threshold, it is determined that the terminal state of the second terminal is a non-survival state.

Optionally, the first database stores source data; the backup data in the second database is obtained by synchronizing the source data;

The to-be-processed task includes the to-be-detected time period and/or the to-be-detected data table identifier.

Optionally, a first page is provided by the first terminal, and the first page includes a first re-detection button;

The state determination module is also used for:

Obtaining abnormal data in response to the first trigger operation of the first re-detection button; wherein the abnormal data includes data to be detected whose data comparison result is a data abnormal result;

The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Optionally, the state determination module is further used for:

Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal.

According to a fourth aspect of the embodiments of the present disclosure, a data monitoring apparatus is provided, which is applied to a second terminal in a terminal cluster, and the apparatus includes:

a data determination module, configured to acquire the task to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the task to be processed;

a data comparison module, configured to compare the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected;

A result processing module, configured to send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first terminal according to the data comparison result corresponding to the data to be detected Data synchronization status between the database and the second database.

Optionally, the data comparison module is specifically used for:

Obtain target field information in the data to be detected; wherein, the target field information includes a target field and a target field value;

Determine from the backup data that the field value corresponding to the target field name is the target data of the target field value;

Calculate the check value corresponding to the target data, and calculate the check value corresponding to the data to be detected;

When the check value corresponding to the target data is different from the check value corresponding to the data to be detected, it is determined that the data comparison result corresponding to the data to be detected is a data abnormality result.

Optionally, the result processing module is also used for:

The data to be detected whose data comparison result is an abnormal data result is stored in the second preset storage device.

Optionally, a second page is provided by the second terminal, and the second page includes a second re-detection button;

Optionally, the data comparison module is also used for:

Acquiring abnormal data in response to the second trigger operation of the second re-detection button; wherein the abnormal data includes data to be detected whose data comparison result in the second preset storage device is a data abnormal result;

The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Optionally, the to-be-processed task includes a to-be-detected time period and/or a to-be-detected data table identifier;

The data determination module is specifically used for:

It is determined from the first database that the storage time is in the to-be-detected time period, and/or the data table identifier is the source data identified by the to-be-detected data table, and the determined source data is used as the to-be-detected data.

Optionally, the result processing module is also used for:

Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal.

Optionally, the device further includes a marking information setting module;

The marking information setting module is specifically used for:

judging whether there is leader terminal mark information in the first preset storage device;

If there is no leader terminal marking information, the current first terminal information is determined, and the leader terminal marking information is determined according to the current first terminal information; wherein, the first terminal is in a working state of the leader state terminal;

saving the leader terminal marking information into a first preset storage device;

If there is leader terminal marking information, acquiring the information of the first terminal in the leader terminal marking information, and acquiring the terminal state of the first terminal corresponding to the information of the first terminal;

In the case where the terminal state of the first terminal is a non-survival state, a new first terminal is determined, and the leader in the first preset storage device is updated according to the information of the new first terminal. The terminal tag information is updated.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a computer device, comprising:

processor;

memory for storing processor-executable instructions;

wherein the processor is configured to:

Acquiring multiple tasks to be processed, and determining at least two target terminals according to the first terminal and/or the second terminal;

Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the data in the second database. The backup data is compared to obtain a data comparison result corresponding to the data to be detected;

A data comparison result corresponding to the data to be detected is acquired, and a data synchronization state between the first database and the second database is determined according to the data comparison result corresponding to the data to be detected.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a computer device, comprising:

processor;

memory for storing processor-executable instructions;

wherein the processor is configured to:

acquiring the task to be processed assigned by the first terminal, and determining the data to be detected from the first database according to the task to be processed;

Comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected;

Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first database and the second database according to the data comparison result corresponding to the data to be detected Data synchronization status between databases.

According to a seventh aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, the above first aspect and the The data monitoring method described in the various possible designs of the first aspect.

According to an eighth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, the above second aspect and Various possible designs of the second aspect describe the data monitoring method.

According to a ninth aspect of the embodiments of the present disclosure, there is provided a computer program product, including a computer program that, when executed by a processor, implements the data monitoring described in the first aspect and various possible designs of the first aspect method.

According to a tenth aspect of the embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the data monitoring described in the second aspect and various possible designs of the second aspect method.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

In the embodiment of the present disclosure, when multiple tasks to be processed are acquired, multiple target terminals that can process the tasks to be processed are determined from the terminal cluster. Assign tasks to the target terminals, that is, assign different tasks to be processed to each target terminal, so that the target terminal determines from the first database based on the assigned tasks to be processed that synchronization checks are required, that is, the source data for data comparison, to Obtain the data to be detected, and compare the data to be detected with the backup data in the second database to determine whether the data to be detected has been synchronized to the second database, so as to obtain the data comparison result corresponding to the data to be detected . The data synchronization state between the first database and the second database is determined according to the data comparison result corresponding to the data to be detected determined by the target terminal, so as to realize the monitoring of the data synchronization between the first database and the second database, and use multiple The target terminal performs data comparison, and each target terminal only needs to perform its assigned task to be processed, that is, it only needs to perform data comparison on part of the data, realize the concurrent data comparison, and reduce the time required for data comparison. This effectively improves the efficiency of data comparison.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate embodiments consistent with the disclosure, and together with the description serve to explain the principles of the disclosure.

FIG. 1 is a structural diagram of a data monitoring system according to an exemplary embodiment of the present disclosure.

FIG. 2 is a flowchart of a data monitoring method according to an exemplary embodiment of the present disclosure.

FIG. 3 is a flowchart of another data monitoring method according to an exemplary embodiment of the present disclosure.

Fig. 4 is a flowchart of yet another data monitoring method according to an exemplary embodiment of the present disclosure.

FIG. 5 is a flowchart of still another data monitoring method according to an exemplary embodiment of the present disclosure.

FIG. 6 is a hardware structure diagram of the computer equipment where the data monitoring apparatus according to the embodiment of the present disclosure is located.

Fig. 7 is a block diagram of a data monitoring apparatus according to an exemplary embodiment of the present disclosure.

FIG. 8 is a block diagram of another data monitoring apparatus according to an exemplary embodiment of the present disclosure.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this specification. Rather, they are merely examples of apparatus and methods consistent with some aspects of this specification as recited in the appended claims.

The terms used in this specification are for the purpose of describing particular embodiments only and are not intended to limit the specification. As used in this specification and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

The data involved in this manual can be the data authorized by the user or fully authorized by the parties.

It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information, without departing from the scope of the present specification. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining."

Next, the embodiments of the present disclosure will be described in detail.

As shown in FIG. 1 , FIG. 1 is a structural diagram of a data monitoring system according to an exemplary embodiment of the present disclosure. The system includes a first terminal 101 and at least one second terminal 102 . The first terminal 101 acquires the tasks to be processed (ie, task 1 and task 2), and assigns them to itself or the second terminal 102, so that the second terminal 102 processes the assigned pending tasks, that is, based on the assigned pending tasks, A synchronization check is performed on the first database 103 and the second database 104, that is, data comparison.

Wherein, the first database represents the main database. The second database represents the slave database. The first database stores source data; the second database stores backup data; the backup data is obtained by synchronizing the source data.

Optionally, the first terminal may be a leader terminal, and the leader terminal is a terminal whose working state is the leader state. The second terminal may be a follower terminal, and the follower terminal is a terminal whose working state is a follower state. Of course, the first terminal may also be a data monitoring system, that is, any terminal in the terminal cluster, and the second terminal may be another terminal in the data monitoring system.

The first terminal includes computer equipment such as a computer and a server. The second terminal includes computer equipment such as a computer and a server.

The number of tasks to be processed is multiple. Correspondingly, the to-be-processed tasks assigned by each second terminal are different. It can be understood that the tasks included in the tasks to be processed in FIG. 1 , that is, the number of anger to be processed and the number of second terminals are only an example, and are not limited here.

As shown in FIG. 2 , FIG. 2 is a flowchart of a data monitoring method according to an exemplary embodiment of the present disclosure. The method is used to monitor the data synchronization state between the first database and the second database. The method is applied to a data monitoring system, that is, a terminal in a terminal cluster, specifically a first terminal, and the terminal cluster further includes at least one second terminal. The method includes the following steps:

Step 201: Acquire multiple tasks to be processed, and determine at least two target terminals according to the slave terminal cluster.

In this embodiment, the synchronization check task to be processed is obtained, that is, the task to be processed is obtained, and in order to improve the efficiency of data synchronization check, that is, data comparison, a plurality of The available terminal, that is, the target terminal, is used for concurrent data comparison using multiple target terminals.

Optionally, the number of tasks to be processed may be one. When the number of tasks to be processed is one, only one target terminal needs to be determined.

Step 202: Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the backup data in the second database , to obtain the data comparison result corresponding to the data to be detected.

In this embodiment, after the target terminal is determined, for each target terminal, at least one to-be-processed task is selected from a plurality of to-be-processed tasks, and the selected to-be-processed task is allocated to the target terminal. After the task to be processed is allocated by a terminal, the corresponding source data is obtained from the first database based on the allocated task to be processed to obtain the data to be detected, and the data to be detected is checked synchronously with the backup data in the second database, That is, data comparison, to obtain a data comparison result corresponding to the data to be detected.

Optionally, the data comparison results corresponding to the data to be detected include abnormal data results and normal data results. The abnormal data result indicates that the data to be detected is not synchronized to the second database, that is, the data to be detected does not exist in the second database. The data normal result indicates that the data to be detected has been synchronized to the second database, that is, the data to be detected exists in the second database.

Optionally, when allocating different tasks to be processed for each target terminal, the allocation can be based on a polling method, that is, each target terminal is allocated a task to be processed in turn, if there are remaining tasks to be processed, that is, there are unallocated tasks. If there are pending tasks, each terminal will continue to be assigned a pending task until the assignment of the pending tasks is completed, so as to achieve load balancing of the terminals. For example, the target terminals include terminal 1 and terminal 2. The pending tasks include task 1, task 2 and task 3. Then, first assign task 1 to terminal 1, and assign task 2 to terminal 2, and there are remaining tasks to be processed, that is, task 3. Assign task 3 to terminal 1.

Wherein, the first database stores active data. Specifically, the relevant terminal saves the collected service data (ie, source data) to the first database.

Optionally, when the business data is stored in the first database, the current time is used as the storage time corresponding to the piece of business data.

Optionally, the task to be processed includes indicating the time period to be detected and/or the identifier of the data table to be detected, so that the second terminal can determine the data to be detected according to the time period to be detected and/or the identifier of the data table to be detected.

Wherein, the identifier of the data table to be detected indicates the identifier of the data table to be synchronously detected.

In this embodiment, multiple tasks to be processed are obtained by splitting the data to be synchronously checked, that is, the tasks are divided into pieces, so that when the target terminal processes the tasks to be processed, the number of tasks to be compared by the target terminal can be reduced. data, thereby reducing the time required for data comparison and improving the efficiency of data comparison.

Step 203: Acquire a data comparison result corresponding to the data to be detected, and determine a data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected.

In this embodiment, after obtaining the data comparison result corresponding to the data to be detected, the target terminal sends the data comparison result corresponding to the data to be detected to the first terminal if the target terminal is the second terminal. If the target terminal is the first terminal, the first terminal may directly acquire. The first terminal performs statistics on the data comparison results corresponding to all the received and/or acquired data to be detected, to determine whether there is data to be detected whose data comparison result is an abnormal data result.

If there is data to be detected whose data comparison result is an abnormal data result, indicating that there is data to be detected in the first database that is not synchronized to the second database, it is determined that the data synchronization state between the first database and the second database is synchronization failure.

If there is no data to be detected whose data comparison result is an abnormal data result, indicating that all the data to be detected has been synchronized to the second database, it is determined that the data synchronization status between the first database and the second database is successful.

Optionally, after obtaining the data synchronization status between the first database and the second database, output the data synchronization status, so that the relevant personnel can know the data synchronization status.

Optionally, when the data synchronization status is synchronization failure, the data to be detected whose data comparison result is an abnormal data result may be output, so that the relevant personnel can know the abnormal synchronization data.

It can be seen from the above description that in the case of acquiring multiple tasks to be processed, multiple target terminals that can process the tasks to be processed are determined from the terminal cluster. Assign tasks to the target terminals, that is, assign different tasks to be processed to each target terminal, so that the target terminal determines from the first database based on the assigned tasks to be processed that synchronization checks are required, that is, the source data for data comparison, to Obtain the data to be detected, and compare the data to be detected with the backup data in the second database to determine whether the data to be detected has been synchronized to the second database, so as to obtain the data comparison result corresponding to the data to be detected . The data synchronization state between the first database and the second database is determined according to the data comparison result corresponding to the data to be detected determined by the target terminal, so as to realize the monitoring of the data synchronization between the first database and the second database, and use multiple The target terminal performs data comparison, and each target terminal only needs to perform its assigned task to be processed, that is, it only needs to perform data comparison on part of the data, realize the concurrent data comparison, and reduce the time required for data comparison. This effectively improves the efficiency of data comparison.

As shown in FIG. 3, it is a flow chart of another data monitoring method according to an exemplary embodiment. Based on the foregoing embodiment, this embodiment describes the process of how to determine the target terminal, including the following steps:

Step 301: Acquire a task to be processed.

Step 302: Acquire status information of the second terminal and/or status information of the first terminal.

Step 303: Determine at least two target terminals from the second terminal and/or the first terminal according to the state information of the second terminal and/or the state information of the first terminal.

In this embodiment, when determining the target terminal to perform the task to be processed, the state information of each second terminal and/or the state information of the first terminal is acquired, and the state information of each second terminal and/or its own state are obtained according to the state information of each second terminal and/or its own state. information, from all the second terminals and/or the first terminal itself to determine the available terminals to obtain the target terminal, so as to realize the accurate determination of the target terminal.

Specifically, when the number of second terminals is one, the target terminal may be determined according to the second terminal and the first terminal itself; when there are multiple second terminals, the target terminal may be determined only from the second terminals, or the target terminal may be determined from the second terminals. The target terminal is determined among itself and the second terminal.

Optionally, the status information includes terminal status and/or running status.

Among them, the terminal state includes a surviving state and a non-surviving state. When the second terminal is in the alive state, it indicates that the second terminal can run normally, that is, the to-be-processed task can be processed. When the second terminal is in a non-survival state, it indicates that the second terminal cannot run normally, has been deactivated, and cannot execute the pending task.

The running state includes an idle state and a busy state. When the second terminal is in an idle state, it indicates that the second terminal is not currently processing pending tasks and can process new pending tasks; when the second terminal is in a busy state, it indicates that the second terminal is processing pending tasks. When the to-be-processed task is allocated to the second terminal, it needs to wait.

In this embodiment, when the first terminal is activated, terminal information corresponding to the first terminal is stored in the first preset storage device. The terminal information includes a terminal identifier. Specifically, the first terminal may be a server instance. Correspondingly, the terminal information corresponding to the first terminal, that is, the instance information, includes a server instance identifier (eg, a server instance name).

In this embodiment, the cluster system, that is, the data monitoring system adopts the leader/follower mode, and when a terminal in the cluster system is activated, the terminal stores its corresponding terminal information to the first preset storage device. Correspondingly, when determining the second terminal, the first terminal may determine the second terminal according to the terminal information in the first preset storage device. When adding a new terminal, that is, a new server instance, when the terminal is started, the corresponding terminal information, that is, the instance information, is saved in the first preset storage device, so as to ensure the horizontal expansion of the cluster system. ability.

Optionally, the first preset storage device further stores the heartbeat recording time corresponding to the first terminal. In order to determine the survival state of the terminal, a heartbeat keep-alive mechanism can also be used, that is, the heartbeat recording time corresponding to the first terminal in the first preset storage device is updated every preset time, which is equivalent to every preset time. time, the first terminal sends a heartbeat message to the first preset storage device, and the heartbeat recording time represents the time when the first preset storage device receives the heartbeat message.

Wherein, when updating the heartbeat recording time corresponding to the first terminal in the first preset storage device, the first terminal acquires the current time, and updates the heartbeat recording time to the current time.

Similarly, the first preset storage device also stores the heartbeat recording time corresponding to the second terminal. The second terminal updates the heartbeat recording time corresponding to the second terminal in the first preset storage device every preset time, so that the first terminal can determine whether the second terminal is alive according to the heartbeat recording time corresponding to the second terminal .

The process of updating the heartbeat recording time corresponding to the second terminal in the first preset storage device by the second terminal is similar to the above-mentioned process of updating the heartbeat recording time by the first terminal, which will not be repeated here.

Optionally, when the terminal state of the second terminal is determined, whether the second terminal is alive may be determined according to the heartbeat recording time corresponding to the second terminal in the first preset storage device. Wherein, the specific process of determining the terminal state of the second terminal is: calculating the time difference between the current moment and the heartbeat recording time corresponding to the second terminal. In the case that the time difference is smaller than the first preset time threshold, it is determined that the terminal state of the second terminal is the alive state. When the time difference is greater than or equal to the first preset time threshold, it is determined that the terminal state of the second terminal is a non-survival state.

Specifically, for each second terminal, the heartbeat recording time corresponding to the second terminal is obtained from the first preset storage device, the difference between the current moment and the heartbeat recording time corresponding to the second terminal is calculated, and the corresponding heartbeat recording time is obtained. When the time difference is greater than or equal to the first preset time threshold, it indicates that the second terminal has not updated its corresponding heartbeat mark time for a long time, that is, it indicates that the second terminal has not been updated for a long time. A heartbeat message is sent to the first preset storage device, and the second terminal has been deactivated, then it is determined that the terminal state of the second terminal is a non-survival state.

In the case that the time difference is less than the first preset time threshold, it indicates that the time from the second terminal to the last update of its corresponding heartbeat mark time is short, that is, it indicates that the second terminal sends the data in a short time before the current moment. The heartbeat message is sent to the first preset storage device, and the second terminal is still active, then it is determined that the terminal state of the second terminal is the alive state.

Wherein, the first preset storage device includes a device with a storage function such as a database.

The process of determining the state information of the first terminal itself is similar to the above-mentioned process of determining the state information of the second terminal, which will not be repeated here.

Optionally, according to the state information of the second terminal and/or the state information of the first terminal, at least two target terminals are determined from the second terminal and/or the first terminal, including:

In response to the state information of the second terminal and/or the state information of the first terminal satisfying the first preset condition, the second terminal and/or the first terminal are used as the target terminal. The first preset condition includes that the running state is an idle state and/or the terminal state is an alive state.

Specifically, for each second terminal, if the state information of the second terminal satisfies the first preset condition, it indicates that the second terminal is currently available and can process pending tasks, then the second terminal is as the target terminal. And/or, when the state information of the first terminal satisfies the first preset condition, indicating that the first terminal itself can also process the task to be processed, the first terminal can be used as the target terminal

Wherein, taking the first preset condition including that the running state is the idle state as an example, the state information of the second terminal includes the running state. When the running state of the second terminal is the idle state, the second terminal is used as the target terminal.

Wherein, taking the first preset condition including that the terminal state is an alive state as an example, the state information of the second terminal includes the terminal state. When the terminal state of the second terminal is the live state, the second terminal is used as the target terminal.

Wherein, taking the first preset condition including that the terminal state is the alive state and the running state being the idle state as an example, the state information of the second terminal includes the terminal state and the running state. When the terminal state of the second terminal is the live state and the running state is the idle state, the second terminal is used as the target terminal.

Optionally, the number of tasks to be processed may also be used to determine the target terminal, that is, after obtaining the second terminal and/or the first terminal whose status information satisfies the first preset condition, select the second terminal whose status information satisfies the first preset condition. The second terminal and/or the first terminal select terminals whose number is the number of tasks to be processed, and use the selected terminal as the target terminal.

Specifically, when the target terminal is determined based on the first terminal and the second terminal, if it is determined that the second terminal whose state information satisfies the first preset condition and that its own state information satisfies the first preset condition, the state information From the second terminal that satisfies the first preset condition and the first terminal itself, the terminal whose number is the number of tasks to be processed is selected as the target terminal.

In the case where the target terminal is determined only based on the second terminal, after obtaining the second terminal whose state information satisfies the first preset condition, the number of the second terminals whose state information satisfies the first preset condition is selected as the task to be processed. number of second terminals, and the selected second terminal is used as the target terminal.

Wherein, when the target terminal is selected from the first terminal and/or the second terminal, the target terminal may be selected randomly, or may be selected based on other methods, for example, based on the priority corresponding to the terminal, which is not limited here.

Optionally, a related page is also provided, so that the user can use the page to modify the data in the first preset storage device/second preset storage device.

Optionally, the user can also dynamically modify, create, and delete pending tasks.

Step 304: Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the backup data in the second database , to obtain the data comparison result corresponding to the data to be detected.

Step 305: Acquire a data comparison result corresponding to the data to be detected, and determine a data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected.

In this embodiment, the first page is provided by the first terminal, and the first page includes the first re-detection button. Correspondingly, in response to the first triggering operation of the first re-detection button, abnormal data is acquired. The abnormal data includes data to be detected whose data comparison result is an abnormal data result. The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Specifically, when it is detected that the user triggers the first re-detection button on the first page on the first terminal, it indicates that it is necessary to determine whether the abnormal data is caused by synchronization delay, and then the abnormal data is acquired, that is, the data comparison result is data The data to be detected of the abnormal result, and for each abnormal data, the abnormal data is compared with the backup data in the second database to obtain the data comparison result corresponding to the abnormal data.

Optionally, abnormal data may be acquired from the second preset storage device.

Optionally, in the case where the data comparison result corresponding to the abnormal data is the normal data result, it indicates that the previously determined data comparison result is wrong due to the synchronization delay. The abnormal data is deleted from the default storage device.

Optionally, alarm information is generated according to a data comparison result corresponding to the data to be detected, and the alarm information is sent to the user terminal.

Specifically, the data to be detected whose data comparison result is an abnormal data result is acquired, and alarm information including the to-be-detected data is generated. By presetting the alarm method, the alarm information is sent to the user terminal, so that the relevant personnel can be informed of the data of synchronization problems in time, so as to realize the timely alarm.

In this embodiment, the status information of each second terminal is acquired, so as to use the status information of the second terminal to determine the second terminal that can process the task to be processed, that is, to determine a stable and reliable target terminal, and assign the target terminal to be processed task, so that the target terminal can process the assigned pending task, that is, perform data comparison, ensure the normal progress of the data comparison, and avoid data comparison failure due to the unavailability of the terminal processing the pending task.

As shown in FIG. 4, FIG. 4 is a flowchart of another data monitoring method shown in the present disclosure according to an exemplary embodiment. The method is applied to a second terminal in a terminal cluster, and the method includes the following steps:

Step 401: Acquire the tasks to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the tasks to be processed.

Step 402: Compare the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected. The backup data in the second database is obtained by synchronizing the source data.

In this embodiment, after obtaining the to-be-processed tasks allocated by the first terminal, the allocated to-be-processed tasks are processed, that is, for each allocated to-be-processed task, the source data to be synchronously detected is determined from the first database to Get the data to be detected. The data to be detected is compared with the backup data in the second database to determine whether the data to be detected has been synchronized to the second database, the data comparison result corresponding to the data to be detected is obtained, and the synchronous detection of the data is realized, that is, Data comparison.

Optionally, the to-be-processed task indication includes the to-be-detected time period and/or the to-be-detected data table identifier. Correspondingly, when the data to be detected is determined from the first database based on the assigned task to be processed, it is determined from the first database that the storage time is in the time period to be detected, and/or the data table is identified as the source of the identification of the data table to be detected. data, and use the determined source data as the data to be detected.

Specifically, if the assigned to-be-processed task includes a to-be-detected time period, search for source data stored in the to-be-detected time period, that is, business data, from each data table in the first database, and retrieve the found data. The source data is used as the data to be detected.

If the assigned task to be processed includes the identifier of the data table to be detected, the data table corresponding to the identifier of the data table to be detected is searched from the first database, and all the source data in the data table are used as the data to be detected.

If the assigned to-be-processed task includes the time period to be detected and the identifier of the data table to be detected, search for the data table corresponding to the identifier of the data table to be detected from the first database, and find the storage time in the to-be-detected data table from the data table. The source data in the time period to obtain the data to be detected.

Step 403: Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected.

In this embodiment, after the data comparison result corresponding to the data to be detected is obtained, the data comparison result corresponding to the data to be detected is sent to the first terminal, so that the first terminal can use the data comparison result corresponding to the data to be detected A data synchronization state between the first database and the second database is determined.

In this embodiment, since the second terminal only needs to process the assigned tasks to be processed, it does not need to execute all the tasks to be processed, that is, it only needs to perform data comparison on part of the data, which reduces the time required for data comparison, that is, reduces the synchronization check. The time required to improve the efficiency of data comparison.

As shown in FIG. 5 , FIG. 5 is a flow chart of still another data monitoring method according to an exemplary embodiment. Based on the foregoing embodiment, this embodiment describes how to determine the data comparison corresponding to the data to be detected. The resulting process includes the following steps:

Step 501: Acquire the tasks to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the tasks to be processed.

Step 502: Obtain target field information in the data to be detected. The target field information includes a target field and a target field value.

Step 503: Determine from the backup data that the field value corresponding to the target field name is the target data of the target field value.

In this embodiment, after the data to be detected is obtained, for each piece of data to be detected, target field information in the piece of data to be detected is extracted. The target field information includes a target field and a target field value corresponding to the target field. Determining whether backup data corresponding to the target field information exists in the second database, that is, judging whether there is backup data with a field value corresponding to the target field name in the second database with the target field value.

In the case where the backup data corresponding to the target field information exists in the second database, that is, in the case where the backup data corresponding to the target field name and the field value corresponding to the target field value exists in the second database, the target field information corresponds to the backup data. The backup data is used as the target data corresponding to the piece of data to be detected, that is, the backup data with the field value corresponding to the target field name being the value of the target field is used as the target data corresponding to the piece of data to be detected, so as to further determine the target data and the piece of data to be detected. Check whether the data are the same, so as to determine the data comparison result corresponding to the target data.

In the case where the backup data corresponding to the target field information does not exist in the second database, it is determined that the piece of data to be detected does not exist in the second database, that is, the piece of data to be detected has not been synchronized to the target database, then it is determined that the piece of data to be detected has not been synchronized to the target database. The data comparison result corresponding to the detection data is the abnormal data result.

Optionally, the target field can be set according to actual requirements, for example, the target field is the primary key.

Optionally, in order to improve the data comparison efficiency, based on the task to be processed including the time period to be detected and/or the identifier of the data table to be detected, the corresponding backup data can be determined from the second database, and the target can be determined from the determined backup data. The field value corresponding to the field name is the target data of the target field value.

Step 504: Calculate the check value corresponding to the target data, and calculate the check value corresponding to the data to be detected.

In this embodiment, for each piece of data to be detected, a check value corresponding to the piece of data to be detected is calculated, and a check value of target data corresponding to the piece of data to be detected is calculated.

The check value may be a hash value, and the hash value is obtained by performing a hash operation on the data, which can be used to quickly compare the similarities and differences of the data. Of course, the check value can also be other types of values that can be used to check whether the data are the same, for example, the check value is a message digest value.

Step 505: In the case that the check value corresponding to the target data is different from the check value corresponding to the data to be detected, determine that the data comparison result corresponding to the data to be detected is a data abnormality result.

In this embodiment, for each piece of data to be detected, it is determined whether the check value corresponding to the piece of data to be checked is the same as the check value corresponding to the target data corresponding to the piece of data to be checked; if they are the same, it indicates that the piece of data to be checked is the same. The data is the same as the target data, which means that the data to be detected already exists in the second database, that is, it means that the data to be detected has been synchronized to the second database, then it is determined that the data comparison result corresponding to the data to be detected is a normal data result . If it is not the same, it means that the piece of data to be detected is not the same as the target data, that is, it means that the data to be detected does not exist in the second database, that is, it means that the data to be detected is not synchronized to the second database, then the piece of data to be detected is determined. The corresponding data comparison results are abnormal data results.

Optionally, the data to be detected whose data comparison result is an abnormal data result is stored in the second preset storage device.

Specifically, when the check value corresponding to the target data is different from the check value corresponding to the data to be detected, that is, when it is determined that the data comparison result corresponding to the data to be detected is an abnormal data result, the data to be detected is determined to be abnormal. If it is abnormal data, the piece of data to be detected is saved to the second preset storage device.

The second preset storage device and the first preset storage device may be the same storage device, or may be different storage devices, which are not limited herein.

Optionally, alarm information is generated according to the data comparison result corresponding to the data to be detected, and the alarm information is sent to the user terminal.

Specifically, the data to be detected whose data comparison result is an abnormal data result is acquired, and alarm information including the to-be-detected data is generated. By presetting the alarm method, the alarm information is sent to the user terminal, so that the relevant personnel can be informed of the data of synchronization problems in time, so as to realize the timely alarm.

Optionally, when acquiring the to-be-detected data whose data comparison result is an abnormal data result, it may be acquired from a second preset storage device.

Optionally, when the check value corresponding to the target data is different from the check value corresponding to the data to be detected, alarm information including the data to be detected may be directly generated, so as to realize a quick alarm.

Optionally, the preset alarm methods include emails, short messages, and designated application programs, which are not limited here.

Optionally, in order to cause a misjudgment of the data comparison result due to synchronization delay, thereby causing a false alarm, a second page is provided through the second terminal, and the second page includes a second re-check button to improve the one-key re-check function. The function is specifically: acquiring abnormal data in response to the second triggering operation of the second re-detection button. The abnormal data includes the data to be detected whose data comparison result in the second preset storage device is a data abnormal result. The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Specifically, when it is detected that the user triggers the second re-detection button on the second page, it indicates that it is necessary to determine whether the abnormal data in the second preset storage device is caused by synchronization delay, and then obtain the information in the second preset storage device. For each abnormal data, the abnormal data is compared with the backup data in the second database, and the corresponding abnormal data is obtained. Data comparison results.

The process of comparing the abnormal data with the backup data in the second database is similar to the process of comparing the data to be detected with the backup data in the second database, which will not be repeated here.

Optionally, in the case where the data comparison result corresponding to the abnormal data is the normal data result, it indicates that the previously determined data comparison result is wrong due to the synchronization delay. The abnormal data is deleted from the default storage device.

Optionally, the second terminal may determine the leader terminal in time for the relevant information in the first preset storage device to ensure the performance of the cluster system, that is, determine whether there is leader terminal marking information in the first preset storage device. If there is no leader terminal marking information, the current first terminal information is determined, and the leader terminal marking information is determined according to the current first terminal information. The leader terminal is a terminal whose working state is the leader state. The leader terminal marking information is saved in the first preset storage device. If there is leader terminal marking information, the leader terminal identifier in the leader terminal marking information is acquired, and the terminal state of the leader terminal corresponding to the leader terminal identifier is acquired. When the terminal state of the leader terminal is a non-survival state, a new leader terminal is determined, and the leader terminal mark information in the first preset storage device is updated according to the information of the new leader terminal.

Specifically, it is determined whether there is leader terminal marking information in the first preset storage device, and if there is no leader terminal marking information, it is determined whether there is currently a leader terminal, that is, whether there is a first terminal. If there is a leader terminal, it indicates that the leader terminal has been elected from the terminals included in the cluster system, then obtain the information of the leader terminal, that is, the information of the first terminal, and generate a leader terminal including the information of the first terminal Tag information. The leader terminal marking information is saved to the first preset storage device. If there is no leader terminal, it indicates that there is no leader terminal, then the first terminal (ie, the leader terminal) is elected, and the leader terminal marking information including the information of the first terminal will be generated, and the leader terminal will be marked. The information is saved to the first preset storage device.

In the case where the leader terminal marking information exists in the first preset storage device, it is judged whether the leader terminal marking information needs to be updated, that is, whether the current leader terminal is still in a live state, and the leader terminal marking information is determined from the leader terminal. Obtain the information of the current leader terminal (that is, the first terminal) in , and obtain the terminal state of the first terminal corresponding to the information of the current first terminal, in the case that the terminal state is a non-survival state, it indicates that the current leader terminal It has been deactivated and cannot work normally, then re-election is performed to determine the new leader terminal, that is, to determine the new first terminal, and update the leader terminal mark information in the first preset storage location to the new first terminal. The information of a terminal can be determined in time by the leader terminal, so as to ensure the performance of the system and thus ensure the normal progress of data comparison.

In the case that the current terminal state of the first terminal is in the alive state, it indicates that the current leader terminal can still work normally, and no re-election is required.

The information of the first terminal includes a terminal identifier of the first terminal.

The process of determining the terminal state of the first terminal is similar to the above-mentioned process of determining the terminal state of the second terminal, and details are not described herein again.

Optionally, when the second terminal is activated, the first preset storage device may be accessed to determine whether there is leader terminal marking information in the first preset storage device; or the first preset storage device may be accessed at regular intervals. A storage device is provided to determine whether the leader terminal marker information exists in the first preset storage device, which is not limited herein.

Optionally, when the assigned pending task is processed, obtain the task type corresponding to the assigned pending task, that is, the task type indicated by the assigned pending task, and respond that the task type is the real-time monitoring task type, then Based on the to-be-detected data identifier and target time period indicated by the to-be-processed task, a new to-be-processed task is generated; the new to-be-processed task is sent to the first terminal, so that the first terminal allocates the new to-be-processed task. The target time period indicates the time after the end time corresponding to the task to be processed and the difference from the end time is within the preset time range. The end time corresponding to the to-be-processed task indicates the time when the to-be-processed task is processed.

The task types include real-time monitoring task types and non-real-time monitoring task types. When the task type corresponding to the task to be processed is the real-time monitoring task type, it indicates that the data table corresponding to the identifier of the data table to be detected indicated by the task to be processed is the data table that needs real-time monitoring, that is, the source data in the data table needs to be monitored in real time Synchronization situation. When the task type corresponding to the task to be processed is a non-real-time monitoring task type, it indicates that the data table corresponding to the identifier of the data table to be detected indicated by the task to be processed is not a data table that needs real-time monitoring, that is, the source data in the data table does not need to be Monitor synchronization in real time.

Specifically, for each allocated task to be processed, when all the data to be detected corresponding to the allocated task to be processed have been compared and completed, indicating that the allocated task to be processed has been processed, the corresponding to-be-processed task of the allocated task is obtained. task type. In the case that the task type is a real-time monitoring task type, it indicates that the data table corresponding to the data table identifier to be detected indicated by the assigned task to be processed needs to be monitored in real time, and a new task to be processed is actively created. The pending task indicates the identification of the data table to be detected and the target time period. The to-be-processed task is sent to the first terminal, so that the first terminal performs allocation, and real-time monitoring of the data table is realized.

The time after the end time corresponding to the task to be processed and the difference between the end time and the end time is within the preset time range. For example, the preset time range is 10 minutes, the time when the pending task is processed is 9:00, and the target time period is 9:00-9:10.

Step 506: Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected.

It can be understood that when the first terminal is the target terminal, the operations performed by the first terminal, for example, performing related operations to determine the data comparison result, and performing relevant processing (eg, alarming, re-detection) on the data comparison result are the same as those described in the above paragraph. The operations performed by the two terminals are similar, and are not repeated here.

In this embodiment, the check value is used to determine whether the target data is the same as the to-be-detected data, that is, the target data and the to-be-detected data are compared, rather than the field-by-field comparison of whether the two are the same, and the target data and the to-be-detected data can be quickly determined. Whether the data are the same, thereby improving the efficiency of data comparison, and quickly determining the data with synchronization problems.

Corresponding to the foregoing method embodiments, the present disclosure also provides embodiments of an apparatus and a terminal to which it is applied.

The embodiments of the data monitoring apparatus of the present disclosure can be applied to computer equipment, such as a server or a terminal equipment. The apparatus embodiment may be implemented by software, or may be implemented by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by reading the corresponding computer program instructions in the non-volatile memory into the memory for operation by the processor where the file is processed. From the perspective of hardware, as shown in FIG. 6 , it is a hardware structure diagram of the computer equipment where the data monitoring apparatus according to the embodiment of the present disclosure is located, except for the processor 610 , the memory 630 , the network interface 620 , and the non-volatile memory shown in FIG. 6 . In addition to the volatile memory 640, the server or terminal device where the data monitoring apparatus 631 is located in the embodiment may also include other hardware, usually according to the actual function of the computer device, which will not be repeated here.

As shown in FIG. 7 , FIG. 7 is a block diagram of a data monitoring apparatus according to an exemplary embodiment of the present disclosure, and the apparatus includes:

The terminal determination module 710 is configured to acquire multiple tasks to be processed, and determine at least two target terminals from the terminal cluster.

The task allocation module 720 is used for allocating different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the backup in the second database The data is compared to obtain a data comparison result corresponding to the data to be detected.

The state determination module 730 is configured to obtain data comparison results corresponding to the data to be detected sent by each target terminal, and determine the data synchronization state between the first database and the second database according to the data comparison results corresponding to the data to be detected.

Optionally, the apparatus is applied to a first terminal in a terminal cluster, and the terminal cluster further includes a second terminal;

The terminal determination module 710 is specifically used for:

Acquire status information of the second terminal and/or status information of the first terminal.

At least two target terminals are determined from the second terminal and/or the first terminal according to the state information of the second terminal and/or the state information of the first terminal.

Optionally, the status information includes terminal status and/or running status.

The terminal determination module 710 is also specifically used for:

In response to the state information of the second terminal and/or the first terminal meeting the first preset condition, the second terminal and/or the first terminal are used as the target terminal. The first preset condition includes that the running state is an idle state and/or the terminal state is an alive state.

Optionally, the data monitoring device further includes a time update module;

The time update module is used to:

The heartbeat recording time corresponding to the first terminal in the first preset storage device is updated every preset time.

Optionally, the first preset storage device further includes a heartbeat recording time corresponding to each second terminal.

The terminal determination module 710 is also used for:

Calculate the time difference between the current moment and the heartbeat recording time corresponding to the second terminal.

In the case that the time difference is smaller than the first preset time threshold, it is determined that the terminal state of the second terminal is the alive state.

When the time difference is greater than or equal to the first preset time threshold, it is determined that the terminal state of the second terminal is a non-survival state.

Optionally, the first database stores the source data; the backup data in the second database is obtained by synchronizing the source data;

The task to be processed includes the time period to be detected and/or the identifier of the data table to be detected.

Optionally, a first page is provided by the first terminal, and the first page includes a first re-detection button.

The state determination module is also used to:

Abnormal data is acquired in response to the first trigger operation of the first re-detection key. The abnormal data includes data to be detected whose data comparison result is an abnormal data result.

The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Optionally, the state determination module is also used to:

Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal.

As shown in FIG. 8, FIG. 8 is a block diagram of another data monitoring apparatus shown in the present disclosure according to an exemplary embodiment, and the apparatus includes:

The data determination module 810 is configured to acquire the tasks to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the tasks to be processed.

The data comparison module 820 is configured to compare the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected.

The result processing module 830 is used to send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the data between the first database and the second database according to the data comparison result corresponding to the data to be detected Sync status.

Optionally, the data comparison module 820 is specifically used for:

Get the target field information in the data to be detected. The target field information includes a target field and a target field value.

It is determined from the backup data that the field value corresponding to the target field name is the target data of the target field value.

Calculate the check value corresponding to the target data, and calculate the check value corresponding to the data to be detected.

In the case where the check value corresponding to the target data is different from the check value corresponding to the data to be detected, it is determined that the data comparison result corresponding to the data to be detected is a data abnormality result.

Optionally, the result processing module 830 is further configured to:

The data to be detected whose data comparison result is an abnormal data result is stored in the second preset storage device.

Optionally, a second page is provided through the second terminal, and the second page includes a second re-detection button.

Optionally, the data comparison module 820 is also used for:

Abnormal data is acquired in response to the second triggering operation of the second re-detection key. The abnormal data includes the data to be detected whose data comparison result in the second preset storage device is a data abnormal result.

The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data.

Optionally, the to-be-processed task includes a to-be-detected time period and/or a to-be-detected data table identifier.

The data determination module 810 is specifically used for:

It is determined from the first database that the storage time is in the to-be-detected time period, and/or the data table is identified as the source data identified by the to-be-detected data table, and the determined source data is used as the to-be-detected data.

Optionally, the result processing module 830 is further configured to:

Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal.

Optionally, the device further includes a marking information setting module.

The tag information setting module is specifically used for:

It is judged whether there is leader terminal mark information in the first preset storage device.

If there is no leader terminal marking information, the current first terminal information is determined, and the leader terminal marking information is determined according to the current first terminal information. The first terminal is a terminal whose working state is the leader state.

The leader terminal marking information is saved in the first preset storage device.

If there is leader terminal marking information, the information of the first terminal in the leader terminal marking information is acquired, and the terminal state of the first terminal corresponding to the information of the first terminal is acquired.

When the terminal state of the first terminal is a non-survival state, a new first terminal is determined, and the leader terminal mark information in the first preset storage device is updated according to the information of the new first terminal.

Correspondingly, the present disclosure also provides a computer device, the device includes a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to:

Acquire multiple tasks to be processed, and determine at least two target terminals according to the first terminal and/or the second terminal;

Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the data in the second database. The backup data is compared to obtain a data comparison result corresponding to the data to be detected;

Acquiring data comparison results corresponding to the data to be detected sent by each target terminal, and determining a data synchronization state between the first database and the second database according to the data comparison results corresponding to the data to be detected;

or,

Acquire the task to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the task to be processed;

Comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected;

Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first database and the second database according to the data comparison result corresponding to the data to be detected Data synchronization status between databases.

The present disclosure also provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, the above-mentioned data monitoring method is implemented.

The present disclosure also provides a computer program product, including a computer program, which, when executed by a processor, implements the data monitoring method as described above.

For details of the implementation process of the functions and functions of each module in the above-mentioned device, please refer to the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

For the apparatus embodiments, since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts. The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in One place, or it can be distributed over multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present disclosure. Those of ordinary skill in the art can understand and implement it without creative effort.

The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention claimed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common general knowledge or techniques in the technical field to which this disclosure is not claimed . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

The above descriptions are only preferred embodiments of the present disclosure, and are not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the present disclosure. within the scope of protection.

Claims (19)

1. a data monitoring method, is characterized in that, described method comprises: Acquire multiple pending tasks, and determine at least two target terminals from the terminal cluster; Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the backup data in the second database. Yes, obtain the data comparison result corresponding to the data to be detected; A data comparison result corresponding to the data to be detected is acquired, and a data synchronization state between the first database and the second database is determined according to the data comparison result corresponding to the data to be detected. 2. The method according to claim 1, wherein the method is applied to a first terminal in a terminal cluster, and the terminal cluster further includes a second terminal; The determining of at least two target terminals from the terminal cluster includes: acquiring status information of the second terminal and/or status information of the first terminal; At least two target terminals are determined from the second terminal and/or the first terminal according to the state information of the second terminal and/or the state information of the first terminal. 3. The method according to claim 2, wherein the state information comprises a terminal state and/or a running state; The determining at least two target terminals from the second terminal and/or the first terminal according to the state information of the second terminal and/or the state information of the first terminal includes: In response to the state information of the second terminal and/or the state information of the first terminal meeting a first preset condition, the second terminal and/or the first terminal are used as target terminals; wherein the The first preset condition includes that the running state is an idle state and/or the terminal state is an alive state. 4. The method according to any one of claims 2 or 3, wherein the method further comprises: The heartbeat recording time corresponding to the first terminal in the first preset storage device is updated every preset time. 5. The method according to claim 4, wherein the first preset storage device further comprises a heartbeat recording time corresponding to each second terminal; The method also includes: Calculate the time difference between the heartbeat recording time corresponding to the current moment and the second terminal; In the case that the time difference value is less than the first preset time threshold, determining that the terminal state of the second terminal is the alive state; When the time difference is greater than or equal to the first preset time threshold, it is determined that the terminal state of the second terminal is a non-survival state. 6. The method according to any one of claims 1 to 3, wherein the first database stores active data; the backup data in the second database is obtained by synchronizing the source data; The to-be-processed task includes the to-be-detected time period and/or the to-be-detected data table identifier. 7. The method according to claim 2 or 3, wherein a first page is provided through the first terminal, and the first page includes a first re-detection button; The method also includes: Obtaining abnormal data in response to the first trigger operation of the first re-detection button; wherein the abnormal data includes data to be detected whose data comparison result is a data abnormal result; The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data. 8. The method according to any one of claims 1 to 3, wherein the method further comprises: Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal. 9. A data monitoring method, characterized in that it is applied to a second terminal in a terminal cluster, the method comprising: Acquire the task to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the task to be processed; Comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected; Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first database and the second database according to the data comparison result corresponding to the data to be detected Data synchronization status between databases. 10. The method according to claim 9, characterized in that, comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected, comprising: Obtain target field information in the data to be detected; wherein, the target field information includes a target field and a target field value; Determine from the backup data that the field value corresponding to the target field name is the target data of the target field value; Calculate the check value corresponding to the target data, and calculate the check value corresponding to the data to be detected; When the check value corresponding to the target data is different from the check value corresponding to the data to be detected, it is determined that the data comparison result corresponding to the data to be detected is a data abnormality result. 11. The method of claim 10, wherein the method further comprises: The data to be detected whose data comparison result is an abnormal data result is stored in the second preset storage device. 12. The method according to claim 11, wherein a second page is provided through the second terminal, and the second page includes a second re-detection button; The method also includes: Obtaining abnormal data in response to the second trigger operation of the second re-detection button; wherein, the abnormal data includes data to be detected whose data comparison result in the second preset storage device is a data abnormal result; The abnormal data is compared with the backup data in the second database to obtain a data comparison result corresponding to the abnormal data. 13. The method according to claim 9, wherein the task to be processed comprises a time period to be detected and/or an identifier of a data table to be detected; The determining of the data to be detected from the first database according to the task to be processed includes: It is determined from the first database that the storage time is in the to-be-detected time period, and/or the data table identifier is the source data identified by the to-be-detected data table, and the determined source data is used as the to-be-detected data. 14. The method according to any one of claims 9 to 13, wherein the method further comprises: Generate alarm information according to the data comparison result corresponding to the data to be detected, and send the alarm information to the user terminal. 15. The method according to any one of claims 9 to 13, wherein the method further comprises: judging whether there is leader terminal mark information in the first preset storage device; If there is no leader terminal marking information, determine the information of the current first terminal, and determine the leader terminal marking information according to the information of the current first terminal; wherein, the working state of the first terminal is the leader state terminal; saving the leader terminal marking information into a first preset storage device; If there is leader terminal marking information, acquiring the information of the first terminal in the leader terminal marking information, and acquiring the terminal state of the first terminal corresponding to the information of the first terminal; In the case where the terminal state of the first terminal is a non-survival state, a new first terminal is determined, and the leader in the first preset storage device is updated according to the information of the new first terminal. The terminal tag information is updated. 16. A data monitoring device, wherein the device comprises: a terminal determination module, used for acquiring a plurality of tasks to be processed, and determining at least two target terminals from the terminal cluster; The task allocation module is used for allocating different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the second database. Compare the backup data in the to-be-detected data to obtain a data comparison result corresponding to the data to be detected; A state determination module, configured to obtain the data comparison result corresponding to the data to be detected, and determine the data synchronization state between the first database and the second database according to the data comparison result corresponding to the data to be detected . 17. A data monitoring device, characterized in that it is applied to a second terminal in a terminal cluster, the device comprising: a data determination module, configured to acquire the task to be processed assigned by the first terminal, and determine the data to be detected from the first database according to the task to be processed; a data comparison module, configured to compare the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected; A result processing module, configured to send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first terminal according to the data comparison result corresponding to the data to be detected Data synchronization status between the database and the second database. 18. A computer device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements the following methods when executing the program: Acquire multiple pending tasks, and determine at least two target terminals from the terminal cluster; Allocate different tasks to be processed for each target terminal, so that the target terminal determines the data to be detected from the first database according to the allocated tasks to be processed, and compares the data to be detected with the backup data in the second database. Yes, obtain the data comparison result corresponding to the data to be detected; A data comparison result corresponding to the data to be detected is acquired, and a data synchronization state between the first database and the second database is determined according to the data comparison result corresponding to the data to be detected. 19. A computer device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements the following methods when executing the program: acquiring the task to be processed assigned by the first terminal, and determining the data to be detected from the first database according to the task to be processed; Comparing the data to be detected with the backup data in the second database to obtain a data comparison result corresponding to the data to be detected; Send the data comparison result corresponding to the data to be detected to the first terminal, so that the first terminal determines the first database and the second database according to the data comparison result corresponding to the data to be detected Data synchronization status between databases.

Images