CN111832956A - Data verification method, device, electronic device and medium - Google Patents

Abstract

The application discloses a data verification method, a data verification device, electronic equipment and a medium, and relates to the field of cloud computing and big data. The data verification method comprises the following steps: acquiring user data of a plurality of users, and dividing the plurality of users into a plurality of levels based on the user data, wherein a plurality of verification modes are respectively set for the plurality of levels; distributing tasks to be processed to a plurality of users respectively; and acquiring a task processing result of the user of each level on the assigned task to be processed, and verifying the accuracy of the task processing result of the user of the level by utilizing a verification mode set for the level for each level in the plurality of levels.

Description

Data verification method, device, electronic device and medium

technical field

The present application relates to the field of computer technology, and more particularly, to a cloud computing and big data technology.

Background technique

With the continuous development of the Internet, the application of crowdsourcing technology is becoming more and more extensive. Crowdsourcing technology refers to the business party assigning tasks to be processed to Internet users for processing. After the business side receives the task processing result of the task to be processed by the user, the business side needs to verify the accuracy of the task processing result. In the related art, when verifying the accuracy of the user's task processing results, the business side usually adopts the same verification method for all users' task processing results. However, since the processing quality of the tasks to be processed by each user is different, using the same verification method for the task processing results of all users will result in low verification efficiency and high verification cost.

SUMMARY OF THE INVENTION

The present application provides a method, apparatus, device and storage medium for data verification.

According to a first aspect, the present application provides a data verification method, comprising: acquiring user data of multiple users, and dividing the multiple users into multiple levels based on the user data, wherein for the multiple levels Set up a variety of verification methods, respectively assign tasks to be processed to the multiple users, obtain the task processing results of the assigned tasks to be processed by users at each level, and for each level in the multiple levels, use The verification mode set for the level verifies the accuracy of the task processing result of the user of the level.

According to a second aspect, the present application provides a data verification device, comprising: a user division module, a task allocation module, and a verification module. The user division module is configured to acquire user data of multiple users, and divide the multiple users into multiple levels based on the user data, wherein multiple verification methods are respectively set for the multiple levels. The task assignment module is used for assigning tasks to be processed to the multiple users respectively. The verification module is used to obtain the task processing results of the assigned tasks to be processed by users of each level, and for each level in the multiple levels, the verification mode set for the level is used to verify the level of The accuracy of the user's task processing results.

According to a third aspect, the present application provides an electronic device comprising: at least one processor and a memory communicatively connected to the at least one processor. Wherein, the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method as described above.

According to a fourth aspect, the present application provides a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method as described above.

The technology according to the present application solves the problems of low verification efficiency and high verification cost of task processing results for tasks to be processed, improves verification efficiency of task processing results, and reduces verification costs.

It should be understood that the content described in this section is not intended to identify key or critical features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the present application will become readily understood from the following description.

Description of drawings

The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present application. in:

FIG. 1 schematically shows a system architecture of a data verification method and a data verification apparatus according to an embodiment of the present application;

FIG. 2 schematically shows a flowchart of a data verification method according to an embodiment of the present application;

FIG. 3 schematically shows a flowchart of a data verification method according to another embodiment of the present application;

FIG. 4 schematically shows a flowchart of a data verification method according to another embodiment of the present application;

FIG. 5 schematically shows a schematic diagram of a data verification method according to an embodiment of the present application;

FIG. 6 schematically shows a block diagram of a data verification apparatus according to an embodiment of the present application; and

FIG. 7 is a block diagram of an electronic device used to implement the data verification method of the embodiment of the present application.

Detailed ways

Exemplary embodiments of the present application are described below with reference to the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

The terminology used herein is for the purpose of describing specific embodiments only and is not intended to limit the application. The terms "comprising", "comprising" and the like as used herein indicate the presence of stated features, steps, operations and/or components, but do not preclude the presence or addition of one or more other features, steps, operations or components.

All terms (including technical and scientific terms) used herein have the meaning as commonly understood by one of ordinary skill in the art, unless otherwise defined. It should be noted that terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly rigid manner.

Where expressions like "at least one of A, B, and C, etc.," are used, they should generally be interpreted in accordance with the meaning of the expression as commonly understood by those skilled in the art (eg, "has A, B, and C") At least one of the "systems" shall include, but not be limited to, systems with A alone, B alone, C alone, A and B, A and C, B and C, and/or A, B, C, etc. ).

An embodiment of the present application provides a data verification method, the method includes: acquiring user data of multiple users, and dividing the multiple users into multiple levels based on the user data, wherein multiple verification methods are respectively set for the multiple levels . Then, assign pending tasks to multiple users respectively. Next, obtain the task processing results of the assigned tasks to be processed by the users of each level, and for each level in the multiple levels, use the verification method set for the level to verify the accuracy of the task processing results of the users of the level. sex.

FIG. 1 schematically shows a system architecture of a data verification method and a data verification apparatus according to an embodiment of the present application. It should be noted that FIG. 1 is only an example of a system architecture to which the embodiments of the present application can be applied, so as to help those skilled in the art to understand the technical content of the present application, but it does not mean that the embodiments of the present application cannot be used for other A device, system, environment or scene.

As shown in FIG. 1 , the system architecture 100 according to this embodiment may include terminal devices 101 , 102 , and 103 , a network 104 and a server 105 . The network 104 is a medium used to provide a communication link between the terminal devices 101 , 102 , 103 and the server 105 . The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

The user can use the terminal devices 101, 102, 103 to interact with the server 105 through the network 104 to receive or send messages and the like. Various communication client applications may be installed on the terminal devices 101 , 102 and 103 , such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

The terminal devices 101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

The server 105 may be a server that provides various services, such as a background management server (just an example) that provides support for websites browsed by users using the terminal devices 101 , 102 , and 103 . The background management server can analyze and process the received user requests and other data, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

It should be noted that, the data verification method provided by the embodiment of the present application may generally be executed by the server 105 . Correspondingly, the data verification apparatus provided in the embodiment of the present application may generally be set in the server 105 . The data verification method provided in this embodiment of the present application may also be executed by a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101 , 102 , 103 and/or the server 105 . Correspondingly, the data verification apparatus provided in this embodiment of the present application may also be provided in a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101 , 102 , 103 and/or the server 105 .

It should be understood that the numbers of terminal devices, networks and servers in FIG. 1 are merely illustrative. There can be any number of terminal devices, networks and servers according to implementation needs.

The data verification method according to the exemplary embodiment of the present application will be described below with reference to FIG. 2 to FIG. 5 in conjunction with the system architecture of FIG. 1 . It should be noted that the above system architecture is only shown for the convenience of understanding the spirit and principle of the present application, and the embodiments of the present application are not limited in this respect.

FIG. 2 schematically shows a flowchart of a data verification method according to an embodiment of the present application.

As shown in FIG. 2 , the data verification method in this embodiment of the present application may include, for example, operations S210 to S230.

In operation S210, user data of multiple users is acquired, and the multiple users are divided into multiple levels based on the user data, wherein multiple authentication methods are respectively set for the multiple levels.

In operation S220, tasks to be processed are respectively allocated to the plurality of users.

Next, in operation S230, the task processing results of the assigned tasks to be processed by the users of each level are obtained, and for each level in the multiple levels, the tasks of the users of the level are verified by using the verification mode set for the level Accuracy of processing results.

The quality of the task processing results obtained by different users processing the to-be-processed task is usually different. In this embodiment of the present application, multiple users are divided into multiple levels according to their user data (for example, data that can reflect the user's task processing experience or processing quality, such as registration time, number of tasks processed, accuracy of task processing, etc.) , and assign tasks to be processed to multiple users, and then use different verification methods to verify the task processing results of users of corresponding levels according to the task processing results of users of different levels.

In an example, for users with higher quality task processing results, a looser verification method may be used to verify the task processing results of users at this level; for users with lower quality task processing results, A more stringent verification method can be used to verify the task processing results of users at this level. In this embodiment of the present application, the so-called high quality of the task processing results may indicate that the accuracy of the task processing results of users at this level is high, and the quality of the task processing results may indicate that the accuracy of the task processing results of users of this level is high lower.

Among them, the accuracy can include two situations in which the task processing result is accurate or inaccurate. The accuracy rate may include a ratio between the number of tasks for which processing results are accurate among the tasks processed by the user and the total number of processed tasks.

It can be understood that the embodiments of the present application verify the accuracy of the task processing results of the tasks to be processed by users of this level by dividing multiple users into levels and using different verification methods for different levels. It can be seen that, through the technical solutions of the embodiments of the present application, the task processing result can be verified in a targeted manner, thereby improving the efficiency of data verification and reducing the cost of data verification.

FIG. 3 schematically shows a flowchart of a data verification method according to another embodiment of the present application.

As shown in FIG. 3 , the data verification method in this embodiment of the present application may include, for example, operations S310 to S330 and operations S341 to S343 . Operations S310 and S320 may be implemented in the same manner as operations S210 and S220 described in FIG. 2 , respectively, and will not be repeated here. A specific implementation manner of operation S230 described in FIG. 2 includes, for example, operations S341 to S343.

According to the embodiment of the present application, the multiple levels may include a first level, a second level, and a third level. The second level is, for example, lower than the first level, and the third level is, for example, lower than the second level. The quality of the task processing results of the users of the first level is high, the quality of the task processing results of the users of the second level is medium, and the quality of the task processing results of the users of the third level is low.

The task processing result of the task to be processed includes at least one of result data and problem feedback data. The problem feedback data may include, for example, that the to-be-processed task cannot be processed or that the to-be-processed task lacks relevant information, and the like.

In operation S330, the level of the user is judged. When the judgment result indicates that the user is at the first level, operation S341 is performed. When the judgment result indicates that the user is at the second level, operation S342 is performed. When the judgment result indicates that the user is at the third level, operation S343 is performed.

For the first level, using the verification mode set for the level to verify the accuracy of the task processing result of the user of the level includes operation S341.

In operation S341, for the result data in the task processing results of the users of the first level, the accuracy of the result data is verified through a combination of task processing program verification and cross-validation with other users. For the question feedback data in the task processing result of the first-level user, the default question feedback data is accurate.

According to the embodiment of the present application, compared with the two methods of the task processing program verification method and the other user cross-verification method, the task processing program verification method is relatively loose, and the cross-verification method with other users is relatively strict.

That is, the quality of the task processing results due to the users of the first level is higher. Therefore, for the result data in the task processing results of the first-level users, the accuracy of the result data can be verified by a relatively loose method of task processing program verification and a relatively strict method of cross-validation with other users. In an example, the result data can be verified first by using the task handler verification method, and in the case that the result data verified by the task handler is inaccurate, the result data can be further verified by cross-validation with other users. verification to improve verification efficiency.

In this embodiment of the present application, since the quality of the task processing results of the users of the first level is higher, the accuracy of the task processing results of the users of the first level is higher. For the question feedback data in the task processing results of the first-level users, the accuracy of the question feedback data is high, so the question feedback data can be defaulted to be accurate, and there is no need to verify the question feedback data, so as to improve the verification efficiency .

For the second level, using the verification mode set for the level to verify the accuracy of the task processing result of the user of the level includes operation S342.

In operation S342, for the result data in the task processing result of the second-level user, the accuracy of the result data is verified through a combination of task processing program verification and cross-validation with other users. For the question feedback data in the task processing results of the second-level users, the accuracy of the question feedback data is verified by cross-validation with other users.

That is, the quality of the task processing results of the users of the second level is moderate. For the result data in the task processing results of the second-level users, the accuracy of the result data can be verified by a relatively loose method of task processing program verification and a relatively strict method of cross-validation with other users. In an example, the result data can be verified first by using the task handler verification method, and in the case that the result data verified by the task handler is inaccurate, the result data can be further verified by cross-validation with other users. verification to improve verification efficiency.

In this embodiment of the present application, for the question feedback data in the task processing result of the second-level user, it is necessary to verify the accuracy of the question feedback data. In this embodiment of the present application, the accuracy of the question feedback data can be verified by means of cross-validation with other users.

For the third level, using the verification mode set for the level to verify the accuracy of the task processing result of the user of the level includes operation S343.

In operation S343, for the result data in the task processing result of the third-level user, the accuracy of the result data is verified by means of cross-validation with other users. For the question feedback data in the task processing results of the third-level users, the accuracy of the question feedback data is verified by cross-validation with other users.

That is, the quality of the task processing results of the users of the third level is lower. For the result data in the task processing result of the third-level user, the accuracy of the result data can be verified through a stricter method of cross-validation with other users. In one embodiment, since the third-level user is a user who has just registered, the user has a low degree of understanding of task processing rules, so the data format of the user's result data usually does not conform to the preset format. The way the task handler validates to validate the third-level user's result data will result in a lower validation accuracy. Therefore, the embodiment of the present application verifies the accuracy of the result data of the third-level users by means of cross-validation with other users.

In the embodiment of the present application, for the question feedback data in the task processing result of the third-level user, the accuracy of the question feedback data needs to be verified. In this embodiment of the present application, the accuracy of the question feedback data can be verified by means of cross-validation with other users.

According to the embodiment of the present application, in operation S341 or operation S342, verifying the accuracy of the result data through the combination of task processing program verification and cross-verification with other users includes:

First, the task processing program is used to perform task processing on the assigned task, and the accuracy of the result data in the user's task processing result is verified based on the task processing result of the task processing program. Then, in the case of verifying that the result data is inaccurate based on the task processing results of the task processing program, the accuracy of the result data is further verified by cross-validation with other users.

According to the embodiment of the present application, the task processing program is, for example, a processing method for automatically processing tasks to be processed. Verifying the accuracy of the result data through the task processing program includes, for example, processing the to-be-processed task through the task processing program to obtain the processing result, and then comparing the processing result of the task processing program with the task processing result of the first-level or second-level user. Compare. If the processing result of the task processing program is consistent with the user's task processing result, it can be confirmed that the user's task processing result has passed the verification, that is, the user's task processing result is accurate. At this time, there is no need to continue cross-validation with other users for further verification. If the processing result of the task processing program is inconsistent with the user's task processing result, it can be confirmed that the user's task processing result is inaccurate, and further verification can be continued through cross-validation with other users.

According to the embodiment of the present application, cross-validation with other users includes: for each task to be processed, comparing the user's task processing result with the task processing results of other users, if the user's task processing results are consistent with other users' task processing results , it is determined that the user's task processing result is accurate.

It can be understood that the embodiments of the present application verify the accuracy of the task processing results of the tasks to be processed by users of this level by dividing multiple users into levels and using different verification methods for different levels. Specifically, the user's task processing result includes result data and problem feedback data, and the accuracy of the result data and the problem feedback data can be verified respectively through corresponding verification methods. It can be seen that, through the technical solutions of the embodiments of the present application, different verification methods are set for users of different levels, and the result data and problem feedback data included in the task processing results of users of this level can also be separately verified through corresponding verification methods. Verify the accuracy of result data and question feedback data. It can be seen that the embodiment of the present application can realize targeted verification of the task processing result, thereby improving the efficiency of data verification and reducing the cost of data verification.

FIG. 4 schematically shows a flowchart of a data verification method according to another embodiment of the present application.

As shown in FIG. 4 , the data verification method in this embodiment of the present application may include, for example, operations S410 to S480. The operations S410, S420 and S470 may be implemented in the same manner as the operations S210, S220, and S230 described in FIG. 2, respectively, and will not be repeated here.

In operation S430, a detection task is assigned to a user who is lower than a preset level among the multiple levels, wherein the task processing result of the detection task is known, and the detection task is assigned to the user who is lower than the preset level together with the task to be processed .

According to the embodiment of the present application, the preset level is, for example, the first level, and the users of the multiple levels below the preset level include users of the second level and users of the third level. Since the second level and the third level are lower levels, in order to improve the verification efficiency, pre-verification is first performed on the second level user and the third level user. If the users of the second level and the users of the third level pass the pre-verification, the accuracy of the task processing results of the users of the second level and the task processing results of the users of the third level are further verified.

Specifically, the detection task and the to-be-processed task may be sent to users who are lower than the preset level. For the user, for example, the user cannot know whether the received task is a detection task or a pending task.

In operation S440, the processing result of the detection task by the user whose level is lower than the preset level is obtained.

In one example, a user who is lower than a preset level can simultaneously feed back the processing result of the detection task and the task processing result of the to-be-processed task. Then, the processing result of the detection task is pre-verified first, and after the processing result of the detection task passes the pre-verification, the task processing result of the to-be-processed task is further verified. If the processing result of the detection task does not pass the pre-validation, it indicates that the processing quality of the task by the user below the preset level is low, then it can be determined that the task processing result of the user below the preset level is inaccurate, and no further verification is required The accuracy of task processing results for users who are below a preset level.

In operation S450, users who are lower than the preset level are pre-authenticated by comparing the processing result of the detection task by the user who is lower than the preset level with the known task processing results of the detection task.

If the processing result of the detection task performed by the user below the preset level is consistent with the known task processing result of the detection task, it is determined that the user below the preset level has passed the pre-verification. If the processing results of the detection tasks performed by the users who are lower than the preset level are inconsistent with the known task processing results of the detection tasks, it is determined that the users who are lower than the preset level have not passed the pre-verification.

In operation S460, it is determined whether the users below the preset level pass the pre-authentication. If the pre-authentication is passed, operation S470 is performed. If the pre-authentication is not passed, operation S480 is performed.

Next, in operation S480, if the processing result of the detection task of the user who is lower than the preset level does not pass the pre-verification, it may be determined that the user has not passed the pre-verification. For users who have not passed the pre-verification, the accuracy of the user's task processing results may not be further verified.

As an example, when pre-authentication is performed on users below a preset level, pre-authentication may be performed on users at the second level and users at the third level respectively. For example, for users of the second level or users of the third level, multiple tasks are sent to the users of the level (second level or third level), and the multiple tasks include detection tasks and tasks to be processed. Then, receive the task processing results of the multiple tasks performed by the user at this level, and perform pre-verification on the processing results of the detection tasks in the task processing results. The processing results are further verified. That is, in this example, the pre-verification can be performed at one level as a whole, thereby improving the efficiency of the pre-verification.

As an example, for each of the low-level users, the multiple tasks sent to each user include a detection task and a to-be-processed task. Then, receive the task processing results of the multiple tasks by the user, and pre-verify the processing results of the detection tasks in the task processing results. If the pre-verification fails, the task processing results of the tasks to be processed by the user are no longer processed. for further verification. That is, in this example, pre-authentication can be performed on a user as a whole, so as to implement pre-authentication for each user below a preset level.

In this embodiment of the present application, the detection task, as a hidden stake, can be used to pre-verify the user to prevent the user from cheating in the process of processing the task. In addition, detection tasks can also be used to guide users in task processing. For example, when sending multiple tasks including detection tasks to a user below a preset level, when a user below the preset level processes multiple tasks, the first task processed by the user may be the detection task. If the processing result of the detection task is inaccurate, prompt information may be sent to the user to prompt the user about the relevant rules for task processing.

It can be understood that, since the processing quality of the to-be-processed task for users below the preset level is low, in order to improve the verification efficiency of the task processing result of the to-be-processed task, the embodiment of the present application first performs pre-verification on users below the preset level. If the users below the preset level pass the pre-verification, the accuracy of the task processing result of the users below the preset level is further verified, thereby improving the verification efficiency and reducing the verification cost.

The specific implementation process of dividing multiple users into multiple levels will be described below.

In this embodiment of the present application, the user data includes the user's registration duration, the number of tasks processed by the user, and the accuracy of the tasks processed by the user. Dividing multiple users into multiple levels based on user data includes for each of the multiple users:

When the user's registration duration is greater than or equal to the preset duration, the number of tasks processed by the user is greater than or equal to the preset number, and the accuracy of the tasks processed by the user is greater than or equal to the preset accuracy, the user is classified into the first level.

In the case that the user's registration duration is greater than or equal to the preset duration, and the accuracy rate of the tasks processed by the user is less than the preset accuracy rate, the user is classified into the second level.

In the case that the user's registration duration is less than the preset duration, the user is classified into the third level.

In this embodiment of the present application, the preset duration may be, for example, 30 days, 60 days, and the like. The number of tasks processed by the user is, for example, the number of tasks processed by the user in a recent period of time (eg, 30 days), or the number of tasks processed by the user since registration. The preset number can be 1000, 2000, and so on. The accuracy rate of the tasks processed by the user is, for example, the ratio between the number of tasks with accurate processing results and the total number of processed tasks in the tasks processed by the user. For example, if the total number of tasks processed by the user is 1000, and the processing results of 800 tasks among the 1000 tasks are accurate, the accuracy of the tasks processed by the user may be 800/1000=80%. Wherein, the accuracy rate of tasks processed by the user may be the accuracy rate of tasks processed by the user in a recent period of time (eg, 30 days), or may also be the accuracy rate of tasks processed by the user since registration. Wherein, the preset accuracy rate may be 80%, 90%, and so on.

When classifying a user into a level, it may be first determined whether the user's registration duration is greater than or equal to a preset duration, and if not, classify the user into a third level. If yes, further determine the number of tasks processed by the user and the accuracy rate of the tasks processed by the user, if the number of tasks processed by the user is greater than or equal to the preset number and the accuracy rate of tasks processed by the user is greater than or equal to the preset accuracy rate, then Users are classified to the first level. If the accuracy rate of the user's processed tasks is less than the preset accuracy rate, the user is divided into the second level, and the number of processed tasks of the second level user may be greater than or equal to the preset number or less than the preset number.

As an example of the present application, the task to be processed in this embodiment of the present application may include an image to be recognized, the task processing result includes a recognition result of the image to be recognized, and the result data includes text information recognized from the image to be recognized. The text information can be text, numbers, symbols, etc. in the image to be recognized. The problem feedback data may include a problem description of the to-be-recognized image, and the problem description includes at least one of blurring of the to-be-recognized image and no textual information in the to-be-recognized image. Task processing programs may include optical character recognition (Optical Character Recognition, OCR) programs.

The process of verifying the recognition result of the image to be recognized will be described below with reference to FIG. 5 .

An operation example of the data verification method of FIG. 4 will be described below with reference to FIG. 5 .

FIG. 5 schematically shows a schematic diagram of a data verification method according to an embodiment of the present application.

5 is used as an example for easy description, and six users A1, A2, . . As shown in FIG. 5, the users A1, A2, . . . , A6 are divided into three levels, ie, the first level, the second level, and the third level, according to the user data of the users.

Users belonging to the first level are, for example, high-quality users. For example, users whose registration duration is greater than or equal to the preset duration, the number of tasks processed by the user is greater than or equal to the preset number, and the accuracy rate of the tasks processed by the user is greater than or equal to the preset accuracy rate are classified to the first level. In FIG. 5, the user A1, the user A2, etc. are classified into the first level. Users belonging to the second level are, for example, ordinary users. For example, users whose registration duration is greater than or equal to a preset duration and whose task accuracy rate is less than the preset accuracy rate are classified to the second level, for example, user A3, user A4, etc. are classified into the second level. Users belonging to the third level are, for example, novice users. For example, users whose registration duration is shorter than the preset duration are classified into the third level, for example, user A5, user A6, etc. are classified into the third level.

As shown in FIG. 5 , users of the first level may be assigned images to be recognized, while users of the second and third levels may be assigned images to be recognized and detected images. The recognition result of the detection image is known, and the detection image is used as a dark pile to pre-verify the user's recognition result for the detection image. In Figure 5, the users of the second level and the third level are ordinary users and primary users, so the users of the second level and the third level are pre-authenticated, and the users of the first level are high-quality users, so the users of the first level are high-quality users. Level 1 users are not pre-authenticated.

The recognition results of the detected images are pre-verified for users of the second level and the third level. For example, a second-level user or third-level user may be pre-authenticated by comparing results of recognition of the detected image by the second-level user or third-level user with known recognition processing results of the detected image. If the recognition result of the detected image by the second-level user or the third-level user is consistent with the known recognition processing result of the detected image, the recognition result of the detected image by the second-level user or the third-level user passes the pre-verification . If not, it means that the pre-validation failed.

The recognition result of the image to be recognized by the user may include at least one of text information and problem description. For example, if the user successfully recognizes the text content in the image, the text content can be uploaded to the server as text information. During this period, if the user thinks that there is a problem with the image and needs feedback, the feedback data can be uploaded to the server together with the text information. If the user cannot recognize the text content in the image, the feedback data can be uploaded to the server, such as the image is not clear, the image file is damaged, etc.

For the recognition results of users at the first level, the text information in the recognition results can be verified by means of optical character recognition program verification and cross-validation with other users. For the problem description in the recognition results, the default is precise.

For the recognition results of users at the second level, the text information in the recognition results can be verified by means of optical character recognition program verification and cross-verification with other users. to verify the problem description.

For the recognition result of the third-level user, the text information in the recognition result can be verified by cross-validation with other users, and the problem description in the recognition result can be verified by cross-validation with other users.

FIG. 6 schematically shows a block diagram of a data verification apparatus according to an embodiment of the present application.

As shown in FIG. 6 , the data verification apparatus 600 in the embodiment of the present application includes, for example, a user division module 610 , a task assignment module 620 , and a verification module 630 .

The user division module 610 may be configured to acquire user data of multiple users, and divide the multiple users into multiple levels based on the user data, wherein multiple authentication methods are respectively set for the multiple levels. According to this embodiment of the present application, the user division module 610 may, for example, perform the operation S210 described above with reference to FIG. 2 , which will not be repeated here.

The task assignment module 620 may be used to assign tasks to be processed to a plurality of users respectively. According to this embodiment of the present application, the task allocation module 620 may, for example, perform the operation S220 described above with reference to FIG. 2 , and details are not described herein again.

The verification module 630 can be used to obtain the task processing results of the assigned tasks to be processed by the users of each level, and for each level in the multiple levels, use the verification mode set for the level to verify the task processing of the users of the level accuracy of results. According to this embodiment of the present application, the verification module 630 may, for example, perform the operation S230 described above with reference to FIG. 2 , which will not be repeated here.

According to the embodiment of the present application, the apparatus 600 may further include: a detection task assignment module, a processing result acquisition module, and a pre-verification module. The detection task assignment module is used to assign detection tasks to users whose levels are lower than a preset level among multiple levels, wherein the task processing results of the detection tasks are known, and the detection tasks and the tasks to be processed are assigned to users who are lower than the preset level. level user. The processing result obtaining module is used to obtain the processing result of the detection task performed by the user whose level is lower than the preset level. The pre-verification module is used to pre-verify users who are lower than the preset level by comparing the processing results of the detection tasks by the users who are lower than the preset level with the known task processing results of the detection tasks. In the case that the user passes the pre-authentication, the accuracy of the task processing result of the user who executes the authentication level.

According to the embodiments of the present application, the present application further provides an electronic device and a readable storage medium.

FIG. 7 is a block diagram of an electronic device used to implement the data verification method of the embodiment of the present application.

As shown in FIG. 7 , it is a block diagram of an electronic device of the method for data verification according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the application described and/or claimed herein.

As shown in FIG. 7 , the electronic device includes: one or more processors 701 , a memory 702 , and interfaces for connecting various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or otherwise as desired. The processor may process instructions executed within the electronic device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used with multiple memories and multiple memories, if desired. Likewise, multiple electronic devices may be connected, each providing some of the necessary operations (eg, as a server array, a group of blade servers, or a multiprocessor system). A processor 701 is taken as an example in FIG. 7 .

The memory 702 is the non-transitory computer-readable storage medium provided by the present application. The memory stores instructions executable by at least one processor, so that the at least one processor executes the data verification method provided by the present application. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to perform the data verification method provided by the present application.

As a non-transitory computer-readable storage medium, the memory 702 can be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the data verification method in the embodiments of the present application (for example, The user division module 610, the task assignment module 620 and the verification module 630 shown in FIG. 6). The processor 701 executes various functional applications and data processing of the server by running the non-transitory software programs, instructions and modules stored in the memory 702 , that is, implementing the data verification method in the above method embodiments.

The memory 702 may include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function; the stored data area may store data created according to the use of the electronic device for data verification, and the like. Additionally, memory 702 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory 702 may optionally include memory located remotely from the processor 701, and these remote memories may be connected to the electronic device for data verification via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The electronic device of the method for data verification may further include: an input device 703 and an output device 704 . The processor 701 , the memory 702 , the input device 703 and the output device 704 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 7 .

The input device 703 can receive input numerical or character information, and generate key signal input related to user settings and function control of the electronic device for data verification, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, a Or multiple input devices such as mouse buttons, trackballs, joysticks, etc. Output devices 704 may include display devices, auxiliary lighting devices (eg, LEDs), haptic feedback devices (eg, vibration motors), and the like. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.

Various implementations of the systems and techniques described herein can be implemented in digital electronic circuitry, integrated circuit systems, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

These computational programs (also referred to as programs, software, software applications, or codes) include machine instructions for programmable processors, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages calculation program. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or apparatus for providing machine instructions and/or data to a programmable processor ( For example, magnetic disks, optical disks, memories, programmable logic devices (PLDs), including machine-readable media that receive machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present application can be performed in parallel, sequentially or in different orders, and as long as the desired results of the technical solutions disclosed in the present application can be achieved, no limitation is imposed herein.

The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of this application shall be included within the protection scope of this application.

Claims (13)

1. a data verification method, is characterized in that, comprises: Obtaining user data of multiple users, and dividing the multiple users into multiple levels based on the user data, wherein multiple verification methods are respectively set for the multiple levels; assigning pending tasks to the plurality of users, respectively; and Obtain the task processing results of the assigned tasks to be processed by the users of each level, and for each level in the multiple levels, use the verification mode set for the level to verify the task processing of the users of the level accuracy of results. 2 . The method according to claim 1 , wherein the multiple levels include a first level, the task processing result of the task to be processed includes at least one of result data and problem feedback data, and the utilization is specific to all the tasks. 3 . The verification method set according to the above-mentioned level to verify the accuracy of the task processing results of the users of the above-mentioned level includes: For the result data in the task processing results of the users of the first level, verify the accuracy of the result data through a combination of task processing program verification and cross-validation with other users; and For the question feedback data in the task processing result of the first-level user, it is assumed that the question feedback data is accurate. 3 . The method according to claim 2 , wherein the multiple levels further include a second level lower than the first level, and the verification is performed using a verification mode set for the level. 4 . The accuracy of task processing results for users at levels includes: For the result data in the task processing results of the users of the second level, verify the accuracy of the result data through a combination of task processing program verification and cross-validation with other users; and For the question feedback data in the task processing result of the second-level user, the accuracy of the question feedback data is verified by means of cross-validation with other users. 4. The method according to claim 3, wherein the multiple levels further include a third level lower than the second level, and the verification is performed using a verification mode set for the level. The accuracy of task processing results for users at levels includes: For the result data in the task processing results of the third-level users, verify the accuracy of the result data by means of cross-validation with other users; and For the question feedback data in the task processing result of the third-level user, the accuracy of the question feedback data is verified by means of cross-validation with other users. 5. The method according to claim 2 or 3, characterized in that, the verification of the accuracy of the result data by a combination of task processing program verification and cross-verification with other users comprises: Use the task handler to perform task processing on the assigned task, and verify the accuracy of the result data in the user's task processing result based on the task processing result of the task handler; and In the case where it is verified that the result data is inaccurate based on the task processing result of the task processing program, the accuracy of the result data is further verified by means of cross-validation with other users. 6. The method of claim 1, wherein the method further comprises: A detection task is assigned to a user who is lower than a preset level among the plurality of levels, wherein the task processing result of the detection task is known, and the detection task is assigned to the low level together with the to-be-processed task. users at a preset level; Obtain the processing result of the detection task performed by the user whose level is lower than the preset level; pre-verifying the user below a preset level by comparing the result of processing the detection task by the user below a preset level with known task processing results for the detection task; and In the case that the user who is lower than the preset level passes the pre-verification, the verification of the accuracy of the task processing result of the user of the level is performed. 7. The method according to claim 1, wherein the user data includes the user's registration duration, the number of tasks processed by the user, and the accuracy rate of tasks processed by the user, and the user data is based on the user data. The division of multiple users into multiple levels includes, for each of the multiple users: When the user's registration duration is greater than or equal to a preset duration, the number of tasks processed by the user is greater than or equal to a preset number, and the accuracy of the tasks processed by the user is greater than or equal to a preset accuracy, the Users are divided into the first level; In the case that the registration duration of the user is greater than or equal to a preset duration, and the accuracy rate of the tasks processed by the user is less than the preset accuracy rate, classifying the user into the second level; and In the case that the registration duration of the user is less than the preset duration, the user is classified into a third level. 8. The method according to any one of claims 2 to 4, wherein the task to be processed includes an image to be recognized, the task processing result includes a recognition result of the image to be recognized, and the The result data includes text information recognized from the to-be-recognized image, the problem feedback data includes a problem description for the to-be-recognized image, and the task processing program includes an optical character recognition program. 9 . The method according to claim 8 , wherein the problem description comprises at least one of the following: the image to be recognized is blurry, and there is no text information in the image to be recognized. 10 . 10. The method according to any one of claims 2 to 4, wherein the cross-validation with other users comprises: For each task to be processed, the user's task processing result is compared with the task processing results of other users. If the user's task processing results are consistent with other users' task processing results, it is determined that the user's task processing results are accurate. 11. A data verification device, comprising: a user division module, configured to obtain user data of multiple users, and divide the multiple users into multiple levels based on the user data, wherein multiple verification methods are respectively set for the multiple levels; a task assignment module, configured to assign tasks to be processed to the plurality of users respectively; and The verification module is used to obtain the task processing results of the assigned tasks to be processed by the users of each level, and for each level in the multiple levels, use the verification mode set for the level to verify the level The accuracy of the user's task processing results. 12. An electronic device, characterized in that, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the execution of any one of claims 1 to 10 Methods. 13. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the method of any one of claims 1 to 10.

Images