JP2020046721A - Information processing apparatus and program - Google Patents

Abstract

To provide a confirmation correction screen configured to prevent first and second confirmation correctors not in agreement on objects to be corrected from correcting a character recognition result not to be corrected, in accordance with recognition accuracy of character recognition results on a plurality of items included in a document.SOLUTION: An information processing apparatus 10 includes: a recognition processing unit 12 which executes recognition processing on a character recognition object (character image) included in a document image to be processed, to output a recognition result and recognition accuracy of the recognition result; and a confirmation correction processing control unit 14 which causes an image generation processing unit 13 to generate first and second confirmation correction screens. In the first confirmation correction screen to be used by a first confirmation corrector, an input field is displayed for correcting a recognition result in association with a character image corresponding to the recognition result with recognition accuracy less than a threshold A. In the second confirmation correction screen to be used by a second confirmation corrector, an input field is displayed for correcting a recognition result in association with a character image corresponding to the recognition result with recognition accuracy less than a threshold B (B<A).SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing device and a program.

  The classification unit of the information processing apparatus disclosed in Patent Document 1 classifies the character recognition target into one of three types, and the extraction unit performs the character recognition when the classification unit classifies the target into the first type. The character recognition result of the target is extracted, and the first control means extracts the character recognition result of the character recognition target when classified by the classification means into the second type, and manually extracts the character recognition target. The second control unit controls the character recognition target to be input manually by a plurality of persons when the classification unit classifies the character into the third type.

JP 2016-212812 A

Hammock Co., Ltd., "TeleForm", [online], [August 23, 2018], Internet (URL: https://www.hammock.jp/ocr/kinou/reader.html)

  In Patent Literature 1, the first and second control means perform control so that a character recognition target is manually input, but do not propose a specific method of how to input.

  The present invention provides character recognition that does not require correction for each of first and second verification and correction persons whose verification and correction targets do not match according to the recognition accuracy of the character recognition result for a plurality of items included in a document. It is an object of the present invention to provide a confirmation and correction screen that does not cause the result to be corrected.

  An information processing apparatus according to the present invention includes: an obtaining unit configured to obtain a character recognition result for a plurality of items included in a document and a recognition accuracy of each character recognition result; and an object to be checked and corrected according to the recognition accuracy of the character recognition result. And control means for controlling display of a confirmation / correction screen for character recognition results used by the first and second confirmation / correction persons who do not match the character recognition results.

  Further, the control means uses the first confirmation and correction person so as not to accept a correction for a character recognition result whose recognition accuracy is equal to or greater than a first threshold and to accept a correction for a character recognition result whose recognition accuracy is less than the first threshold. An input control is performed from the first confirmation and correction screen, and a correction for a character recognition result with a recognition accuracy of a second threshold or more smaller than the first threshold is not accepted, and a correction for a character recognition result with a recognition accuracy of less than a second threshold is performed. It is characterized in that input control is performed from a second confirmation and correction screen used by a second confirmation and correction person so as to be accepted.

  Further, the acquisition unit further acquires a read image of the character described in the plurality of items, and the control unit displays the read image of each item on each confirmation / correction screen and performs the first confirmation. On the correction screen, an input for causing the first verification and correction person to input correction contents of the character recognition result in association with the read image corresponding to the character recognition result to be verified and corrected by the first verification and correction person Column, and the second confirmation / correction screen displays, on the second confirmation / correction person, the correction content of the character recognition result corresponding to the read image corresponding to the character recognition result to be confirmed / corrected. An input field for inputting the confirmation and correction by the user is displayed.

  Further, the control means does not display the input field on the first confirmation / correction screen in association with a read image corresponding to a character recognition result which is not a target of confirmation / correction by the first confirmation / correction person, The input field is not displayed on the second confirmation / correction screen so as to correspond to a read image corresponding to a character recognition result that is not to be confirmed / corrected by the second confirmation / correction person.

  The control means controls the first confirmation and correction person not to display the first confirmation and correction screen when there is no character recognition result to be confirmed and corrected by the first confirmation and correction person. When there is no target character recognition result, control is performed so as not to display the second confirmation / correction screen.

  Further, when displaying the second confirmation / correction screen after receiving an input from the first confirmation / correction screen by the first confirmation / correction person, the control means may perform a first When the correction content input by the verification and correction person matches the character recognition result, the character recognition result is excluded from the verification and correction by the second verification and correction person.

  In each of the confirmation and correction screens, a display area is set for each of the items, and the control unit controls the display of the display area of each of the items in accordance with the recognition accuracy of the character recognition result. And

  Further, the obtaining unit further obtains a read image of a character described in the plurality of items, and the control unit displays the read image of the item in each of the display areas, and displays the read image of each item on each of the confirmation and correction screens. An input field for inputting the correction content of the character recognition result is displayed in association with the read image corresponding to the character recognition result to be corrected by the confirmation and correction person.

  Further, the control means does not display the input field in each of the confirmation / correction screens in correspondence with a read image corresponding to a character recognition result which is not to be corrected by the confirmation / correction person.

  Further, the control means displays the character recognition result in association with the read image.

  Further, the control means is capable of omitting the input of the input field by a confirming and correcting person.

  Further, the control means does not display a display area of an item corresponding to a character recognition result not to be corrected by the verification corrector on each verification correction screen.

  Further, a comment column is provided in a display area of each item.

  Further, the display area of each item is provided with a check column for allowing a person who confirms and corrects input that the confirmation and correction work on the item is completed.

  A program according to the present invention is a computer, comprising: an acquisition unit configured to acquire a character recognition result for a plurality of items included in a document and a recognition accuracy of each character recognition result; In this case, the first and second confirmation / correction persons whose character recognition results do not match each other function as control means for controlling the display of a confirmation / correction screen for character recognition results.

  According to the first aspect of the present invention, depending on the recognition accuracy of the character recognition result for a plurality of items included in the document, each of the first and second verification and correction persons whose verification and correction target does not match each other. On the other hand, it is possible to provide a confirmation / correction screen that does not correct a character recognition result that does not require correction.

  According to the second aspect of the present invention, it is possible to cause each confirmation and correction person to input correction contents only for a character recognition result that can be corrected by each confirmation and correction person based on the magnitude relationship between the recognition accuracy and each threshold value.

  According to the third aspect of the present invention, it is possible for each confirming and correcting person to input the correction content only for the character recognition result to be corrected.

  According to the fourth aspect of the present invention, it is possible to prevent the user from inputting correction details for a character recognition result that is not to be corrected.

  According to the fifth aspect of the present invention, it is possible to prevent the confirmation / correction screen corresponding to the confirmation / correction person having no character recognition result to be confirmed / corrected from being displayed.

  According to the invention described in claim 6, when the character recognition result and the correction content by the first confirming corrector match, the input of the correction content by the second verifying corrector can be omitted.

  According to the invention described in claim 7, each display area can be displayed in a different display form for each recognition accuracy of the character recognition result.

  According to the eighth aspect of the present invention, it is possible for each of the verification and correction persons to input the correction content for the character recognition result to be corrected.

  According to the ninth aspect of the present invention, it is possible to prevent the user from inputting correction details for a character recognition result that is not to be corrected.

  According to the tenth aspect of the present invention, the correction content can be input by the confirming / correcting person with reference to the character recognition result.

  According to the invention described in claim 11, when the verification and correction person compares the read image with the character recognition result and determines that the character recognition result is correct, the verification and correction person can omit the input of the correction content. it can.

  According to the twelfth aspect, for an item corresponding to a character recognition result that is not to be corrected, it is not necessary to present information on the item to the confirmation and correction person.

  According to the thirteenth aspect of the present invention, the comment on the character recognition result corresponding to each item can be input by the confirmation and correction person.

  According to the fourteenth aspect of the present invention, it is possible to confirm that the confirmation and correction person has confirmed the character recognition result corresponding to each item.

  According to the fifteenth aspect of the present invention, the first and second confirmation and correction persons whose confirmation and correction objects do not match each other are determined according to the recognition accuracy of the character recognition result for a plurality of items included in the document. On the other hand, it is possible to provide a confirmation / correction screen that does not correct a character recognition result that does not require correction.

FIG. 1 is a block diagram illustrating an overall configuration of an information processing system according to the present embodiment and an information processing apparatus according to the present embodiment. FIG. 2 is a hardware configuration diagram of a computer forming the information processing device according to the present embodiment. It is a flowchart which shows the confirmation correction process in this Embodiment. It is a flowchart which shows the confirmation correction process number determination process in this Embodiment. FIG. 5 is a diagram illustrating an example of a first confirmation and correction screen according to the present embodiment. It is a figure showing an example of the screen for the 2nd confirmation correction in this embodiment. FIG. 11 is a diagram showing another example of the first confirmation and correction screen in the present embodiment. FIG. 14 is a diagram illustrating another example of the second confirmation and correction screen according to the present embodiment. FIG. 14 is a diagram illustrating another example of the second confirmation and correction screen according to the present embodiment. FIG. 11 is a diagram showing another example of the first confirmation and correction screen in the present embodiment.

  Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an overall configuration of an information processing system for confirming and correcting a form in the present embodiment and an embodiment of an information processing apparatus according to the present invention. FIG. 1 shows a configuration in which a first client 1 for correction and correction, a client 2 for second correction and correction, a client 3 for approver, and an information processing device 10 are connected via a network 4.

  In the information processing system according to the present embodiment, handwritten characters are recognized by performing character recognition processing on characters input by handwriting on a form, and the recognized characters are confirmed and corrected by a user (confirmation corrector). The system further allows the approver (confirmer) to confirm the recognition result by the character recognition process and the contents of the confirmation and correction by the confirmer / corrector, thereby finally confirming the recognition result of the handwritten character. “Confirmation and correction” refers to confirming a read image (an image of a manually input character) of a character to be recognized and inputting a correct character. In some cases, you can simply check the scanned image of a character and enter the correct character without displaying the character recognition result, or compare the scanned image with the result of the character recognition process to determine whether the result of the character recognition process is correct. In some cases, the user is asked to confirm whether the character is correct and, if it is determined that the character is incorrect, correct the result of the character recognition processing, that is, input a character considered to be correct. In this embodiment, the term “confirmation and correction” includes the case where no input is made when it is determined to be correct (only confirmation), and the case where the same character as the result of the character recognition process is input even when it is further determined to be correct. To Note that the term “character” here means a character string composed of one or more characters strictly, but for convenience of explanation, in this embodiment, it may be simply referred to as “character”. .

  The first confirming and correcting person's client 1 is a client computer used by a user (first confirming and correcting person) who confirms and corrects the content of the form. The second client 2 for confirmation and correction is a client computer used by a user (second confirmation and correction person) who confirms and corrects the content of the form. The approver client 3 looks at the result of the character recognition processing (character recognition result) and, if the user has made a correction input, the content of the correction input, and finally checks the character recognition result for the character recognition target. This is a client computer used by a user (approver) who performs the operation. The first confirming and correcting person and the second confirming and correcting person among the first confirming and correcting person, the second confirming and correcting person and the approver are at least different persons.

  In the present embodiment, when it is not necessary to distinguish the first client 1 for the corrective corrector and the client 2 for the second corrective corrector from each other, they are collectively referred to as “clients for the corrective corrector”. Similarly, when it is not necessary to distinguish the first confirming and correcting person from the second confirming and correcting person, they are collectively referred to as “confirming and correcting person”. In addition, the first confirmation and correction person performs confirmation and correction of the character recognition target from the first confirmation and correction screen displayed on the first confirmation and correction person client 1, and the second confirmation and correction person uses the second confirmation and correction person. If the character recognition target is confirmed and corrected from the second confirmation and correction screen displayed on the client 2, but it is not necessary to distinguish the first and second confirmation and correction screens from each other, “Confirm and correct” is used. Screen ".

  In the information processing system according to the present embodiment, two confirmation and correction persons are made to confirm and correct the form. It is a so-called double entry, where two people check the form. Further, as described later, depending on conditions, there may be a case where only one person checks and corrects the form. It should be noted that the number of confirmation / correction persons need not be limited to two, but may be more.

  In the present embodiment, a LAN is assumed as the network 4 connecting the computers 1 to 3, but may be configured to connect the external clients 1 and 2 using the Internet, for example.

  The information processing apparatus 10 is a computer that performs overall control in cooperation with each of the clients 1 to 3 in order to obtain a correct recognition result of a character that is handwritten in an input field of a form item. FIG. 2 is a hardware configuration diagram of a computer forming the information processing apparatus 10 according to the present embodiment. The information processing apparatus 10 according to the present embodiment can be realized by a general-purpose hardware configuration that has existed before, such as a personal computer (PC). That is, the information processing apparatus 10 connects the CPU 21, the ROM 22, the RAM 23, the hard disk drive (HDD) 24, and the network 4 shown in FIG. 2 and includes a network controller 25 for performing data communication with each of the clients 1 to 3. It is connected to the internal bus 26. If necessary, an input / output controller 30 for connecting the mouse 27, the keyboard 28, and the display 29 as a user interface may be connected to the internal bus 26.

  Each of the clients 1 to 3 is also the same computer as the information processing apparatus 10, and thus has the hardware configuration shown in FIG.

  Returning to FIG. 1, the information processing apparatus 10 according to the present embodiment includes a form image acquisition unit 11, a recognition processing unit 12, a screen generation processing unit 13, a confirmation correction processing control unit 14, a final confirmation processing control unit 15, and a final result output. It has a part 16.

  The form image acquisition unit 11 acquires an image of a form to be processed. The recognition processing unit 12 executes a character recognition process (a character recognition result) obtained by executing a character recognition process on a character recognition target (a character input by handwriting in an entry field of a form item) included in the acquired form image. A pair of the text code shown) and the recognition accuracy is output. As a character recognition process, the recognition processing unit 12 performs, for example, a known OCR (optical character recognition) process on a read image (input image data) of a character to be subjected to character recognition, and is thereby included in the input image data. Recognize characters (character strings). The “recognition accuracy” is a degree indicating the likelihood that the text code of the character recognition result (hereinafter, also simply referred to as “recognition result”) correctly represents a character string (may be handwritten) included in the input image data. It is. The higher the recognition accuracy, the higher the possibility that the text code of the recognition result is correct (that is, the character code in the input image data is correctly represented). The recognition accuracy may be calculated using an existing character recognition technology.

  The screen generation processing unit 13 generates a confirmation and correction screen for confirming and correcting the recognition result by the recognition processing unit 12. Further, a final confirmation screen for causing the approver to make a final confirmation of the recognition result for the character recognition target is generated. The confirmation and correction processing control unit 14 performs overall control of the confirmation and correction processing. For example, when a set of the recognition result and the recognition accuracy output by the recognition processing unit 12 is acquired, the confirmation and correction processing control unit 14 displays the confirmation and correction screen displayed on the clients 1 and 2 for the correction and correction person according to the recognition accuracy. The screen generation processing unit 13 generates the screen and controls the display of the generated confirmation / correction screen. The final confirmation processing control unit 15 executes processing for causing the approver to make a final confirmation of the recognition result for the character recognition target. The final result output unit 16 outputs a final recognition result of each character recognition target included in the form image acquired by the form image acquisition unit 11.

  Each of the constituent elements 11 to 16 in the information processing device 10 is realized by a cooperative operation of a computer forming the information processing device 10 and a program operated by a CPU 21 mounted on the computer.

  In addition, the program used in the present embodiment can be provided not only by communication means but also stored in a computer-readable recording medium such as a CD-ROM or a USB memory. The program provided from the communication unit or the recording medium is installed in the computer, and various processes are realized by the CPU 21 of the computer sequentially executing the program.

  In the information processing system according to the present embodiment, the form can be confirmed and corrected by two persons. However, in the present embodiment, when the recognition result (recognition result for one character recognition target) by the recognition processing unit 12 can be confirmed and corrected by two confirmation and correction persons, the confirmation and correction is made only by one confirmation and correction person. In this case, the number of confirmation and correction persons who perform confirmation and correction on the recognition result is determined in accordance with the recognition accuracy. Among these three patterns, it is considered that the recognition accuracy of the final character recognition result (correction rate) is highest when the recognition result by the recognition processing unit 12 is verified and corrected by two verification correctors. However, if confirmation and correction are always performed by a two-person system, human costs are higher than in the case of performing the correction and correction by one person, and the amount of work performed by the verification and correction person cannot be reduced. The time required for confirmation and correction also increases.

  Therefore, in the present embodiment, although one form-based confirmation / correction screen is generated for one form, the confirmation / correction screen used by each confirmation / correction person is the object of confirmation / correction. Can now be corrected and input only for character recognition targets.

  Hereinafter, a confirmation and correction process performed on a form in the present embodiment will be described with reference to a flowchart shown in FIG.

  The form image acquisition unit 11 receives a form image sent from the outside (step 101). Subsequently, the recognition processing unit 12 cuts out a read image (hereinafter, “character image”) of a character described in the area of the extraction target item from the acquired form image (step 102). The area of the item to be extracted is usually defined at the time of form design or the like. The character image cut out in this way is a character recognition target. Subsequently, the recognition processing unit 12 performs a character recognition process on the character image to acquire a recognition result and a recognition accuracy of each character image (Step 103).

  Subsequently, the confirmation and correction processing control unit 14 initializes the variable N to 0 (step 104), and then increments N by 1 (step 107). Until the number reaches (Y in step 105), the process of determining the number of confirmation and correction processors is repeatedly executed (step 106). Hereinafter, the process of determining the number of confirmation and correction processors according to the present embodiment will be described with reference to the flowchart shown in FIG.

  The confirmation / correction processing person number determination processing is processing for determining the number of confirmation / correction persons required for confirmation / correction of a character image to be processed (character recognition target). Therefore, the confirmation and correction processing control unit 14 sequentially obtains a set of the recognition result and the recognition accuracy of each character image from the recognition processing unit 12 (step 1061). Determine the number of verification and correction persons for the image. In other words, in this embodiment, two types of thresholds A and B are prepared in order to determine whether any of the above-mentioned three patterns (the number of confirming and correcting persons is 0, 1 or 2). . As the threshold A (first threshold), a value for determining that the recognition result of the character image by the recognition processing unit 12 for the character image is reliable is set. For example, when the recognition accuracy is equal to or larger than the threshold value A (“recognition accuracy ≧ A” in step 1062), the recognition processing unit 12 recognizes the character to be recognized correctly, and the recognition result by the recognition processing unit 12 is reliable. It is determined that confirmation / correction by the confirmation / correction person for the recognition result is unnecessary (step 1063). For example, the threshold A is set to 90%.

  As the threshold B (second threshold), a value for determining that the recognition result of the character image by the recognition processing unit 12 for the character image is not reliable is set. For example, when the recognition accuracy is less than the threshold value B (“recognition accuracy <B” in step 1062), the recognition processing unit 12 recognizes that it is unlikely that the character recognition target is correctly character-recognized. It is determined that the recognition result by the processing unit 12 is not reliable, and it is determined that two confirmation correctors are necessary for the recognition result (step 1064). For example, the threshold B is set to 50%.

  As described above, in the present embodiment, two types of thresholds indicating whether or not the recognition result of the character image by the recognition processing unit 12 is reliable are set. Is greater than or equal to the threshold B and less than the threshold A (“B ≦ recognition accuracy <A” in step 1062), the recognition result by the recognition processing unit 12 is not so reliable, but it is determined that the recognition accuracy is more reliable than when the recognition accuracy is less than the threshold B. Then, it is determined that one confirmation and correction person is necessary for the recognition result (step 1065).

  As described above, when the number of confirmation and correction persons required for each character image (character recognition target) is determined (N in step 105), the confirmation and correction processing control unit 14 The number of corrective and correctors is determined (step 108). That is, when it is determined that two confirmation and correction persons are necessary for the recognition result of at least one character image, the number of confirmation and correction persons is determined to be two. If it is determined that the verification and correction person is unnecessary for the recognition result of all the character images, the number of verification and correction persons is determined to be zero. Otherwise, if there are no recognition results for character images for which two verification and correction persons were determined to be necessary, and no verification and correction persons were determined to be unnecessary for all character image recognition results, the number of verification and correction persons Is determined to be 1.

  If the number of confirmation / correction persons is 0 (“0” in step 109), since the recognition result of all the character images by the recognition processing unit 12 is reliable, the confirmation / correction processing control unit 14 performs the first and second confirmation. Control not to display the correction screen. Then, the final result output unit 16 outputs the recognition result by the recognition processing unit 12 as the final recognition result without receiving the final confirmation by the approver (step 117). The output destination in the final result output unit 16 does not need to be particularly limited. For example, a form image provider, a printing device, a storage unit such as the HDD 24, a computer connected via the network 4, and the like may be used.

  In the present embodiment, the processing is performed so as not to receive the final confirmation by the approver, but the recognition accuracy is 90% or more, but not all 100%. Therefore, a confirmation process (step 116) by the approver may be received.

  When the number of confirmation and correction persons is one (“1” in step 109), the confirmation and correction processing control unit 14 sends a first confirmation and correction screen to the screen generation processing unit 13 so that only the first confirmation and correction person confirms and corrects. It is generated (step 110). Then, the confirmation / correction processing control unit 14 requests the first confirmation / correction person to perform confirmation / correction (step 111). The method of the request does not need to be particularly limited, and may be notified to the first confirming and correcting person's client 1 using, for example, an e-mail or a dedicated application. In this case, the confirmation / correction processing control unit 14 controls so as not to display the second confirmation / correction screen.

  When the number of confirmed and corrected persons is two ("2" in step 109), the confirmation and correction processing control unit 14 causes the first and second confirmed and corrected persons to confirm and correct each of the first and second confirmed and corrected persons. Screen is generated by the screen generation processing unit 13 (step 112). Then, the confirmation / correction processing control unit 14 requests confirmation / correction from the first and second confirmation / correction persons (step 113). In this case, the confirmation / correction processing control unit 14 controls to display the first and second confirmation / correction screens.

  FIG. 5 is a diagram showing an example of the first confirmation and correction screen according to the present embodiment. FIG. 6 is a diagram showing an example of the second confirmation and correction screen according to the present embodiment. FIGS. 5 and 6 show confirmation / correction screens generated when the number of confirmation / correction persons is determined to be two. For confirmation / correction for double entry in which one form is confirmed and corrected by two confirmation / correction persons. Screen. The confirmation and correction screen is displayed on each of the clients 1 and 2 under the display control by the confirmation and correction processing control unit 14. It may be generated on a web page.

  The confirmation / correction screen is formed in a common form for one form as illustrated in FIGS. 5 and 6, but the first confirmation / correction screen is used because the recognition result to be confirmed / corrected differs. And the display contents of the second confirmation and correction screen do not match. On the confirmation / correction screen, display areas of a form image 31 acquired by the form image acquisition unit 11 and a work table 32 for performing confirmation / correction work are formed. In the display area of the form image 31, identification information (form ID) for identifying the form image acquired at the time of acquisition of the form image is also displayed. In the work table 32, items of item name, character image / recognition result, and recognition accuracy are associated. In the work table 32, a display area is set for each item included in the form.

  The item name is an item included in the form, and is a name of an item associated with an entry field in which characters on the form are manually input. The character image and the recognition result are displayed in the character image / recognition result. The character image 33 is a read image of a character manually input in an entry column corresponding to the item on the form. The recognition result is a character recognition result of the character image by the recognition processing unit 12, but is not displayed in FIGS. In the character image / recognition result, an input field 34 for inputting correction contents by a confirming and correcting person corresponding to the character image is displayed. The recognition accuracy is the recognition accuracy for the recognition result by the recognition processing unit 12.

  In FIGS. 5 and 6, when the recognition accuracy is equal to or larger than the threshold value A (90%), the recognition result by the recognition processing unit 12 is reliable, so that the correction by the corrector is unnecessary. For this reason, the input field 34 is not displayed in association with the item "name 1" having a recognition accuracy of 95%. For this reason, the confirmation and correction person can recognize that the confirmation and correction work on the item is unnecessary.

  When threshold B (50%) ≦ recognition accuracy <threshold A (90%), confirmation and correction by only one confirmation and correction person is necessary. Therefore, the first confirmation / correction screen used by the first confirmation / correction person corresponding to the one confirmation / correction person has an input field 34 corresponding to the item “birth date 1” having a recognition accuracy of 75%. Is displayed. For this reason, the first confirming / correcting person can recognize the item as a subject of confirmation and correction. On the other hand, the input field 34 is not displayed on the second confirmation / correction screen. For this reason, the second confirmation and correction person can recognize that the confirmation and correction work on the item is unnecessary.

  If the recognition accuracy <threshold B (50%), confirmation and correction by two confirmation and correction persons is necessary. Therefore, in both the first and second confirmation and correction screens used by the first and second confirmation and correction persons, the items “name 2” and “date of birth” whose recognition accuracy is 40% and 45%, respectively, are displayed. The input field 34 is displayed in association with “Day 2”. For this reason, each of the confirmation and correction persons can recognize the item as a target for confirmation and correction.

  According to the example of the confirmation and correction screen shown in FIGS. 5 and 6, for the form with the form ID 001, the first confirmation and correction person has the items “birth date 1”, “name 2”, and “birth date 2”. It can be seen that is a subject of confirmation and correction. Since the item "Name 1" is not the subject of confirmation and correction, the confirmation and correction work can be omitted. On the other hand, the second confirmation corrector knows that the items “name 2” and “date of birth 2” are to be corrected. The items “name 1” and “date of birth 1” are out of the scope of confirmation and correction, so that the confirmation and correction work can be omitted.

  In the present embodiment, as described above, the confirmation / correction person generates the confirmation / correction screen so that the input field 34 is displayed in correspondence with the character image of the item requiring the confirmation / correction. Controls the display of the confirmation and correction screen for each of the clients 1 and 2.

  The verification and correction person recognizes the described character by looking at the character image 33 on the verification and correction screen, and inputs the recognized character into the input box 34. Thus, in the confirmation and correction work using the confirmation and correction screens shown in FIGS. 5 and 6, an input is required without confirming the recognition result by the recognition processing unit 12.

  When the confirming and correcting person selects an item row in the work table 32, the display form of the item row may be different from other item rows to make it easier to visually recognize that the item row has been selected. For example, a background color may be added or a highlight may be displayed as illustrated in the item row “name 1” in FIG. Also, by making the display form of the item corresponding to the item of the selected item line different from other items on the form image, it is easy to visually confirm which item is to be checked and corrected by the checking and correcting person. You may. For example, an encircling line (broken line) may be added as illustrated in FIG. 5 or a frame of a corresponding item may be highlighted.

  In addition, in the work table 32 according to the value of the recognition accuracy so that the recognition accuracy falls within a range (recognition accuracy <B, B ≦ recognition accuracy <A, A ≦ recognition accuracy) so that it is easy to visually recognize. May be displayed in different display forms. For example, the item row or the recognition accuracy (item column) may be painted out in a preset color for each (the value of) the recognition accuracy. Alternatively, only the recognition accuracy (character) portion may be painted out.

  Further, in the present embodiment, when the number of items displayed on the work table 32 is large, there is a possibility that not all items can be displayed on the screen. In this case, the selection button 35 may be operated to selectively display, for example, the recognition accuracy of a desired range.

  When the confirmation and correction person enters all the input fields 34 corresponding to the character images to be confirmed, the confirmation button 36 is selected at the bottom of the screen to notify the information processing apparatus 10 of the end of the work. The control may be performed so that the enter button 36 cannot be selected unless characters have been input in all the input fields 34. Alternatively, when there is an uninput item, a confirmation dialog may be displayed.

  When all of the confirmation and correction persons recognize that the confirmation and correction work by all of the confirmation and correction persons has been completed by selecting the confirm button 36, the confirmation and correction processing control unit 14 inputs the confirmation and correction processing from the clients 1 and 2 to the input field 34. The obtained recognition result is obtained (step 114). In addition, in order to clarify the difference from the recognition result by the recognition processing unit 12, the recognition result input by the confirmation and correction person into the input box 34 is referred to as “work result”.

  When the confirmation and correction work by the confirmation and correction person is completed, the final confirmation processing control unit 15 displays the character image, the recognition result by the recognition processing unit 12, and the work result by the confirmation and correction person acquired by the confirmation and correction processing control unit 14. Screen is generated by the screen generation processing unit 13 (step 115). Then, the final confirmation processing control unit 15 requests the approver to perform final confirmation of the recognized character on the character image (step 116). The method of the request does not need to be particularly limited. For example, the requester may be notified to the approver client 3 using an e-mail or a dedicated application.

  The approver verifies the recognition result of the correct character image by comparing the character image with the recognition result by the recognition processing unit 12 and the work result by the confirmation and correction person. At this time, the approver may correct the recognition result as necessary.

  When the final confirmation by the approver is completed as described above, the final result output unit 16 outputs the result of the final confirmation by the approver as a final recognition result (step 117).

  The above is the case of the double entry, but the case where the number of confirmed and corrected persons is one, that is, the case of a single entry in which one form is confirmed and corrected by only one confirmed and corrected person is also illustrated in FIGS. A screen for confirmation and correction is generated for the first person who confirms and corrects, and the display of the screen is controlled.

  Hereinafter, a modification of the confirmation and correction screen will be described.

  FIG. 7 is a diagram illustrating another example of the first confirmation and correction screen according to the present embodiment. FIG. 8 is a diagram showing another example of the second confirmation and correction screen according to the present embodiment. 5 and 6 is that the recognition result 37 of the character image 33 by the recognition processing unit 12 is displayed in the character image / recognition result column of each item line. In the confirmation / correction screens shown in FIGS. 5 and 6, the confirmation / correction person is made to input the confirmation / correction person regardless of whether the recognition result by the recognition processing unit 12 is correct or incorrect. In order not to display the recognition result. On the other hand, if the confirmation / correction screens shown in FIGS. 7 and 8 are used, the confirmation / correction person can enter the input field 34 with reference to the character image 33 and the recognition result 37.

  When the confirmation and correction screen shown in FIGS. 7 and 8 is used, the confirmation and correction person can omit the input to the input field 34 when the recognition result 37 by the recognition processing unit 12 is determined to be correct. Good. That is, in the confirmation / correction screens shown in FIGS. 5 and 6, if there is an input field 34 in which no character is entered, the confirm button 36 cannot be selected. On the confirmation / correction screens shown in FIGS. Even if no character is input in the input field 34, the enter button 36 can be selected. If the input is omitted, the confirmation and correction processing control unit 14 considers that the confirmation and correction person has input the same content as the recognition result 37 by the recognition processing unit 12 as the work result.

  FIG. 9 is a diagram illustrating another example of the second confirmation and correction screen according to the present embodiment. The difference from FIG. 6 is that the input column is not displayed in the column of the character image / recognition result in “date of birth 2”.

  In steps 112 and 113 in FIG. 3, it has been described that the first correction and correction person and the second verification and correction person generate the confirmation and correction screen simultaneously and request the confirmation and correction. However, it is not always necessary to perform the processing in parallel, and either of them may be processed first. For example, suppose that a request is first made to the first confirmation and correction person, and a work result is received from the first confirmation and correction person. Here, when the recognition result by the recognition processing unit 12 and the work result by the first confirmation / correction person match, the recognition result by the recognition processing unit 12 has a correct probability as in the case where the recognition accuracy is equal to or more than the threshold A. It can be said that it is extremely high. In this case, a second confirmation / correction screen is generated so as not to display an input field in order to omit the confirmation / correction operation of the item by the second confirmation / correction person, and a confirmation / correction is requested. As described above, by excluding the item from the target of the confirmation and correction by the second confirmation and correction person, the work efficiency of the second confirmation and correction person can be improved.

  As shown in FIG. 8, a recognition result (a work result by the first confirmation and correction person) 37 by the recognition processing unit 12 may be displayed in a corresponding item line.

  FIG. 10 is a diagram illustrating another example of the first confirmation and correction screen according to the present embodiment. The difference from FIG. 5 is that a comment column 38 and a confirmation flag column 39 are added to the work table 32. The comment column 38 is provided with a comment area 40 for writing a comment for each item line. In the confirmation flag column 39, a check box 41 is provided for each item line.

  When the first confirming and correcting person wants to make a comment on an item on the form or a character image of the item, the comment is written in the comment area 40 of the item. In addition, a check box 41 corresponding to the item for which the work has been completed is checked in order to cause the first confirmation and correction person to input that the check and correction work for the item row has been completed. Only after all the check boxes 41 are checked, the confirm button 36 can be selected.

  If the number of items included in the work table 32 is large, the work efficiency may be deteriorated if the check boxes 41 of all the items are checked. Therefore, the check box provided at the top of the check flag column 39 By checking the box 42, the check boxes 41 of all items may be checked.

  The comment column 38 is provided for entering a comment for each item. A comment column 43 is provided on the first confirmation / correction screen so that comments corresponding to a plurality of items can be entered.

  Although the modification of the first confirmation and correction screen has been described with reference to FIG. 10, the modification is also applicable to the second confirmation and correction screen.

  A modification of the confirmation and correction screen will not be described with reference to the drawings. However, when the number of items to be displayed on the work table 32 is large, there is a possibility that not all items can be displayed on the screen. The items on the form not to be checked and corrected may not be displayed on the work table 32. For example, on the second confirmation and correction screen shown in FIG. 6, the items "name 1" and "birth date 1" are not displayed.

  Although the present embodiment has been described assuming a double entry in which a plurality of confirmation and correction persons duplicately confirm and correct the information, the present invention is not limited to the double entry. For example, of the seven items included in the form, the items 1 to 4 can be applied to the case where the first confirmation and correction person confirms and corrects the items 5 to 7 respectively. In this case, the input fields are not displayed on the first confirmation / correction screen corresponding to the items 5 to 7, that is, are not corrected. On the other hand, on the second confirmation / correction screen, input fields are not displayed corresponding to the items 1 to 4, that is, are not corrected. As described above, the present invention is also applicable to a case where items included in a form are divided and confirmed and corrected.

  Further, in the present embodiment, a confirmation / correction screen is generated and displayed so that a confirmation / correction person can input a work result (result of recognition of a character image) only for a character image to be confirmed / corrected. I made it. In the above description, an input field is not provided on the confirmation / correction screen so that a character recognition result that does not require correction is not corrected. However, the present invention is not limited to this input control. For example, the first and second confirmation and correction screens are shared, and an input field is displayed in each item line. Then, the confirmation / correction processing control unit 14 may be configured not to accept the correction input of the character recognition result that does not need to be corrected, for example, by discarding the input content.

REFERENCE SIGNS LIST 1 Client for first confirming and correcting person 2 Client for second confirming and correcting person 3 Client for approver 4 Network 10 Information processing device 11 Form image acquisition unit 12 Recognition processing unit 13 Screen generation processing unit 14 Confirmation / correction processing control unit, 15 final confirmation processing control unit, 16 final result output unit, 21 CPU, 22 ROM, 23 RAM, 24 hard disk drive (HDD), 25 network controller, 26 internal bus, 27 mouse, 28 keyboard, 29 Display, 30 input / output controller, 31 form image, 32 work table, 33 character image, 34 input field, 35 select button, 36 confirm button, 37 recognition result, 38, 43 comment field, 39 confirmation flag field, 40 comment area , 41, 42 check boxes.

Claims (15)

Acquiring means for acquiring a character recognition result for a plurality of items included in the document and a recognition accuracy of each character recognition result;
Control means for controlling the display of a confirmation / correction screen for character recognition results used by first and second confirmation / correction persons whose character recognition results to be confirmed / corrected do not match in accordance with the recognition accuracy of the character recognition results. When,
An information processing apparatus comprising: The control means includes:
A first confirmation / correction screen used by a first confirmation / correction person to accept a correction for a character recognition result whose recognition accuracy is equal to or greater than a first threshold and accept a correction for a character recognition result whose recognition accuracy is less than the first threshold. Control input from
A second confirmation corrector uses the second confirmation and correction person so as not to accept a correction for a character recognition result whose recognition accuracy is smaller than a first threshold and a second threshold or more and accept a correction for a character recognition result whose recognition accuracy is smaller than a second threshold. The information processing apparatus according to claim 1, wherein input control is performed from a confirmation / correction screen. The obtaining means further obtains a read image of characters written in the plurality of items,
The control means displays the read image of each item on each confirmation and correction screen,
The first confirmation / correction screen displays the correction contents of the character recognition result to the first confirmation / correction person in association with the read image corresponding to the character recognition result to be confirmed / corrected by the first confirmation / correction person. Display the input field for inputting,
The second confirmation / correction screen displays the correction contents of the character recognition result to the second confirmation / correction person in association with the read image corresponding to the character recognition result to be confirmed / corrected by the second confirmation / correction person. The information processing apparatus according to claim 2, wherein an input field for inputting is displayed. The control means includes:
The first confirmation / correction screen does not display the input field in correspondence with a read image corresponding to a character recognition result that is not a target of confirmation / correction by the first confirmation / correction person,
4. The input screen according to claim 3, wherein the second confirmation and correction screen does not display the input field in correspondence with a read image corresponding to a character recognition result that is not to be confirmed and corrected by the second confirmation and correction person. 5. An information processing apparatus according to claim 1. The control means includes:
If the first confirmation and correction person has no character recognition result to be confirmed and corrected, control is performed so as not to display the first confirmation and correction screen,
The information processing apparatus according to claim 2, wherein when the second confirmation corrector does not have a character recognition result to be confirmed and corrected, control is performed so as not to display the second confirmation and correction screen.   The control means, when displaying the second confirmation / correction screen after receiving an input from the first confirmation / correction screen by the first confirmation / correction person, performs the first confirmation / correction on the character recognition result. The information processing apparatus according to claim 2, wherein when the correction content input by the user matches the character recognition result, the character recognition result is excluded from the verification and correction by the second verification and correction person. On each of the confirmation and correction screens, a display area is set for each of the items,
The information processing apparatus according to claim 1, wherein the control unit controls display of a display area of each item according to recognition accuracy of a character recognition result. The obtaining means further obtains a read image of characters written in the plurality of items,
The control means displays the read image of the item in each of the display areas and, on each of the confirmation and correction screens, associates the character with the read image corresponding to the character recognition result to be corrected by the verification and correction person. The information processing apparatus according to claim 7, wherein an input field for inputting a correction content of the result is displayed.   9. The information according to claim 8, wherein the control unit does not display the input field on each of the confirmation and correction screens in correspondence with a read image corresponding to a character recognition result that is not to be corrected by the verification and correction person. 10. Processing equipment.   9. The information processing apparatus according to claim 8, wherein the control unit displays the character recognition result in association with the read image.   The information processing apparatus according to claim 10, wherein the control unit is capable of omitting an input in the input field by a person who confirms and corrects the information.   The information processing apparatus according to claim 7, wherein the control unit does not display a display area of an item corresponding to a character recognition result not to be corrected by the verification corrector on each verification correction screen.   The information processing apparatus according to claim 7, wherein a comment column is provided in a display area of each of the items.   8. The information processing apparatus according to claim 7, wherein a check box is provided in a display area of each of the items so that a person who confirms and corrects the input of the completion of the confirmation and correction work on the item. Computer
Acquiring means for acquiring a character recognition result for a plurality of items included in the document and a recognition accuracy of each character recognition result,
Control means for controlling the display of a confirmation / correction screen for character recognition results used by first and second confirmation / correction persons whose character recognition results to be confirmed / corrected do not match in accordance with the recognition accuracy of the character recognition results. ,
Program to function as