JP7709053B2 - Information processing device, information processing system, control method, and program - Google Patents

Description

The present invention relates to technology for acquiring and processing images.

Application procedures for products and services have been digitized and can now be applied for over the network, but there are still documents that must be attached to the application. To deal with this, a method has been adopted in which the application user (applicant or sales representative) takes a photo of the document using the camera function of a mobile device or smartphone, sends (uploads) the document image over the network to a server that accepts applications, and the server uses OCR (optical character recognition) to recognize the necessary information from the document image and registers it as digital data.

However, the images taken by the application source user, who is a general user, are often unclear, and in such cases the server cannot recognize the required items, and it is necessary to ask the application source user to retake the image and resend it. Such rework is time-consuming and burdensome for both the application source user and the application receiving party. If it were possible to determine whether or not a retake is necessary before uploading the image to the server, this would eliminate rework and improve efficiency.

Patent document 1 discloses a mechanism for detecting the outline of a document contained in an image of the document obtained by photographing the document, and notifying the user whether or not re-photographing is required depending on whether or not the detected outline of the document is complete.

JP 2010-204806 A

However, Patent Document 1 only determines whether the outline detected from the form image is complete, and does not mention determining whether the form image is clear.

In addition, the characteristics (complexity, etc.) of the captured image differ depending on the structure and contents of the form. Therefore, the criteria for determining whether a captured image is clear differ depending on the type of form and the characteristics of the image.

Furthermore, even within a single form image, the judgment of whether each partial area is clear may differ depending on the difference in brightness, etc. Also, in white areas and solid color areas, there are no boundaries (edges) that can be used for the clearness judgment, so a judgment cannot be made at all, and how much of the entire image can be judged for clearness varies depending on the type of form, etc.

The present invention aims to provide a mechanism that can determine whether an image is clear based on the captured image.

The present invention is an information processing device that acquires an image of a document , and is characterized by comprising a determination means that determines a criterion for judging whether the image of the document is clear or not based on the type of document , and a notification means that notifies whether the image of the document is clear or not based on the determination result of whether each small area into which the image of the document is divided is clear or not and the determined criterion.

The present invention provides a mechanism for determining whether an image is clear based on the captured image.

FIG. 1 is a diagram showing an example of a configuration of an information processing system 100 according to an embodiment of the present invention. FIG. 1 is a diagram showing an example of a hardware configuration applicable to an information processing device 101 and a server 102. 1 is a flowchart showing an example of an overall process in the information processing system 100. A flowchart showing an example of a threshold setting process. Flowchart showing an example of image sharpness determination processing Flowchart showing an example of OCR result reflection processing Flowchart showing an example of OCR result confirmation processing FIG. 1 is a data configuration diagram showing an example of a threshold setting table. FIG. 1 shows an example of block extraction. FIG. 1 is a diagram showing an example of small region division; FIG. 1 is a diagram showing an example of small region division; An example of a screen showing a judgment result OK screen An example of a screen showing a judgment result of NG An example of an OCR result OK screen An example of a screen showing an NG OCR result

The following describes an embodiment of the present invention in detail with reference to the drawings.

As shown in FIG. 1, the information processing system 100 of this embodiment has a configuration in which an information processing device 101 and a server 102 are communicatively connected via a network 103.

The information processing device 101 captures an image of the document (hereinafter, the captured image) using a camera or the like, and performs a clarity judgment. The information processing device 101 acquires a threshold setting table 800 from the server 102 for determining a threshold value required for the clarity judgment of the captured image.

In this embodiment, the information processing device 101 acquires the threshold setting table 800 managed by the server 102 and determines the clarity of the captured image, but this is not limited to the above. The information processing device 101 may manage the threshold setting table 800, or the information processing device 101 may provide the necessary data to the server 102, and the server 102 may perform the clarity determination of the captured image.

The information processing device 101 is a portable terminal such as a mobile phone, smartphone, tablet terminal, notebook PC, or PDA terminal, has a browser or a dedicated application installed, and is capable of communicating with the server 102 via the network 103 by wireless communication.

Below, an example of a hardware configuration that can be applied to the information processing device 101 and server 102 shown in FIG. 1 will be described with reference to FIG. 2.

In FIG. 2, 201 is a CPU that performs overall control of each device and controller connected to a system bus 204. In addition, ROM 203 or external memory 212 stores a BIOS (Basic Input/Output System), which is the control program of the CPU 201, an operating system program (hereinafter, OS), and various programs required to realize the functions executed by each server or each PC.

202 is a RAM, which functions as the main memory, work area, etc. of the CPU 201. The CPU 201 loads programs and the like required for executing processing from the ROM 203 or the external memory 212 into the RAM 202, and executes the loaded programs to realize various operations.

In addition, 205 is an input controller that controls input from the touch sensor 210. 206 is a video controller that controls display on a display device such as a display 211. Note that while FIG. 2 shows a display 211, the display device may be other display devices such as a liquid crystal display, not just a CRT. These are used by the user of the information processing device 101 as needed.

207 is a memory controller that controls access to an external memory 212 such as an external storage device (hard disk (HD)) that stores boot programs, various applications, font data, user files, edited files, various data, etc., a flexible disk (FD), or a compact flash (registered trademark) memory connected to a PCMCIA card slot via an adapter.

208 is a communication I/F controller that connects and communicates with external devices via the network 103 and executes communication control processing on the network. For example, communication using TCP/IP is possible.

The CPU 201 enables display on the display 211 by, for example, executing a process of expanding (rasterizing) an outline font into a display information area in the RAM 202. The CPU 201 also enables the user to receive touch operation instructions on the touch sensor 210 on the display 211.

The various programs and tables described below for implementing the present invention are recorded in external memory 212, and are loaded into RAM 202 as necessary and executed by CPU 201.

209 is a captured image input controller that controls input from a camera 215 via a captured image input processing unit 214. It is capable of recognizing and capturing the captured image input from the camera 215.

Figure 3 is a flowchart showing an example of the overall processing in the information processing system 100.

The overall process in Figure 3 is explained below.

In step S101, the information processing device 101 photographs the form and imports the photographed image. Here, the user logs in to the server 102 in advance via a browser or a dedicated application, and a photographing screen (not shown) is displayed to allow the user to photograph the form. At that time, the user may be allowed to select the size and type (target type) of the form.

In step S102, the information processing device 101 performs image adjustment and correction of the captured image. Specifically, in order to improve the efficiency of subsequent image processing, the color captured image is converted to grayscale and keystone correction or the like is performed for distortion. In step S103, the information processing device 101 acquires the threshold setting table 800 transmitted from the server 102 in step S104.

In step S105, the information processing device 101 executes a threshold determination process to determine a threshold. The threshold determination process will be described in detail with reference to FIG. 4.

Figure 4 is a flowchart showing an example of the threshold determination process.

In step S201, the information processing device 101 determines whether the object type of the captured image can be identified. For example, it is determined that the object type can be identified when a selection of the form type is received from the user from a shooting screen (not shown) before or after shooting, or when a barcode or the like included in the captured image contains identification information indicating the form type. The form type may also be acquired from another information processing system, or the form type may be determined for each function executed by the user. If the object type can be identified, proceed to step S202; if the object type cannot be identified, proceed to step S205.

In step S202, the information processing device 101 identifies the object type of the captured image. For example, if a selection of a form type is accepted from the user, the selected form type is identified as the object type of the captured image. If a barcode or the like included in the captured image contains identification information indicating the form type, the form type indicated by the identification information is identified as the object type of the captured image.

In step S203, the information processing device 101 checks the identified target type against the conditions in the threshold setting table 800. Specifically, the information processing device 101 checks whether the identified target type exists in the target type 801 in the threshold setting table 800. If the target type does not exist, the process proceeds from step S205, as in the case where the target type cannot be identified. The threshold setting table 800 will be described later.

In step S204, the information processing device 101 determines the threshold 806 of the record matched in the threshold setting table 800 as the threshold, and ends this processing flow.

In step S205, the information processing device 101 performs image analysis of the captured image, and in step S206, acquires image features.

Here, we will explain a specific example of image analysis using Figure 9.

The form image 900 is an image showing an example of the captured image to be processed this time. The form image 900 includes various areas such as a single-line text area 901, a multi-line text area 902, a table area 903, a line-enclosed text area 904, and a figure area 905. In the image analysis of this embodiment, block selection is used to extract each area as a block group (for details of block selection, see JP 2006-195887 A, etc.), and the text area is further decomposed and extracted into blocks for each line (911, 912, 914), and the table area is decomposed into cell blocks (913). For blocks containing characters, the number of characters is obtained, and the number of lines is obtained from the table area and the line-enclosed text area. In addition, the pixel ratio of the entire image (the ratio of pixels that are not white) is also obtained.

Note that the above image analysis method is just one example, and various information (feature quantities) indicating the characteristics of the captured image can be obtained using publicly known techniques, etc.

Return to the explanation of Figure 4.

In step S207, the information processing device 101 checks the feature acquired in step S206 against the conditions in the threshold setting table 800. Specifically, it checks whether the acquired feature amounts, such as the number of blocks, number of characters, pixel ratio, and number of lines, match each item (802 to 805) in the condition section of the threshold setting table 800.

In step S208, the information processing device 101 determines the threshold 806 of the record matched in the threshold setting table 800 as the threshold, and ends this processing flow.

In this embodiment, the threshold is determined by checking against a threshold setting table having condition items and decision items, but a function with each feature as a variable may be defined and the threshold may be determined by the function. A table may also be used to determine the weighting coefficient for each feature in the function.

This completes the explanation of the threshold setting process in FIG. 4. Now, the threshold setting table will be explained with reference to FIG.

The threshold setting table 800 is a table for determining a threshold value using the target type or the feature amount obtained by image analysis as a condition. In this embodiment, the target type 801 is a condition item related to the target type, and the number of blocks 802, number of characters 803, pixel ratio 804, and number of lines 805 are condition items related to the feature amount. Each item is set by a value or range, and if the condition is free, "*} is set. In this embodiment, the condition items related to the target type and the condition items related to the feature amount are set separately, but a record with a condition that combines both may be set. In addition, the threshold 806 is a decision item, and this value indicates the number (absolute value) or ratio (relative value) of small areas described later. In addition, in order to deal with cases where none of the conditions are met, a default record with all the condition items set to "*" may be set.

In this embodiment, the above condition items are adopted as features (feature information) that affect the determination of the clarity of the captured image, but this is not limiting. Any index that indicates the characteristics (particularly the complexity) of the captured image and that affects the determination of the clarity of the captured image can be adopted.

Return to the explanation of Figure 3.

In step S106, the information processing device 101 divides the captured image into small regions.

Here, we will explain how to divide a captured image into small regions using Figures 10 and 11.

In this embodiment, two types of division methods are assumed. Figure 10 shows a method of dividing with a fixed number of divisions, and Figure 11 shows a method of dividing with a fixed division size.

In the method of dividing the image with a fixed number of divisions shown in FIG. 10, the captured image is divided into small regions by dividing both the vertical and horizontal directions by a fixed number of equal parts, regardless of the size of the captured image. Since the number of small regions generated by division remains the same even if the size of the captured image changes, a threshold value indicating the number can be used. A threshold value indicating a ratio can also be used.

In the method of dividing the image into fixed division sizes shown in Figure 11, the number of vertical and horizontal divisions of the captured image varies depending on the size of the captured image. Because the number of small regions generated by division varies depending on the size of the captured image, a threshold indicating the number cannot be used, and a threshold indicating the ratio is used.

Return to the explanation of Figure 3.

In steps S107 to S109, the information processing device 101 repeats the process for each divided small area.

In step S108, the information processing device 101 performs a sharpness/sharpness determination on the small area to be processed. In this process, the small area to be processed is determined to be sharp or blurry using known techniques such as spectral analysis of the image or automatic determination using machine learning. By performing a sharpness/sharpness determination on divided small areas, even if there is a difference in brightness or darkness within a single captured image, a determination is made based on the determination criteria for each small area, making it possible to perform a sharpness/sharpness determination more appropriately and efficiently.

In step S110, the information processing device 101 executes an image sharpness determination process. The image sharpness determination process will be described in detail with reference to FIG. 5.

Figure 5 is a flowchart showing an example of an image sharpness assessment process.

In step S301, the information processing device 101 tallies the results of the sharpness/sharpness judgment for each small region. Specifically, the number of small regions judged to be sharp and the number of small regions judged to be blurred are tallied, and the number of small regions judged to be sharp is divided by the total number of small regions to obtain the ratio of small regions judged to be sharp.

In step S302, the information processing device 101 determines whether the counted result is equal to or greater than the threshold value set in step S105. That is, if the set threshold is a threshold indicating a number, it determines whether the number of small areas determined to be clear is equal to or greater, and if the threshold is a threshold indicating a ratio, it determines whether the ratio of small areas determined to be clear is equal to or greater. If it is determined to be equal to or greater than the threshold, it proceeds to step S303, and if it is determined not to be equal to or greater than the threshold (less than the threshold), it proceeds to step S308.

In step S303, the information processing device 101 displays a judgment result OK screen 1200, an example of which is shown in FIG. 12. The judgment result OK screen 1200 displays the sharpness/sharpness judgment result for each small region as a judgment result preview on the captured image (1201), and displays the sharpness/sharpness judgment result together with the reason for the judgment in text (1202). In addition, instructions from the user are accepted by an image send button 1203 and a re-shoot button 1204.

In step S304, the information processing device 101 determines whether an image transmission instruction has been received using the image transmission button 1203. If so, the process proceeds to step S305; if not (if a re-shooting instruction has been received), the process proceeds to step S306.

In step S305, the information processing device 101 determines that the clarity judgment based on the threshold matches the user's judgment, sets the subsequent process to "image transmission," and ends this processing flow.

In step S306, the information processing device 101 transmits a request to the server 102 to update the threshold setting table 800 because the clarity judgment based on the threshold does not match the user's judgment. Specifically, the information processing device 101 requests the server 102 to make the threshold stricter, that is, to increase the threshold beyond the current counting result. In response to the update request, in step S313, the server 102 updates the threshold setting table 800.

In step S307, the information processing device 101 sets the subsequent process as "re-shooting" and ends this processing flow.

In step S308, the information processing device 101 displays a judgment result NG screen 1300, an example of which is shown in FIG. 13. The judgment result NG screen 1300 displays the sharpness/sharpness judgment result for each small area as a judgment result preview on the captured image (1301), and displays the sharpness/sharpness judgment result together with the reason for the sharpness/sharpness judgment result in text (1302). In addition, instructions from the user are accepted by a re-shoot button 1303 and an image send button 1304.

In step S309, the information processing device 101 determines whether a re-shoot instruction has been received using the re-shoot button 1303. If so, the process proceeds to step S310; if not (if an image transmission instruction has been received), the process proceeds to step S311.

In step S310, the information processing device 101 determines that the blur judgment based on the threshold matches the user's judgment, and ends this processing flow by selecting "re-shooting" as the subsequent process.

In step S311, the information processing device 101 transmits a request to update the threshold setting table 800 to the server 102 because the blur judgment based on the threshold does not match the user's judgment. Specifically, the information processing device 101 requests the server 102 to make the threshold more lenient, that is, to reduce the threshold to below the current count result. In response to the update request, in step S313, the server 102 updates the threshold setting table 800.

In step S312, the information processing device 101 sets the subsequent process to "image transmission" and ends this processing flow.

This concludes the explanation of the image clarity assessment process in Figure 5.

Return to the explanation of Figure 3.

In step S112, the information processing device 101 determines whether the subsequent process is "re-shooting," and if so, returns to step S101; if not (if it is "image transmission"), proceeds to step S113.

In step S113, the information processing device 101 transmits the captured image to the server 102.

In step S114, the server 102 receives the captured image.

In step S115, the server 102 performs OCR processing on the captured image to recognize and acquire the acquisition items from the captured image. The acquisition items are acquired by setting in advance the position within the form image, keywords that serve as landmarks, and the like, and by following a predetermined processing procedure.

In step S116, the server 102 executes an OCR result reflection process. The OCR result reflection process will be described in detail with reference to FIG. 6.

Figure 6 is a flowchart showing an example of the OCR result reflection process.

In step S401, the server 102 determines whether the OCR results are OK. Specifically, if all required items among the acquired items are recognized and acquired, it is judged as OK, but if even one required item is not recognized or acquired, it is judged as NG. A classification is preset for the required items in the acquired items. If it is OK, proceed to step S402, and if it is NG, proceed to step S403.

In step S402, the server 102 determines that the information processing device 101's decision to send the image was correct, sets the OCR result to OK, and ends this processing flow.

In step S403, the server 102 determines that the decision by the information processing device 101 to send an image was incorrect, and updates the threshold setting table 800. Specifically, the threshold is updated to be stricter, that is, the threshold is increased to be greater than the current count result in the information processing device 101. Even if the user decides to "send an image" in step S311 and the threshold is temporarily relaxed, if the OCR result is NG, the threshold will be returned to the stricter setting.

In step S404, the server 102 sets the OCR result to NG and ends this processing flow.

This concludes the explanation of the OCR result reflection process in Figure 6.

Return to the explanation of Figure 3.

In step S117, the server 102 transmits the OCR results set in step S116 to the information processing device 101.

In step S118, the information processing device 101 receives the OCR results.

In step S119, the information processing device 101 executes an OCR result confirmation process. The OCR result confirmation process will be described in detail with reference to FIG. 7.

Figure 7 is a flowchart showing an example of the OCR result confirmation process.

In step S501, the information processing device 101 determines whether the OCR results are OK, and if they are OK, proceeds to step S502, and if they are not OK, proceeds to step S506.

In step S502, the information processing device 101 displays an OCR result OK screen 1400, an example of which is shown in FIG. 14. The OCR result OK screen 1400 displays an image of the transmitted image as a transmitted image preview (1401), and displays the OCR result together with its reasons in text form (1402). In addition, instructions from the user are accepted by a capture another image button 1403 and an end button 1404.

In step S503, the information processing device 101 determines whether an instruction to capture another image has been received using the another image capture button 1403. If it has been received, the subsequent process is set to "capture another image" in step S504, and if not (if an end instruction has been received), the subsequent process is set to "end" in step S505, and this processing flow is terminated.

In step S506, the information processing device 101 displays an OCR result NG screen 1500, an example of which is shown in FIG. 15. The OCR result NG screen 1500 displays an image of the transmitted image as a transmitted image preview (1501), and displays the OCR result together with the reason for the result in text (1502). In addition, instructions from the user are accepted by a retake button 1503 and an end button 1504.

In step S507, the information processing device 101 determines whether a re-shooting instruction has been received using the re-shooting button 1503. If so, the subsequent process is set to "re-shooting" in step S508, and if not (if an end instruction has been received), the subsequent process is set to "end" in step S509, and this processing flow is terminated.

This concludes the explanation of the OCR result confirmation process in Figure 7.

Return to the explanation of Figure 3.

In step S120, the information processing device 101 determines whether the subsequent process is "capturing another image" or "re-capturing," and if so, returns to step S101; if not, ends this processing flow.

This concludes the explanation of the overall processing in Figure 3.

As a result, it becomes possible to appropriately determine whether an image is clear, even when there are differences in brightness or darkness within the image, depending on the characteristics of the captured image.

Although several embodiments have been described above, the present invention can be embodied, for example, as a system, device, method, computer program, or recording medium, and specifically, may be applied to a system made up of multiple devices, or may be applied to a device made up of a single device.

The computer program of the present invention is a computer program that enables a computer to execute the processing method of each flowchart, and the storage medium of the present invention stores a computer program that enables a computer to execute the processing method of each flowchart. Note that the computer program of the present invention may be a computer program for each processing method of each device of each flowchart.

As described above, it goes without saying that the object of the present invention can be achieved by supplying a recording medium on which a program that realizes the functions of the above-mentioned embodiments is recorded to a system or device, and having the computer (or CPU or MPU) of that system or device read and execute the program stored on the recording medium.

In this case, the program read from the recording medium itself realizes the novel functions of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying the program may include, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD-ROM, a magnetic tape, a non-volatile memory card, a ROM, an EPROM, a silicon disk, etc.

Furthermore, it goes without saying that not only are the functions of the above-mentioned embodiments realized by the computer executing a program it has read, but also that the functions of the above-mentioned embodiments can be realized by an operating system (OS) or the like running on the computer carrying out some or all of the actual processing based on the instructions of the program.

Furthermore, it goes without saying that this also includes cases where a program read from a recording medium is written into a memory provided on a function expansion board inserted into a computer or a function expansion unit connected to a computer, and then a CPU or the like provided on the function expansion board or function expansion unit performs some or all of the actual processing based on the instructions of the program code, thereby realizing the functions of the above-mentioned embodiments.

The present invention may be applied to a system made up of multiple devices, or to a device made up of a single device. Needless to say, the present invention can also be applied to cases where the effects of the present invention are achieved by supplying a program to a system or device. In this case, the effects of the present invention can be enjoyed by reading a recording medium that stores a program for achieving the present invention into the system or device.

The program may be in the form of object code, program code executed by an interpreter, script data supplied to an OS (operating system), etc.

Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or device can enjoy the effects of the present invention. Note that the present invention also includes configurations that combine the above-mentioned embodiments and their variations.

100 Information processing system 101 Information processing device 102 Server 103 Network

Claims (24)

An information processing device for acquiring an image of a document,
a determining means for determining a standard for determining whether the image is clear or not based on the type of the document;
a notification means for notifying whether the image is clear or not based on a result of determining whether the image of the document is clear or not for each divided small area and on the criterion;
Equipped with
The information processing device is characterized in that the notification means notifies the determination result of whether each small area in the document image is clear or not by superimposing and displaying information on the document image that clearly indicates small areas in the document image that are determined to be clear and small areas in the document image that are determined to be unclear. An information processing device for acquiring an image of a document,
a determination means for determining a standard for determining whether an image of the document is clear or not based on a feature amount obtained from the image of the document;
a notification means for notifying whether the image is clear or not based on a result of determining whether the image of the document is clear or not for each divided small area and on the criterion;
Equipped with
The information processing device is characterized in that the notification means notifies the determination result of whether each small area in the document image is clear or not by superimposing and displaying information on the document image that clearly indicates small areas in the document image that are determined to be clear and small areas in the document image that are determined to be unclear. a receiving means for receiving an instruction in response to the notification content by the notification means;
an update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content accepted by the acceptance means;
3. The information processing apparatus according to claim 1, further comprising: The information processing device according to claim 3, characterized in that the update control means controls to update the determined criteria when the notification by the notification means indicates that the image is clear and the instruction received by the reception means indicates that the image is unclear. The information processing device according to claim 3 or 4, characterized in that the update control means controls the update so that the determined criteria are stricter when the notification by the notification means indicates that the image is clear and the instruction received by the reception means indicates that the image is unclear. The criterion is a criterion based on a value indicating image clarity,
The information processing device according to any one of claims 3 to 5, characterized in that when the notification content by the notification means is that the image is clear and the instruction content accepted by the acceptance means is that the image is unclear, the update control means controls to update the determined standard to be equal to or greater than the clarity of the image. The information processing device according to any one of claims 3 to 6, characterized in that the update control means controls to update the determined criteria when the notification by the notification means indicates that the image is unclear and the instruction received by the reception means indicates that the image is clear. The information processing device according to any one of claims 3 to 7, characterized in that the update control means controls to update the determined criteria to be more relaxed when the notification by the notification means indicates that the image is unclear and the instruction received by the reception means indicates that the image is clear. The criterion is a criterion based on a value indicating image clarity,
The information processing device according to any one of claims 3 to 8, characterized in that when the notification content by the notification means is that the image is blurred and the instruction content accepted by the acceptance means is that the image is clear, the update control means controls to update the determined standard to be equal to or lower than the clarity of the image. an OCR means for performing character recognition processing on the image,
The information processing device according to any one of claims 7 to 9, characterized in that the update control means controls the updated criteria to be returned to the state before the update when the notification content by the notification means is that the image is unclear, the instruction content accepted by the acceptance means is that the image is clear, and the character recognition processing by the OCR means results in a failure. The information processing device according to any one of claims 3 to 10, characterized in that the update control means controls not to update the criteria when the notification by the notification means indicates that the image is clear and the instruction received by the reception means indicates that the image is clear, and when the notification by the notification means indicates that the image is unclear and the instruction received by the reception means indicates that the image is unclear. The information processing device according to any one of claims 1 to 11, characterized in that the criterion is a condition value related to the number or ratio of small areas that are determined to be clear. The information processing device according to any one of claims 1 to 12, characterized in that the image of the document is divided into small regions of a fixed number or size. An information processing device for acquiring an image of a document,
a determining means for determining a criterion for determining whether an image of the document is clear or not based on the type of the document;
a notification means for notifying whether the image of the document is clear or not based on a result of determining whether the image of the document is clear or not for each divided small region and the determined criterion;
a receiving means for receiving an instruction in response to the notification content by the notification means;
an update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content accepted by the acceptance means;
An OCR means for performing character recognition processing on the image;
Equipped with
The information processing device is characterized in that the update control means controls the updated criteria to be reverted to the state before the update when the notification content from the notification means is to the effect that the image is unclear, the instruction content accepted by the acceptance means is to the effect that the image is clear, and the character recognition processing by the OCR means results in a failure. An information processing device for acquiring an image of a document,
a determination means for determining a standard for determining whether an image of the document is clear or not based on a feature amount obtained from the image of the document;
a notification means for notifying whether the image of the document is clear or not based on a result of determining whether the image of the document is clear or not for each divided small region and the determined criterion;
a receiving means for receiving an instruction in response to the notification content by the notification means;
an update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content accepted by the acceptance means;
An OCR means for performing character recognition processing on the image;
Equipped with
The information processing device is characterized in that the update control means controls the updated criteria to be reverted to the state before the update when the notification content from the notification means is to the effect that the image is unclear, the instruction content accepted by the acceptance means is to the effect that the image is clear, and the character recognition processing by the OCR means results in a failure. An information processing system for acquiring an image of a document, comprising:
a determining means for determining a standard for determining whether the image is clear or not based on the type of the document;
a notification means for notifying whether the image is clear or not based on a result of determining whether the image of the document is clear or not for each divided small area and on the criterion;
Equipped with
The information processing device is characterized in that the notification means notifies the determination result of whether each small area in the document image is clear or not by superimposing and displaying information on the document image that clearly indicates small areas in the document image that are determined to be clear and small areas in the document image that are determined to be unclear. An information processing system for acquiring an image of a document, comprising:
a determination means for determining a standard for determining whether an image of the document is clear or not based on a feature amount obtained from the image of the document;
a notification means for notifying whether the image is clear or not based on a result of determining whether the image of the document is clear or not for each divided small area and on the criterion;
Equipped with
The information processing device is characterized in that the notification means notifies the determination result of whether each small area in the document image is clear or not by superimposing and displaying information on the document image that clearly indicates small areas in the document image that are determined to be clear and small areas in the document image that are determined to be unclear. An information processing system for acquiring an image of a document, comprising:
a determining means for determining a criterion for determining whether an image of the document is clear or not based on the type of the document;
a notification means for notifying whether the image of the document is clear or not based on a result of determining whether the image of the document is clear or not for each divided small region and the determined criterion;
a receiving means for receiving an instruction in response to the notification content by the notification means;
an update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content accepted by the acceptance means;
An OCR means for performing character recognition processing on the image;
Equipped with
The information processing system is characterized in that the update control means controls the updated standards to be reverted to the state before the update when the notification content from the notification means is to the effect that the image is unclear, the instruction content accepted by the acceptance means is to the effect that the image is clear, and the character recognition processing by the OCR means results in a failure. An information processing system for acquiring an image of a document, comprising:
a determination means for determining a standard for determining whether an image of the document is clear or not based on a feature amount obtained from the image of the document;
a notification means for notifying whether the image of the document is clear or not based on a result of determining whether the image of the document is clear or not for each divided small region and the determined criterion;
a receiving means for receiving an instruction in response to the notification content by the notification means;
an update control means for controlling to update the determined criteria based on the notification content by the notification means and the instruction content accepted by the acceptance means;
An OCR means for performing character recognition processing on the image;
Equipped with
The information processing system is characterized in that the update control means controls the updated standards to be reverted to the state before the update when the notification content from the notification means is to the effect that the image is unclear, the instruction content accepted by the acceptance means is to the effect that the image is clear, and the character recognition processing by the OCR means results in a failure. A method for controlling an information processing device for acquiring an image of a document, comprising:
A determination step in which a determination means determines a criterion for determining whether the image is clear or not based on the type of the document;
a notification step of notifying whether the image is clear or not based on a result of the determination of whether the image of the document is clear or not for each divided small area and the criterion by a notification means;
Equipped with
The notification step is a control method for an information processing device, characterized in that it notifies the determination result of whether each small area in the image of the document is clear or not by superimposing and displaying information on the image of the document that clearly indicates small areas in the image of the document that have been determined to be clear and small areas in the image of the document that have been determined to be unclear. A method for controlling an information processing device for acquiring an image of a document, comprising:
A determination step in which a determination means determines a criterion for determining whether an image of the document is clear or not based on a feature amount obtained from the image of the document;
a notification step of notifying whether the image is clear or not based on a result of the determination of whether the image of the document is clear or not for each divided small area and the criterion by a notification means;
Equipped with
The notification step is a control method for an information processing device, characterized in that it notifies the determination result of whether each small area in the image of the document is clear or not by superimposing and displaying information on the image of the document that clearly indicates small areas in the image of the document that have been determined to be clear and small areas in the image of the document that have been determined to be unclear. A method for controlling an information processing device for acquiring an image of a document, comprising:
A determination step in which a determination means determines a criterion for determining whether an image of the document is clear or not based on the type of the document;
a notification step of notifying whether the image of the document is clear or not based on a result of the determination of whether the image of the document is clear or not for each divided small region and the determined criterion by a notification means;
a receiving step in which a receiving means receives an instruction regarding the notification content by the notification means ;
an update control step in which an update control means controls to update the determined criteria based on the notification content in the notification step and the instruction content accepted in the acceptance step;
an OCR step in which an OCR means performs character recognition processing on the image;
an update control step in which, when the notification step notifies that the image is unclear, the instruction received in the reception step indicates that the image is clear, and the character recognition process in the OCR step results in a failure, the update control step controls to return the updated standard to the state before the update;
13. A method for controlling an information processing device, comprising: A method for controlling an information processing device for acquiring an image of a document, comprising:
A determination step in which a determination means determines a criterion for determining whether an image of the document is clear or not based on a feature amount obtained from the image of the document;
a notification step of notifying whether the image of the document is clear or not based on a result of the determination of whether the image of the document is clear or not for each divided small region and the determined criterion by a notification means;
a receiving step in which a receiving means receives an instruction regarding the notification content by the notification means ;
an update control step in which an update control means controls to update the determined criteria based on the notification content in the notification step and the instruction content accepted in the acceptance step;
an OCR step in which an OCR means performs character recognition processing on the image;
an update control step in which, when the notification step notifies that the image is unclear, the instruction received in the reception step indicates that the image is clear, and the character recognition process in the OCR step results in a failure, the update control step controls to return the updated standard to the state before the update;
13. A method for controlling an information processing device, comprising: A program for causing a computer to function as each of the means described in any one of claims 1 to 15.