JP2022030672A - Reading support apparatus and reading support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a reading support device for accurately reading information in a document, converting it into data, and enabling automatic processing in a business in which a paper document exists. A reading support device has an acquisition unit, a registration unit, a generation unit, a designation unit, a transmission unit, a reception unit, and an output unit. The acquisition unit acquires image information of a document containing a text having at least one of a character, a number, and a symbol as an image. The registration unit accepts registration of at least one reading area to be read. The generation unit generates a partial image corresponding to the reading area. The designation unit accepts the designation of the destination to which the partial image is transmitted. The transmission unit transmits the text recognition information of the partial image together with the partial image. The receiving unit receives the comparison result information based on the result of comparing the text recognition information and the partial image. The output unit outputs reading result information indicating the result of reading the reading area based on the comparison result information. [Selection diagram] FIG. 7

Description

The present invention relates to a reading support device and a reading support system.

In recent years, with the development of information processing technology, RPA (Robotic Process Automation) technology that automatically processes various tasks using a robot has been attracting attention.

In order to effectively implement RPA, it is necessary to convert the input information into data so that the computer can process it. However, in the business of processing paper-based documents such as invoices and delivery notes sent from customers, it is necessary to read letters and numbers from the documents and input them into a computer. In order to perform such processing, various OCR (Optical Character Recognition) technologies are known that analyze an image obtained by scanning a paper document with a scanner and automatically recognize characters and numbers (for example, a patent). See Document 1).

Japanese Unexamined Patent Publication No. 2020-16946

However, there is a problem that the automatic reading technique by OCR cannot be applied to the work that requires accuracy because the reading accuracy is not perfect. For example, it is difficult to accurately distinguish between the alphabet "l" and the number "1" by OCR. Further, even when a document has a table, a ruled line, or the like, it is difficult to perform accurate character recognition by OCR. For this reason, there is a problem that the introduction of automatic processing by RPA or the like has to be given up in the business where paper documents exist.

The present invention has been made in view of the above circumstances, and is a reading support device for accurately reading information in a document, converting it into data, and enabling automatic processing in a business in which a paper document exists, and reading. The purpose is to provide a support system.

The above object is achieved by the following means.

The reading support device has an acquisition unit, a registration unit, a generation unit, a designation unit, a transmission unit, a reception unit, and an output unit. The acquisition unit acquires image information of a document containing a text having at least one of a character, a number, and a symbol as an image. The registration unit accepts registration of at least one reading area to be read in the image information acquired by the acquisition unit. The generation unit generates a partial image corresponding to at least one reading area registered in the registration unit in the image information. The designation unit accepts the designation of the destination to which the partial image generated by the generation unit is transmitted. The transmitting unit transmits the text recognition information indicating the result of executing the text recognition processing on the partial image together with the partial image to the destination designated by the designated unit. The receiving unit receives the comparison result information based on the result of comparing the text recognition information and the partial image from the transmission destination. The output unit outputs reading result information indicating the result of reading the reading area based on the comparison result information received by the receiving unit.

The reading support system includes the above-mentioned reading support device and a destination device provided at a destination for receiving a partial image from the reading support device. The destination device has a reception unit that displays the partial image in association with the text recognition information corresponding to the partial image and receives input of the comparison result between the partial image and the text recognition information from the reader.

According to the reading support device of the present invention, image information of a document containing at least one of characters, numbers and symbols as an image is acquired, and at least one reading area to be read is registered in the image information. Accept. The reading support device generates a partial image corresponding to at least one registered reading area in the image information, and accepts the designation of the transmission destination to which the generated partial image is transmitted. The reading support device transmits the text recognition information indicating the result of executing the text recognition process on the partial image together with the partial image to the specified destination, and compares the text recognition information with the partial image from the destination. Receive comparison result information based on the result. The reading support device outputs reading result information indicating the result of reading the reading area based on the received comparison result information. Therefore, when the user transmits the image information of the paper document to the reading support device, the reading support device sends the partial image of the reading area registered in advance and the text recognition result of the partial image to the destination, and the destination. The result of reading the reading area based on the comparison result in is output. As a result, the user can accurately convert the information in the document into data simply by transmitting the image information of the paper document or the paper processing to the reading support device, so that even in the business in which the paper document exists, the business can be performed. It will be possible to realize automation.

It is a figure which shows the schematic structure of the reading support system which concerns on one Embodiment of this invention. It is a block diagram which shows the schematic structure of a requester terminal. It is a block diagram which shows the schematic structure of a support device. It is a block diagram which shows the schematic structure of a reader server. It is a block diagram which shows the schematic structure of a reader terminal. It is a block diagram which shows the schematic structure of a checker terminal. It is a sequence chart which shows the procedure of the process executed in a read support system. It is a figure which shows an example of the request creation screen displayed in a requester terminal. It is a figure which shows an example of the request matter list screen displayed on a requester terminal. It is a figure which shows an example of the support project list screen displayed in the support device. It is a figure which shows an example of the distribution screen displayed in the support device. It is a figure which shows an example of the reading matter list screen displayed on a reader server. It is a figure which shows an example of the comparison result input screen displayed in a reader terminal. It is a figure which shows an example of the check screen displayed in a checker terminal.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted. In addition, the dimensional ratios in the drawings are exaggerated for convenience of explanation and may differ from the actual ratios.

<Configuration of reading support system>
FIG. 1 is a diagram showing a schematic configuration of a reading support system according to an embodiment of the present invention.

As shown in FIG. 1, the reading support system includes a requester terminal 100, a support device 200, a reader server 300, a reader terminal 400, and a checker terminal 500, and each configuration is configured to be communicable with each other through a network. There is.

The requester terminal 100 is an information terminal such as a notebook PC, a desktop PC, a smartphone, or a tablet PC used by the requester.

The support device 200 is a server provided by a business operator (hereinafter referred to as "service provider") that manages and operates a reading support system and a service. The support device 200 constitutes a reading support device.

The reader server 300 is a server provided by a business operator (hereinafter referred to as "leader business operator") who manages a reader who is a person in charge of comparing a partial image and an OCR reading result of the partial image described later.

The reader terminal 400 is an information terminal such as a smartphone used by the reader. The reader terminal 400 constitutes a destination device.

The checker terminal 500 is an information terminal such as a smartphone used by a checker who is in charge of checking the comparison result by the reader.

Hereinafter, each configuration will be described in detail.

<Requester terminal 100>
FIG. 2 is a block diagram showing a schematic configuration of the requester terminal.

As shown in FIG. 2, the requester terminal 100 includes a CPU (Central Processing Unit) 110, a ROM (Read Only Memory) 120, a RAM (Random Access Memory) 130, a storage 140, a communication interface 150, an operation unit 160, and a display. It has a unit 170. Each configuration is communicably connected to each other via bus 180.

The CPU 110 controls each of the above configurations and performs various arithmetic processes according to the programs recorded in the ROM 120 and the storage 140.

The ROM 120 stores various programs and various data.

The RAM 130 temporarily stores programs and data as a work area.

The storage 140 stores various programs including an operating system and various data.

The communication interface 150 is an interface for communicating with an external device such as a support device 200, and is used by, for example, standards such as 3G, 4G, and 5G for mobile phone communication, and standards such as Wi-Fi (registered trademark). Be done.

The operation unit 160 includes a pointing device such as a mouse and a keyboard, and is used for performing various inputs.

The display unit 170 is, for example, a liquid crystal display and displays various information. The display unit 170 may function as an operation unit 160 by being configured by a touch panel type display.

<Support device 200>
FIG. 3 is a block diagram showing a schematic configuration of the support device.

As shown in FIG. 3, the support device 200 includes a CPU 210, a ROM 220, a RAM 230, a storage 240, a communication interface 250, an operation unit 260, and a display unit 270. Each configuration is communicably connected to each other via bus 280. The configurations of the CPU 210, ROM 220, RAM 230, storage 240, communication interface 250, operation unit 260, and display unit 270 include the CPU 110, ROM 120, RAM 130, storage 140, communication interface 150, and operation unit 160 of the requester terminal 100. And since it has the same function as the display unit 170, duplicate description will be omitted.

The CPU 210 functions as an acquisition unit, a registration unit, a generation unit, a designation unit, a transmission unit, a reception unit, and an output unit. The acquisition unit acquires image information of a document containing a text having at least one of a character, a number, and a symbol as an image. The registration unit accepts registration of at least one reading area to be read in the image information. The generation unit generates a partial image corresponding to at least one registered reading area in the image information. The designation unit accepts the designation of the destination to which the partial image is transmitted. The transmission unit transmits the text recognition information indicating the result of executing the text recognition process on the partial image together with the partial image to the designated destination. The receiving unit receives the comparison result information based on the result of comparing the text recognition information and the partial image from the transmission destination. The output unit outputs reading result information indicating the result of reading the reading area based on the received comparison result information.

<Reader server 300>
FIG. 4 is a block diagram showing a schematic configuration of a reader server.

As shown in FIG. 4, the reader server 300 includes a CPU 310, a ROM 320, a RAM 330, a storage 340, a communication interface 350, an operation unit 360, and a display unit 370. Each configuration is communicably connected to each other via bus 380. The configurations of the CPU 310, ROM 320, RAM 330, storage 340, communication interface 350, operation unit 360, and display unit 370 include the CPU 110, ROM 120, RAM 130, storage 140, communication interface 150, and operation unit 160 of the requester terminal 100. And since it has the same function as the display unit 170, duplicate description will be omitted.

<Reader terminal 400>
FIG. 5 is a block diagram showing a schematic configuration of a reader terminal.

As shown in FIG. 5, the reader terminal 400 has a CPU 410, a ROM 420, a RAM 430, a storage 440, a communication interface 450, an operation unit 460, and a display unit 470. Each configuration is communicably connected to each other via bus 480. The configurations of the CPU 410, ROM 420, RAM 430, storage 440, communication interface 450, operation unit 460, and display unit 470 include the CPU 110, ROM 120, RAM 130, storage 140, communication interface 150, and operation unit 160 of the requester terminal 100. And since it has the same function as the display unit 170, duplicate description will be omitted.

The CPU 410 functions as a reception unit. The reception unit displays the partial image in association with the text recognition information corresponding to the partial image, and receives the input of the comparison result between the partial image and the text recognition information from the reader.

<Checker terminal 500>
FIG. 6 is a block diagram showing a schematic configuration of a checker terminal.

As shown in FIG. 6, the checker terminal 500 has a CPU 510, a ROM 520, a RAM 530, a storage 540, a communication interface 550, an operation unit 560, and a display unit 570. Each configuration is communicably connected to each other via bus 580. The configurations of the CPU 510, ROM 520, RAM 530, storage 540, communication interface 550, operation unit 560, and display unit 570 include the CPU 110, ROM 120, RAM 130, storage 140, communication interface 150, and operation unit 160 of the requester terminal 100. And since it has the same function as the display unit 170, duplicate description will be omitted.

The CPU 510 functions as a confirmation unit. The confirmation unit displays the matching status of the plurality of comparison results input by the plurality of readers and the plurality of comparison results, and receives a correction or confirmation instruction from the checker.

It should be noted that each configuration of the reading support system may include components other than the above components, or may not include a part of the above components.

<Overview of processing in the reading support system>
FIG. 7 is a sequence chart showing a procedure of processing executed in the reading support system. FIG. 8 is a diagram showing an example of a request creation screen displayed on the requester terminal. FIG. 9 is a diagram showing an example of a request matter list screen displayed on the requester terminal. FIG. 10 is a diagram showing an example of a support project list screen displayed on the support device. FIG. 11 is a diagram showing an example of a distribution screen displayed on the support device. FIG. 12 is a diagram showing an example of a read matter list screen displayed on the reader server. FIG. 13 is a diagram showing an example of a comparison result input screen displayed on the reader terminal. FIG. 14 is a diagram showing an example of a check screen displayed on the checker terminal. The process shown in the sequence chart of FIG. 7 is stored as a program in the storage of each configuration, and is executed by the CPU of each configuration controlling each part.

First, the requester terminal 100 acquires information regarding a document for which reading support is requested (step S101). For example, the client reads a paper document such as an invoice or a delivery note received from a customer with a scanner or the like to generate image information (PDF file, JPG file, etc.). Alternatively, the client receives a PDF file such as an invoice or a delivery note from the customer as image information. The document contains text having at least one of letters, numbers and symbols, and the image information of this document includes the text as described above as an image.

For example, when the requester operates the requester terminal 100 to access the support device 200 and requests the creation of the request, the requester terminal 100 displays the request creation screen as shown in FIG. The requester selects the image information to be transmitted to the support device 200 on the screen of FIG. In addition, the requester selects the document type of the selected image information by selecting the pull-down menu of "form". The type information indicating the selected type is stored in association with the image information. When the requester selects the "Create" button, request information including image information and type information is created. The created request information is displayed in a list on a screen as shown in FIG.

Next, the requester terminal 100 transmits the request information including the image information and the type information to the support device 200 (step S102). The requester terminal 100 may transmit to the support device 200 the delivery date information regarding the delivery date for receiving the result of the processing related to the image information from the support device 200 in association with the image information and the type information.

Next, the support device 200 acquires the image information and the type information transmitted from the requester terminal 100, and acquires the reading area information regarding the reading area registered in advance in the storage 240 in association with the type information (step S103). .. The reading area information is, for example, information registered in advance for each type of document, and is information including at least one reading area to be read in the image information. Further, the reading area information includes information regarding the type of text in each reading area. The text type is information indicating the content or attribute of the text such as "number", "alphanumerical", "alphanumerical symbol", "Japanese character", and "Chinese character".

For example, documents such as invoices and invoices that are continuously used with the same business partner generally have a fixed format. Therefore, by registering in advance the area in which the information that needs to be read is described for each type of document, the part in which the necessary information is described can be extracted. For example, when the type of document is an invoice, the reading area contains an area in which the contents of items necessary for business such as billing date, billing item, unit price, quantity, amount, payment deadline, and payee account are described. Set. The business operator who manages and operates the reading support service hears from the client the reading area for each type of document and registers it in the support device 200 in advance.

The reading area may be set to include the text shown on one line, or may be set to include the text shown over two or more lines. The read area information is registered as, for example, a coordinate group in a coordinate system based on a predetermined position.

Next, the support device 200 generates a partial image corresponding to the read area acquired in the process of step S103 in the image information acquired from the requester terminal 100 (step S104). For example, when the type of document is a purchase order and the reading area is set to an area in which the contents of the order number, quantity, total amount, product number, order date, and delivery date are described, the “image” in FIG. As shown in the column, a plurality of images showing the contents of each are generated as partial images.

The support device 200 displays a list of image information or information on partial images corresponding to the request information received from the requester terminal 100 on a screen as shown in FIG. Information such as "subject (file name)", "client", "form", "request date", and "status" is displayed on the screen of FIG. 10. In addition, delivery date information regarding the delivery date may also be displayed. The "subject (file name)" is identification information for identifying an image information or a group (section) composed of a plurality of partial images generated from the image information. The "client" is information for identifying the requester. The "form" is information indicating the type of document corresponding to the image information. The "status" is information indicating the progress of processing in the reading support service. For example, as the "status", information indicating the number of partial images that need to be processed and the number of comparison result information received from the destination may be displayed.

Next, the support device 200 accepts the designation of the transmission destination to transmit the generated partial image (step S105). For example, the support device 200 transmits a partial image on the screen of FIG. 11 displayed by selecting image information (or a section in which the image information is divided or integrated into appropriate processing units) on the screen of FIG. Accept the previous designation. The support device 200 specifies, for example, a transmission destination for transmitting a partial image by accepting a designation of a distribution destination of the leader business operator for transmitting the partial image from a plurality of leader business operators that are candidates for the transmission destination. Accept. Alternatively, the support device 200 may automatically determine the transmission destination according to the type of text corresponding to the partial image and the supportable language of each reader operator registered in the support device 200 in advance. Further, the support device 200 may automatically determine the destination in consideration of the processing capacity, processing speed, free resource status, etc. of each leader operator and the delivery date information set in each request information.

Next, the support device 200 transmits information regarding the partial image and the type of text associated and registered to the leader server 300 of the leader operator of the destination designated in the process of step S105 (step S106). At this time, the support device 200 also transmits text recognition information indicating the result of executing the text recognition process on the partial image. The text recognition process for the partial image may be executed by the support device 200, or may be executed by an external device such as a cloud server, and the execution result may be acquired by the support device 200 or the reader server 300. In the present embodiment, the reader server 300 is described as having a configuration different from that of the support device 200, but the function of the reader server 300 may be logically realized by the same physical configuration as the support device 200. .. The reader server 300 displays a list of image information received from the support device 200 on a screen as shown in FIG.

Next, the reader server 300 determines which reader should process the partial image received from the support device 200 (step S107). For example, the leader server 300 determines the allocation by receiving an instruction from the person in charge of the leader company. Alternatively, the reader server 300 may automatically determine the allocation according to the type of text corresponding to the partial image and the compatible language of each reader registered in advance in the reader server 300. Further, the reader server 300 may automatically determine the allocation in consideration of the processing capacity, processing speed, free resource status, etc. of each reader and the delivery date information set in each image information. In the present embodiment, the leader operator causes a plurality of readers to execute the process for the same partial image, causes the checker to confirm the matching status of the execution results, and improves the accuracy of reading the document. Therefore, the reader server 300 accepts the designation of a plurality of readers as the distribution destination. For example, on the screen of FIG. 12, by selecting the "Read" button, a plurality of readers can be specified from the list, and by selecting the "Check" button, a checker can be selected from the list. Can be specified.

Next, the reader server 300 transmits the partial image, the information regarding the text type, and the text recognition information to the reader terminal 400 of the reader of the distribution destination according to the distribution determined in the process of step S107 (step S108).

Each of the reader terminals 400 of the plurality of readers to be distributed associates the partial image transmitted from the reader server 300, the information regarding the text type, and the text recognition information, and displays them in a list on a screen as shown in FIG. 13, for example (step). S109). In the screen of FIG. 13, a partial image is displayed in the "image" column, text recognition information is displayed in the "text" column, and information regarding the text type is displayed in the "input type" column.

In the screen of FIG. 13, the partial image and the text recognition information are displayed side by side along the text arrangement direction, but the partial image and the text recognition information are displayed side by side at overlapping positions in the text arrangement direction. May be good. That is, the partial image and the text recognition information may be displayed side by side along the direction orthogonal to the text arrangement direction. For example, in the example of FIG. 13, the partial image showing the horizontally arranged text and the text recognition information are displayed side by side, but may be displayed vertically. As a result, in the partial image and the text recognition information, the positions of the corresponding texts in the horizontal direction can be aligned, so that the reader comparison can be easily performed.

In the process of step S109, the reader terminal 400 displays the partial image and the text recognition information, and then receives the result of the comparison of the partial image and the text recognition information by the reader (step S110). Specifically, the reader compares the partial image displayed on the screen of FIG. 13 with the corresponding text recognition information, and confirms whether or not the contents of both match. If the reader determines that the two match, the text recognition information is saved as it is, and if it is determined that the two do not match, the text recognition information is corrected on the screen of FIG. 13 and then saved. At this time, the reader can appropriately make comparisons and corrections by referring to the information regarding the text type.

The reader terminal 400 transmits the result of comparison of the partial image and the text recognition information received in the process of step S110 to the checker terminal 500 (step S111).

The checker terminal 500 displays the comparison results transmitted from the reader terminals 400 of each of the plurality of readers side by side (step S112). For example, the checker terminal 500 displays the results of comparison by a plurality of readers on a screen as shown in FIG. In the screen of FIG. 14, the "image" column is a partial image, the "input 01" column is the result of comparison by the first reader, and the "input 02" column is the result of comparison by the second reader, "status". The column shows the match status of the results of comparisons by multiple readers.

The checker terminal 500 determines whether or not the comparison results transmitted from the plurality of readers match each other (step S113). On the screen of FIG. 14, if there is a match, "Match" is displayed in the "Status" column, and if there is no match, "Not Match" is displayed in the "Status" column. ..

When the comparison results by the plurality of readers match each other (step S113: YES), the checker terminal 500 receives a confirmation instruction from the checker and confirms the comparison result (step S115).

When the comparison results by the plurality of readers do not match each other (step S113: NO), the checker terminal 500 receives a correction instruction from the checker (step S114). On the screen of FIG. 14, the checker inputs the correction content in the "text correction" field, and the correction instruction is accepted.

When the correction instruction from the checker is not received (step S114: NO), the checker terminal 500 waits until the instruction is received.

When the correction instruction from the checker is received (step S114: YES), the checker terminal 500 proceeds to the process of step S115 and determines the result of the comparison.

The checker terminal 500 determines the result of comparison between the partial image and the text recognition information, and then transmits the comparison result information indicating the confirmed comparison result to the support device 200 (step S116).

The support device 200 integrates the comparison result information regarding each partial image transmitted from the checker terminal 500, and generates reading result information indicating the result of reading the reading area of the image information (step S117).

The support device 200 transmits the reading result information generated in the process of step S117 to the requester terminal 100 (step S118).

The requester terminal 100 receives and outputs the reading result information transmitted from the support device 200 (step S119). For example, in the example as shown in FIG. 11, the requester terminal 100 has the order number "129.03.050R", the quantity 1 is "36", the quantity 2 is "1", and the total amount is "1" as the reading result information. It is possible to receive information indicating that "51,360", the product number is "MT60-03551", the order date is "20/01/16", and the delivery date is "20/01/31". As a result, the requester terminal 100 can use the received reading result information as input data in, for example, a business terminal or an application to perform automatic processing.

In the above description, an example of transmitting the comparison result information between the partial image and the text recognition information from the checker terminal 500 to the support device 200 has been described, but the present invention is not limited to this. For example, when the checker does not perform the check, the comparison result information may be transmitted from the reader terminal 400 to the support device 200.

Further, although the example in which the support device 200 transmits the partial image and the text recognition information to the reader terminal 400 via the reader server 300 has been described, the support device 200 directly transmits the partial image and the text recognition information to the reader terminal 400. May be good.

As described above, according to the reading support system according to the present embodiment, the image information of the document including the text having at least one of characters, numbers and symbols as an image is acquired, and the image information is read. Accepts registration of at least one read area. The reading support device generates a partial image corresponding to at least one registered reading area in the image information, and accepts the designation of the transmission destination to which the generated partial image is transmitted. The reading support device transmits the text recognition information indicating the result of executing the text recognition process on the partial image together with the partial image to the specified destination, and compares the text recognition information with the partial image from the destination. Receive comparison result information based on the result. The reading support device outputs reading result information indicating the result of reading the reading area based on the received comparison result information. Therefore, when the user transmits the image information of the paper document to the reading support device, the reading support device sends the partial image of the reading area registered in advance and the text recognition result of the partial image to the destination, and the destination. The result of reading the reading area based on the comparison result in is output. As a result, the user can accurately convert the information in the document into data simply by transmitting the image information of the paper document or the paper processing to the reading support device, so that even in the business in which the paper document exists, the business can be performed. It will be possible to realize automation.

Further, the reading support system acquires the type information indicating the type of the image information together with the image information, and when the image information and the type information are received, the portion corresponding to the reading area registered in association with the type information. Generate an image. As a result, it is possible to register a reading area for each type of document for a standard document that is continuously sent and received, so that it is not necessary to specify the reading area each time. The requester can obtain the necessary text data in the document simply by sending the image information of the document and the type of the document.

Further, in the reading support system, the reading area includes the text shown in one line. As a result, necessary information can be acquired with high accuracy.

Further, the reading support system registers at least one reading area as a coordinate group in a coordinate system based on a predetermined position. As a result, the reading area can be registered as relative coordinate information with respect to a predetermined position. Therefore, for example, even if the position shifts when scanning a document to generate image information, the reading area is appropriately applied. Can generate a partial image.

Further, the reading support system acquires the delivery date information regarding the delivery date of the reading result information together with the image information, sends the delivery date information to the destination together with the partial image, and associates the image with the identification information for identifying the image information. The number of partial images generated from the information, the number of partial images received from the destination of comparison results, and the delivery date information are output in a list displayable manner. This makes it possible to easily check the delivery date and progress of each item in the reading support service, which leads to smooth service provision without delay.

Further, the reading support system can accept the designation of different destinations for each reading area. As a result, it is possible to specify an appropriate destination (leader operator) in combination according to the content to be read, the volume, the delivery date, etc., which leads to smooth and efficient service provision.

Further, the reading support system can accept the registration of the text type associated with the reading area, and the destination of the reading area is determined according to the registered text type and the compatible language of the destination registered in advance. To determine. This makes it possible to specify an appropriate destination according to the type of text. Since it is expected that businesses from various countries will participate as the leader business of the destination, for example, leader business that is good at Japanese, leader business that is good at Chinese, and alphanumericals are only available. By grasping and registering the leader business operator in advance, it is possible to specify an appropriate leader business operator according to the type of text.

Further, the reader terminal 400 of the reading support system displays the partial image in association with the text recognition information corresponding to the partial image, and accepts the input of the comparison result between the partial image and the text recognition information from the reader. .. Thereby, the reader can easily compare the partial image displayed on the screen of the reader terminal 400 with the text recognition information.

Further, the reading support system can accept the registration of the text type in association with the reading area, and the reader terminal 400 associates the partial image corresponding to the reading area and the text recognition result with the text registered in the registration unit. Display the type of. This allows the reader to make accurate comparisons and corrections by referring to the registered text types.

Further, the reader terminal 400 displays the partial image and the text recognition result side by side at overlapping positions in the text arrangement direction. As a result, in the partial image and the text recognition result, the positions of the corresponding texts are aligned and displayed, so that the comparison by the reader can be easily performed.

Further, the reader terminal 400 displays a list of the plurality of partial images and the plurality of text recognition results corresponding to the plurality of partial images in association with each other. As a result, the reader can perform comparison processing of a large number of partial images at one time, and can proceed with the work efficiently.

Further, the checker terminal 500 displays a plurality of comparison results input by the plurality of readers and a matching status of the plurality of comparison results, and receives a correction or confirmation instruction from the checker. As a result, the matching status of the comparison results by the plurality of readers is confirmed, necessary corrections are made, and then the comparison results are confirmed, so that the reading support process can be performed more accurately.

Further, the checker terminal 500 does not accept the confirmation instruction when the matching status indicates a mismatch and the correction instruction is not accepted. As a result, when the comparison results by the plurality of readers do not match, the comparison result cannot be confirmed unless the checker makes corrections, so that the checker can surely execute the check work.

In addition, the checker terminal 500 can display information about a plurality of readers. This allows, for example, the checker to consider information about each leader when reviewing comparison results by multiple leaders.

The present invention is not limited to the above-described embodiment, and various modifications can be made within the scope of the claims.

For example, the requester terminal 100, the support device 200, the reader server 300, the reader terminal 400, and the checker terminal 500 may each be configured by a plurality of devices, or may be configured by a single device.

Further, the functions of each configuration may be realized by other configurations. For example, a part of each function of the support device 200 may be realized by the reader server 300. Alternatively, a part of each function of the reader server 300 may be realized by the reader terminal 400 or the checker terminal 500.

Further, the processing units of the sequence chart and the flowchart in the above embodiment are divided according to the main processing contents in order to facilitate understanding of each processing. The invention of the present application is not limited by the method of classifying the processing steps. Each process can be further divided into more process steps. Also, one processing step may perform more processing.

The means and methods for performing various processes in the system according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The program may be provided, for example, by a computer-readable recording medium such as a flexible disk and a CD-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. Further, the above program may be provided as a single application software, or may be incorporated into the software of the device as a function of the system.

100 Requester terminal,
110 CPU,
120 ROM,
130 RAM,
140 storage,
150 communication interface,
160 operation unit,
170 Display,
180 bus,
200 support device,
210 CPU,
220 ROM,
230 RAM,
240 storage,
250 communication interface,
260 operation unit,
270 display section,
280 bus,
300 reader server,
310 CPU,
320 ROM,
330 RAM,
340 storage,
350 communication interface,
360 operation unit,
370 display section,
380 bus,
400 reader terminal,
410 CPU,
420 ROM,
430 RAM,
440 storage,
450 communication interface,
460 operation unit,
470 display section,
480 bus,
500 checker terminal,
510 CPU,
520 ROM,
530 RAM,
540 storage,
550 communication interface,
560 operation unit,
570 display section,
580 bus.

Claims (14)

An acquisition unit that acquires image information of a document that includes text containing at least one of letters, numbers, and symbols as an image.
In the image information acquired by the acquisition unit, a registration unit that accepts registration of at least one reading area to be read, and a registration unit.
In the image information, a generation unit that generates a partial image corresponding to the at least one reading area registered in the registration unit, and a generation unit.
A designated unit that accepts the designation of a destination for transmitting the partial image generated by the generator, and a designated unit.
A transmission unit that transmits text recognition information indicating the result of executing text recognition processing on the partial image together with the partial image to the transmission destination designated by the designated unit.
A receiving unit that receives comparison result information based on the result of comparing the text recognition information and the partial image from the destination.
An output unit that outputs reading result information indicating the result of reading the reading area based on the comparison result information received by the receiving unit, and an output unit.
A reading support device with. The acquisition unit acquires the type information indicating the type of the image information together with the image information, and obtains the type information.
The registration unit receives registration of the reading area in association with the type information, and receives the registration.
The reading according to claim 1, wherein the generation unit generates the partial image corresponding to the reading area registered in association with the type information when the image information and the type information are received by the acquisition unit. Support device. The reading support device according to claim 1 or 2, wherein the reading area includes the text shown in one line. The reading support device according to any one of claims 1 to 3, wherein the registration unit registers at least one reading area as a coordinate group in a coordinate system based on a predetermined position. The acquisition unit acquires the delivery date information regarding the delivery date of the reading result information together with the image information.
The transmission unit transmits the delivery date information together with the partial image to the transmission destination.
The output unit is associated with the identification information for identifying the image information, the number of the partial images generated from the image information, and the number of the partial images received from the destination of the comparison result information. The reading support device according to any one of claims 1 to 4, wherein the delivery date information and the delivery date information are output in a list displayable manner. The reading support device according to any one of claims 1 to 5, wherein the designation unit can accept designation of the destination different for each reading area. The registration unit can accept registration of the text type in association with the reading area.
The reading support device according to any one of claims 1 to 6, wherein the designated unit determines the destination of the reading area according to the type of the text and the available language of the destination registered in advance. .. A reading support system comprising the reading support device according to any one of claims 1 to 7 and a destination device provided at the destination for receiving the partial image from the reading support device.
The destination device displays the partial image in association with the text recognition information corresponding to the partial image, and also receives an input of a comparison result between the partial image and the text recognition information from a reader. Read support system to have. The registration unit can accept registration of the text type in association with the reading area.
The reading support system according to claim 8, wherein the reception unit displays the type of the text registered in the registration unit in association with the partial image corresponding to the reading area and the text recognition information. The reading support system according to claim 8 or 9, wherein the reception unit displays the partial image and the text recognition information side by side at overlapping positions in the arrangement direction of the text. The reading support system according to any one of claims 8 to 10, wherein the reception unit associates and displays a list of the plurality of the partial images and the plurality of the text recognition information corresponding to each of the plurality of the partial images. 7. The reading support system described in Crab. The reading support system according to claim 12, wherein the confirmation unit does not accept the confirmation instruction when the matching situation indicates a disagreement and the correction instruction is not accepted. The reading support system according to claim 12 or 13, wherein the confirmation unit can display information about the plurality of readers.

Images