JP2019068323A - Device for setting file name for scanned image, control method thereof and program - Google Patents

Abstract

To enhance the user's convenience in setting of a file name and the like by using a character string obtained by performing OCR processing on a scanned image.SOLUTION: A device for performing predetermined processing on a scanned image obtained by scanning a document incudes display control means for displaying a UI screen for performing predetermined processing, in which a unit area presumed to be a continuous character strings in the scanned image displayed so as to be distinguished by a user and setting means for performing OCR processing on the unit area selected by the user via the UI screen and setting incidental information for the predetermined processing by using the character string extracted by the OCR processing, and the display control means displays the unit area on the UI screen such that the unit area can be distinguished by the user according to the size of the unit area in the direction intersecting the direction along the document direction of the document.SELECTED DRAWING: Figure 10

Description

  The present invention relates to a technique for setting a file name or the like for a scanned image using character recognition results of the scanned image.

  Conventionally, as a document management method, a method of scanning and digitizing a paper document is widely used. Then, at the time of digitizing a document, there is a technique of performing character recognition processing (OCR processing) on scanned image data, and using the recognized character as the file name of the digitized document file. For example, in the document scanner described in Patent Document 1, when a position is designated by a user in an image obtained by scanning a document, an extraction area is determined based on the position. Then, OCR processing is performed on the extraction area to acquire metadata (character string information).

Japanese Patent Publication No. 2007-503032

  However, in Patent Document 1, an extraction area containing characters other than the character string intended by the user or an extraction area containing only a part of the character string intended by the user may be determined, and the user intended appropriate. There was a case that could not get the string. On the other hand, it is conceivable that the user can select all character strings in the image. In this case, if the user mistakenly selects a character string, the user may have to delete the erroneously selected character string and then select a desired character string again. In either case, the user's convenience may be reduced.

  The present invention has been made in view of the above problems, and it is an object of the present invention to improve user's convenience in setting a file name and the like using a character string obtained by performing an OCR process on a scanned image. It is an object.

  An apparatus according to the present invention which solves the above-mentioned problem is an apparatus which performs predetermined processing on a scanned image obtained by scanning a document, and is presumed to be a series of character strings in the scanned image. A display control means for displaying a UI screen for performing the predetermined processing, in which a unit area is identifiably displayed, and performing OCR processing on the unit area selected by the user via the UI screen; And setting means for setting incidental information for the predetermined process using the character string extracted by the OCR process, the display control means may set the unit in a direction intersecting the direction along the text direction of the document. The unit area is displayed on the UI screen so as to be distinguishable by the user according to the size of the area.

  According to the present invention, the convenience of the user can be enhanced in the setting of the file name and the like using the character string obtained by performing the OCR processing on the scan image.

Diagram showing the overall configuration of the image processing system MFP hardware configuration File server hardware configuration diagram Software configuration of MFP Flow chart showing the flow of operation control from generation of scan image to upload A diagram showing an example of a scan setting screen A diagram showing an example of a preview screen Diagram showing the file name generated on the preview screen Figure showing an example of upload setting screen Flowchart showing details of file name generation processing Flowchart showing details of character string area display processing A figure showing an example of a preview screen concerning a 2nd embodiment Flowchart showing details of file name generation processing Flowchart showing display processing of non-display character string area according to the third embodiment

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following embodiments do not limit the invention according to the claims, and all combinations of the features described in the embodiments are not necessarily essential to the solution means of the invention.

First Embodiment
<Configuration of image processing system>
FIG. 1 is a diagram showing an overall configuration of an image processing system according to the present embodiment. The image processing system includes an MFP 110 and a file server 120, and is communicably connected to each other via a LAN (Local Area Network).

  An MFP (Multi Function Printer) 110 is a multifunction peripheral having a plurality of functions such as a scanner and a printer, and is an example of an image processing apparatus. The file server 120 is an example of an external server that stores and manages digitized document files. The image processing system of the present embodiment is configured of the MFP 110 and the file server 120, but is not limited to this. For example, the MFP 110 may have the role of the file server 120. Also, instead of the LAN, connection may be made via the Internet or the like. Further, the MFP 110 is connected to a Public Switched Telephone Networks (PSTN), and can perform facsimile communication of image data with a facsimile apparatus (not shown).

<Hardware Configuration of MFP>
FIG. 2 is a hardware configuration diagram of the MFP 110. As shown in FIG. The MFP 110 includes a control unit 210, an operation unit 220, a printer unit 221, a scanner unit 222, and a modem 223. The control unit 210 includes the following units 211 to 219, and controls the overall operation of the MFP 110. The CPU 211 reads out the control program stored in the ROM 212, and executes / controls various functions of the MFP 110 such as reading / printing / communication. The RAM 213 is used as a main memory of the CPU 211 and a temporary storage area such as a work area. In the present embodiment, one CPU 211 executes each process shown in a flowchart to be described later using one memory (the RAM 213 or the HDD 214). However, another mode may be used. For example, multiple CPUs or multiple RAMs or HDDs may cooperate to execute each process. The HDD 214 is a large-capacity storage unit that stores image data and various programs. The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 is provided with a liquid crystal display unit having a touch panel function, a keyboard, and the like, and plays a role as a reception unit for receiving an operation / input / instruction by the user. These operations by the user may be received by touching the liquid crystal panel, or may be received by the user operating the keyboard or button. The printer I / F 216 is an interface that connects the printer unit 221 and the control unit 210. Image data for printing is transferred from the control unit 210 to the printer unit 221 via the printer I / F 216 and printed on a recording medium. The scanner I / F 217 is an interface that connects the scanner unit 222 and the control unit 210. The scanner unit 222 reads an original document set on an unshown document table or an ADF (Auto Document Feeder) to generate image data, and inputs the image data to the control unit 210 via the scanner I / F 217. The MFP 110 can print out (copy) the image data generated by the scanner unit 222 from the printer unit 221, and can transmit a file or a mail. The modem I / F 218 is an interface that connects the modem 223 and the control unit 210. A modem 223 carries out facsimile communication of image data with a facsimile apparatus on the PSTN. A network I / F 219 is an interface that connects the control unit 210 (MFP 110) to a LAN. The MFP 110 transmits image data and information to an external device (such as the file server 120) on the LAN using the network I / F 219, and receives various information.

<Hardware Configuration of File Server>
FIG. 3 is a hardware configuration diagram of the file server 120. As shown in FIG. The file server 120 includes a CPU 311, a ROM 312, a RAM 313, an HDD 314, and a network I / F 315. The CPU 311 controls the entire operation of the file server 120 by reading out the control program stored in the ROM 312 and executing various processes. The RAM 313 is used as a main memory of the CPU 311 and a temporary storage area such as a work area. The HDD 314 is a large-capacity storage unit that stores image data and various programs. The network I / F 315 is an interface that connects the file server 120 to a LAN. The file server 120 transmits / receives various information to / from another device (for example, the MFP 110) on the LAN using the network I / F 315.

<Software Configuration of MFP>
FIG. 4 is a software configuration diagram of the MFP 110. The software of the MFP 110 can be roughly divided into two, a native function module 410 and an additional function module 420. Each unit included in the native function module 410 is a function module provided in the MFP 110 as a standard. On the other hand, each unit included in the additional function module 420 is a function module additionally provided to the MFP 110, and is, for example, a function module realized by installing an application. The additional function module 420 in the present embodiment is an application based on Java (registered trademark), and can easily realize the addition of functions to the MFP 110. Note that another application (not shown) may be installed in the MFP 110. Hereinafter, each part which comprises both functional modules 410 and 420 is demonstrated.

  The application display unit 423 performs display control to display a UI screen for receiving various operations by the user on the touch panel of the operation unit 220. Details of the UI screen to be displayed will be described later. The scan instruction unit 421 transmits a scan request including information on scan setting and transfer setting to the scan execution unit 411 according to a user instruction input via the UI screen, and causes the scan execution unit 411 to execute a scan process. The scan request also includes a request ID for identifying whether the image data received by the application reception unit 422 described later corresponds to the scan request.

  The scan execution unit 411 receives a scan request from the scan instruction unit 421, controls the scanner unit 222 via the scanner I / F 217, and executes a scan process. Thus, the document is read and image data is generated. The image data (hereinafter referred to as “scan image data”) generated by the scan is passed to the transfer unit 412 together with transfer specific information specifying the transfer destination. The transfer unit 412 transfers the scan image data received from the scan execution unit 411 according to the transfer setting. As the transfer destination of the scan image data, the file server 120 or a PC (not shown) on the LAN can be set. However, in the present embodiment, it is assumed that all scan image data generated by the scan execution unit 411 is temporarily set to be transferred to the additional function module 420. The transfer unit 412 has an FTP (File Transfer Protocol) client function, and transfers scan image data to the application reception unit 422 having an FTP server function by FTP.

  The application reception unit 422 receives the scan image data internally transferred from the transfer unit 412, and passes the scan image data to the application transfer unit 424. The application transfer unit 424 passes the received scan image data to the image analysis unit 425.

  The image analysis unit 425 performs an image analysis process such as specifying a character string area, character string recognition, and specifying a sentence direction on the received scan image data. Then, the scan image data and the analysis result thereof are passed to the preview display unit 426 via the application transfer unit 424. The preview display unit 426 performs display control such as generating a preview screen which is a UI screen for the user to set the file name based on the scan image data and the analysis result, and displaying the preview screen on the touch panel of the operation unit 220. Details of the preview screen to be displayed will be described later.

  The upload instruction unit 427 generates a UI screen for the user to set folder paths, and displays the UI screen on the touch panel of the operation unit 220. The application transfer unit 424 transfers (sends) scan image data to the file server 120. When the transfer is completed, the application transfer unit 424 notifies the application display unit 423 that the transfer is completed. The application display unit 423 receives the notification from the application transfer unit 424, and updates the display content. In addition, the application transfer unit 424 has an SMB (Server Message Block) client function. As a result, file operation and folder operation are performed on the file server 120 having the SMB server function using the SMB. The protocol to be used is not limited to SMB, and may be WebDAV, FTP, SMTP or the like. Also, protocols other than file transmission purpose such as SOAP and REST can be used.

  Subsequently, operation control at the time of generating a scan image from a document in the MFP 110 and uploading it to the file server 120 will be described. FIG. 5 is a flowchart showing a flow of control from generation of scan image data to upload. This series of processing is realized by control unit 210 executing a control program stored in HDD 214. Details will be described below.

  In step 501, the application display unit 423 displays a UI screen (hereinafter, referred to as “scan setting screen”) for performing various settings for scan processing on the touch panel of the operation unit 220. FIG. 6 is a diagram showing an example of a scan setting screen. Five setting buttons 601 to 605 exist in the scan setting screen 600 of FIG. [Color setting] button 601 is a button for setting color / monochrome when scanning an original. [Resolution setting] button 602 is a button for setting the resolution when scanning an original. [Duplex reading setting] button 603 is a setting button used when it is desired to scan both sides of a document. An “mixed original setting” button 604 is a setting button used when it is desired to scan originals of different sizes collectively. An “image format setting” button 605 is a setting button used to designate a storage format of scan image data. At the time of setting using these setting buttons 601 to 605, settable candidates (options) are displayed in the range supported by the MFP 110, and the user selects a desired one from the displayed candidates. In addition, the above-mentioned setting button is an example, Comprising: All these setting items may not exist, and setting items other than these may exist. The user also makes detailed settings for scan processing via such a scan setting screen 600. [Cancel] button 620 is used to cancel the scan setting. [Scan start] button 621 is a button for instructing start of scan processing for the document set on the document table or the like.

  In step 502, the application display unit 423 divides the processing according to the content of the button operation by the user. When pressing of the [scan start] button 621 is detected, the application display unit 423 notifies the scan instruction unit 421 of the contents set by the setting buttons 601 to 605 and the acceptance of the start of the scan process. On the other hand, when it is detected that the [cancel] button 620 has been pressed, this processing ends.

  In step 503, in response to the instruction from the scan instruction unit 421, the scan execution unit 411 executes scan processing. The scan image data thus obtained is internally transferred by FTP to the application receiving unit 422 through the transfer unit 412 in step 504, and is further sent to the image analysis unit 425 through the application transfer unit 424.

  In step 505, the image analysis unit 425 executes analysis processing of scan image data. More specifically, the analysis process can be easily performed by first performing binarization of the image signal, correcting the skew of the document shifted during scanning, and rotating the document in a direction in which the document is erected, with respect to the scanned image data. Correct to Then, edge extraction or the like is performed on the corrected scan image (binary image) to specify a character string area in the image, that is, a block (unit area) that is presumed to be a continuous character string. The coordinates of the character string area, and the size in the width direction (horizontal direction) and the height direction (longitudinal direction) of the character string area are specified. The width direction (horizontal direction) of the character string area indicates the direction along the text direction of the document. The height direction (longitudinal direction) of the character string area indicates a direction intersecting the direction along the text direction of the document, for example, the orthogonal direction. In addition, it is specified in the original document whether the text direction is horizontal or vertical. There is a method of taking vertical and horizontal projections with respect to a scan image (binary image) and determining the one with the lower dispersion of this projection as the row direction, which can be used. Table 1 below shows an example of the result of performing the image analysis processing on a part of the scanned image of a certain written estimate.

  In Table 1 above, [No.] is a number uniquely indicating each identified character string area. In this example, serial numbers 1 to 10 are assigned in the order of recognition. Coordinates take the X axis in the right direction and the Y axis in the lower direction, with the upper left of the preview area 710 as the origin (0, 0). [X coordinate of area] indicates the X coordinate of the upper left corner of each specified character string area. [Y coordinate of area] indicates the Y coordinate of the upper left corner of each specified character string area. Hereinafter, the term "coordinates" with respect to the character string area means the position coordinates of the upper left corner of the character string area unless otherwise specified. [Area width] indicates the distance from the left side to the right side of each of the specified character string areas. [Area height] indicates the distance from the upper side to the lower side of each specified character string area. In the present embodiment, “X coordinate of area”, “Y coordinate of area”, “width of area”, and “height of area” are all represented by pixels, but may be represented by points, inches or the like. Information on each character string area extracted from the scan image (hereinafter referred to as “character string area information”) is passed to the application transfer unit 424 as image analysis data. The image analysis data is, for example, in the format of CSV or XML, but may be another format. Alternatively, the data may be temporarily stored in the HDD 214 and then delivered at a predetermined timing.

  In step 506, the application transfer unit 424 displays a preview of the scan image read in step 503 on the touch panel of the operation unit 220. The screen data for preview display is generated and provided by the application display unit 423. The user can set a file name of scan image data via a UI screen (hereinafter referred to as a “preview screen”) on which a scan image is previewed. FIG. 7A shows an example of the preview screen. In the preview screen 700, in the preview area 710 at the center of the screen, a plurality of buttons 711-714 for changing the display state are also displayed along with the scanned image. Buttons 711 and 712 appear when the entire scanned image can not be displayed, and are buttons for vertically scrolling the display area. The touch panel provided in the MFP 110 is usually not so large. Therefore, for example, when the scanned image is a read of an A4 vertical / horizontal written document, the entire image in the width direction (short side direction) of the scanned image is displayed in a reduced size so that it fits exactly in the preview area 710. Initialized. That is, in the initial setting, the lower part of the A4 vertical scan image is not displayed in the preview area 710. In such a case, when the “↓” button 712 is pressed, the display area scrolls downward, and the lower part can be displayed. Furthermore, in the case where the scan image is, for example, A4 side or A3 side, a button may be further provided to scroll the display area in the horizontal direction. The buttons 713 and 714 are buttons for enlarging or reducing the display area, and zoom in is performed when the “+” button 713 is pressed, and zoom out is performed when the “−” button 714 is pressed. The operation by these button operations may be realized by the user's finger operation such as swipe or pinch out / pinch in on the preview screen. Further, in the preview area 710, the character area identified by the image analysis processing in step 505 is displayed in a manner that can be selected and identified by the user based on the above-described character string area information. Details of the character string area display processing will be described later. FIG. 7B is a view showing a state in which each character string area is displayed in a distinguishable manner by a surrounding frame on the preview screen 700 of FIG. 7A. Details of the display processing of the character string area will be described later. An arbitrary character string area is selected (for example, touched with a finger) from among the character string areas displayed in the preview area 710 in such a manner that the user can identify the user. With this selection operation, the character string contained therein is displayed in the file name input field 701, that is, automatically input, and becomes part of the character string constituting the file name. A [Back] button 720 is a button used to cancel the preview display. [Next] button 721 is a button for shifting to a screen for setting an upload destination of the read scan image data. A button 702 is a button for setting the format of the file name and the like. Note that the types of various buttons described above and the manner of displaying and selecting each character string area are merely an example, and the present invention is not limited thereto. For example, there may be a button for correcting or changing the character string displayed in the file name input field 701 or determining the file name.

  In step 507, the preview display unit 426 generates a file name for the read scan image. FIG. 8 shows the state of the preview screen 700 after file name generation. In this example, “quotation sheet _ Tokyo Co., Ltd. _ April 14, 2017” is selected by sequentially selecting character string areas corresponding to “quotation sheet”, “Tokyo corporation”, and “April 14, 2017”. The character string “is displayed and set in the file name input field 701. Further, in the preview area 710, the box of the character string area touched by the user is changed to a thick frame to indicate that it has been selected as a part of the file name. Details of this file name generation process will be described later. When a desired file name is generated and the user presses the “next” button 721, the process proceeds to step 508.

  In step 508, as in step 502, the preview display unit 426 divides the processing according to the content of the button operation by the user. When pressing of the [Next] button 721 is detected, information of the file name (character string set as the file name) being displayed in the file name input field 701 is sent to the upload instruction unit 427, and the process proceeds to step 509. move on. On the other hand, if pressing of the [Return] button 720 is detected, the process returns to step 501 (display of scan setting screen).

  In step 509, the upload instruction unit 427 displays a UI screen (hereinafter referred to as “upload setting screen”) for setting a transfer destination of the scan image data on the touch panel of the operation unit 220. The user performs detailed settings for uploading to the file server 120 via the upload setting screen. FIG. 9 is a diagram showing an example of the upload setting screen. The user inputs the name (path name) of the folder path for external transfer to the file server 120 in the [folder path] input field 901. In the example of FIG. 9, “2017 — 04 — 14” is input as the path name. As an input method, for example, there is a method of displaying a sub window (not shown) of the keyboard screen in response to a tap operation on the [folder path] input column 901 and having the user input a path name via the keyboard screen. . Alternatively, the address book stored in the HDD 214 may be selected and set. A “Back” button 920 is a button used to cancel the detailed setting regarding upload. An “Upload” button 921 is a button for instructing uploading to the folder path set in the “Folder path” input field 901.

  In step 510, the upload instruction unit 427 divides the processing according to the content of the button operation by the user, as in step 508. If pressing of the “Upload” button 921 is detected, the process proceeds to Step 511. At this time, the path name input to the [folder path] input field 901, the file name generated in step 507, and the file server setting are information necessary for storing the scan image data in the file server 120. Specifically, it includes information such as host name, folder path start point, login user name and password. On the other hand, when pressing of the [Return] button 920 is detected, the process returns to Step 506 (display of a preview screen).

  In step 511, the application transfer unit 424 generates a storage destination path of the scan image data based on the information received from the upload instructing unit 427. Specifically, it is generated by adding a folder path to the file server setting (host name of file server 120, starting point of folder path). As a result, for example, a storage destination path such as "\\ server01 \ Share \ 2017_04_14" is generated. Then, in step 512, the application transfer unit 424 executes access to the file server 120. At this time, the user name and password included in the file server setting are transmitted to the file server 120. The file server 120 that has received the user name and password executes an authentication process.

  In step 513, the application transfer unit 424 divides the processing according to the authentication result of the file server 120. That is, when the notification of the authentication success is received from the file server 120, the process proceeds to step 514. On the other hand, when the notification of the authentication failure is received, the present process ends.

  In step 514, the application transfer unit 424 externally transfers the scan image data to the folder indicated by the storage destination path generated in step 511, and stores the scan image data in the file server 120.

  The above is the contents of operation control from generation of a scan image to upload according to the present embodiment. In the present embodiment, it is assumed that the processing in steps 505 to 507 is performed on image data of one page generated by scanning. For example, a button for performing image analysis of the next page is provided in the preview screen 700, and the preview display of the next page obtained by the analysis is performed, and the characters constituting the file name from the character string area of the subsequent pages It may be possible to set the column.

<Generation of file name>
FIG. 10 is a flowchart showing details of the file name generation process (step 507) in the preview display unit 426. Hereinafter, description will be made along the flow of FIG.

  In step 1001, the presence or absence of a touch operation by the user on the preview screen 700 displayed on the touch panel is monitored. If a touch operation is detected, the process proceeds to step 1002. In the subsequent step 1002, the processing is divided according to the content of the touch operation. If the content of the touch operation is the pressing of the [Next] button 721 or the [Back] button 720, this processing ends. If the “next” button 721 or the “back” button 720 is not pressed, the process proceeds to step 1003.

  In step 1003, position coordinates (x, y) on the touch panel on which the touch operation has been performed are acquired. In the following step 1004, it is determined whether the position coordinates touched by the touch overlap with any of the character string areas displayed in a selectable and identifiable manner by the user. For example, the position coordinates touched by the touch may be located inside each character string area displayed in the preview area 710 in a selectable and distinguishable manner (a rectangular shape specified by the position coordinates representing the four corners of the character string area (Inside) to determine if it is included. If the position coordinates of the touch operation overlap with any of the character string areas displayed in a selectable and distinguishable manner for the user, the process proceeds to step 1005. On the other hand, if they do not overlap, the process returns to step 1001.

  In step 1005, a character string in a character string area overlapping the position coordinates touched is acquired. Acquisition of a character string is performed by executing OCR processing on a character string area (hereinafter referred to as “selected character string area”) selected by a touch operation by the image analysis unit 425 to extract a character string. Ru. Then, in step 1006, the file name currently displayed in the file name input field 701 is acquired. In the next step 1007, it is determined whether the content of the acquired file name is "empty". Here, the file name "empty" means a blank state in which no character string is displayed in the file name input field 701. If the acquired file name is "empty", the process proceeds to step 1009. On the other hand, if it is not "empty", the process proceeds to step 1008.

  In step 1008, processing is performed to add a predetermined delimiter to the end of the file name acquired in step 1006. Here, underbars will be described as an example of predetermined delimiters, but the present invention is not limited to this. For example, hyphens and other symbols and characters other than underscores may be used, and those without an entity such as a space may also be used.

  In step 1009, the character string acquired in step 1005 (character string extracted from the selected character string area) is set as a component of the file name. At this time, if there is a string that has already been set, it is added to the end. Then, in step 1010, the character string currently set is displayed (automatically input) in the file name input field 701.

  The above is the contents of the file name generation process. By such processing, the delimiter is inserted between the plurality of character string areas selected by the user, and the file name of the scan image is generated.

<Display of character string area>
FIG. 11 is a flowchart showing details of preview screen display processing (step 506) in the preview display unit 426. Hereinafter, description will be made along the flow of FIG.

  In step 1101, the preview display unit 426 acquires information on the text direction specified by the image processing in step 505 via the application transfer unit 424.

  In step 1102, the preview display unit 426 acquires the display conditions of the character string area stored in advance in the HDD 214 or the like. The display condition of the character string area is a condition for determining whether to display the character string area on the preview screen. For example, it is possible to use the aspect ratio of the character string area as the display / non-display determination value (for example, the upper limit value, the lower limit value, the reference value, etc.). The determination value can be changed according to the document size.

  Judgment values differ in the sentence direction. When a sentence (character string) is written horizontally, the value obtained by dividing the size in the width direction (horizontal direction) of the character string area by the size in the height direction (vertical direction) of the character string area is the judgment value Used as Further, when the sentence (character string) is written vertically, a value obtained by dividing the size in the height direction of the character string area by the size in the width direction of the character string area is used as the determination value. In the present embodiment, the upper limit value for displaying the character string area on the preview screen is 15. The reason why the upper limit is set to 15 is that if it is assumed that the width and height of one character are almost the same, it can be expected to be a character string area of about 15 characters, and the 15 character character string may be a sentence such as text And is unlikely to be used for file names. The setting of the determination value may be stored in advance in the HDD 214, for example. In this case, it is also possible to set the determination value in accordance with the document size. Alternatively, a sub window (not shown) of the display condition setting screen may be displayed in response to pressing of the setting button on the scan setting screen, and the user may input the determination value via the display condition setting screen.

  In step 1103, the preview display unit 426 determines one character area from among the plurality of character string areas obtained by the image analysis unit 425.

  In step 1104, the preview display unit 426 acquires information on the character string area specified by the image processing in step 505 with respect to the character string area determined in step 1103 via the application transfer unit 424.

  In step 1105, the preview display unit 426 calculates the aspect ratio (aspect ratio) of the character string area based on the information on the text direction acquired in step 1101 and the information on the character string area acquired in step 1004. When the scanned image is read from a horizontally written document, the size in the width direction (horizontal direction) of the character string area is the height direction (vertical direction) of the character string area as a method of calculating the aspect ratio of the character string area It is possible to use a calculation method of dividing by the size of. When the scanned image is a read of a vertically-written document, the size of the character string area in the height direction (longitudinal direction) is the width direction of the character string area as a method of calculating the aspect ratio of the character string area. It is possible to use a calculation method of dividing by the size of the width direction). For example, the aspect ratio of the character string area corresponding to the number 1 in Table 1 is obtained by dividing the size 20 in the width direction by the size 10 in the height direction, and becomes 2. On the other hand, the aspect ratio of the character string area corresponding to the number 10 in Table 1 is obtained by dividing the size 80 in the width direction by the size 5 in the vertical direction, and becomes 18.

  In step 1106, it is determined by the preview display unit 426 whether the character string area display condition to be displayed on the touch panel in a selectable and distinguishable manner for the user is satisfied. This determination is performed based on the result calculated in step 1105 and the character string area display condition acquired in step 1102. For example, the case where the determination value acquired in step 1102 is used as the upper limit value for displaying the character string area in a distinguishable manner to the user will be described below. If the aspect ratio of the character string area calculated in step 1105 satisfies the character string area display condition, that is, if it is equal to or smaller than the determination value acquired in step 1102, the process proceeds to step 1107. On the other hand, if the aspect ratio of the character string area calculated in step 1105 does not satisfy the character string area display condition, that is, it is larger than the determination threshold, the character string area is displayed on the preview screen identifiably by the enclosing frame. Without going to step 1107, the process proceeds to step 1108. For example, when the determination value is 15, as shown in Table 2 below, if the aspect ratio (width / height) of the character string area is 15 or less at the numbers 1 to 9, and the display condition of the character string area is satisfied. It is judged. On the other hand, in the case of No. 10, it is determined that the aspect ratio (width / height) of the character string area is 18 greater than 15 and the display condition of the character string area is not satisfied. If the condition is not satisfied in step 1106, the frame is not displayed at the position where the character string is written as indicated by reference numeral 722 on the preview screen 700.

  In step 1007, the preview display unit 426 displays the character string area determined in step 1103 in the preview area 710 of the preview screen 700 in a selectable and distinguishable manner by the user. For example, as shown in the preview area 710 of FIG. 8, a border surrounding the character string area is displayed.

  In step 1108, the preview display unit 426 determines whether there is an unprocessed character string area. If there is an unprocessed character string area, the process returns to step 1103 and the processes of steps 1104 to 1108 are performed. On the other hand, if there is no unprocessed character string area, this processing ends.

  Since the character string area is displayed on the preview screen in a selectable and distinguishable manner based on the character string area display condition, the character string displayed on the preview screen as compared with the case where there is no character string area display condition The area can be restricted, and the convenience of the user can be enhanced.

Here, the process until the file name of “estimate document _ Tokyo Ltd. April 14, 2017” shown in FIG. 8 is generated will be described with reference to the above-mentioned Table 1. First, serial numbers 1 to 10 in Table 1 are associated with the respective character string areas as shown below.
1: "Estimate"
2: "Tokyo Corporation"
3: "On the house"
4: "Estimate number"
5: "R-1234"
6: "desired delivery date"
7: "April 14, 2017"
8: "Yokohama Corporation"
9: "1000-1 Yokohama City, Kanagawa Prefecture"
10: "I would like to thank you very much for your exceptional service."

  First, when image analysis processing is performed on scan image data and a character string area is acquired, the aspect ratio of all acquired character string areas is calculated. Then, only the character string area that satisfies the character string display condition is displayed in the preview area of the preview screen in a selectable and distinguishable manner for the user. Assuming that the aspect ratio of the character string area is 15 or less, the character string area corresponding to the numbers 1 to 9 is an example of a character string area that can be selected and identified by the user. A frame surrounding is displayed in the preview area of the preview screen. On the other hand, since the aspect ratio of the character string area corresponding to the number 10 is 18, and the character string display condition is not satisfied, a frame surrounding the character string area is a preview screen which is an example of a user selectable and distinguishable mode. It will not be displayed in the preview area of.

  Next, when a touch operation on the touch panel is detected, a character string overlapping the touched coordinates is determined (steps 1001 to 1004). When a touch operation on the character string area of “estimate sheet” is detected, the character string area of “estimate sheet” is subjected to OCR processing to acquire the characters “estimate sheet” (steps 1005 to 1006). Then, at this stage, the file name input field 701 does not display any character string and is "empty" (Yes in step 1007), so the "quotation" is displayed in the file name input field 701 (step 1010). Further, in the preview area 710, in order to indicate that the file is selected as a part of the file name by the touch operation of the user, the box of the character string area of “quotation sheet” changes to a thick frame.

  Next, when a touch operation on the character string area of "Tokyo, Inc." is detected (steps 1001 to 1006), the character string area of "Tokyo, Inc." is subjected to OCR processing and the character of "Tokyo, Inc." It is acquired (steps 1001 to 1006). Then, at this stage, the characters "Estimate" are displayed in the file name input field 701 and they are not "empty" (No in step 1007). Therefore, in the file name input field 701, an underscore “_” which is a delimiter is added and set following the characters “estimate sheet” (step 1008). At this point, the file name is "estimate _". Thereafter, the characters "Tokyo, Ltd." are further added (step 1009), and "quotation document _ Tokyo corporation" is displayed in the file name input field 701 (step 1010), and the file name is "quotation document _ Tokyo corporation" It becomes ".

  Then, when the touch operation is detected in the character string area of "Apr. 14, 2017" (steps 1001 to 1006), the OCR processing is performed on the character string area of "Apr. 14, 2017". Thus, the characters "Tokyo, Ltd." are obtained (steps 1001 to 1006). Therefore, in the file name input field 701, an underscore “_” which is a delimiter is added and set following the characters “Tokyo, Inc.” (step 1008). At this point, the file name is "estimate _ Tokyo Ltd. _". Thereafter, the characters "April 14, 2017" are further added (step 1009), and "quotation document-Tokyo, Ltd.-April 14, 2017" is displayed in the file name input field 701 (step 1010). Finally, the file name of "estimate _ Tokyo Ltd. _ April 14, 2017" is obtained. Further, in the preview area 710, similarly to the character string area of the "quotation sheet", the box of the character string areas of "Tokyo, Ltd." and "April 14, 2017" is also changed to a bold frame.

  The above is the contents of the file name generation process. In the present embodiment, the scene where the file name is set using the character recognition result of the character string area in the scan image is described as an example, but the scope of application of the present invention is limited to the scene where the file name is set. Absent. For example, the present invention may be applied to transfer destination setting of data such as a scan image upload destination, and destination setting of FAX transmission and mail transmission. In this case, for example, in the upload setting screen 900 of FIG. 9 described above, the character recognition result of the character string area in the scan image can be displayed as selectable folder path candidates so that the path name can be set according to user selection. Make it In addition, on the destination setting screen (not shown), the character recognition result of the character string area in the scan image can be displayed as a FAX number or a mail address candidate so that it can be selected, and the FAX number or the mail address can be set according to the user selection. Make it As described above, the present invention can be widely applied to the setting of various information (incidental information) related to a scanned image, such as setting of a transfer destination of data, etc., other than setting of a file name.

  Therefore, according to the present embodiment, the character string area that satisfies the display condition of the character string area is displayed in a selectable and distinguishable manner for the user. As a result, compared with the case where all the character string areas of the scan image are displayed in a selectable manner for the user, an erroneous operation by the user can be prevented and the convenience of the user can be enhanced.

  Since the OCR processing is performed on the character string area selected by the user, it is possible to efficiently acquire the character string from the scanned image data as compared to the case where the OCR processing is performed on the entire scanned image data. .

Second Embodiment
Next, in a case where the character string display condition according to the size of the character string area in the orthogonal direction of the sentence is provided, the second aspect of displaying identifiably to the user without calculating the aspect ratio of the character string area It demonstrates as embodiment of. The description of the flow common to the first embodiment such as the flow of control of the scan operation in the MFP 110 will be omitted, and the following description will be focused on the display processing of the character string area which is the feature of the present embodiment. I assume.

  In the present embodiment, for example, in the character string area display determination of FIG. 10, instead of the aspect ratio of the character string area, the height direction (or width direction) of the character string area corresponding to the document size of the scan image data. Use a range of sizes (range between upper limit and lower limit).

  If the size in the height direction (or width direction) of the character string area is within the size range in the height direction (or width direction) of the character string area corresponding to the document size, the character string area is It is displayed in the preview area of the preview screen in a manner that can be selected and identified by the user. On the other hand, if the size in the height direction (or width direction) of the character string area is outside the size range in the height direction (or width direction) of the character string area corresponding to the document size, the character string area In a user selectable and distinguishable aspect, the preview area is not displayed in the preview area of the preview screen.

  The above is the content of the character string area display processing. As a result, it is possible to prevent the display of a character string area of small characters or large characters that are clearly assumed not to be used for file names and the like. Therefore, although the character string area which is unlikely to be selected by the user according to the character string area display condition is not displayed, it is possible to display only the character string area of a specific size which is highly likely to be used as a file name. It is possible to prevent false selection by the user.

Third Embodiment
Next, when there is a plurality of input areas (input fields), a mode of displaying the character string area in a discriminable manner for the user based on the character string area display condition corresponding to each area will be described as the third embodiment. Do. In the case of having a folder name input box and a file name input box input based on a character string area display condition different from the file name input box, the user does not select the character string display condition according to the input area each time Also, an aspect of automatically selecting will be described as a third embodiment. The description of the flow of control of the scan operation in MFP 110 and the contents common to the first embodiment will be omitted. In the following description, processing for generating a file name and the like when there are a plurality of input areas having different input conditions, which is a feature of the present embodiment, will be mainly described.

  FIG. 12A is a view showing an example of a preview screen provided with a plurality of input areas. In the preview screen 1200, an input area 1202 corresponding to the input of the file name and an input area 1203 corresponding to the input of the folder name are displayed above the preview area 1201 at the center of the screen. The input area 1202 and the input area 1203 are displayed adjacent to each other at the top and bottom. FIG. 12B is a view showing a state in which each character string area is displayed in a distinguishable manner by a surrounding frame on the preview screen 1200 of FIG. 12A. Further, in the preview screen 1200, the box of the input area 1203 of the folder name touched by the user is changed to a thick frame to indicate that the area is selected.

  FIG. 13 is a flowchart showing details of the redisplay processing of the character string area by the preview display unit 426 when the input area in operation is switched by the user operation. Hereinafter, description will be made along the flowchart of FIG.

  In step 1301, the presence or absence of a touch operation by the user on the preview screen 1200 displayed on the touch panel is monitored. If a touch operation is detected, the process proceeds to step 1302. In the following step 1302, processing is separated according to the content of the touch operation. If the content of the touch operation is the pressing of the [Next] button or the [Back] button, this processing ends. If the “Next” button 1321 or the “Return” button is not pressed, the process proceeds to Step 1303.

  In step 1303, position coordinates (x, y) on the touch panel on which the touch operation has been performed are acquired. In the following step 1304, it is determined whether the position coordinates touched by the touch overlap the input area. For example, it is determined whether the position coordinates touched are included inside the file name input area 1302 or the folder name input area 1303 (inside the rectangle specified by the position coordinates representing the four corners of the rectangle). If the position coordinates of the touch operation overlap with either the file name input area 1202 or the folder name input area 1203, the process proceeds to step 1305. On the other hand, if they do not overlap, the process returns to step 1301.

  In step 1305, a character string area display condition corresponding to the touch-operated position coordinate and the input area selected by the touch operation (hereinafter referred to as "selection input area") is acquired. The character string area display conditions are preset according to the input area.

  Table 3 shows an example of the character string area display condition table held for each input area.

  For example, in the file name input area (number 1) where there is a possibility of inputting a relatively long character string, 15 is set as the threshold of the aspect ratio of the character string area. Also, in the folder name input area (No. 2) where there is little possibility of inputting a long character string and only a character string shorter than the file name input area, 10 is set as the threshold of the aspect ratio of the character string area ing. The character string area display conditions are stored in advance in the HDD 214 or the like. When the preview display unit 426 receives the selection of the input to the input area, the character string area display condition corresponding to the selection input area is acquired from the HDD 214 or the like.

  Subsequently, in step 1306 and subsequent steps, character string area display processing is performed. Each process of steps 1306 to 1311 is the same as steps 1103 to 1108 shown in FIG. 11 of the first embodiment. For example, the character string area display condition of the folder name input area (number 2) has an aspect ratio threshold (upper limit) of 10. Therefore, the aspect ratio of the character string area corresponding to the numbers 1 to 8 in Table 2 is 10 or less, which is the character string area display condition acquired in step 1305, and is displayed in an identifiable manner for the user. . On the other hand, the aspect ratio of the character string area corresponding to the numbers 9 and 10 in Table 2 is not 10 or less which is the character string area display condition acquired in step 1305, respectively, and the preview screen It is not displayed in the preview area. The box is not displayed where the character string indicated by reference numeral 1304 is described.

  The above is the contents of the character string area display processing when there are a plurality of input areas with different character string display conditions. Thus, only the character string area that can be input to the input area can be displayed in a manner that can be identified by the user. That is, the character string area to be displayed can be switched according to the input area being selected.

  If the number of characters that can be input to the input area is determined, it is possible to change the character string area displayed in a selectable and distinguishable manner according to the number of characters input to the input area. is there.

Fourth Embodiment
Next, an aspect will be described as a fourth embodiment in which a character string area that does not satisfy the character string display condition can be displayed on the user in a selectable and distinguishable manner. The description of the flow common to the first embodiment such as the flow of control of the scan operation in the MFP 110 will be omitted, and the following description will be focused on the display processing of the character string area which is the feature of the present embodiment. I assume.

  The present embodiment is, for example, processing content when a specific touch operation (for example, long press touch, double tap) different from the first to third embodiments described above is detected.

  FIG. 14 is a flowchart showing details of character string area display processing when a specific user operation is detected. It demonstrates along the flowchart of FIG.

  In step 1401, the presence or absence of a specific touch operation by the user on the preview screen displayed on the touch panel is monitored. The specific touch operation includes, for example, a touch operation which can be detected separately from an operation in the case of pressing a button such as a screen long press touch, double tap, etc. once. If a specific touch operation such as a long screen touch is detected, the process proceeds to step 1402. In the following step 1402, processing is separated according to the content of the touch operation. If the content of the touch operation is the pressing of the [Next] button 721 or the [Back] button 720, this processing ends. If the “next” button 721 or the “back” button 720 is not pressed, the process proceeds to step 1403.

  In step 1403, position coordinates (x, y) on the touch panel on which the touch operation has been performed are acquired. In the following step 1404, it is determined whether the position coordinates touched by the touch overlap a character string area (hereinafter referred to as "non-display character string area") which is not displayed in a selectable and distinguishable manner for the user. Be done. For example, whether or not the touch-operated position coordinate is included inside the character string area (inside the rectangle specified by the position coordinate representing the four corners of the character string area) that is not displayed in a user identifiable manner judge. If the position coordinates touched by the touch overlap the character string area not displayed in a distinguishable manner for the user, the process advances to step 1405. On the other hand, if they do not overlap, the process returns to step 1401.

  In step 1405, a character string area overlapping the position coordinates touched by the touch operation is displayed on the preview screen in a selectable and distinguishable manner by the user.

  The above is the contents of the display processing of the non-display character string area. Even if the character string area is determined to not satisfy the character string area display condition by such processing and is in the non-display state (non-selectable state), the preview screen can be selected and identifiable by the user. It can be displayed. Therefore, it is possible to perform extraction of a desired character string from a scanned image including characters by a simple operation without requiring a complicated operation.

[Modification]
The modification of this embodiment is described below.

  It is also possible to add a delimiter selected from the file name side to the beginning of the file name displayed in the file name input field and a character string selected by touch operation in the order of description to generate a file name.

Other Embodiments
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

110 MFP
120 file server 210 control unit 211 CPU
212 ROM
213 RAM
214 HDD
410 native function module 411 scan execution unit 420 additional function module 426 preview display unit

Claims (16)

An apparatus for performing predetermined processing on a scanned image obtained by scanning a document,
A display control unit that displays a UI screen for performing the predetermined processing, in which a unit area inferred as a series of character strings in the scanned image is identifiably displayed by a user;
Setting means for performing an OCR process on a unit area selected by the user via the UI screen, and setting additional information for the predetermined process using a character string extracted by the OCR process;
Equipped with
The display control means may display the unit area on the UI screen so as to be distinguishable by a user according to the size of the unit area in a direction intersecting the direction along the text direction of the document. The apparatus according to claim 1, wherein the display control means displays the unit area on the UI screen so as to be distinguishable by a user according to an aspect ratio of the unit area.   The display control means divides a size of the unit area in a direction along the text direction of the document by a size of the unit area in a direction intersecting the direction along the text direction of the document. 3. The apparatus according to claim 2, wherein the unit area which is equal to or less than the determination value is displayed on the UI screen so as to be distinguishable by a user. The apparatus according to any one of claims 1 to 3, wherein the display control unit displays the unit area on the UI screen together with the scan image. The UI screen has a plurality of input areas that can be input,
The display control unit according to any one of claims 1 to 4, wherein the unit area corresponding to the input area selected by the user is displayed on the UI screen so as to be distinguishable by the user. apparatus. The UI screen has a plurality of input areas that can be input,
The apparatus according to any one of claims 1 to 4, wherein the display control means switches the unit area displayed on the UI screen so as to be distinguishable by the user according to the input area selected by the user. . The apparatus according to any one of claims 1 to 6, wherein the display control means displays the unit area which can not be identified by the user as unselectable.   When the user performs a specific operation on the unit area that can not be selected by the user, the display control unit can select the unit area on which the user performed the specific operation on the UI screen so that the user can select the unit area. The apparatus according to claim 7, characterized in that it is displayed. The predetermined process is a process of storing data of the scan image,
The apparatus according to any one of claims 1 to 8, wherein the incidental information is a file name when the scanned image is stored. The predetermined process is a process of storing data of the scan image,
The apparatus according to any one of claims 1 to 8, wherein the incidental information is a folder name for storing the scan image. The predetermined process is a process of uploading the data of the scanned image to a predetermined place,
The apparatus according to any one of claims 1 to 8, wherein the incidental information is a path name indicating an upload destination. The predetermined process is a process of faxing data of the scanned image,
The apparatus according to any one of claims 1 to 8, wherein the incidental information is a fax number. The predetermined process is a process of transmitting data of the scan image by e-mail,
The apparatus according to any one of claims 1 to 8, wherein the incidental information is a mail address. An apparatus for performing predetermined processing on a scanned image obtained by scanning a document,
Display control means for displaying a UI screen for performing the predetermined processing, in which a user can selectably display a unit area that is presumed to be a series of character strings in the scanned image;
Setting means for performing an OCR process on a unit area selected by the user via the UI screen, and setting additional information for the predetermined process using a character string extracted by the OCR process;
Equipped with
The display control means may display the unit area on the UI screen so as to be selectable by a user according to the size of the unit area in a direction intersecting the direction along the text direction of the document. A control method of an apparatus for performing predetermined processing on a scanned image obtained by scanning a document, comprising:
Displaying a UI screen for performing the predetermined processing, in which the display control means displays a unit area that is considered as a series of character strings in the scan image in a selectable manner by the user;
The setting unit performs an OCR process on a unit area selected by the user via the UI screen, and sets additional information for the predetermined process using a character string extracted by the OCR process; ,
Including
And displaying the unit area on the UI screen so that the unit area can be identified by the user according to the size of the unit area in a direction intersecting the direction along the text direction of the document.   The program for functioning a computer as an apparatus as described in any one of Claims 1-14.

Images